python獲取羽絨服購買指南

“加拿大鵝”因虛假廣告被處罰45萬元成爲新聞的熱點，然後網友們都直呼，加拿大鵝處罰決定書簡直是羽絨服購買指南，從含絨量、充絨量、蓬鬆度，這些指標去選擇羽絨服，可以幫助大家更好的選擇羽絨服。最近不是天氣已經很冷了嗎，所以爲了幫助大家抵禦嚴寒，我特地爬了下京東的羽絨服數據。

爲啥不是天貓呢，理由很簡單，滑塊驗證有點麻煩，而京東就不用考慮滑塊的問題，對於網站反爬機制直接加代理就可以了，代理也是很簡單的一種，動態轉發，使用超級簡單，方便，一起分享給大家參考下。

import org.apache.commons.httpclient.Credentials;
import org.apache.commons.httpclient.HostConfiguration;
import org.apache.commons.httpclient.HttpClient;
import org.apache.commons.httpclient.HttpMethod;
import org.apache.commons.httpclient.HttpStatus;
import org.apache.commons.httpclient.UsernamePasswordCredentials;
import org.apache.commons.httpclient.auth.AuthScope;
import org.apache.commons.httpclient.methods.GetMethod;

import java.io.IOException;

public class Main {
    # 代理服務器(產品官網 www.16yun.cn)
    private static final String PROXY_HOST = "t.16yun.cn";
    private static final int PROXY_PORT = 31111;

    public static void main(String[] args) {
        HttpClient client = new HttpClient();
        HttpMethod method = new GetMethod("https://httpbin.org/ip");

        HostConfiguration config = client.getHostConfiguration();
        config.setProxy(PROXY_HOST, PROXY_PORT);

        client.getParams().setAuthenticationPreemptive(true);

        String username = "16ABCCKJ";
        String password = "712323";
        Credentials credentials = new UsernamePasswordCredentials(username, password);
        AuthScope authScope = new AuthScope(PROXY_HOST, PROXY_PORT);

        client.getState().setProxyCredentials(authScope, credentials);

        try {
            client.executeMethod(method);

            if (method.getStatusCode() == HttpStatus.SC_OK) {
                String response = method.getResponseBodyAsString();
                System.out.println("Response = " + response);
            }
        } catch (IOException e) {
            e.printStackTrace();
        } finally {
            method.releaseConnection();
        }
    }
}

從獲取的數據看，大家選擇羽絨服都是從價格，版型，厚度等方面去進行選擇。