HttpClient筆記

背景:因爲想寫一個測試tomcat連接的程序,就試試自已去構造Http請求。找了一下發現Apache下有一個比較成熟的輪子HttpComponets.

使用庫:Apache Http Client
HttpClient是一個代碼級的Http客戶端工具,可以使用它模擬瀏覽器向Http服務器發送請求。
其中HttpClient是HttpComponents項目其中的一部份,HttpComponents簡稱爲hc.
見http://hc.apache.org/
使用HttpClient還需要HttpCore.這裏其中包括Http請求與Http響應的代碼封裝。

現在導入兩個jar包:
httpclient-4.0.jar
httpcore-4.0.jar
httpmime-4.0.jar


開始一個請求代碼如下:
Java代碼
HttpClient httpClient = new DefaultHttpClient();
//構造請求,如果想使用POST則new一個HttpPost
HttpGet get = new HttpGet("http://www.iteye.com");
HttpResponse response = httpClient.execute(get);
//先從響應頭得到實體
HttpEntity entity = response.getEntity();
//得到實體輸入流
InputStream inSm = entity.getContent();
Scanner inScn = new Scanner(inSm);
while(inScn.hasNextLine()){
System.out.println(inScn.nextLine());
}
entity.consumeContent();

HttpClient httpClient = new DefaultHttpClient();
//構造請求,如果想使用POST則new一個HttpPost
HttpGet get = new HttpGet("http://www.iteye.com");
HttpResponse response = httpClient.execute(get);
//先從響應頭得到實體
HttpEntity entity = response.getEntity();
//得到實體輸入流
InputStream inSm = entity.getContent();
Scanner inScn = new Scanner(inSm);
while(inScn.hasNextLine()){
System.out.println(inScn.nextLine());
}
entity.consumeContent();

這個是在HC例子中有代碼作了少量的修改。
輸出:
Java代碼
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="zh-CN" dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>
<title>JavaEye Java編程 Spring框架 AJAX技術 Agile敏捷軟件開發 ruby on rails實踐 - JavaEye做最棒的軟件開發交流社區</title>
<meta name="description" content="Java編程,Spring Struts Webwork框架深入,XMLHTTP AJAX開發,Java Web開發,Java企業應用,Java設計模式,Java開源框架,Java應用服務器,Rich Client討論,Ruby編程,Ruby DSL開發,Ruby on rails實踐,JavaScript編程,敏捷軟件開發XP TDD,軟件配置管理,軟件測試,項目管理UML,數據庫,C#/.net C/C++ Erlang/FP PHP/Linux平臺,精通Hibernate" />
<meta name="keywords" content="Java編程 Spring框架 AJAX技術 Agile敏捷軟件開發 ruby on rails實踐 JavaEye深度技術社區" />
<link rel="shortcut icon" href="/images/favicon.ico" type="image/x-icon" />
<link href="/rss" rel="alternate" title="JavaEye技術網站RSS頻道訂閱" type="application/rss+xml" />
<link href="http://www.iteye.com/stylesheets/homepage.css?1263389049" media="screen" rel="stylesheet" type="text/css" />

</head>

...省略,證明以上代碼已經成功

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="zh-CN" dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>
<title>JavaEye Java編程 Spring框架 AJAX技術 Agile敏捷軟件開發 ruby on rails實踐 - JavaEye做最棒的軟件開發交流社區</title>
<meta name="description" content="Java編程,Spring Struts Webwork框架深入,XMLHTTP AJAX開發,Java Web開發,Java企業應用,Java設計模式,Java開源框架,Java應用服務器,Rich Client討論,Ruby編程,Ruby DSL開發,Ruby on rails實踐,JavaScript編程,敏捷軟件開發XP TDD,軟件配置管理,軟件測試,項目管理UML,數據庫,C#/.net C/C++ Erlang/FP PHP/Linux平臺,精通Hibernate" />
<meta name="keywords" content="Java編程 Spring框架 AJAX技術 Agile敏捷軟件開發 ruby on rails實踐 JavaEye深度技術社區" />
<link rel="shortcut icon" href="/images/favicon.ico" type="image/x-icon" />
<link href="/rss" rel="alternate" title="JavaEye技術網站RSS頻道訂閱" type="application/rss+xml" />
<link href="http://www.iteye.com/stylesheets/homepage.css?1263389049" media="screen" rel="stylesheet" type="text/css" />

</head>

...省略,證明以上代碼已經成功

當然這個只是大刀一小試。現在還離我的目標差一點點:
需要做個頭,我還不太清楚有什麼頭可以使用,那樣我又寫了個程序看看IE的頭到底是怎樣子的,
沒有抓包程序,只好自已寫個程序:
Java代碼
ServerSocket socketServer = new ServerSocket(10086);
Socket client = socketServer.accept();
InputStream inClient = client.getInputStream();
Scanner inScn = new Scanner(inClient);
while(inScn.hasNextLine()){
System.out.println(inScn.nextLine());
}
inScn.close();
client.close();
socketServer.close();

ServerSocket socketServer = new ServerSocket(10086);
Socket client = socketServer.accept();
InputStream inClient = client.getInputStream();
Scanner inScn = new Scanner(inClient);
while(inScn.hasNextLine()){
System.out.println(inScn.nextLine());
}
inScn.close();
client.close();
socketServer.close();

在IE地址欄上輸入:
http://locahost:10086/
點確定後可以得到程序輸出:
Java代碼
GET / HTTP/1.1
Accept: image/jpeg, application/x-ms-application, image/gif, application/xaml+xml, image/pjpeg, application/x-ms-xbap, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, application/x-shockwave-flash, */*
Accept-Language: zh-CN
User-Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; QQWubi 87; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0)
Accept-Encoding: gzip, deflate
Host: localhost:10086
Connection: Keep-Alive

GET / HTTP/1.1
Accept: image/jpeg, application/x-ms-application, image/gif, application/xaml+xml, image/pjpeg, application/x-ms-xbap, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, application/x-shockwave-flash, */*
Accept-Language: zh-CN
User-Agent: Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; QQWubi 87; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0)
Accept-Encoding: gzip, deflate
Host: localhost:10086
Connection: Keep-Alive

分析請求包中這六個頭信息。可以參考以下文章:
http://zsxxsz.iteye.com/blog/568250
現在我使用HC模擬IE的請求,修改後代碼如下:
Java代碼
HttpClient httpClient = new DefaultHttpClient();
HttpGet get = new HttpGet("http://www.iteye.com");

get.setHeader("Accept", "image/jpeg, application/x-ms-application, image/gif, application/xaml+xml, image/pjpeg, application/x-ms-xbap, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, application/x-shockwave-flash, */*");
get.setHeader("Accept-Language","zh-CN");
get.setHeader("User-Agent","Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0; QQWubi 87; SLCC2; .NET CLR 2.0.50727; .NET CLR 3.5.30729; .NET CLR 3.0.30729; Media Center PC 6.0)");
get.setHeader("Accept-Encoding","gzip, deflate");
get.setHeader("Host","you never be know");
get.setHeader("Connection","Keep-Alive");

HttpResponse response = httpClient.execute(get);
發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章