Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

handle the request's path error when using system proxy #254

Closed
wants to merge 2 commits into from

Conversation

DarrenLuo
Copy link

system: macOS 10.15.6

problem: I take cookieStore to manage my cookies, if I config the system's network, set a proxy, the cookies in the cookieStore won't sent to the website

the reason is the code I changed, before my change, the request's path will change to the all url, actually, the path should be the url's last part expect the host, like 'https://google.com/', the path should be '/', but if there have system proxy, the path will changed to 'http://google.com/', this will make cookie match mistake, so, it won't sent the cookie to the website

@carterkozak
Copy link
Contributor

Please create a jira ticket for this issue. Can you write a test that reproduces the problem?

@ok2c
Copy link
Member

ok2c commented Sep 5, 2020

I suppose a test case involving a proxy might be difficult to setup and reproduce but please at the very least provide a wire / context log of the session exhibiting the problem.

@DarrenLuo
Copy link
Author

I don‘t know where is the jira, so I take a example here

public static void main(String[] args) throws IOException {
    CookieStore cookieStore = new BasicCookieStore();
    BasicClientCookie cookie = new BasicClientCookie("test", "test");
    cookie.setDomain("cn.bing.com");
    cookie.setPath("/");
    cookieStore.addCookie(cookie);

    Request request = Request.get("http://cn.bing.com");
    Executor.newInstance()
            .use(cookieStore)
            .execute(request);
}

if use the system proxy, the debug log like this:

22:49:15.872 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ex-00000001: preparing request execution
22:49:18.836 [main] DEBUG org.apache.hc.client5.http.protocol.RequestAddCookies - Cookie spec selected: strict
22:49:18.841 [main] DEBUG org.apache.hc.client5.http.impl.classic.ProtocolExec - ex-00000001: target auth state: UNCHALLENGED
22:49:18.842 [main] DEBUG org.apache.hc.client5.http.impl.classic.ProtocolExec - ex-00000001: proxy auth state: UNCHALLENGED
22:49:18.842 [main] DEBUG org.apache.hc.client5.http.impl.classic.ConnectExec - ex-00000001: acquiring connection with route {}->http://192.168.31.145:10809->http://cn.bing.com:80
22:49:18.842 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ex-00000001: acquiring endpoint (3 MINUTES)
22:49:18.843 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ex-00000001: endpoint lease request (3 MINUTES) [route: {}->http://192.168.31.145:10809->http://cn.bing.com:80][total available: 0; route allocated: 0 of 100; total allocated: 0 of 200]
22:49:18.848 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ex-00000001: endpoint leased [route: {}->http://192.168.31.145:10809->http://cn.bing.com:80][total available: 0; route allocated: 1 of 100; total allocated: 1 of 200]
22:49:18.858 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ex-00000001: acquired ep-00000000
22:49:18.858 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ex-00000001: acquired endpoint ep-00000000
22:49:18.858 [main] DEBUG org.apache.hc.client5.http.impl.classic.ConnectExec - ex-00000001: opening connection {}->http://192.168.31.145:10809->http://cn.bing.com:80
22:49:18.859 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ep-00000000: connecting endpoint (3 MINUTES)
22:49:18.859 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ep-00000000: connecting endpoint to http://192.168.31.145:10809 (3 MINUTES)
22:49:18.872 [main] DEBUG org.apache.hc.client5.http.impl.io.DefaultHttpClientConnectionOperator - http-outgoing-0: connecting to /192.168.31.145:10809
22:49:18.879 [main] DEBUG org.apache.hc.client5.http.impl.io.DefaultHttpClientConnectionOperator - http-outgoing-0: connection established 192.168.31.61:52750<->192.168.31.145:10809
22:49:18.880 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ep-00000000: connected http-outgoing-0
22:49:18.880 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ep-00000000: endpoint connected
22:49:18.880 [main] DEBUG org.apache.hc.client5.http.impl.classic.MainClientExec - ex-00000001: executing GET http://cn.bing.com/ HTTP/1.1
22:49:18.881 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ep-00000000: start execution ex-00000001
22:49:18.881 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ep-00000000: executing exchange ex-00000001 over http-outgoing-0
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> GET http://cn.bing.com/ HTTP/1.1
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> Accept-Encoding: gzip, x-gzip, deflate
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> Host: cn.bing.com
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> User-Agent: Apache-HttpClient/5.0.1 (Java/14.0.2)
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "GET http://cn.bing.com/ HTTP/1.1[\r][\n]"
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "Accept-Encoding: gzip, x-gzip, deflate[\r][\n]"
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "Host: cn.bing.com[\r][\n]"
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "User-Agent: Apache-HttpClient/5.0.1 (Java/14.0.2)[\r][\n]"
22:49:18.882 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "[\r][\n]"
22:49:19.309 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "HTTP/1.1 200 OK[\r][\n]"
22:49:19.309 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Content-Length: 50198[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Cache-Control: private, max-age=0[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Connection: keep-alive[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Content-Encoding: gzip[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Content-Type: text/html; charset=utf-8[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Date: Sat, 05 Sep 2020 14:49:53 GMT[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Keep-Alive: timeout=4[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "P3p: CP="NON UNI COM NAV STA LOC CURa DEVa PSAa PSDa OUR IND"[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Proxy-Connection: keep-alive[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: SRCHD=AF=NOFORM; domain=.bing.com; expires=Mon, 05-Sep-2022 14:49:53 GMT; path=/[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: SRCHUID=V=2&GUID=FF7C29E14AEE4C9C969241E3D80CAEC5&dmnchg=1; domain=.bing.com; expires=Mon, 05-Sep-2022 14:49:53 GMT; path=/[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: SRCHUSR=DOB=20200905; domain=.bing.com; expires=Mon, 05-Sep-2022 14:49:53 GMT; path=/[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: _SS=SID=114C559D5C0069D7132C5AA15D386805; domain=.bing.com; path=/[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: _EDGE_S=F=1&SID=114C559D5C0069D7132C5AA15D386805; path=/; httponly; domain=bing.com[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: _EDGE_V=1; path=/; httponly; expires=Thu, 30-Sep-2021 14:49:53 GMT; domain=bing.com[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: MUID=1530A707A3A667AF197EA83BA29E669E; samesite=none; path=/; secure; expires=Thu, 30-Sep-2021 14:49:53 GMT; domain=bing.com[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: MUIDB=1530A707A3A667AF197EA83BA29E669E; path=/; httponly; expires=Thu, 30-Sep-2021 14:49:53 GMT[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Vary: Accept-Encoding[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "X-Msedge-Ref: Ref A: 14D5FAFFACE94BD0BEE91D2C3C585338 Ref B: SGEEDGE0516 Ref C: 2020-09-05T14:49:53Z[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[\r][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[0x1f][0xffffff8b][0x8][0x0][0x0][0x0][0x0][0x0][0x4][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[0xffffffec][0xfffffffd][0xffffffe9][0xffffff92][0xffffffa3]H[0xffffff96]0[0xc][0xffffffff][0x1f][0xffffffb3][0xffffffb9][0x7]M[0xffffffa6][0xfffffff5][0xffffffd3][0xffffff95][0xffffffa3][0xffffff88]`[0x13] Ev[0xffffffd5][0xffffffbc][0x8][0xffffffa1][\r][0x9][0xffffffb4] [0xffffffb4][0xffffffcc][0xffffff8c][0xffffff85][0xffffffb1][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "$6[0xffffffb1][\n]"
22:49:19.310 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[0xffffffa5][0xffffffc5][0xffffffbd][0x7f][0xffffffe6][0xe]H(B[0xffffff99]][0xffffffdd]=?[0xffffffbf][0xffffff8a][0xffffffaa][\n]"
22:49:19.311 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "p|=~[0xfffffff6]s[0xffffffdc][0xffffffe3]o[0xffffffff][0xffffffd1][0x13]Yi;[0xffffffe3][0x1a]V[0xffffffec]:[0x7f][0xfffffffc][\r][0xfffffffc][0xffffffbf][0xffffffe1]([0xffffffde][0xfffffffe][0xfffffff7]/[0x17][0xffffffeb][0xffffffcb][0x1f][0x7f][0xffffff8b][0xffffffb4][0xffffffd0][0xe][0xffffffe2]F[0xffffff9c][0x7][0xffffffc6][0xffffffef]_b[0xffffffe3][0x1c]#[0x7]%U[0xffffff8a][0xffffffd2]/[0xffffff8d]?[0x10][0xffffffe4]o[0xffffffff][0xfffffff1][0xffffffdf]l[0xffffff8f][0xffffff91][0xffffff98][0xffffffff][0xfffffffe][0xfffffff7][0x7f][0xffffff8b][0xffffffec][0xffffffb7][0xffffffa5][0xfffffff4][0xffffffbb]gd[0xffffff8d][0xffffff9e][0x12][0x1b][0xffffffff][0xfffffffe]o[0x8][0xfffffff2][0xffffffbf][0xffffffff][0xfffffffb][0xffffffc7][0xffffffdf][0xffffff90][0xffffffa2][0xfffffff2][0x1f][0x7f][0xffffffb3][0xc]E[0xffffffff][0xffffffe3]o[0xffffff8e][0xffffffed][0x1d][0x1b][0xffffffb6][0xfffffffe][0xfffffffb][0x17]u?[0xffffffb1][0xffffffbd][0xffffffe3][0xffffff97]Fh8[0xffffffbf][0x7f][0x9]B[0xffffffc3][0xfffffff1][0x15][0xfffffffd]K[0xffffffc3][\n]"
22:49:19.311 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[\r][0xfffffff3][0xfffffff7]/Hl[0xfffffffd][0xffffff97][0xffffffad][0xffffffff].[0xe][0x17]/]CI[0xffffff8d][0xffffffb0][0xffffffa7][0xffffffb8]o[0xffffffbb][0xffffffe1]3+Pm[0xffffff92][0xffffffc4]([0xffffffb4][0xffffffd5][0xffffffc1][0xffffffdf][0xffffffb0][0xe][0xffffff8e][0xffffff9e]1[0xffffffb4][0xffffff8d][0xffffffbe][0x1c][0xffffff82][0xfffffffd][0xffffffff]S[0xffffffdc][0xffffffe0]{h[0xfffffffe]>Qz[0xfffffff6]>1[0x1e]|[0xc]l[0xfffffffd]w+[0xfffffff8][0xffffffd2]P[0xffffffa2][0xffffffdf][0xffffffbf][0xffffffd8][0xffffffae][0xffffffb2]7[0xffffffbe]4[0xffffff90]r:[0xf][0xffffffa7]"
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << HTTP/1.1 200 OK
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Content-Length: 50198
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Cache-Control: private, max-age=0
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Connection: keep-alive
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Content-Encoding: gzip
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Content-Type: text/html; charset=utf-8
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Date: Sat, 05 Sep 2020 14:49:53 GMT
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Keep-Alive: timeout=4
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << P3p: CP="NON UNI COM NAV STA LOC CURa DEVa PSAa PSDa OUR IND"
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Proxy-Connection: keep-alive
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: SRCHD=AF=NOFORM; domain=.bing.com; expires=Mon, 05-Sep-2022 14:49:53 GMT; path=/
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: SRCHUID=V=2&GUID=FF7C29E14AEE4C9C969241E3D80CAEC5&dmnchg=1; domain=.bing.com; expires=Mon, 05-Sep-2022 14:49:53 GMT; path=/
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: SRCHUSR=DOB=20200905; domain=.bing.com; expires=Mon, 05-Sep-2022 14:49:53 GMT; path=/
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: _SS=SID=114C559D5C0069D7132C5AA15D386805; domain=.bing.com; path=/
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: _EDGE_S=F=1&SID=114C559D5C0069D7132C5AA15D386805; path=/; httponly; domain=bing.com
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: _EDGE_V=1; path=/; httponly; expires=Thu, 30-Sep-2021 14:49:53 GMT; domain=bing.com
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: MUID=1530A707A3A667AF197EA83BA29E669E; samesite=none; path=/; secure; expires=Thu, 30-Sep-2021 14:49:53 GMT; domain=bing.com
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: MUIDB=1530A707A3A667AF197EA83BA29E669E; path=/; httponly; expires=Thu, 30-Sep-2021 14:49:53 GMT
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Vary: Accept-Encoding
22:49:19.313 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << X-Msedge-Ref: Ref A: 14D5FAFFACE94BD0BEE91D2C3C585338 Ref B: SGEEDGE0516 Ref C: 2020-09-05T14:49:53Z
22:49:19.317 [main] DEBUG org.apache.hc.client5.http.impl.classic.MainClientExec - ex-00000001: connection can be kept alive for 4 SECONDS
22:49:19.334 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [SRCHD="AF=NOFORM", domain:bing.com, path:/, expiry:Mon Sep 05 22:49:53 CST 2022]
22:49:19.335 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [SRCHUID="V=2&GUID=FF7C29E14AEE4C9C969241E3D80CAEC5&dmnchg=1", domain:bing.com, path:/, expiry:Mon Sep 05 22:49:53 CST 2022]
22:49:19.335 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [SRCHUSR="DOB=20200905", domain:bing.com, path:/, expiry:Mon Sep 05 22:49:53 CST 2022]
22:49:19.335 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [_SS="SID=114C559D5C0069D7132C5AA15D386805", domain:bing.com, path:/, expiry:null]
22:49:19.335 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [_EDGE_S="F=1&SID=114C559D5C0069D7132C5AA15D386805", domain:bing.com, path:/, expiry:null]
22:49:19.336 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [_EDGE_V="1", domain:bing.com, path:/, expiry:Thu Sep 30 22:49:53 CST 2021]
22:49:19.336 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [MUID="1530A707A3A667AF197EA83BA29E669E", domain:bing.com, path:/, expiry:Thu Sep 30 22:49:53 CST 2021]
22:49:19.336 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [MUIDB="1530A707A3A667AF197EA83BA29E669E", domain:cn.bing.com, path:/, expiry:Thu Sep 30 22:49:53 CST 2021]

don't use the system proxy, the debug log like this:

22:47:35.130 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ex-00000001: preparing request execution
22:47:35.147 [main] DEBUG org.apache.hc.client5.http.protocol.RequestAddCookies - Cookie spec selected: strict
22:47:35.159 [main] DEBUG org.apache.hc.client5.http.protocol.RequestAddCookies - Cookie [name: test; value: test; domain: cn.bing.com; path: /; expiry: null] match [cn.bing.com:80/]
22:47:35.160 [main] DEBUG org.apache.hc.client5.http.impl.classic.ProtocolExec - ex-00000001: target auth state: UNCHALLENGED
22:47:35.160 [main] DEBUG org.apache.hc.client5.http.impl.classic.ProtocolExec - ex-00000001: proxy auth state: UNCHALLENGED
22:47:35.160 [main] DEBUG org.apache.hc.client5.http.impl.classic.ConnectExec - ex-00000001: acquiring connection with route {}->http://cn.bing.com:80
22:47:35.161 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ex-00000001: acquiring endpoint (3 MINUTES)
22:47:35.162 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ex-00000001: endpoint lease request (3 MINUTES) [route: {}->http://cn.bing.com:80][total available: 0; route allocated: 0 of 100; total allocated: 0 of 200]
22:47:35.166 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ex-00000001: endpoint leased [route: {}->http://cn.bing.com:80][total available: 0; route allocated: 1 of 100; total allocated: 1 of 200]
22:47:35.176 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ex-00000001: acquired ep-00000000
22:47:35.176 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ex-00000001: acquired endpoint ep-00000000
22:47:35.176 [main] DEBUG org.apache.hc.client5.http.impl.classic.ConnectExec - ex-00000001: opening connection {}->http://cn.bing.com:80
22:47:35.176 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ep-00000000: connecting endpoint (3 MINUTES)
22:47:35.176 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ep-00000000: connecting endpoint to http://cn.bing.com:80 (3 MINUTES)
22:47:35.198 [main] DEBUG org.apache.hc.client5.http.impl.io.DefaultHttpClientConnectionOperator - http-outgoing-0: connecting to cn.bing.com/202.89.233.101:80
22:47:35.252 [main] DEBUG org.apache.hc.client5.http.impl.io.DefaultHttpClientConnectionOperator - http-outgoing-0: connection established 192.168.31.61:52196<->202.89.233.101:80
22:47:35.252 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ep-00000000: connected http-outgoing-0
22:47:35.252 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ep-00000000: endpoint connected
22:47:35.252 [main] DEBUG org.apache.hc.client5.http.impl.classic.MainClientExec - ex-00000001: executing GET / HTTP/1.1
22:47:35.252 [main] DEBUG org.apache.hc.client5.http.impl.classic.InternalHttpClient - ep-00000000: start execution ex-00000001
22:47:35.252 [main] DEBUG org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager - ep-00000000: executing exchange ex-00000001 over http-outgoing-0
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> GET / HTTP/1.1
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> Accept-Encoding: gzip, x-gzip, deflate
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> Host: cn.bing.com
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> Connection: keep-alive
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> User-Agent: Apache-HttpClient/5.0.1 (Java/14.0.2)
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> Cookie: test=test
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "GET / HTTP/1.1[\r][\n]"
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "Accept-Encoding: gzip, x-gzip, deflate[\r][\n]"
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "Host: cn.bing.com[\r][\n]"
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "Connection: keep-alive[\r][\n]"
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "User-Agent: Apache-HttpClient/5.0.1 (Java/14.0.2)[\r][\n]"
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "Cookie: test=test[\r][\n]"
22:47:35.253 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 >> "[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "HTTP/1.1 200 OK[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Cache-Control: private, max-age=0[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Content-Length: 50196[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Content-Type: text/html; charset=utf-8[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Content-Encoding: gzip[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Vary: Accept-Encoding[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "P3P: CP="NON UNI COM NAV STA LOC CURa DEVa PSAa PSDa OUR IND"[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: SRCHD=AF=NOFORM; domain=.bing.com; expires=Mon, 05-Sep-2022 14:48:09 GMT; path=/[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: SRCHUID=V=2&GUID=79D80FD2F57940D096D6131B1633AD0E&dmnchg=1; domain=.bing.com; expires=Mon, 05-Sep-2022 14:48:09 GMT; path=/[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: SRCHUSR=DOB=20200905; domain=.bing.com; expires=Mon, 05-Sep-2022 14:48:09 GMT; path=/[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: _SS=SID=39BE5A8AFBB66B9309A655B6FA986ADE; domain=.bing.com; path=/[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "X-MSEdge-Ref: Ref A: FEF37967FEEF44F0A7000BC78F86E418 Ref B: BJ1EDGE0219 Ref C: 2020-09-05T14:48:09Z[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: _EDGE_S=F=1&SID=39BE5A8AFBB66B9309A655B6FA986ADE; path=/; httponly; domain=bing.com[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: _EDGE_V=1; path=/; httponly; expires=Thu, 30-Sep-2021 14:48:10 GMT; domain=bing.com[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: MUID=166FD84928446A022C2BD775296A6B75; samesite=none; path=/; secure; expires=Thu, 30-Sep-2021 14:48:10 GMT; domain=bing.com[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Set-Cookie: MUIDB=166FD84928446A022C2BD775296A6B75; path=/; httponly; expires=Thu, 30-Sep-2021 14:48:10 GMT[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Date: Sat, 05 Sep 2020 14:48:09 GMT[\r][\n]"
22:47:35.354 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[\r][\n]"
22:47:35.355 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[0x1f][0xffffff8b][0x8][0x0][0x0][0x0][0x0][0x0][0x4][\n]"
22:47:35.355 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[0xffffffec][0xfffffffd][0xffffffe7]r[0xffffffe3]H[0xffffff96]0[0xc][0xffffffff][0xffffffdf][0xffffff88][0xffffffbd][0x7]nU[0xffffffcc]3]KI[0xfffffff0][0xffffff86][0xffffffaa][0xffffffe9][0xffffffde][0x17][0x4]AO[0xffffff82][0x6][0x4][0xffffffcd][0xffffffee][0xffffff86][0x2][0xffffff96][0x0][0x9]GX[0xffffff82][0x15][0xffffffba][0xfffffff7]/2[0x1][0xffffff90][0xffffffa0][0xffffffc4][0xffffffaa][0xffffffe9][0xffffff99][0xffffffd9][0xffffff9f]_[0xffffffab][0xffffffbb][0x5]$[0xffffffd2][0xffffff9e]<[0xfffffffe][0xffffff9c]L[0xfffffffd][0xffffffed]?:"/mgB[0xffffffc3][0xffffff8a]][0xffffffe7][0xffffff8f][0xffffffbf][0xffffff81][0xffffffff]7[0x1c][0xffffffc5][0xffffffdb][0xffffffff][0xfffffffe][0xffffffe5]b}[0xfffffff9][0xffffffe3]o[0xffffff91][0x16][0xffffffda]A[0xffffffdc][0xffffff88][0xfffffff3][0xffffffc0][0xfffffff8][0xfffffffd]Kl[0xffffff9c]c[0xffffffe4][0xffffffa0][0xffffffa4]JQ[0xfffffffa][0xffffffa5][0xfffffff1][0x7][0xffffff82][0xfffffffc][0xffffffed]?[0xfffffffe][0xffffff9b][0xffffffef]p[0x12][0xfffffff7][0xffffffdf][0xffffffff][0xfffffffe]o[0xffffff91][0xfffffffd][0xffffffb6][0xffffff94]~[0xfffffff7][0xffffff8c][0xffffffac][0xffffffd1]Qb[0xffffffe3][0xffffffdf][0xffffffff][\r]A[0xfffffffe][0xfffffff7][0x7f][0xffffffff][0xfffffff8][0x1b]RT[0xfffffffe][0xffffffe3]o[0xffffff96][0xffffffa1][0xffffffe8][0x7f][0xfffffffc][0xffffffcd][0xffffffb1][0xffffffbd]c[0xffffffc3][0xffffffd6][0x7f][0xffffffff][0xffffffa2][0xffffffee][0xffffffc7][0xffffffb6]w[0xfffffffc][0xffffffd2][0x8][\r][0xffffffe7][0xfffffff7]/Ah8[0xffffffbe][0xffffffa2][0x7f]iX[0xffffffa1]a[0xfffffffe][0xfffffffe][0x5][0xffffff89][0xffffffad][0xffffffff][0xffffffb2][0xfffffff5][0xffffffdf][0xffffffc5][0xfffffffe][0xffffffe2][0xffffffa5]m([0xffffffa9][0x11]v[0x14][0xfffffff7]m[0xffffffd7][0x7f][0xffffffe6][0xffffffa7]4KQ[0x18][0xffffff8d][0xffffff92]-[0xfffffffc][\r]k[0xffffffe1][0xffffffe8][0x19]CY[0xfffffff4][0xffffffe5][0x10][0xffffffec][0xffffffff][0xffffff9f][0xffffffe2][0x6][0xffffffdf]C[0xfffffff3][0xfffffff7][0xffffffb1][0xffffffd2][0xffffffb1][0xfffffff7][0xffffff89][0xfffffff1][0xffffffe0]c`[0xffffffeb][0xffffffbf][[0xffffffc1][0xffffff97][0xffffff86][0x12][0xfffffffd][0xfffffffe][0xffffffc5]v[0xffffff95][0xffffffbd][0xfffffff1][0xffffffa5][0xffffff81][0xffffff94][0xffffffd3]y8[0xffffff85]HA"[0xffffffdb][0xffffffdd]#V[0xffffffa0][0xffffffe1][0xffffffcc]K[0xffffffe0][0xffffffed]?6u[0xffffff8d]Xih[0xffffffbe][0x17][0x1b]^\[0xffffffc2][0x6]@[0xffffffef]{C[0xffffffb3][0xffffff94]02[0xffffffe2][0xffffffdf][0xffffff93][0xffffffd8]|f[0xffffffbf]4[0xffffffac]8[0xe][0xffffff9e][0xffffff8d]Sb[0xffffffa7][0xffffffbf][0x7f])[0xffffffab]?[0x3]x~A[0xfffffffe][0xe]x[0xffffffeb][0xffffffd0][0xfffffffd]7[0xffffffe4]?[0xffffffff][0xffffffa3]cG[0xffffff8a][0xffffffea][0x18][0xffffffc3][0xffffffeb][0x6][0xffffffcc]B[0xffffffdf][0xffffffb4][0x1d]#[0xfffffffc]O[0xffffffe4][0xffffffdf][0xffffffff][\r][0xfffffffd][0xfffffffe][0xffffffef][0xffffffff][0xfffffff6][0xfffffffd][0xffffffd7][0xffffff95][0xfffffffe][\r][0xfffffffd];[0x15][0xffffffca]^[0xffffffde]z[0xffffffbf][0xffffffff]XJ[0xffffffaf][0xffffffbf][0xffffff81]I[0xfffffffa]f[0x3]n[0xffffffeb][0x7f][0xfffffffc][0xfffffffe][0xfffffffb]_[0x13]O7L[0xffffffdb]3[0xfffffff4][0xffffffbf][0xfffffffe][0x17],{[0xffffffad][0xffffffb6][0xfffffffa][0xffffffdb][0xffffffd3][0xffffffe4][0x18][0xffffffbf]~[0xffffffb9]X[0xffffffcf][0xfffffffc][0xfffffff4][0xffffffcb][0xffffffd3][0xffffffc2]H[0x7][0x1][0xffffffcf][0xffffffbf]~[0xffffffd1][0xffffffbc]/O[0xb]i[0xfffffffc]j*Nd<[0xffffffc9]F[0xfffffff8][0xfffffffa][0xffffff85][0xffffffa0][0xffffffbf]<[\r]z[0xffffffaf]_[0x8][0xffffffb6][0xffffff8d]r[0x4][0xffffffdb]f0[0xffffff82]%[0xfffffff9][0x16][0xffffffc7][0xffffff92]D[0xffffff8b][0xffffffed][0x8],K[0xffffffa2]m[0x2]g[0xffffff98]/OBjx[0xfffffff1][0xffffffa0][0xfffffff3][0xfffffffa][0xffffffa5]+t[0x9][0xffffffa6]E3]A[0xffffffe8][0xffffff92]d[0x17][0xffffffe5][0x18][0x14]E[0xffffffdb]<[0xffffffc3]vYZ 1[0xfffffff6][0xffffffcb][0xffffff93][0xfffffffc][0xfffffffa][0xffffffc5][0xfffffff2]]#[0x0]{[0xfffffffa]4{[0xfffffffd][0xffffffb2][0x14][0x16][0xffffffb3]/O[0x1d][0xffffffee][0xfffffff5]K[0x7f][0xffffffd4]C[0xffffffb1]/O<[0xffffffe8][0x7][0xffffffa3][0xffffffe9]n[0xffffff87]%[8K[0xffffff92]4[0xffffff87][0xffffffe2]8[0xffffff8f][0xffffffb7];[0xc]C[0xffffffe1]-[0xffffff9a][0xffffffa3][0xffffffdb][0xc][0xfffffff5][0xffffffe5]i[0xffffffb9][0x1a][0xfffffff4]_[0xffffffbf][0xffffffcc][0xffffffa9][0xffffffac]{[0xffffff99]h[0xffffffa9][0xffffffd0][0xb][0xe]=e[0xffffffc7]G[0xffffffab]|[0xffffffd9][0xffffffe7][0xffffffbe]<)[0xffffffba][0xfffffff6][0xfffffffa]E}S[0xfffffff4]/O[0xfffffffb]`[0x15]:[0xffffffaf]_[0xfffffffe][0x7]1[0xfffffff5][0xffffffff]A[0xffffff9c][0xffffffe8][0x7f][0xffffff90][0x1e]@[0xffffffe5][0xffffff99][0xffffffed][0xffffffed]_[0xffffff94](8[0xffffffff][0xffffffd7][0xffffff97][0xffffffc6][0xfffffffb][0xfffffff7][0xffffffc6][[0xffffffef][0xffffffc5][0xffffff89]V[0xffffffa1][0xfffffff3][0xfffffffb][0x17][0xffffffc4][0xffffffd4][0x11]'B[0xffffff9c][0xffffffff][0x1a][0xfffffff4]~[0xffffffff][0xffffffd2]|[0xffffffeb][0xffffffbd][0xc]z[0xffffffcd]/[0xffffffff][0xffffff8f][0x1f]t[0xffffff8a]7~[0xffffffd0]i|[0xffffffd7][0xffffff92][0x10][0xffffffd6][0x5][0xffffffc8][0xfffffff2][0xfffffffa]?[0xffffffc8][0xffffffff] [0xffffff9a][0xfffffff7][0xffffffa2][0xffffff82][0xe]5[0xffffffdf][0xfffffffd][0x1f][0xffffffe4][0xffffffcb]w3[0xfffffff1][0xffffffb4][0xffffffd8][0xfffffff6]=[0xffffffb0][0x1b][0xffffffd2]o[0xffffffca][0xffffffb7][0x1f][\r][0xffffffdb][0xfffffffc]M[0xfffffff7][0xffffffb5][0xffffffc4]5[0xffffffbc][0xfffffff8][0x5][0xffffffe2]s[0xfffffff4][0xffffffed][0xffffffc7][[0xffffffef][0xffffffa5]7[0x1b][0xffffffb8]{H[0xffffff84][0x3][0xffffff80][0xffffffe4][0xffffffdf][0xffffffab][0xffffffa2][0xffffff97]([0xffffffd4]~[0x7f][0xffffffeb][0xffffffbd][0xffffffc0][0xffffffb9]7[0xffffffff]:[0xffffffe8][0xfffffffd][0xfffffffe][0xffffffd7]r*[0x7f][0xffffff85]S[0xffffff81]o[0xfffffffc][0xffffffa0][0xffffffd3][0xfffffffc][0xffffffeb][0xffffffff][0xfffffffb]kS[0xfffffff9][0xfffffffe][0x1e][0x1a]q[0x12]z[0xffffff8d]8L[0xffffff8c][0xffffffef][0xffffffef][0xffffffdf]?[0xffffffd2]r[0x14][0xffffffe7][0xffffff8e]Q[0xffffffe7][\n]"
22:47:35.355 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "Z[0x14]}[0xfffffff9][0x3][0xffffffa0][0xffffffff][0xf]?5B[0xffffffd3][0xfffffff1][0xffffffb3]W%[0xffffff89][0xfffffffd]w[0xffffffe5]I[0xfffffff5][0xfffffff5][0xfffffffc][0xffffff87][0xffffffe9]{[0xfffffff1][0xffffffb3][0xffffffa9][0xffffffb8][0xffffffb6][0xffffff93][0xffffffbf]~Y[0x1a]{[0xffffffdf]h[0xffffffac][0x6]_[0xffffff9e][0xffffffe0][0xffffffd3][0xffffff93][0xffffffa4]X[0xffffffbe][0xffffffab]<q[0xffffffa1][0xffffffad]8[0x0]Mt[0xffffffc5]S[0xffffff9e]"[0xffffffc5][0xffffff8b][0xffffff9e]##[0xffffffb4][0xffffffcd][0xffffffef][0xffffffb0]qd_[0xffffff8c][0xffffffd7][0xffffffc8]U[0x1c][0xffffffe7];`C[0xffffffcf][0xffffffba][0xffffffa1][0xfffffff9][0xffffffa1][0x2]@[0xfffffff2][0xffffffea][0xfffffff9][0xffffff9e][0xfffffff1][0xffffffae][0xffffffbc]Z`[0xffffffe4][0x1f][0x1f]?[0x2][0xffffffa4][\r][0x1d][0xffffffdb]3[0xffffffde][0x13][0xffffffe7]G[0xffffffa0][0xffffffe8][0xffffffba][0xffffffed][0xffffffed]_[0xffffffd1]w0U8[0xffffffb5][0xffffffa7][0xffffffaf]V[0xfffffff0][0x16][0x3][0xffffffba][0xffffff82]O[0xffffff9a][0xffffffe1]8[0xffffffbc][0xffffffe1][0xffffffc5]F[0xfffffff8][0xffffffc3]2[0xffffffec][0xffffffbd][0x15][0xffffffbf]b([0xfffffffa][0xffffff97][0xffffffef][0xffffff99][0xffffffad][0xffffffc7]V[0xfffffff1][0xffffffa8][0xfffffffa][0xffffffa1]n[0xffffff84][0xffffffcf][0xffffff9a][0xffffffef]8J[0x10][0x19][0xffffffaf][0xffffffd5][0xffffffc3]wW[0x9][0xfffffff7][0xffffffb6][0xfffffff7][0xffffff8a]~[0xffffffbf][0xffffff8e][0xfffffff2]]U[0xffffffb4][0xffffffe3]>[0xfffffff4][0x13]O[0x7][0xfffffff5][0xfffffffd][0xfffffff0][0xfffffff5]+A[0x10][0xffffffdf][0xffffff8b][0x1e]^[0xffffffd1]w0tm[0xffffffc0][0xffffffd4][0x8]c[S[0xffffff9c]g[0xffffffc5][0xffffffb1][0xfffffff7][0xffffffde][0xffffffab]k[0xffffffeb][0xffffffba]c|[0xffffffbf][0xffffffc2][0xffffffd3][0xffffffb2]u[0xffffffdd][0xfffffff0]`[0xffffffa3]({[0xffffffb3][0xfffffff4][0xfffffff0]G[0xffffffe0]G6[0xffffff84][0xffffff80][0xffffffa2]F[0xffffffbe][0xffffff93][0xffffffc4][0xffffffc6][0xfffffff7][0xffffffd8][0xf]^[0xffffffd1][0xffffffda]lk[0xffffffb5][0x1b]_#[0xffffffed][0xffffffcd][0xffffffd2][0x13][0xffffffb8]L[[0x7][0x1d]4[0xffffffbe][0xffffff82][0xffffffdf]?[0x0]t[0xffffff9e][0xffffffcb][0xffffffd5][0xffffffa2][0xffffffdf]/[0xffffffcf][0xffffffb6][0xffffffa7][0x1b][0xffffffe7]W[0xc]{/[[0xfffffffc]t[0xffffff9c][0xffffffb2][\r]I[0x4][0xffffffe7][0xffffffef][0xfffffff5]N[0xffffff88]Vp[0xfffffffe][0xffffffae][0xfffffffa]q[0xffffffec][0xffffffbb][0xffffffaf][0xffffffe8]w[0xffffffc7]0[0xffffffe3]W[0xffffffb4][0x4][0xffffffcf]3|[0xffffffc3][0xffffffd9][0xffffffe0]\[0xfffffff5][0xffffffde]p[0xffffffec][0x1f][0x17][0xffffffdf]w_[0xffffffb1][0xffffffef][0xffffffba][0x1d][0x5][0xffffff8e][0xffffff92][0xffffffbf][0xffffffda][0x1e][0xffffffdc][0xffffffb0]r[0xfffffff8][0xffffff86]c7[0xffffff94][0x1f][0xffffff8f][0xffffff81][0xfffffff3]q[0xffffffd4][0xffffffc6][0x7f][0xffffffd8]n[0xffffffe0][0xffffff87][0xffffffb1][0xffffffe2][0xffffffc5][0x1f]z{V[0x1d]_;Bx[0x14]3[0xffffffe3][\r][0xffffffc7]y[0xffffffb0][0xffffffb2][0xffffffeb][0xffffffb4]o[^[0xffffffec][0xffffff93][0xffffffef][0xffffffc5][0xffffff8a][0xffffffed][0x19][0xffffffe1][0xf][0xffffffd7][0xfffffff6][0xffffff9e][0xffffffcb][0xffffff8f][0x18]F[0x5][0xffffffe7][0xffffffef][0xffffffae]r[0xffffffae][\n]"
22:47:35.355 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[0x8][0xffffff9a][0xe][0xffffffce]5[0xfffffff8][0x7f][0x7][0xffffff95]K0Q-[0x0][0x16]P[0xffffffb9],`h68[0x7f]/_ [0xffffff9a]]744[0x1c]%[0xffffffb6]S[0xffffffa3]B*HK[0xffffffff][0xffffffd9][0xffffff84][0xffffffd2][0x19]b[0xffffffcd]u6[0x1f][0xffffffd1][0xffffffa3]@[0xffffffe5]X[0xffffffff]Q[0xffffffe2]i[0x14]([0x1a]D[0xfffffff9]+[0xffffffda][0xffffffdd][0xfffffff0][0xfffffff3][0xfffffffd][0xffffffab][0xffffffba][0xffffffef][0xffffffd8][0xffffffe9][0x3]([0x14]x[0xfffffff4][0xffffffa1][0xffffffef][0xfffffffa][0xffffffba][0xffffffea][0xffffffb3][0xffffffae]ayh[0x4][0xffffff86][0x12][0xffffffbf]z[0xfffffffe]s[0xfffffff1][0xfffffff4][0xffffff80][0x2]h[0xffffff9a][0xffffffae][0xffffff97]B[0xffffffba][0xffffffd6][0xffffffc0]H[0xffffffef][0xffffffbe]z0[0xffffffb4][0xfffffff8][0xffffffc1]l[0xffffffca][0xffffffc1]*[0xffffffc4]F![0xffffff9a]?c[0x0][0xffffffeb][0x0]n[0xffffffc1][0xffffffa7][0xf]s}[0x7f][0x1]dm[0xffffff9c][0xffffffe3][0xffffffa7][0xffffff97]H{[0xb]4[0xffffff88]DO[0xffffff89][0x3][0xffffff8a][0xffffff81]"[0xfffffff2][0xffffffe6])i[0xffffff81]X[0xffffff90][0xffffffbb]d[0x5][0xffffffad][0xffffff93](zmX[0xfffffff0],8=[0xffffff8c][0x0][0xffffffe8]j[0x5]o%[0xffffffdd][0xffffffdd]P[0xffffffe3][0xfffffffb][0xffffffe7][0x1d][0xffffffab][0xffffffa8][0xffffffbb][0xe][0xffffffe6][[0xffffffd3][0x1b][0xffffffac] [0xffffffdb][0xffffffaa]v[0x1f][0xffffff90][0xffffffd0][0xffffff95] t;}z[0xffffff89][0xffffffb2][0xffffffb7]XmX[0x4][0xffffff98][0xffffffbe][0xffffffe5]`U[0xffffff81]c[0xffffffff][0xfffffff8]@%E[0xffffffcd][0x1b]k{[0xffffffb0]K[0xffffff90]@[0xffffffaf][0xffffffec][0xffffffe9][0xffffffc6]N[0xffffffe1][0xffffffba][0xffffffca][0xffffff91][0x12][0xffffffe7][0xffffffc7][0xffffffb5][0xffffffc6][0xffffff95][0xffffff81][0xffffffbd]_?[0xffffff96][0xffffffd3](@V[0xffffff90][0xffffffeb]{[0x1][0xffffffd9][0x1f][0x0]W[0x8]"8[0xffffffd7]h[0xffffffef][0xfffffffd][0xffffffab][0xffffffa5][0xffffff87]oQp[0xffffffeb][0xffffffb3][0x1])[0xffffffa5]d[0xffffff82][0xffffffa6]i[0xffffffd6][0xffffffc0][0xffffffd9]H[0xffffff9c];J[0xfffffff7][0x1][0xffffffc6][0xffffffc6][0xfffffff9][0xffffffeb][0xb][0xfffffffb][0xfffffff3]J%[0xffffffb3][0xffffffaf][0xffffffaa]b[0xfffffff7]5[0xffffffe1],[0x7f]"[0xf][0xffffff80][0xffffffb0][0xfffffff8][0xfffffffe]x[0x1e][0xffffff8e][\r]V[0xffffffa4]h[0xffffff80][0xfffffff0][0xffffff8a][0xffffffdd]/[0xffffffd1][0xffffff82]A[0xffffffd1][0xffffff92]z[\n]"
22:47:35.355 [main] DEBUG org.apache.hc.client5.http.wire - http-outgoing-0 << "[0xfffffff6][0x15][0xfffffff9][0xffffff8e][0xffffffad]7[0xffffffb0][0xffffffe0][0xffffffdc][0xfffffff8][0xffffffaa][0xffffffb0]*[0xffffffa6]2[0xffffffd5][0xffffffd7][0x10]J[0xffffff8c][0xffffffcf][0xffffff9f][0xffffffaf][0xffffff90]-[0xffffff91][0x3]J[0xffffffac][0x1b]B5[0xffffffea]#[0xffffffff][0xffffffa1]T[0xffffffa4][[0xffffffb2]"0N[0xffffffd1][0xffffffe5]W[0x0][0xffffffb8]{[0x1c][0xffffffae][0xfffffff6][0xffffffbd][0xffffff98][0x18][0xffffffc0][0xffffffa2][0xfffffffb][0xffffffef][0xffffffc5][0xffffff86][0x15][0xffffffe3][0x17]u0[0xffffffc0]t[0xffffffca][0xffffff82]b[0xffffffbe][0xffffffb0][0xffffffa4][0x6]"
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << HTTP/1.1 200 OK
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Cache-Control: private, max-age=0
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Content-Length: 50196
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Content-Type: text/html; charset=utf-8
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Content-Encoding: gzip
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Vary: Accept-Encoding
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << P3P: CP="NON UNI COM NAV STA LOC CURa DEVa PSAa PSDa OUR IND"
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: SRCHD=AF=NOFORM; domain=.bing.com; expires=Mon, 05-Sep-2022 14:48:09 GMT; path=/
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: SRCHUID=V=2&GUID=79D80FD2F57940D096D6131B1633AD0E&dmnchg=1; domain=.bing.com; expires=Mon, 05-Sep-2022 14:48:09 GMT; path=/
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: SRCHUSR=DOB=20200905; domain=.bing.com; expires=Mon, 05-Sep-2022 14:48:09 GMT; path=/
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: _SS=SID=39BE5A8AFBB66B9309A655B6FA986ADE; domain=.bing.com; path=/
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << X-MSEdge-Ref: Ref A: FEF37967FEEF44F0A7000BC78F86E418 Ref B: BJ1EDGE0219 Ref C: 2020-09-05T14:48:09Z
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: _EDGE_S=F=1&SID=39BE5A8AFBB66B9309A655B6FA986ADE; path=/; httponly; domain=bing.com
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: _EDGE_V=1; path=/; httponly; expires=Thu, 30-Sep-2021 14:48:10 GMT; domain=bing.com
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: MUID=166FD84928446A022C2BD775296A6B75; samesite=none; path=/; secure; expires=Thu, 30-Sep-2021 14:48:10 GMT; domain=bing.com
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Set-Cookie: MUIDB=166FD84928446A022C2BD775296A6B75; path=/; httponly; expires=Thu, 30-Sep-2021 14:48:10 GMT
22:47:35.357 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 << Date: Sat, 05 Sep 2020 14:48:09 GMT
22:47:35.359 [main] DEBUG org.apache.hc.client5.http.impl.classic.MainClientExec - ex-00000001: connection can be kept alive for 3 MINUTES
22:47:35.378 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [SRCHD="AF=NOFORM", domain:bing.com, path:/, expiry:Mon Sep 05 22:48:09 CST 2022]
22:47:35.379 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [SRCHUID="V=2&GUID=79D80FD2F57940D096D6131B1633AD0E&dmnchg=1", domain:bing.com, path:/, expiry:Mon Sep 05 22:48:09 CST 2022]
22:47:35.379 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [SRCHUSR="DOB=20200905", domain:bing.com, path:/, expiry:Mon Sep 05 22:48:09 CST 2022]
22:47:35.379 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [_SS="SID=39BE5A8AFBB66B9309A655B6FA986ADE", domain:bing.com, path:/, expiry:null]
22:47:35.380 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [_EDGE_S="F=1&SID=39BE5A8AFBB66B9309A655B6FA986ADE", domain:bing.com, path:/, expiry:null]
22:47:35.380 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [_EDGE_V="1", domain:bing.com, path:/, expiry:Thu Sep 30 22:48:10 CST 2021]
22:47:35.380 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [MUID="166FD84928446A022C2BD775296A6B75", domain:bing.com, path:/, expiry:Thu Sep 30 22:48:10 CST 2021]
22:47:35.381 [main] DEBUG org.apache.hc.client5.http.protocol.ResponseProcessCookies - Cookie accepted [MUIDB="166FD84928446A022C2BD775296A6B75", domain:cn.bing.com, path:/, expiry:Thu Sep 30 22:48:10 CST 2021]

they are too long to read, only focus on this line:

22:47:35.253 [main] DEBUG org.apache.hc.client5.http.headers - http-outgoing-0 >> Cookie: test=test

this log only appeared in the second debug log

@DarrenLuo
Copy link
Author

DarrenLuo commented Sep 5, 2020

I simplify this code, and adjust the log level, only log org.apache.hc.client5.http.headers

the code like this:

public static void main(String[] args) throws IOException {
    CookieStore cookieStore = new BasicCookieStore();
    BasicClientCookie cookie = new BasicClientCookie("test", "test");
    cookie.setDomain("cn.bing.com");
    cookie.setPath("/");
    cookieStore.addCookie(cookie);

    log.info("request no proxy: ");

    Request request = Request.get("http://cn.bing.com");
    Executor.newInstance()
            .use(cookieStore)
            .execute(request);

    log.info("request with proxy: ");

    Request requestThroughProxy = Request.get("http://cn.bing.com")
            .viaProxy("192.168.31.145:10809");
    Executor.newInstance()
            .use(cookieStore)
            .execute(requestThroughProxy);
}

the log is:

2020-09-05 23:11:38.532  INFO 10485 --- [lication Thread] xyz.darrenluo.front.IndexController      : request no proxy: 
2020-09-05 23:11:38.762 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 >> GET / HTTP/1.1
2020-09-05 23:11:38.762 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 >> Accept-Encoding: gzip, x-gzip, deflate
2020-09-05 23:11:38.763 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 >> Host: cn.bing.com
2020-09-05 23:11:38.763 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 >> Connection: keep-alive
2020-09-05 23:11:38.763 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 >> User-Agent: Apache-HttpClient/5.0.1 (Java/14.0.2)
2020-09-05 23:11:38.763 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 >> Cookie: test=test
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << HTTP/1.1 200 OK
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Cache-Control: private, max-age=0
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Content-Length: 50197
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Content-Type: text/html; charset=utf-8
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Content-Encoding: gzip
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Vary: Accept-Encoding
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << P3P: CP="NON UNI COM NAV STA LOC CURa DEVa PSAa PSDa OUR IND"
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Set-Cookie: SRCHD=AF=NOFORM; domain=.bing.com; expires=Mon, 05-Sep-2022 15:12:13 GMT; path=/
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Set-Cookie: SRCHUID=V=2&GUID=E44E11C37DE441DFA5940BAE884596BC&dmnchg=1; domain=.bing.com; expires=Mon, 05-Sep-2022 15:12:13 GMT; path=/
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Set-Cookie: SRCHUSR=DOB=20200905; domain=.bing.com; expires=Mon, 05-Sep-2022 15:12:13 GMT; path=/
2020-09-05 23:11:38.865 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Set-Cookie: _SS=SID=2E8C407D0B98662F2D5F4F410AB6672F; domain=.bing.com; path=/
2020-09-05 23:11:38.866 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << X-MSEdge-Ref: Ref A: BE500D3E6E4540FC8ACB3C378D68DB63 Ref B: BJ1EDGE0211 Ref C: 2020-09-05T15:12:13Z
2020-09-05 23:11:38.866 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Set-Cookie: _EDGE_S=F=1&SID=2E8C407D0B98662F2D5F4F410AB6672F; path=/; httponly; domain=bing.com
2020-09-05 23:11:38.866 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Set-Cookie: _EDGE_V=1; path=/; httponly; expires=Thu, 30-Sep-2021 15:12:13 GMT; domain=bing.com
2020-09-05 23:11:38.866 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Set-Cookie: MUID=0AFCAD618379630E0B1CA25D825762D3; samesite=none; path=/; secure; expires=Thu, 30-Sep-2021 15:12:13 GMT; domain=bing.com
2020-09-05 23:11:38.866 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Set-Cookie: MUIDB=0AFCAD618379630E0B1CA25D825762D3; path=/; httponly; expires=Thu, 30-Sep-2021 15:12:13 GMT
2020-09-05 23:11:38.866 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-0 << Date: Sat, 05 Sep 2020 15:12:13 GMT
2020-09-05 23:11:38.887  INFO 10485 --- [lication Thread] xyx.darrenluo.front.IndexController      : request with proxy: 
2020-09-05 23:11:45.729 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 >> GET http://cn.bing.com/ HTTP/1.1
2020-09-05 23:11:45.729 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 >> Accept-Encoding: gzip, x-gzip, deflate
2020-09-05 23:11:45.729 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 >> Host: cn.bing.com
2020-09-05 23:11:45.729 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 >> User-Agent: Apache-HttpClient/5.0.1 (Java/14.0.2)
2020-09-05 23:11:47.396 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << HTTP/1.1 200 OK
2020-09-05 23:11:47.396 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Content-Length: 50189
2020-09-05 23:11:47.396 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Cache-Control: private, max-age=0
2020-09-05 23:11:47.396 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Connection: keep-alive
2020-09-05 23:11:47.396 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Content-Encoding: gzip
2020-09-05 23:11:47.396 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Content-Type: text/html; charset=utf-8
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Date: Sat, 05 Sep 2020 15:12:21 GMT
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Keep-Alive: timeout=4
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << P3p: CP="NON UNI COM NAV STA LOC CURa DEVa PSAa PSDa OUR IND"
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Proxy-Connection: keep-alive
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Set-Cookie: SRCHD=AF=NOFORM; domain=.bing.com; expires=Mon, 05-Sep-2022 15:12:21 GMT; path=/
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Set-Cookie: SRCHUID=V=2&GUID=CC885652695145E887299DF256097783&dmnchg=1; domain=.bing.com; expires=Mon, 05-Sep-2022 15:12:21 GMT; path=/
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Set-Cookie: SRCHUSR=DOB=20200905; domain=.bing.com; expires=Mon, 05-Sep-2022 15:12:21 GMT; path=/
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Set-Cookie: _SS=SID=01BC6F54CDD16E6A04936068CC5A6F68; domain=.bing.com; path=/
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Set-Cookie: _EDGE_S=F=1&SID=01BC6F54CDD16E6A04936068CC5A6F68; path=/; httponly; domain=bing.com
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Set-Cookie: _EDGE_V=1; path=/; httponly; expires=Thu, 30-Sep-2021 15:12:21 GMT; domain=bing.com
2020-09-05 23:11:47.397 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Set-Cookie: MUID=2AE7B0BA15D560010AA3BF86145E6103; samesite=none; path=/; secure; expires=Thu, 30-Sep-2021 15:12:21 GMT; domain=bing.com
2020-09-05 23:11:47.398 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Set-Cookie: MUIDB=2AE7B0BA15D560010AA3BF86145E6103; path=/; httponly; expires=Thu, 30-Sep-2021 15:12:21 GMT
2020-09-05 23:11:47.398 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << Vary: Accept-Encoding
2020-09-05 23:11:47.398 DEBUG 10485 --- [lication Thread] org.apache.hc.client5.http.headers       : http-outgoing-1 << X-Msedge-Ref: Ref A: E5AD174CC4AA4832BC8F8D750AD30CA9 Ref B: SG2EDGE1120 Ref C: 2020-09-05T15:12:21Z

can search Cookie: in the log, only with no proxy have http-outgoing-0 >> Cookie: test=test

@ok2c
Copy link
Member

ok2c commented Sep 19, 2020

Superseded by ae67250

@ok2c ok2c closed this Sep 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants