Mitmproxy received an absolute-form request error #2079

axot · 2017-03-01T06:42:48Z

Steps to reproduce the problem:

tcpdump result:

CONNECT sample.domain.com:80 HTTP/1.1
Proxy-Connection: Keep-Alive
Connection: Keep-Alive
Host: sample.domain.com:80

HTTP/1.1 200 Connection established

POST http://sample.domain.com/ajax/info/info HTTP/1.1
User-Agent: Unity/5.4.3p4 (Mac OS X 10.12.3; MacBookPro12,1)
Host: sample.domain.com
Accept-Encoding: gzip, identity
Proxy-Connection: Keep-Alive
Connection: Keep-Alive, TE
TE: identity
Content-Length: 0
Cookie: apv=1.0; abc=; abd=; abe=

HTTP/1.1 400 Bad Request
Server: mitmproxy 2.0.0
Connection: close
Content-Length: 436
Content-Type: text/html

<html>
            <head>
                <title>400 Bad Request</title>
            </head>
            <body>
            <h1>400 Bad Request</h1>
            <p>HttpException(&#x27;Mitmproxy received an absolute-form request even though it is not running in regular mode. This usually indicates a misconfiguration, please see http://docs.mitmproxy.org/en/stable/modes.html for details.&#x27;,)</p>
            </body>
        </html>HTTP/1.1 502 Bad Gateway
Server: mitmproxy 2.0.0
Connection: close
Content-Length: 479
Content-Type: text/html

<html>
            <head>
                <title>502 Bad Gateway</title>
            </head>
            <body>
            <h1>502 Bad Gateway</h1>
            <p>ProtocolException(&#x27;HTTP protocol error in client request: Mitmproxy received an absolute-form request even though it is not running in regular mode. This usually indicates a misconfiguration, please see http://docs.mitmproxy.org/en/stable/modes.html for details.&#x27;,)</p>
            </body>
        </html>

Any other comments? What have you tried so far?

I fixed this temporarily with

mitmproxy/mitmproxy/proxy/root_context.py

Line 100 in 83f1e2e

return protocol.Http1Layer(top_layer, http.HTTPMode.transparent)

- return protocol.Http1Layer(top_layer, http.HTTPMode.transparent)
+ return protocol.Http1Layer(top_layer, http.HTTPMode.regular)

System information

Mitmproxy version: 2.0.0 (release version)
Python version: 3.6.0
Platform: Darwin-16.4.0-x86_64-i386-64bit
SSL version: OpenSSL 1.1.0e 16 Feb 2017
Mac version: 10.12.3 ('', '', '') x86_64

The text was updated successfully, but these errors were encountered:

mhils · 2017-03-01T09:03:09Z

Thanks for the extensive report. This seems to be a duplicate of #848?

axot · 2017-03-01T13:17:30Z

Did this mean, I should change the behaviour to like this way?

CONNECT sample.domain.com:80 HTTP/1.1
POST /ajax/info/info HTTP/1.1

Kriechi · 2017-03-01T14:05:24Z

Yes, this is what most clients do. They send a CONNECT with the host they need a connection to, and then they only send relative paths.

axot · 2017-03-03T13:13:57Z

Should we add an option to disable validate_request_form ?

mhils · 2017-03-03T18:08:07Z

So there are two things I'd love to see:

First, always accept requests in absolute-form going to the same host. For example, after CONNECT example.com, we should accept GET http://example.com/foo, but not GET http://example.org/foo. This would for example fix this issue.
Second, as you suggested, add a --relax-http-form-validation switch.

mhils · 2017-03-03T18:09:06Z

I copied that to #848, let's continue there :)

sk3lk0 · 2019-12-18T15:35:02Z

--relax-http-form-validation not working

mhils added the kind/triage Unclassified issues label Mar 1, 2017

mhils closed this as completed Mar 3, 2017

Mitmproxy received an absolute-form request error #2079

Mitmproxy received an absolute-form request error #2079

axot commented Mar 1, 2017

mhils commented Mar 1, 2017

axot commented Mar 1, 2017 •

edited

Kriechi commented Mar 1, 2017

axot commented Mar 3, 2017

mhils commented Mar 3, 2017

mhils commented Mar 3, 2017

sk3lk0 commented Dec 18, 2019

Mitmproxy received an absolute-form request error #2079

Mitmproxy received an absolute-form request error #2079

Comments

axot commented Mar 1, 2017

Steps to reproduce the problem:

Any other comments? What have you tried so far?

System information

mhils commented Mar 1, 2017

axot commented Mar 1, 2017 • edited

Kriechi commented Mar 1, 2017

axot commented Mar 3, 2017

mhils commented Mar 3, 2017

mhils commented Mar 3, 2017

sk3lk0 commented Dec 18, 2019

axot commented Mar 1, 2017 •

edited