zgrab/zgrab2: HTTP bodies getting mangled

[bwireman]

• Use DetermineEncoding To try and translate http bodies to UTF8 if possible.

How to Test

make
echo "qq.com" | ./zgrab2 http --port=443 --use-https --max-size=64 --max-redirects=5 | jq . | grep -o 腾讯首页

And hopefully get that a result. The chinese is the title of qq's webpage and is malformed in current results. https://censys.io/domain/qq.com

Notes & Caveats

• I've tested this with some of domains from the alexa top million, but I've been unable to run a full 1% scan from scratch-01

• DetermineEncoding returns a certainty boolean, but at least with qq it was getting the right result even though it was returning a certainty of false, so I decided to ignore it

Issue Tracking

[justinbastress]

This looks like the right solution, esp since GET / is usually text.

Still feels like it needs BodyBytes or something, but obviously that would be a lot more disruptive.