web proxy: yoyo ACL https download writes garbage to disk

[fichtner]

Hi Ad, do you know what's wrong? I could only verify for now :(

https://forum.opnsense.org/index.php?topic=4893.0

[AdSchellevis]

Oo it's gzipped... which won't get unpacked by request.raw

As soon as I have some time I'll try to prepare a fix.

[fichtner]

doesn't http take care of this? if this already happens then what happens with chunked encoding??

[fabianfrz]

just use zlib for that. Python has a module for that:
https://docs.python.org/2/library/zlib.html

[AdSchellevis]

i know, it's just a time constraint.

[AdSchellevis]

please be aware that the list mentioned in the forum (https://pgl.yoyo.org/as/serverlist.php?hostformat=squid-dstdom-regex&showintro=0&mimetype=plaintext) isn't compatible with our system, because it's a regexp and not a domain list (https://pgl.yoyo.org/as/serverlist.php?hostformat=plain&showintro=0&mimetype=plaintext)

[fichtner]

thanks for fixing 👍 I'll coordinate with the user