Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Encoding issue with BeautifulSoup #184
When I was downloading some images (for example, illust_id=59140460), in the function 'getImagePage' BeautifulSoup converted utf-8 encoded content (var 'response') to a mess with HTML entities (var 'parsed'). Likely BeautifulSoup was confused by some characters (have no idea what) and treated the page as other encoding. It only happened on some of my computers, so I am not sure if the problem is repeatable with the illust_id above.
I tried adding 'Accept-Charset: utf-8' to request header and passing the content by