bitextor-identifyMIME.py error

[hieuhoang]

cat 1 | ~/permanent/software/bitextor/bitextor-identifyMIME.py

Traceback (most recent call last):
File "/home/hieu/permanent/software/bitextor/bitextor-identifyMIME.py", line 41, in
magicoutput.append(base64.b64encode(base64.b64decode(content + "==").decode(magicoutput[1].split("=")[1].replace("unknown-8bit","iso-8859-1").replace('us-ascii','iso-8859-1')).encode("utf8")).decode("utf8"))
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xed in position 16161: invalid continuation byte
1.gz

[hieuhoang]

For now, I've hacked the script to write 'dunno' to the output stream when there is an encoding error
0396e24

[mespla]

I have added a second attempt to convert the file by using ISO-8859-1 by default. Should we better discard a file if te encoding cannot be identified properly? This is, insetad of printing it with dunno, just not including it in the ouptut of the script?