评论语料乱码的解决

[zhugw]

问题

Mac git clone 下来的评论语料乱码 如下所示

➜  neg git:(master) ✗ head neg.0.txt 
��׼��̫�� ���仹����3�ǵ� ������ʩ�dz��¾�.����Ƶ���ϵı�׼����¸���.

解决

 #读取文件内容
 def getContent(fullname):
-    f = codecs.open(fullname, 'r')
+    f = codecs.open(fullname, 'r', encoding="gbk", errors="ignore")

[wenk207]

good

[RongBoZ]

nice

[lailaiya]

beauti