OpenRefine messes up encoding when exporting as CSV

[daviddou82]

I am able to import utf-8 encoded french text into open refine. When exporting as csv, Open refines adds garbage to exported csv. exporting as tsv and excel works fine but csv produces garbage chracters.

[tfmorris]

If you have a chance to describe your workaround or misunderstanding, that might help the next user with the same issue...

[daviddou82]

I think this encoding issue is still persistent. I though I could fix it by changing the encoding to uft-8. I can contain the issue with cell level transformation to replace the garbage characters. Out of 400k rows there always appears about 150 rows with garbage character when i export to csv. I can share the data if you would like to see it.

David

[daviddou82]

https://drive.google.com/drive/#folders/0BwLvaFRd3dxEekRCVDVUa01TNzg/0BwLvaFRd3dxES0FMSHl2RVZDNW8

the file is in here. with the name concat6.csv

[patd0000]

I am having the same issues. Is there any update on this bug? Data seems to export correctly to Excel but there is the limit of 65536 rows.

[tfmorris]

@patd0000 We update the issue tracker whenever there's a change in status, so there is no new news. It's likely to be an easy fix, but someone needs to find the time to look at it. Pull requests accepted, of course. :-)

[patd0000]

Thanks Tom. I wonder how anyone can process international data if the
character sets don't work.