Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Encoding of special chars (e.g. äöü) in data #512

Closed
geofranzi opened this issue Mar 24, 2020 · 5 comments
Closed

Encoding of special chars (e.g. äöü) in data #512

geofranzi opened this issue Mar 24, 2020 · 5 comments
Assignees
@geofranzi @DavidBlaa
Milestone
2.14.0

Comments

@geofranzi
Copy link
Member

Appears not during Excel upload, but during upload with text formats
image
@geofranzi geofranzi added this to the 2.14.0 milestone Mar 24, 2020
@DavidBlaa
Copy link
Member

can you please write what the original data looks like? Are the data wrong in the database or only in the user display

@geofranzi
Copy link
Member Author

test_upload.xlsx

and the same file saved as csv ( I can not upload here). Excel works, csv shows the result in the image. It also happens during migration as we import txt files.

@DavidBlaa
Copy link
Member

image_2020_03_31T07_23_50_244Z

@geofranzi
Copy link
Member Author

https://stackoverflow.com/a/7102180
On example which detects at least the Windows format. Normal "detect" fails as it uses only the first chars.

AsciiReader.cs

DavidBlaa added a commit that referenced this issue Apr 2, 2020
@DavidBlaa
#512 adding tests to detect the encoding of an ascci file.
016cece 
Extension of the Ascci Reader to detect the encoding when opening the file
@DavidBlaa
Copy link
Member

fixed and merge to dev

DavidBlaa added a commit that referenced this issue Apr 23, 2020
@DavidBlaa
#512 add a unit test for encoding to AsciiReaderEncodingTest
16aa21b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@geofranzi geofranzi

@DavidBlaa DavidBlaa

Labels
None yet
Projects
None yet
Milestone
2.14.0
Development

No branches or pull requests
2 participants
@geofranzi @DavidBlaa