Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Netconvert problems with UTF-8 BOM character sequence #13932

Closed
transport111 opened this issue Oct 11, 2023 · 6 comments
Closed

Netconvert problems with UTF-8 BOM character sequence #13932

transport111 opened this issue Oct 11, 2023 · 6 comments

Comments

@transport111
Copy link

Hi everyone,
I have a problem with importing a VISUM net file to the SUMO. I fixed the language problem at first, but now i got so many warning messages, but not this is my biggest problem, I got errors also. "Error: Too short value line in NODE occurred." This error message is for the node, zone, linktype. I checked none of the rows are empty , even i did not save zones in the net file. Can somebody help me with this problem please?
Thank you so much.

@m-kro
Copy link
Contributor

m-kro commented Oct 11, 2023

Could you provide the VISUM file?

@transport111
Copy link
Author

I made a mini model just for an example. It came with the same issues.

mini_visum.zip

@m-kro m-kro added the bug label Oct 12, 2023
@m-kro
Copy link
Contributor

m-kro commented Oct 12, 2023

Note: There is a problem with the general input parser LineReader we have to solve. Shifting the reader forward to a certain character offset does not work (different offset).

@m-kro
Copy link
Contributor

m-kro commented Oct 13, 2023

@transport111 Your input file has some "invisible" characters at the begin (Hex: EF BB BF) which confuse netconvert. Did you process it after saving in VISUM or did you provide it "as is"?

@m-kro
Copy link
Contributor

m-kro commented Oct 16, 2023

Actually this is a bug/feature of the internal parser LineReader. We will fix that.

m-kro added a commit that referenced this issue Oct 16, 2023
Signed-off-by: m-kro <m.barthauer@t-online.de>
m-kro added a commit that referenced this issue Oct 16, 2023
Signed-off-by: m-kro <m.barthauer@t-online.de>
m-kro added a commit that referenced this issue Oct 16, 2023
Signed-off-by: m-kro <m.barthauer@t-online.de>
@m-kro m-kro changed the title Visum input via Netconvert Netconvert problems with UTF-8 BOM character sequence Oct 16, 2023
@m-kro
Copy link
Contributor

m-kro commented Oct 16, 2023

@transport111 Please try again with a fresh build from Github source or wait until tomorrow for new development binaries. Our parser had some issues with considering the UTF byte order mark (BOM) correctly. Your small example network does not have any edges, though, so the import will fail nonetheless.

@m-kro m-kro added this to the 1.19.0 milestone Oct 16, 2023
@m-kro m-kro closed this as completed Oct 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants