Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Are you sure that vroom can guess the separator automatically like data.table? #167

Closed
turgut090 opened this issue Jul 20, 2019 · 2 comments

Comments

@turgut090
Copy link

Hi, it is not the first time that vroom cannot guess the separator.
As an example, you can try the following datasets
https://www.kaggle.com/c/ieee-fraud-detection/leaderboard

@phileas-condemine
Copy link

same here, i'm using a ";" separated file, I use col_select but I get the error "Evaluation error : objet 'finess' introuvable" meaning the variable can't be found.
When I set explicitly delim=";" it works.

@jimhester
Copy link
Collaborator

jimhester commented Jul 23, 2019

The heuristics used are not perfect and are not as robust as those used in data.table, if it is not working for your dataset set the delimiter explicitly, which is also safer if you know what the delimiter is.

There are existing issues related to this #141 so I am going to close this issue.

jimhester added a commit that referenced this issue Dec 6, 2019
The previous logic was hard to follow and did not work well for many
real world files. The new code seems simpler to read and also works
better on files which used to fail. It also deals better with quoted
fields.

Fixes #126
Fixes #141
Fixes #167
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants