Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CSV Provider performance improvements for big files #53

Closed
ovatsus opened this issue Feb 1, 2013 · 0 comments
Closed

CSV Provider performance improvements for big files #53

ovatsus opened this issue Feb 1, 2013 · 0 comments

Comments

@ovatsus
Copy link

ovatsus commented Feb 1, 2013

The csv providers still hangs VS when we give it very large files. Possible improvements:

  • Do the inference only when accessing the first member of a row, so it doesn't start processing before we're able to change the InferRows parameters
  • Make the default InferRows something other than int.Max. Let's say put 1000 the max by default
  • Do the Inference asynchronously with a timeout so we don't hang VS when it takes more than 10 seconds
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants