Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Progress feedback during upload #179

Closed
tfmorris opened this issue Oct 15, 2012 · 3 comments
Closed

Progress feedback during upload #179

tfmorris opened this issue Oct 15, 2012 · 3 comments
Labels
imported from old code repo Issue imported from Google Code in 2010 Priority: Medium Represents important issues that need to be addressed but are not urgent Type: Feature Request Identifies requests for new features or enhancements. These involve proposing new improvements.
Milestone

Comments

@tfmorris
Copy link
Member

Original author: kena...@gmail.com (November 04, 2010 18:04:49)

When creating a large-ish project from a data file, I don't get any feedback during the import, so I'm uncertain whether it's just spinning its wheels & thrashing, or whether it's making slow but steady progress.

It would also be great if there were a "cancel" button for the upload. The only way I can see is to quit the background application & cancel the browser page load.

I'm using google-refine-2.0-r1760.dmg on OS X 10.6.4 with java 1.6.0_22.

Original issue: http://code.google.com/p/google-refine/issues/detail?id=179

@tfmorris
Copy link
Member Author

From kopo...@gmail.com on December 14, 2010 20:17:14:
Just creating a project with ~1M rows. Taking 3 hours and I don't know if it will even finish today. An ETA would be really helpful for my workflow.

@tfmorris
Copy link
Member Author

From tfmorris on December 14, 2010 20:49:27:
Not really relevant to the issue at hand, but since people attempting to load large projects are likely to end up here, for large projects you should:

  1. Make sure that you've got sufficient real memory
  2. Make sure that your Java heap size is set large enough to accommodate your project
  3. Strongly consider turning off "guess data types" (which is on by default). It will make multiple guesses for each cell and for the common case (i.e. text), it will try them all before falling through to accept the value as ordinary text.
  4. Consider turning off splitting and import as a single column. There's a substantial amount of per-cell overhead which you may end up incurring unnecessarily for "uninteresting" columns that you'll just delete later. Better to import things as a single column and do a little more work to split things by hand afterwards for very large projects.

@tfmorris
Copy link
Member Author

From dfhu...@gmail.com on September 11, 2011 05:17:58:
The new importer UI framework in trunk/ should already show uploading progress.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
imported from old code repo Issue imported from Google Code in 2010 Priority: Medium Represents important issues that need to be addressed but are not urgent Type: Feature Request Identifies requests for new features or enhancements. These involve proposing new improvements.
Projects
None yet
Development

No branches or pull requests

1 participant