Skip to content
This repository has been archived by the owner on Apr 5, 2024. It is now read-only.

[Push] Not able pushing data with large files #62

Closed
3 of 4 tasks
zelima opened this issue Feb 1, 2018 · 5 comments
Closed
3 of 4 tasks

[Push] Not able pushing data with large files #62

zelima opened this issue Feb 1, 2018 · 5 comments

Comments

@zelima
Copy link
Collaborator

zelima commented Feb 1, 2018

Tries publishing large dataset, with large number of columns or large in size (170mb). CLI either hangs without displaying spinner or justs exits - terminates job.

How to reproduce

Expected behavior

  • Able to push large files
  • Able to see the progress (to be sure it's not stuck...)
  • Able to see the dataset page with preview data

sub-issues

@AcckiyGerman
Copy link
Contributor

data-cli issue: datopian/data-cli#255

@AcckiyGerman
Copy link
Contributor

processing page issue added: datopian/frontend#198

@AcckiyGerman
Copy link
Contributor

AcckiyGerman commented Feb 7, 2018

Ok, the 168 mb file was processed successfully.
It took two days 😭 but generally it is working.
We have another issue about the processing speed #71
and issue about showing Progress Bar is postponed #85, datopian/data-cli#116 so

FIXED: User could push big dataset and it is processed.

@AcckiyGerman
Copy link
Contributor

Again FAILing with 1030_columns.csv 😢

@AcckiyGerman
Copy link
Contributor

FIXED in v 0.7.3
TESTED

  • 1030_colums - OK
  • 80mb.csv - OK

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants