New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Increase size of upload data > 10MB #126

Closed
lewismc opened this Issue Jan 15, 2019 · 9 comments

Comments

Projects
None yet
2 participants
@lewismc
Copy link

lewismc commented Jan 15, 2019

I have been working on generating RDF manifestations of the NASA Global Reservoir and Dam Database (GRanD v1.01) which results in a two fairly large datasets. One is ~20MB and the other ~130MB.
@carueda what are the chances of us increasing the maximum 10MB for datasets ?
Thanks

@lewismc lewismc self-assigned this Jan 15, 2019

@carueda

This comment has been minimized.

Copy link
Member

carueda commented Jan 15, 2019

@lewismc @graybeal

Those are large datasets.

Anyway, I can increase the size limit for the upload (this restriction is performed on the backend).

What limit should I set?

@carueda

This comment has been minimized.

Copy link
Member

carueda commented Jan 15, 2019

BTW, because it's specially relevant, I'll try to also address mmisw/orr-ont#68 for the resulting new ORR version.

@lewismc

This comment has been minimized.

Copy link
Author

lewismc commented Jan 15, 2019

For the LDaaS initiative we would be looking to facilitate large RDF datasets with possibly hundreds of thousands if not millions of statements. The hydrography datasets I a working with now will reflect that. For the time being if we could set it at 150MB it would be excellent. Thank you for the quick reply @carueda

@carueda

This comment has been minimized.

Copy link
Member

carueda commented Jan 15, 2019

@lewismc I've just implemented this (with 150M as size limit for uploads -- but this is now configurable), created new docker image, and updated the COR instance. I'm marking this as resolved. Please give it a try when you have a chance and let me know.

NOTE: The docker image is v3.8.0, but the frontend component is 3.7.3, which is the version you should now see on the UI. (Will try to "resync" the versions next time.)

(btw, mmisw/orr-ont#68 not addressed yet.)

@lewismc

This comment has been minimized.

Copy link
Author

lewismc commented Jan 15, 2019

@carueda thanks for acting on this. When I try to use the frontend WebUI, it still indicates 10MB is upper limit.
screen shot 2019-01-15 at 1 21 12 pm

@carueda

This comment has been minimized.

Copy link
Member

carueda commented Jan 15, 2019

Unexpected, perhaps I missed some step in my build process (it's been a while since I last touched this code)... In the mean time, please try a hard-reload of the page in your browser (even clearing the cache). Also open the dev console while you are retrying and attach any output there if the problem persists.

@carueda

This comment has been minimized.

Copy link
Member

carueda commented Jan 15, 2019

@lewismc Can you email me that 21MB file (compressed) so I can do some local tests?

carueda added a commit that referenced this issue Jan 15, 2019

@carueda

This comment has been minimized.

Copy link
Member

carueda commented Jan 15, 2019

Found the problem. Will create a new release.

@carueda

This comment has been minimized.

Copy link
Member

carueda commented Jan 15, 2019

Fixed. The new version is now 3.8.1 (in the docker image and reflected in the UI).

COR just updated.

3.8.1 also includes resolution of mmisw/orr-ont#68

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment