Add warning for large dataset files (>500MB?) on Chrome

[Vjimenez-vasquez]

Hi everyone,

Cannot open a *.json file in https://auspice.us/. My file is about 750Mb (2400 monkeypox complete genomes). I ran augur pipeline more than 5 times trying to solve the issue and I never received a warning message, my pipeline runs good and produces a final "right" file. I made a test with only 600 monkeypox genomes (retrieving json file about 25mb) and auspice.us works well (it opens the file with any problem). Is there any limit size to upload in auspice.us ?

Please find attached the drive link to check my files, my compressed *json file is "ns_monkeypox_221222.rar". You will find my metadata.tsv, auspice_config.json, lat_longs.tsv, raw_tree.nwk, refine_tree.nwk

https://drive.google.com/drive/folders/1zHeNQCCkTndamhUpay_VxPAyBJLnEZ4W?usp=share_link

Please, I would appreciate you to help me with this issue.

[joverlee521]

Hi @Vjimenez-vasquez,

Which browser are you using? Your issue sounds similar to #1499.
I am able to load your JSON in Firefox but not Chrome. If you are using Chrome, then this is most likely due to Chrome's limits on memory usage.

In general, I recommend using the --minify-json option for augur export v2 to export the JSON without indentations and line returns to reduce the size of the file.

[Vjimenez-vasquez]

Thank you so much @joverlee521, you are right Firefox works pretty fine ! I did not notice that solution.

[corneliusroemer]

Maybe we could add a warning in Export if the file is bigger than what Chrome will tolerate, say 500 MB, and suggest to minify.

[Vjimenez-vasquez]

Hi @corneliusroemer. Sure ! That would help a lot !