-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update with use of esupy for flowlist storage #151
Conversation
@WesIngwersen flagging you on this to ensure you are comfortable shifting to local data storage of the flowlist instead of within the repo. |
I assume it will store the flowlist parquet on the Data Commons? |
I can add the piece to download from data commons (I did not yet since generating locally is quite quick). |
Yes. We should go for consistency across other tools. where the principle API function to get the data in init calls in an esupy function to load from local storage or download it from the Commons if missing. |
ok added with c497ab6. I can confirm its working once we have a parquet up there. |
Assigning @catherinebirney for preparing data commons upon returning. |
tested and works for me |
This implements the use of parquet storage via esupy for locally saving the flowlist and removes the flowlist parquet file from the repository
Attempting to access the flowlist will cause it to be created if not found locally.