Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can you put the example data somewhere for download, so one can run the example more easily and quickly? #69

Open
cutebomb opened this issue Mar 9, 2024 · 11 comments

Comments

@cutebomb
Copy link

cutebomb commented Mar 9, 2024

the data in the examples like
'data/ethusdt_20221003.npz',
'data/ethusdt_20221004.npz',
'data/ethusdt_20221005.npz',
'data/ethusdt_20221006.npz',
'data/ethusdt_20221007.npz'

@cutebomb cutebomb changed the title Can you put the example data somewhere for download, so one can run the example more easy quickly? Can you put the example data somewhere for download, so one can run the example more easily and quickly? Mar 9, 2024
@nkaz001
Copy link
Owner

nkaz001 commented Mar 10, 2024

Do you know a good platform for uploading large amounts of data for free? Initially, I uploaded the sample data on GitHub LFS, but it quickly reached the bandwidth limit.

@cutebomb
Copy link
Author

kaggle datasets may be one option.
or other cloud filesystem like google file

@nkaz001
Copy link
Owner

nkaz001 commented Mar 11, 2024

i'll check it out. since i need to collect data newly, it will take time.

@SUSHANTH009
Copy link

@nkaz001 can you please please upload this data
'data/ethusdt_20221003.npz',
'data/ethusdt_20221004.npz',
'data/ethusdt_20221005.npz',
'data/ethusdt_20221006.npz',
'data/ethusdt_20221007.npz' like maye be on kaggle

@nkaz001
Copy link
Owner

nkaz001 commented Mar 27, 2024

i'll set up a new data collection to avoid any licensing issues and provide the sample data publicly. But, it also costs me to run a server in the cloud, so please wait for a moment. or you can directly collect the data yourself using https://github.com/nkaz001/collect-binancefutures.

@nkaz001
Copy link
Owner

nkaz001 commented Mar 31, 2024

I began collecting the feed and may provide sample data which will be about for a week. Once the collection and preparation of the sample data are complete, I will attempt to upload it and update the demo accordingly.

@qtbgo
Copy link

qtbgo commented Apr 16, 2024

Great, are you done?

@nkaz001
Copy link
Owner

nkaz001 commented Apr 16, 2024

Still collecting it. need to select pairs for upload. already now it's ~hundreds of gb. maybe I'll try to upload it next week?

@qtbgo
Copy link

qtbgo commented Apr 17, 2024

wow

@nkaz001
Copy link
Owner

nkaz001 commented Apr 24, 2024

i couldn't create a public dataset.

@nkaz001
Copy link
Owner

nkaz001 commented Apr 26, 2024

Meanwhile, I've added a Rust version of the data collector for Binance Futures USDM. It's a quick way to gather the data and test it. https://github.com/nkaz001/collect-binancefutures/tree/master/rust

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants