Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Seed Database #2

Closed
owocki opened this issue Mar 26, 2016 · 18 comments
Closed

Seed Database #2

owocki opened this issue Mar 26, 2016 · 18 comments

Comments

@owocki
Copy link
Owner

owocki commented Mar 26, 2016

I have a database of price, volume, bid/ask spread history for the entire poloniex index, at a minute-by-minute- granularity, for the last several months (from 2/21 to present). I will post if there is enough interest.

@lsseckman
Copy link

Definitely interested, and thanks for the writeup

@owocki
Copy link
Owner Author

owocki commented Mar 27, 2016

Will run the DB dump today.

@igorber
Copy link

igorber commented Mar 27, 2016

I'd love to see the data. Great work on the project!

@owocki
Copy link
Owner Author

owocki commented Mar 27, 2016

OK, i've created a 1.3 GB postgres dump with prices/volume/bidask spread (from 2/21 to present) and put it in the following bittorrent file. (redacted)

File is also available as a direct HTTP download: http://experiments.owocki.com/pytrader/prices.zip

EDIT: Please see the more up to date price historys posted @ #2 (comment)

@owocki
Copy link
Owner Author

owocki commented Mar 27, 2016

Bittorrent is a little slow. I zipped up the file to 152MB and posted it @ http://experiments.owocki.com/pytrader/prices.zip

@densmirnov
Copy link

Thanks for sharing! Made a mirror in case of problems with download: https://densmirnov.com/prices.psql.zip

@owocki
Copy link
Owner Author

owocki commented Mar 28, 2016

linked to this issue from the readme so others can find the seed DB, going to close it since it's now resolved.

@owocki owocki closed this as completed Mar 28, 2016
@owocki
Copy link
Owner Author

owocki commented Apr 2, 2016

Notes from slack channel. To restore

  1. Make sure none of the cornjobs are running
  2. Drop or truncate the history_prices table
  3. psql <dbname> < filename

@Snipa22
Copy link
Collaborator

Snipa22 commented Apr 3, 2016

For anyone interested, I'm dumping my history_price every two hours:
http://dumps.snipanet.com/history_price-latest.psql.gz

Archival dumps for 7 days (In theory!) are at: http://dumps.snipanet.com/

I'll be moving this likely this week to a new server that will be running a copy of pytrader master

@owocki
Copy link
Owner Author

owocki commented Apr 5, 2016

A script to restore these prices available @ https://github.com/owocki/pytrader/pull/54/files#diff-0730bb7c2e8f9ea2438b52e419dd86c9R262

@owocki
Copy link
Owner Author

owocki commented Dec 30, 2016

Anther good source of data => http://api.bitcoincharts.com/v1/csv/

@owocki
Copy link
Owner Author

owocki commented Dec 30, 2016

Just curious, has anyone been collecting pytrader data for the last several months? I'm holed up with some friends who are deep learning experts and we're trying to have another go at making a profit.... but it looks like there's some holes in my data set i've been collecting (my server had some downtime and ran out of disk space a couple times in 2016)

@Snipa22
Copy link
Collaborator

Snipa22 commented Dec 30, 2016

I have not unfortunately, I purged almost everything a couple days ago when my main server needed a rebuild. Might be fun to pick this up again though if there's interest.

@0xecute
Copy link

0xecute commented Aug 20, 2017

Hi. is it possible to get a new link for the prices?
Anyone has anything on bittrex by chance?

Thanks

@maithanhtan
Copy link

Can someone reup the file?

Repository owner deleted a comment from gitcoinbot Sep 22, 2017
@AlanForester
Copy link

All links are not available ((

@justyntemme
Copy link

Does anyone have the format of the pre-existing DB. I would like to use http://api.bitcoincharts.com/v1/csv/ and run a script to format it how it needs to be

@mellertson
Copy link

I understand I'm late to the party here, but if anyone is still looking for data CCXT and CCXTPro are both great libraries which can easily be scripted to populate a database with OHLCV prices from many crypto exchanges. I'm not affiliated with CCXT at all, just been using it for a couple years and a big fan of the authors' work. They've done a great job of transpiling the library into Python, PHP, and JavaScript.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

10 participants