Ethercrash (Previously Ethcrash) Scraper
A simple asynchronous script to scrape all of the games of ethercrash from any given interval, like game number 100 to 12000, etc with fail checks to restart the script from where it left in any case of error.
Data is stored in
ethcrash_stats.csv, fields that are scraped are as follows:
- Game Number
- Crash value
- Clone the repo:
git clone https://github.com/slapbot/ethercrash-stats-scraper
- Cd into the directory:
- Create a virtualenv:
python3 -m venv ethercrash-stats-scraper-env
- Activate the env:
- Install the application dependencies:
pip install -r requirements.txt
- Open up the
ethcrash_scrape.pyfile and put the values at
endvariables that defines the starting and ending game_numbers to scrape the data between. (Like start = 100, ending = 10000) meaning scrape from game_number 100 to 10000
- Can also run the shell script as well:
./monitor.sh- but ensure that you activate your virtualenv.
I don't know - was just clearing my system and found this program that I wrote for someone - Figured to host it in github.
With the dataset in hand, you can deploy various strategies to forecast the crash values to bet on the platform.