A basic web scraper to collect player counts for some fun data analytics
Files
- steamscraper.py
- steamscraper.BAT
- 24hAnalysis.py
Purpose of each file
- steamscraper.py scrapes the steam game and player statistics page, depositing the data in a local instance of a mySQL server
- steamscraper.BAT is my BAT file for the steamscraper to start when I log into my computer.
- 24hAnalysis.py creates the visuals in Links 1 and 2
Links to see the outcome of this work
- Visualization of the first 24 hours with some preliminary conclusions
- Visualization of 24 hours plus! This is the page that will update everyday so we can see he unweighted race unfold.
- Coming soon: is that cumulative sum from a stationary or cyclical process?
- Coming soon: relative contribution of each game to cyclical fluctuation in player counts
- Coming soon: data reduction via cumulative sum slope estimation
- Coming soon: the race in terms of 2020 vs 2021 games
- Coming soon: the race in terms of genre
- Coming soon: Anomalous day detection