Skip to content

finn42/ao3mine

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ao3mine

AO3 mine is a scraper for ao3 query searches, collecting metadata and storing it in mySQL, and notebooks for analysis of the databases collected.

This project uses pandas, sqlite3, beautifulsoup. The code is not yet published as a library but specific functions in ao3.py can be accessed in notebooks with the suitable priming cell (see Demo notebooks).

The OTW asks that scrapers send request with 5 second delays and to avoid collecting data on weekends, when the site has the most user traffic. Please respect their request.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published