Creates a full database of data for website fanfiction.net by crawling all webpages. Data format is SQLite (using CoreData). Data output module wasn't written, though here are SQL commands I used:
sqlite> .output favorites.csv
sqlite> SELECT ZNAME,ZCHAPTERSINT,ZFAVSINT,ZFOLLOWSINT,ZWORDSINT,ZLASTUPDATEDATE,ZPUBLISHEDDATE,ZBOOKID,ZCHARACTERSSTRING,ZGENRE,ZLANGUAGE,ZRATING,REPLACE(REPLACE(REPLACE(ZTITLE, CHAR(10), ' '), CHAR(13), ' '), ',', ' ') AS ZTITLE FROM ZPROFILE INNER JOIN Z_1FAVORITEDBY ON Z_2FAVORITEDBY==ZPROFILE.Z_PK INNER JOIN ZBOOK ON ZBOOK.Z_PK==Z_1FAVBOOKS WHERE ZPROFILE.zobj_deleted == 0 AND ZBOOK.zobj_deleted == 0;
sqlite> .output books.csv
sqlite> SELECT ZNAME,ZCHAPTERSINT,ZFAVSINT,ZFOLLOWSINT,ZWORDSINT,ZLASTUPDATEDATE,ZPUBLISHEDDATE,ZBOOKID,ZCHARACTERSSTRING,ZGENRE,ZLANGUAGE,ZRATING,REPLACE(REPLACE(REPLACE(ZTITLE, CHAR(10), ' '), CHAR(13), ' '), ',', ' ') AS ZTITLE FROM ZPROFILE INNER JOIN ZBOOK ON ZPROFILE.Z_PK==ZBOOK.ZAUTHOR WHERE ZPROFILE.zobj_deleted == 0 AND ZBOOK.zobj_deleted == 0;
No documentation is provided and not intended to be provided.
To request partial dataset, contact me.
Runs and compiles only on macOS, using Xcode 8.1 with Swift 3.1.
Use pods update to fetch all Cocoa Pods before using. Also, I didn't verify Xcode project thoroughly,
so some paths may be broken.