minecraft-schematic-crawler

Automatic minecraft schematic crawler for bots and ML

Usage

Analyse the index page to retrieve schematics with node indexCrawler.js. It takes about a minute.
Analyze each page to get more information with node pageCrawler.js. Takes about 20min due to the website throttling.
Get the final urls for schematics with node getFinalDownloadLinks.js. Takes 5min.
Download the schematics with node schematicDownloader.js. Takes 5min.
Run node schematicsReader.js to read a few schematics
Run node imageDownloader.js to get schematic images.
Run node imagesReader.js to read a few images

Name		Name	Last commit message	Last commit date
Latest commit History 15 Commits
.github		.github
test		test
.gitignore		.gitignore
.gitpod		.gitpod
.npmrc		.npmrc
HISTORY.md		HISTORY.md
LICENSE		LICENSE
README.md		README.md
downloadBottleneck.js		downloadBottleneck.js
getFinalDownloadLinks.js		getFinalDownloadLinks.js
imageDownloader.js		imageDownloader.js
imagesReader.js		imagesReader.js
index.js		index.js
indexCrawler.js		indexCrawler.js
package.json		package.json
pageCrawler.js		pageCrawler.js
schematicDownloader.js		schematicDownloader.js
schematicsReader.js		schematicsReader.js