A scraper that retrieves install/live images (.iso files) from different distributions
JavaScript Shell
Switch branches/tags
Nothing to show
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
lib
mirrors
scrapers-disabled
scrapers
test
.gitignore
README.md
format.js
index.js
mirrors.js
npm-shrinkwrap.json
package.json
request.js
retrievelogos.sh
scraper-output.json
validation.js

README.md

DistScraper

DistScaper retrieves where the various images (.iso files) are located for a number of Linux distributions. It is being used for DriveDroid to show a list of downloadable images.

The distributions that are supported can be found in scrapers.

Installation

$ git clone git://github.com/FrozenCow/distscraper.git
$ cd distscraper
$ npm install

Usage

To let distscaper retrieve all images of all distributions, execute:

$ node index.js

To let distscaper only retrieve specified distributions, for example only Debian, execute:

$ node index.js -s scrapers/debian.js

Retrieval of logo-images of the different distribution is done through retrievelogos.sh. This script downloads images of the distributions from various sources and transforms them to 48x48-PNG logos:

$ ./retrievelogos.sh

Contribute

To add new scrapers, look at the different scrapers that are already in place (under scrapers/). The output of a scraper should look like scraper-output.json.

If you have a new or updated scraper, please do a pull request.