A scraper that retrieves install/live images (.iso files) from different distributions
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
lib
mirrors
scrapers-disabled
scrapers
test
.gitignore
README.md
format.js
index.js
mirrors.js
npm-shrinkwrap.json
package.json
request.js
retrievelogos.sh
scraper-output.json
validation.js

README.md

DistScraper

DistScaper retrieves where the various images (.iso files) are located for a number of Linux distributions. It is being used for DriveDroid to show a list of downloadable images.

The distributions that are supported can be found in scrapers.

Installation

$ git clone git://github.com/FrozenCow/distscraper.git
$ cd distscraper
$ npm install

Usage

To let distscaper retrieve all images of all distributions, execute:

$ node index.js

To let distscaper only retrieve specified distributions, for example only Debian, execute:

$ node index.js -s scrapers/debian.js

Retrieval of logo-images of the different distribution is done through retrievelogos.sh. This script downloads images of the distributions from various sources and transforms them to 48x48-PNG logos:

$ ./retrievelogos.sh

Contribute

To add new scrapers, look at the different scrapers that are already in place (under scrapers/). The output of a scraper should look like scraper-output.json.

If you have a new or updated scraper, please do a pull request.