Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
When given a list of URLs from Internet Archive will download associated full text objects and metadata (Written in PHP) http://elibtronic.ca/category/softwar…
Fetching latest commit…
Cannot retrieve the latest commit at this time.
|Type||Name||Latest commit message||Commit time|
|Failed to load latest commit information.|
IA Scraper v0.8php -by Tim Ribaric firstname.lastname@example.org The Internet Archive Scraper Simply untar the software edit config.php and you should be ready to go You'll need CURL installed and working in your php config for this to work The main page will suggest what you should add to your crontab to automate the RSS scraping The downloading takes a bit so be patient (items can be up to 25megs), it is best to automate the RSS scrape and use that. Next version will be in Python... Until then this is mostly an exercise in learning Git.