HTTPS clone URL
Subversion checkout URL
When given a list of URLs from Internet Archive will download associated full text objects and metadata (Written in PHP)
Fetching latest commit...
Cannot retrieve the latest commit at this time.
|Failed to load latest commit information.|
IA Scraper v0.8php -by Tim Ribaric email@example.com The Internet Archive Scraper Simply untar the software edit config.php and you should be ready to go You'll need CURL installed and working in your php config for this to work The main page will suggest what you should add to your crontab to automate the RSS scraping The downloading takes a bit so be patient (items can be up to 25megs), it is best to automate the RSS scrape and use that. Next version will be in Python... Until then this is mostly an exercise in learning Git.