What does it do?
Pokes the following news sites, parses the content, tags it for use in relevant pages:
- The Malaysian Insider
- The Star Online
- The Malay Mail
- Utusan Malaysia (you really should look at their HTML)
- Merdeka Review (Malay language version)
- Free Malaysia Kini
- PHP 5.3.x (with command line support)
- MySQL 5.x + relevant PHP bindings
- A good sense of humour
How do I use it?
$ php -q scrapper.php
Note that it's not been daemonized yet.
Errors are logged in error.log. Other output is to stdout.