Qscrape is a Ruby on Rails app that scrapes vehicle classified ads from websited in Qatar. It comes with a web interface to visualize ads, search in them, favorite and comment on any. There are also 2 rake tasks to scrape and notify, respectively.
rake scraper:scrape_ql # QatarLiving
or to scrape from a specific page (0 based index):
rake scraper:scrape_ql # starts from page 100
To scrape from QatarSale:
rake scraper:scrape_qs # QatarSale
To send an email notification if an ad matches your text criteria, run:
Note that you need to insert records for each recipient in the recipients table, for example:
rails console > Recipient.create name: 'Your name', email: 'your@email'
You may put any of these 2 rake tasks in a cron job that runs every 10 or 15 minutes to periodically scrape and notify you. An example crontab file can found in file:lib/tasks/crontab To install: