A simple scraper for Njuskalo ads
Switch branches/tags
Nothing to show
Clone or download
Latest commit 0703a06 Jun 13, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
app Hindent Jun 12, 2018
src/Network/Njusko Formatting Jun 13, 2018
test Horrible initial version Jan 16, 2016
.gitignore Ignore swp files Jan 25, 2017
.travis.yml Adds system dependency to travis May 16, 2018
LICENSE Bumps licence Feb 17, 2016
Makefile Fixes Makefile May 16, 2018
README.md Fixes README formatting May 16, 2018
Setup.hs Horrible initial version Jan 16, 2016
njusko.cabal Bumps version Jun 12, 2018
stack.yaml Bumps lts and removes irrelevant ads from results Jun 12, 2018

README.md

Njusko

Master
master

A simple scraper for Njuskalo ads. Scrapes the urls you give it and notifies you via email when new entries are found.

This is a CLI app that is intended to be used as a cron job.

Usage

HNjusko - Njuskalo scraper in Haskell

Usage: njusko (-u|--url-file PATH) (-t|--type TYPE) (-n|--notify EMAIL)
                     [--debug]
  Scrapes new apartments from Njuskalo given a search link.

Available options:
  -h,--help                Show this help text
  -u,--url-file PATH       File that contains list of search urls on each line.
  -t,--type TYPE           Type of scraper to be used. Available types: APT, CAR
  -n,--notify EMAIL        The email to send notifications to.
  --debug                  Print out results to stdout and don't send emails

Create a urls.txt file with njuskalo search param in it. Be sure to remove the "page" parameter though. The scraper will parse that file and search all pages for a given url. It will store the new found ads into a sqlite databse and notify you if there are any new ads.

Issues

Report issues on the Issue tracker: https://github.com/denibertovic/njusko-hs/issues

How to build

  1. Install stack

  2. Clone the repo (or fork it first and then clone):

    git clone git@github.com:denibertovic/njusko-hs.git

2.1. Install pre-requisites:

sudo apt-get install libcurl4-gnutls-dev
  1. Build:

    cd njusko-hs && make build