Skip to content

Python Scraper for the UK RightMove website - live notifications through Telegram when new ads are posted

License

Notifications You must be signed in to change notification settings

fcaponetto/RightMoveScraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 

Repository files navigation

RightMoveScraper

rightmove.co.uk is one of the UK's largest property listings websites, hosting thousands of listings of properties for sale and rent.

This python script scrapes property listings from rightmove.co.uk website. It also sends a notification through Telegram if new ads added that respects the search criteria.

Telegram Bot is used.

How to create a Telegram Bot

  1. Create your bot by following these instructions
  2. Save the generated token
  3. Get the list of updates for your bot by going to https://api.telegram.org/bot<YourBOTToken>/getUpdates
  4. Send a message to your bot (any)
  5. Look for "id" and that would be your chatid

In case you would add the bot to a group (public or private), here are the instructions

Requirements to use the scraper

I strongly suggest using a virtual environment, eg. miniconda wiht the following packages:

  • python 3.x
  • requestes
  • Beautiful Soap
conda create --name rightmove python=3.8 requests bs4
conda activate rightmove

Why python -m pip ...? Here is a meaningful explanation Why you should use python -m pip?

How to run the scraper

Activate the environment (if you have created it), then:

python rightmove.py --url ... --addtoken ... --addchatid ...
  • --url is the URL of your search
  • --addtoken is the token of the bot
  • --addchatid is the id of the chat to send the notification

It makes a new request for every random delta between 30 min to 1 hour.

Legal

This project is meant only for educational purposes. Even though this script makes a new request between 30min and 1 hour, scraping a website is a grey area.

About

Python Scraper for the UK RightMove website - live notifications through Telegram when new ads are posted

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages