Flatr is a webscraping python package developed to aid flat hunting in the UK. It provides functionality to extract the details of the latest properties posted on some of the more popular sites in the UK. For each listing the listing title, rent/month, availability and link are extracted. The listing title is composed from the number of bedrooms and the location of the flat.
Note: Webscraping on some of the supported sites is restricted. To view allowed activiteis, check <site-url-root>/robots.txt.
Note: Given the restrictions of the supported sites, the package was developed for personal use only and not meant to cause harm or distrupt the operation of the sites. Please make sure to not spam the sites with requests (used in the package to retrieve data). Checking for new flats every 5 minutes or so should be sufficient in most cases.
Make sure to have Python 3.8 or higher installed on your machine or the environment you are using.
# Clone this repository
git clone https://github.com/MarioMihaly/flatr.git
# Change directory
cd flatr
# Install the flatr package
pip install .If you wish to continue developemnt, install the development requirements. This way the flatr package is installed using the editable flag with pip.
# Clone this repository
git clone https://github.com/MarioMihaly/flatr.git
# Change directory
cd flatr
# Install requirements for development
pip install -r requirements_dev.txtTo check installation, open a Python interactive session in a terminal and run the following code. You should see the details of the most recent listings of the site printed.
from flatr.sites import Gumtree
link = 'https://www.gumtree.com/search?search_category=property-to-rent'
listings = Gumtree(link).get_listings()
for listing in listings:
print(f'{listing}\n')Custom sites can be added using this template. Replace ClassName with your custom site's name and add it to the sites directory. Edit the __init__.py file in the same directory to allow access to your custom site in the package. If you installed the package for development, you should be able to access your custom site just like any other.
Note: The provided example is for personal usage only.
The example provided in the examples folder is an adaption of my original script ran on a Linux VM every 5 minutes to find new flats, save them in a Google Sheet for later reference and send an email with the new flats.
The script allowed the review of over 1200 listings over a period of 1 month with minimal effort.