Aerogest Scrapper

A web scrapper made for aerogest.com.
View Demo · Report Bug · Request Feature

Table of Contents

1. About The Project
   • Built With
2. Getting Started
   • Prerequisites
   • Installation
3. Usage
4. Roadmap
5. License
6. Contact

About The Project

The process of finding schedule in aerogest.com is time consuming and tedious. You need to login, search for an available pilot instructor as well as a schedule for the plane you are flying with. There is no notification system available in the website to notify you when the schedule is available. I belive this project is the solution to the problem.

Here's why:

• Your time should be focused on learning how to pilot and not on finding a schedule.
• Sometime it is hard to find a schedule for a precise instructor (particulary on the weekend).
• You save enought time to star this repo 😃

(back to top)

Built With

• python 3.9
• beautifulsoup4
• cssutils
• python-requests

(back to top)

Getting Started

Prerequisites

This project have been build with python and the dependancies are managed with pipenv. Those are mandatory to run the project.

• python 3.9

  sudo apt install python3.8

• pipenv

  pip3 install pipenv

Installation

1. Clone the repo

   git clone https://github.com/hugoperier/Aerogest-Scrapper

2. Install pip packages

   pipenv install

3. rename the default configuration file

   mv default.template.conf default.conf

(back to top)

Usage

There is a configuration file named default.conf in the root directory of the project. This file is used to configure the scrapper. It contains informations about the aeroclub you targets, credentials that will be used to log in and fetch informations, and some configuration for the scrapper.

Example

[AEROGEST_INFOS]
HOST=http://www.aerogest-reservation.com
CLUB_ID=aeroclub_bellegarde

[CREDENTIALS]
LOGIN=9874 
PASSWORD=31021978

[SCHEDULESFINDER]
# The scrapper will look for schedules for the following days
WEEKDAYS=lundi,mardi,mercredi,jeudi,vendredi,samedi,dimanche
# The duration is expressed in minutes
DURATION=120
# Trigram must be used for the instructor selection
INSTRUCTORS=KAT
# Airplane registration must be use for the airplane selection 
AIRPLANE=F-GTFC
# The number of days to look into, starting from the current day
SEARCHRANGE=40

(back to top)

Roadmap

• Create schedule finder
• Create tests
• Notification module
  • Email
  • Sendgrid

See the open issues for a full list of proposed features (and known issues).

(back to top)

License

Distributed under the MIT License.

(back to top)

Contact

Hugo PERIER - website - hugo.perier@protonmail.com

Project Link: https://github.com/hugoperier/Aerogest-Scrapper

(back to top)