3.0.0

v3.0.0 Improve of Search engine

What's Changed

• Adding TD9-TD10 search engine and Dash interface improved, new statistics added and recommendations for final user by @jdalfons and @magjil in #5

Changes:

During TD9 TD10

Procedures performed:

• Implemented new IT-IDF compare to recomend related articles.
• Added graph to show word evolution in time.
• Improved Dash interface with images, graph, best way to show results
• Jupyter interface deleted.
• Docs added.
• Code refactor and functions deprecated deleted.

What's Changed

• Adding TD 4 and test by @jdalfons and @magjil in #4
• Adding TD 5 and jupyter interface by @jdalfons in #5
• Process td3 td5 by @jdalfons and @magjil in #6
• updating by @jdalfons in #7
• Create python-app.yml by @jdalfons in #8
• Process td3 td7 by @jdalfons in #9
• Process TD3-TD7: gh actions and test modified tests 🐛 by @jdalfons in #10
• Enhacement TD3-TD10: by @magjil in #12
• update requirements by @magjil in #13

Full Changelog: 0.2...v3.0.0

1.0 TD3 - TD5 First steps of project

v1.0 Design patterns and interface for TD5

What's Changed

• Adding TD 5 and jupyter interface by @jdalfons and @magjil in #5

Changes:

During TD3

Procedures carried out during this initial phase:

• Information from Arxiv and Reddit is gathered using Scrapping methods.
• Initial project statistics are generated.

During TD4

Following the creation of file scrapping processes and initial statistics, the following are implemented:

• Classes to control document creation.
• Functions that simplify code reading and prevent code repetition.
• Initial conception of the corpus.

During TD5

Procedures performed:

• Polymorphism is implemented in the Document classes.
• Singleton Factory design patterns are applied.
• A basic interface in Jupyter is created for the end user.

**Branch **: https://github.com/jdalfons/search_engine/tree/process-TD3-TD5

2.0-beta TD3 - TD7

v2.0 Interfaces and TD-IDF for search engine

What's Changed

• Adding TD 7 search engine in Dash interface and jupyter interface by @jdalfons and @magjil in #5

Changes:

During TD6

Adding search process

• Search inside corpus using regex.
• Statistics using pandas.

During TD7

Procedures performed:

• Using IT-IDF is added a search engine.
• Added new interface basd in TD-8 dash interface.
• Interface in Jupyter improved to show same as DASH interface.

What's Changed

• Adding TD 4 and test by @jdalfons and @magjil in #4
• Adding TD 5 and jupyter interface by @jdalfons in #5
• Process td3 td5 by @jdalfons and @magjil in #6
• updating by @jdalfons in #7
• Create python-app.yml by @jdalfons in #8

Full Changelog: 0.2...v2.0-beta

0.2 TD3

v0.2 Basic web request for TD3

What's Changed

• Adding TD 3 start Search engine project by @jdalfons and @magjil in #2

Changes:

During TD3

Procedures carried out during this initial phase:

• Adding main
• Adding scrapper for Arxiv.
• Adding scrapper for Reddit.
• File saving full corpus in a CSV.

Full Changelog: 0.1...0.2

0.1 TD1 - TD2

v0.1 Basic data analysis TD1 - TD2

The main objective of this first project is to be capable of understanding and implementing different data analysis of data using pandas and other visualization tools such as matplotlib and numpy.
We will be using the following public data:

Data of walking routes in the city of Lyon:
https://data.grandlyon.com/portail/fr/jeux-de-donnees/boucles-randonnee-metropole-lyon/donnees

Data of route accidents in France of 2018:
https://www.data.gouv.fr/fr/datasets/bases-de-donnees-annuelles-des-accidents-corporels-de-la-circulation-routiere-annees-de-2005-a-2022/

• The original Guide to create this binary is in file called td1-2.pdf
• To run .py file you can download all files and add to ./data/ folder in following routes.
  • ./data/td1/evg_esp_veg.envpdiprboucle.json
  • 'data/td2/caracteristiques-2018.csv`
  • data/td2/usagers-2018.csv
  • data/td2/vehicules-2018.csv
  • data/td2/lieux-2018.csv

What's Changed

• update TD1 and TD2 deleting data folder ot used by @jdalfons in #1
• Update TD_1_TD_2.py by @magjil in #2

Full Changelog: https://github.com/jdalfons/search_engine/commits/0.1