This script scrapes job data from the JustJoin.it website based on predefined configurations and saves it to text files. It also provides functionality to visualize the scraped data using matplotlib. GUI is built in tkinkter.
- Python 3.x
- requests
- BeautifulSoup4
- matplotlib
- tkinter
- Clone the repository:
git clone https://github.com/your_username/justjoin-it-scraper.git
- Install the required packages:
pip install -r requirements.txt
- Run the
main.py
script:python main.py
- Select a save folder or create a new one.
- Choose whether to fetch and save data or read and visualize existing data.
- If fetching data, the script will scrape job data from JustJoin.it based on the configurations provided in
config.json
and save it to text files. - If reading data, the script will prompt you to select a data file to visualize. It will then plot the data using matplotlib.
config.json
: Contains configurations for the script, including locations, languages, filters, and colors for visualization.
main.py
: Main script file to run.config.json
: Configuration file.saves/
: Folder containing saved data files.README.md
: This file.