This project is a web application built with Flask that takes a URL from Microsoft Bing's job search page, scrapes job details using BeautifulSoup, and outputs the results as a JSON file.
- Input a URL from Microsoft Bing's job search page.
- Scrape job details such as job titles, companies, and locations.
- Download the scraped job details as a JSON file.
Before you begin, ensure you have the following installed:
- Python 3.x
- Flask
- BeautifulSoup4
- Requests
Clone the repository:
git clone https://github.com/yourusername/job-scraper-flask.git
cd job-scraper-flask
Create and activate a virtual environment:
python -m venv venv
source venv/bin/activate # On Windows use `venv\Scripts\activate
Install the required packages:
pip install -r requirements.txt
Start the Flask application:
python app.py
Open your web browser and navigate to http://127.0.0.1:5000/
Enter a Bing job search URL (e.g., https://www.bing.com/jobs?q=ml+jobs&scp=0&rb=0&rc=20&L2=true&c=1&form=JOBL2S) and click the submit button.
The application will scrape job details and will automatically download a JSON file containing the results.