MultiJobScraper is a Python project to scrape job listings from multiple job portals like LinkedIn and Indeed.
- Clone the repository.
- Navigate to the project directory.
- Create a virtual environment and activate it:
python -m venv .venv source .venv/bin/activate # On Windows use: .venv\Scripts\activate
- Install the required libraries:
pip install -r requirements.txt
- Update the
linkedin_urlandindeed_urlinmain.pywith the actual job search URLs. - Run the scraper:
python main.py
- The scraped job data will be saved to
linkedin_jobs.jsonandindeed_jobs.json.
To add more job portals, create a new scraper class extending BaseScraper and implement the required methods.