JobSeeker is a Python application for scraping job vacancies from Djinni.co. It harnesses the power of BeautifulSoup, Requests, and other libraries for seamless web scraping. The collected data includes job names, URLs, owners, salaries, descriptions, company information, publication dates, and additional insights.
-
Dynamic Scraping: The application dynamically scrapes job vacancies from Djinni.co, intelligently adapting to changes in pagination.
-
Data Integrity: Handles duplicate job names by appending a unique identifier to the filename, ensuring pristine data integrity.
-
Structured Data: Collects meticulously structured data, including comprehensive job details, to create a rich and informative JSON file.
-
Clone the repository:
git clone https://github.com/yourusername/job-scraper.git
-
Install dependencies:
pip install -r requirements.txt
-
Set your Djinni.co job search URL and domain in the
.envfile:URL=https://djinni.co/jobs/?primary_keyword=Python DOMAIN=https://djinni.co
Run the main script:
python main.pySpecial thanks to the creators of BeautifulSoup, Requests, and other libraries used in this project.
Happy coding! π