- Added TechInAsia spider for job data collection
- Integrated Algolia API for efficient data retrieval
- Improved data sanitization and CSV export
- Enhanced error handling and logging
- Updated docs with new data source details
id-jobs gathers job listings from Indonesian job portals and company websites, following each site's terms of service.
View Data on Google Sheets: https://s.id/id-jobs-v2
View Dashboard on Looker Studio: https://s.id/id-jobs-dashboard
| Age | Time | Color |
|---|---|---|
| New | ≤ 1 day | |
| Hot | 1-7 days | |
| Recent | 8-15 days | |
| Aging | 16-21 days | |
| Old | 22-30 days | |
| Expired | > 30 days |
id-jobs scrapes job data from multiple sites, cleans it, and compiles it into a single spreadsheet. We use Scrapy for most sites and Playwright for JavaScript-heavy sites.
id-jobs aggregates job listings in one place, offering insights like work arrangements, job levels, and deadlines.
We collect data from several job portals and company websites, including:
Blibli, Dealls, Evermos, Flip, GoTo, Glints (Lite), Jobstreet, Kalibrr, Karir.com, Kredivo, Mekari, SoftwareOne, Tiket, Tech in Asia Jobs, and more.
- Daily updates
- Identifies work arrangements & job levels
- Tracks application deadlines
- Accurate data
- User-friendly Google Sheets interface
- Tracks job age
- Handles JavaScript-rendered content
- Efficient pagination
- Integrated with Algolia API
For a quick guide, check the Quickstart Guide.
See our FAQ for common questions.
id-jobs is open source under the GPL-3.0 license. You can use, modify, and share it, as long as it remains open source.
We respect website terms of service when collecting data.