Scalable Linkedin job post scraping
- BeautifulSoup
- Redis
- Celery
- nix-shell
Run the following commands:
- nix-shell nix/default.nix
- python main.py
- Distributed crawling via Celery
- Proxy Management/IP Rotation
- User-Agent Management
- Set up lints
-
Notifications
You must be signed in to change notification settings - Fork 0
TheGabCode/scalable-linkedin-scraper
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published