This code parses through the Common Crawl database and pulls out records of job listings based on different filters. It can be run locally or scaled up to run on a cluster.
-
Notifications
You must be signed in to change notification settings - Fork 0
Parsing the common crawl database using Scala and Spark
License
skyler-myers-db/Common-Crawl-Analysis
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
About
Parsing the common crawl database using Scala and Spark
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published