The ATS Job Posting Extraction Method Guide

[Masterjx9]

The ATS Job Posting Extraction Method Guide

I have put together a list of ATS job posting extraction methods as a guide to not just understand how to get the raw data for job postings but to also help people understand how the OpenPostings codebase works for each ATS.

I figured out the methods on my own by reverse engineering as I have been doing http reverse engineering for over a decade+ now. Then I did some tests with codex after I found the extraction method where I would:

• Make a test function in python
• Make a full file test in python that takes a list of urls in a txt file (from data gathering methods) and outputs a list of only valid working urls
• Use that test and logic to have codex update the OpenPostings app with the correct method of extracting job postings.

This will be important for others down the road as the request for extracting job postings descriptions will require understanding the different methods of extraction to keep with the current extraction method as pulling the descriptions requires either another url or another API call OR can be already in the included data from the first call (most likely if the method was an API call).

• ADP MyJobs

  • Method: API call after discovery call
  • Careers page url string format: https://myjobs.adp.com/<company_name>/cx/job-listing
  • API call url string format:
    • GET https://myjobs.adp.com/public/staffing/v1/career-site/<company_name>
    • POST <myadpUrl>/myadp_prefix/mycareer/public/staffing/v1/job-requisitions/apply-custom-filters
  • Notes: First call gets myJobsToken and myadpUrl.

• ADP Workforce Now

  • Method: API call
  • Careers page url string format: https://workforcenow.adp.com/mascsr/default/mdf/recruitment/recruitment.html?cid=<cid>&ccId=<cc_id>
  • API call url string format:
    • GET https://workforcenow.adp.com/mascsr/default/careercenter/public/events/staffing/v1/job-requisitions?cid=<cid>&ccId=<cc_id>
    • GET https://workforcenow.adp.com/mascsr/default/careercenter/public/events/staffing/v1/content-links/career-center?cid=<cid>&timeStamp=0&ccId=<cc_id>&locale=en_US&lang=en_US
  • Notes: Uses cid and ccId.

• ApplicantAI

  • Method: HTML scrape
  • Careers page url string format: https://applicantai.com/<company_or_board_path>
  • API call url string format: N/A
  • Notes: Parses job links with numeric job IDs.

• ApplicantPro

  • Method: HTML scrape that has JSON/API values, then API call
  • Careers page url string format: https://<company_name>.applicantpro.com/jobs/
  • API call url string format: GET https://<company_name>.applicantpro.com/core/jobs/<domain_id>
  • Notes: Extracts domain_id from the jobs page first.

• ApplyToJob

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.applytojob.com/
  • API call url string format: N/A
  • Notes: Supports newer list-group-item-heading layout and legacy resumator-job-title-link.

• AshbyHQ

  • Method: GraphQL API call
  • Careers page url string format: https://jobs.ashbyhq.com/<organizationHostedJobsPageName>
  • API call url string format: POST https://jobs.ashbyhq.com/api/non-user-graphql?op=ApiJobBoardWithTeams
  • Notes: Sends organizationHostedJobsPageName in GraphQL variables.

• BambooHR

  • Method: API call
  • Careers page url string format: https://<company_name>.bamboohr.com/careers
  • API call url string format: GET https://<company_name>.bamboohr.com/careers/list
  • Notes: Rejects redirects to main BambooHR site.

• BrassRing

  • Method: API/AJAX call after page setup
  • Careers page url string format: https://sjobs.brassring.com/TGnewUI/Search/Home/Home?partnerid=<partner_id>&siteid=<site_id>
  • API call url string format: POST https://sjobs.brassring.com/TgNewUI/Search/Ajax/MatchedJobs
  • Notes: Requires partnerid and siteid.

• BreezyHR

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.breezy.hr/
  • API call url string format: N/A
  • Notes: Parses /p/<job_id> links and Breezy portal markers.

• CareerPlug

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.careerplug.com/
  • API call url string format: N/A
  • Notes: Parses /jobs/<job_id> links.

• CareerPuck

  • Method: API call
  • Careers page url string format: https://app.careerpuck.com/job-board/<company_name>
  • API call url string format: GET https://api.careerpuck.com/v1/public/job-boards/<company_name>
  • Notes: Checks jobs, employerProfile, and permalink.

• CareersPage

  • Method: HTML scrape
  • Careers page url string format: https://careerspage.io/<company_slug>
  • API call url string format: N/A
  • Notes: Parses job-item cards.

• Dayforce HCM

  • Method: HTML scrape that has JSON values, then API call
  • Careers page url string format: https://jobs.dayforcehcm.com/<cultureCode>/<company_name>/<jobBoardCode>
  • API call url string format: POST https://jobs.dayforcehcm.com/api/geo/<company_name>/jobposting/search
  • Notes: Extracts site info from __NEXT_DATA__.

• Eightfold

  • Method: HTML scrape that has JSON/config values, then API call
  • Careers page url string format: https://<company_name>.eightfold.ai/careers
  • API call url string format: GET https://<company_name>.eightfold.ai/api/pcsx/search?domain=<window._EF_GROUP_ID>&query=&location=&start=0&
  • Notes: Requires window._EF_GROUP_ID.

• Fountain

  • Method: JSON/API endpoint
  • Careers page url string format: https://web.fountain.com/c/<company_name>/<company_name>/<country>
  • API call url string format: GET https://web.fountain.com/c/<company_name>/<company_name>/<country>.json
  • Notes: Parses openings.

• Freshteam

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.freshteam.com/jobs
  • API call url string format: N/A
  • Notes: Parses job cards and data attributes.

• Gem

  • Method: GraphQL batch API call
  • Careers page url string format: https://jobs.gem.com/<board_id>
  • API call url string format: POST https://jobs.gem.com/api/public/graphql/batch
  • Notes: Sends boardId to theme/list GraphQL queries.

• Getro

  • Method: HTML scrape that has JSON values
  • Careers page url string format: https://<network>.getro.com/
  • API call url string format: N/A
  • Notes: Parses __NEXT_DATA__, then initialState.jobs.found.

• Greenhouse

  • Method: API call
  • Careers page url string format: https://job-boards.greenhouse.io/<board_token>
  • API call url string format: GET https://boards-api.greenhouse.io/v1/boards/<board_token>/jobs?content=true
  • Notes: Board token comes from URL last segment.

• Gusto

  • Method: HTML scrape
  • Careers page url string format: https://jobs.gusto.com/boards/<board_slug>
  • API call url string format: N/A
  • Notes: Parses /postings/ job links.
  • Notes: Gusto has cloudflare protection on its html pages so it has not been added to the main OpenPostings codebase as of yet.

• Hirebridge

  • Method: HTML scrape
  • Careers page url string format: https://recruit.hirebridge.com/v3/jobs/list.aspx?cid=<cid>
  • API call url string format: N/A
  • Notes: Requires cid; parses jid from job links.

• HRMDirect

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.hrmdirect.com/employment/job-openings.php
  • API call url string format: N/A
  • Notes: Parses table rows with reqitem, posTitle, cities, state, and departments.

• iCIMS

  • Method: HTML scrape with iframe handling
  • Careers page url string format: https://<company_name>.icims.com/jobs/search?ss=1
  • API call url string format: N/A
  • Notes: Adds in_iframe=1 and extracts iframe URL when needed.

• JobAps

  • Method: HTML scrape
  • Careers page url string format: https://www.jobapscloud.com/<agency>/
  • API call url string format: N/A
  • Notes: Parses JobTitle, JobNum, Locs, Dept, and Salary.

• Jobvite

  • Method: HTML scrape
  • Careers page url string format:
    • https://jobs.jobvite.com/<company_name>
    • https://careers.jobvite.com/<company_name>
  • API call url string format: N/A
  • Notes: Parses jv-job-list tables.

• JOIN

  • Method: HTML scrape that has JSON values
  • Careers page url string format: https://join.com/companies/<company_slug>
  • API call url string format: N/A
  • Notes: Parses __NEXT_DATA__, then initialState.jobs.items.

• Lever

  • Method: API call
  • Careers page url string format: https://jobs.lever.co/<organization>
  • API call url string format: GET https://api.lever.co/v0/postings/<organization>?mode=json
  • Notes: Organization comes from URL first path segment.

• Loxo

  • Method: HTML scrape
  • Careers page url string format: https://app.loxo.co/<company_slug>
  • API call url string format: N/A
  • Notes: Parses jobs-listing-card and /job/ links.

• Manatal

  • Method: HTML scrape that has config values, then API call
  • Careers page url string format:
    • https://www.careers-page.com/<client_slug>
    • https://<client_slug>.careers-page.com/
  • API call url string format: GET https://www.careers-page.com/api/v1.0/c/<client_slug>/jobs/?page=1&page_size=50&ordering=-is_pinned_in_career_page,-last_published_at
  • Notes: Extracts clientSlug and baseUrl from page.

• Oracle Cloud HCM

  • Method: API call
  • Careers page url string format: https://<tenant>.oraclecloud.com/hcmUI/CandidateExperience/<language>/sites/<siteNumber>/jobs
  • API call url string format: GET https://<tenant>.oraclecloud.com/hcmRestApi/resources/latest/recruitingCEJobRequisitions
  • Notes: Uses finder=findReqs;siteNumber=<siteNumber>,facetsList=<facets>,limit=25,sortBy=POSTING_DATES_DESC.

• PageUp

  • Method: AJAX POST returning HTML, then HTML scrape
  • Careers page url string format: https://careers.pageuppeople.com/<board_id>/<route_type>/<locale>/search/
  • API call url string format: POST https://careers.pageuppeople.com/<board_id>/<route_type>/<locale>/search/
  • Notes: Defaults to cw/en-us; parses returned job-link rows.

• Paylocity

  • Method: HTML scrape that has JSON values
  • Careers page url string format: https://recruiting.paylocity.com/recruiting/jobs/All/<company_id>/<company_slug>
  • API call url string format: N/A
  • Notes: Parses embedded window.pageData JSON.

• PeopleForce

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.peopleforce.io/careers
  • API call url string format: N/A
  • Notes: Uses requests, then curl fallback; detects closed career sites.

• PinpointHQ

  • Method: API call
  • Careers page url string format: https://<company_name>.pinpointhq.com/
  • API call url string format: GET https://<company_name>.pinpointhq.com/postings.json
  • Notes: Rejects redirects to main PinpointHQ site.

• RecruitCRM

  • Method: API call
  • Careers page url string format: https://recruitcrm.io/jobs/<account>
  • API call url string format: POST https://albatross.recruitcrm.io/v1/external-pages/jobs-by-account/get?account=<account>&batch=true
  • Notes: POST payload includes limit, offset, search_data, and onlyJobs.

• Recruitee

  • Method: HTML scrape that has JSON values
  • Careers page url string format: https://<company_name>.recruitee.com/
  • API call url string format: N/A
  • Notes: Parses data-component="PublicApp" and data-props.

• Rippling

  • Method: API call
  • Careers page url string format: https://ats.rippling.com/<company_slug>/jobs
  • API call url string format: GET https://ats.rippling.com/api/v2/board/<company_slug>/jobs?page=0&pageSize=100
  • Notes: Parses items.

• SageHR

  • Method: HTML scrape
  • Careers page url string format: https://talent.sage.hr/<company_id>/vacancies
  • API call url string format: N/A
  • Notes: Uses requests with curl fallback.

• SAP HR Cloud

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.jobs.hr.cloud.sap/
  • API call url string format: N/A in this verifier
  • Notes: Looks for SAP/RMK markers like jobTitle-link, job-tile-list, xweb/rmk-jobs-search, and widgetLoaderComponents.

• Simplicant

  • Method: HTML scrape
  • Careers page url string format:
    • https://<company_name>.simplicant.com/
    • https://<company_name>.simplicant.com/jobs
  • API call url string format: N/A
  • Notes: Parses /jobs/.../detail links.

• TalentLyft

  • Method: AJAX/API fragment call, then HTML fragment scrape
  • Careers page url string format: https://<company_name>.talentlyft.com/
  • API call url string format: GET https://<company_name>.talentlyft.com/JobList/
  • Notes: Extracts initial config like layoutId, themeId, language, subdomain, and websiteUrl.

• TalentReef

  • Method: API call
  • Careers page url string format: https://apply.jobappnetwork.com/<company_name>
  • API call url string format:
    • GET https://prod-kong.internal.talentreef.com/apply/careerPages/alias/<company_name>
    • POST https://prod-kong.internal.talentreef.com/apply/proxy-es/search-en-us/posting/_search
  • Notes: First call resolves clientId and brand; second call searches postings.

• Taleo

  • Method: HTML scrape that extracts tokens, then REST API or AJAX fallback
  • Careers page url string format: https://<company_name>.taleo.net/careersection/<section>/jobsearch.ftl?lang=<lang>
  • API call url string format:
    • POST https://<company_name>.taleo.net/careersection/rest/jobboard/searchjobs?lang=<lang>&portal=<portal>
    • POST https://<company_name>.taleo.net/careersection/<section>/jobsearch.ajax
  • Notes: Extracts portal, CSRF token name, and CSRF token value.

• Talexio

  • Method: API call
  • Careers page url string format: https://<company_name>.talexio.com/jobs
  • API call url string format: GET https://<company_name>.talexio.com/api/jobs?search=&sortBy=relevance&page=1&limit=10
  • Notes: Parses vacancies and totalVacancies.

• Teamtailor

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.teamtailor.com/
  • API call url string format: N/A
  • Notes: Checks teamtailor-cdn, jobs_list_container, block--jobs, or /jobs.rss.

• The Applicant Manager

  • Method: HTML scrape
  • Careers page url string format: https://<company_name>.theapplicantmanager.com/
  • API call url string format: N/A
  • Notes: Parses pos_title_list and department headings.

• UltiPro

  • Method: API call
  • Careers page url string format: https://recruiting.ultipro.com/<company_code>/JobBoard/<board_id>/
  • API call url string format: POST https://recruiting.ultipro.com/<company_code>/JobBoard/<board_id>/JobBoardView/LoadSearchResults
  • Notes: POST payload uses opportunitySearch.

• Workable

  • Method: API call
  • Careers page url string format: https://apply.workable.com/<organization>/
  • API call url string format: POST https://apply.workable.com/api/v3/accounts/<organization>/jobs
  • Notes: POST payload uses query, department, location, workplace, and worktype.
  • Notes: Not ACTUALLY apart of OpenPostings due to an extremely aggressive hueristic that soft bans the an IP after 100 requests. It usually blocks you for about 6 hours straight which is the reason why I have not added it to the main OpenPostings codebase as of yet.

• Workday

  • Method: API call
  • Careers page url string format: https://<subdomain>.<wd_id>.myworkdayjobs.com/<company_id>
  • API call url string format: POST https://<subdomain>.<wd_id>.myworkdayjobs.com/wday/cxs/<subdomain>/<company_id>/jobs
  • Notes: Handles locale prefixes before company_id.

• Zoho Recruit

  • Method: HTML scrape that has JSON values
  • Careers page url string format: https://<company_name>.zohorecruit.com/jobs/Careers
  • API call url string format: N/A
  • Notes: Parses hidden input#jobs JSON and input#meta list URL.