Skip to content

Add Woonnet Rijnmond parser#59

Merged
wtfloris merged 2 commits into
wtfloris:masterfrom
ventilaar:woonnet_rijnmond
Nov 24, 2024
Merged

Add Woonnet Rijnmond parser#59
wtfloris merged 2 commits into
wtfloris:masterfrom
ventilaar:woonnet_rijnmond

Conversation

@ventilaar
Copy link
Copy Markdown
Contributor

@ventilaar ventilaar commented Nov 11, 2024

Related issue #53

POST https://www.woonnetrijnmond.nl/wsWoonnetRijnmond/WoningenModule/Service.asmx/getAanbod
Headers:

{'Content-Type': 'application/json; charset=utf-8', 'User-Agent': 'Hestia Bot'}

User Agent must not be the default requests agent, since Cloudflare will block it. Content type must be set as well or we get a 520 error
Data:

{"Velden": "id;straat;huisnummer;huisletter;huisnummertoevoeging;plaats;gebruik;kalehuur", "Filters": "", "Volgorde": "", "inschrijfnummerTekst": "-1", "pagina": 1, "paginaGrootte": 9999, "Filterlijst": "", "StatischeFilters": "gebruik!=cluster", "addAantalReacties": False}

@ventilaar ventilaar marked this pull request as ready for review November 11, 2024 18:35
@ventilaar ventilaar mentioned this pull request Nov 11, 2024
19 tasks
@wtfloris
Copy link
Copy Markdown
Owner

This looks good, no comments

Checklist:

  • Homes are written to database, filling address, city, price and url
  • House number additions are handled properly
  • URLs lead to the correct page
  • Prices are rounded integers
  • Scraper either gets all homes or sorts by "Newest first"

Running it in test for a few days before merging

@wtfloris wtfloris merged commit b963905 into wtfloris:master Nov 24, 2024
@ventilaar ventilaar deleted the woonnet_rijnmond branch November 24, 2024 11:15
xenbyte pushed a commit to xenbyte/hermes that referenced this pull request Mar 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants