Skip to content

Add more categories to ALDI SÜD (Germany) scraper #1

@Tech-FZ

Description

@Tech-FZ

So, the ALDI SÜD scraper for Germany is almost done, but it currently only supports one category. If we look at https://www.aldi-sued.de/de/homepage.html however, they'd have a lot more.

The process of getting the hidden API

  1. Go to https://www.aldi-sued.de/de/homepage.html
  2. Select "Produkte", then "Produktsortiment", as shown in the picture.

image

  1. Select a category
  2. Press F12 to open your webbrowser's dev console. On Microsoft Edge, it may or may not open depending on your settings.
  3. Click on "Network", then on "Fetch/XHR" if you're using Chrome, Chromium or Edge. On Firefox, click on "Network", then on "XHR".

image
image

  1. Scroll down until you find the "Mehr anzeigen" button and click on that.
  2. Congratulations. You found the hidden API!

chrome_av8D5koW6q

Using the API

  1. Open the ALDI SÜD scraper file.
  2. Add a new function for your category. You can use the first one as a template and update the variables.
  3. Add the function to the scrapeStarter() function.
  4. Test it and see its magic.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions