Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Speed up the OTTO scrape #126

Closed
itrajanovska opened this issue Feb 17, 2023 · 0 comments · Fixed by #121
Closed

Speed up the OTTO scrape #126

itrajanovska opened this issue Feb 17, 2023 · 0 comments · Fixed by #121

Comments

@itrajanovska
Copy link
Collaborator

itrajanovska commented Feb 17, 2023 •
edited
Loading

After adding some new changes to the OTTO scraping:

  • Scraping unsustainable electronics and;
  • Adding more categories to the electronics list
    our scraping lasts longer in terms of days (more than 4 days right now).

For that matter we need to address these to comments
#120 (comment)
#120 (comment)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Task/optimize otto scrapes disable unavailable for sustainabile products calgo-lab/green-db
1 participant
@itrajanovska