New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Provide stats for scraping data #16

Closed

9 tasks done

asrafalih opened this issue Feb 12, 2021 · 0 comments · Fixed by #20

Closed

9 tasks done

Provide stats for scraping data #16

asrafalih opened this issue Feb 12, 2021 · 0 comments · Fixed by #20

Assignees

Labels

Projects

Flipkart scraper

Milestone

Member

asrafalih commented Feb 12, 2021 •

edited

Loading

Acceptance

Total No. of products scraped
Elapsed time
Products scraper per second
Aprox. Time to scrape 1 Million products
Current concurrency
Avg. Response API call time
Completed categories with product count, elapsed time, no. of pages
Ongoing categories with product count
Should have a option to get all the stats as numbers otherwise human readable format like (3.1K, 1H 20M)

asrafalih added the enhancement label

asrafalih added this to the Sprint 1 milestone

asrafalih self-assigned this

asrafalih added this to To do in Flipkart scraper via automation

asrafalih linked a pull request

that will close this issue

[Feat-16] - Scraping stats #20

Merged

10 tasks

asrafalih moved this from To do to In progress in Flipkart scraper

asrafalih closed this as completed in #20

Flipkart scraper automation moved this from In progress to Done

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment