Skip to content

Commit

Permalink
reformatting t
Browse files Browse the repository at this point in the history
  • Loading branch information
omorilewa committed Jun 29, 2017
1 parent cee8718 commit 06d8392
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions healthtools/scrapers/base_scraper.py
Expand Up @@ -69,6 +69,7 @@ def scrape_site(self):
print "[{0}] - Started Scraper.".format(datetime.now().strftime("%Y-%m-%d %H:%M:%S"))
self.get_total_number_of_pages()
for page_num in range(1, self.num_pages_to_scrape + 1):
print "Number of pages over 5 {}".format(self.num_pages_to_scrape / 5)
if (self.num_pages_to_scrape / 5) % page_num == 0:
print "[{}] - Scraped {}% out of {} pages.".format(datetime.now().strftime("%Y-%m-%d %H:%M:%S"), (page_num/self.num_pages_to_scrape) * 100, self.num_pages_to_scrape)
else:
Expand Down

0 comments on commit 06d8392

Please sign in to comment.