Conti - Scraping Error

[GRIT-5ynax]

Describe the bug

Error Message Below:

Traceback (most recent call last):
File "/app/ransomwatch.py", line 66, in main
s.scrape_victims()
File "/app/sites/conti.py", line 56, in scrape_victims
last_li = page_list.find_all("li")[-1]
AttributeError: 'NoneType' object has no attribute 'find_all'

To Reproduce
Steps to reproduce the behavior:
This error has happened several times over the last 24 hours while ransomwatch has been run on a cron job.

Expected behavior
Parse the contents of the Conti site with no errors or have additional error handling built in to handle this error.

Screenshots
If applicable, add screenshots to help explain your problem.

Logs

Traceback (most recent call last):
File "/app/ransomwatch.py", line 66, in main
s.scrape_victims()
File "/app/sites/conti.py", line 56, in scrape_victims
last_li = page_list.find_all("li")[-1]
AttributeError: 'NoneType' object has no attribute 'find_all'

Environment

• OS: Ubuntu 20.04
• How you are running it: Docker via cron job (read me best practices implementation)

Additional context
Add any other context about the problem here.

[GRIT-5ynax]

Errors occurred at 3PM and 5PM CT on 6/27/21 and 3AM and 5AM CT on 6/28/21.

[captainGeech42]

Thank you @GRIT-5ynax for reporting this!

I only see this once in my logs, at 2:10am PDT on June 28th, which aligns with when you saw it. I didn't see it at any of the other times, which makes me think that it was possibly an error by the operators when they added data? Or a site bug perhaps.

Since it's not currently reproducible and the scraper for Conti is working properly still, I am going to close this. But please feel free to open any other issues for scraping issues you have. Thank you!