Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

If no people were found on face book page and we abort scraping, delete the saved page file #28

Open
ErikBoesen opened this issue Feb 16, 2021 · 0 comments

Comments

@ErikBoesen
Copy link
Collaborator

ErikBoesen commented Feb 16, 2021

This failure is caused when authentication has failed. Currently, if we change the passed token so that it's valid, and then immediately rerun the scraper, it'll use the existing page.html file from when the request failed, and the problem won't be fixed until we restart the heroku dyno (which resets the ephemeral filesystem).

Add code to the failing case to delete the page.html file.

@ErikBoesen ErikBoesen changed the title If no people were found on page and we abort scraping, delete the saved page file If no people were found on face book page and we abort scraping, delete the saved page file Feb 21, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants