Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scraping a site with CloudFlare protection/redirect returns no results #203

Closed
gelform opened this issue Dec 19, 2023 · 2 comments
Closed

Comments

@gelform
Copy link

gelform commented Dec 19, 2023

When scraping a url that has a CloudFlare firewall, the "Please wait while your request is being verified..." javascript redirect is returned instead of the HTML.

Current examples:
$web->go('https://eynzone.com')
$web->go('https://brilliantly.net')

Running the code on my local environment works, but not on my server.

Any known ways to get around this?

@spekulatius
Copy link
Owner

Hey @gelform

I guess this is due to the IP of the webserver. I haven't got any way around this.

Let me know if you identify a way to solve this.

Cheers!

@gelform
Copy link
Author

gelform commented Dec 20, 2023

Makes sense. Thank you so much for getting back to me! And thank you for such a great library.

@gelform gelform closed this as completed Dec 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants