Skip to content

WebFetch tool and Google - "Click here if you haven't been redirected." #11299

@ArfyFR

Description

@ArfyFR

Question

Hi,
Since yesterday (using GPT-4.1 OpenAI) WebFetch seems to be blocked.
Is it a way to allow WebFetch on Google again ?

Here is the reply on my OpenCode:
Sure! Let me try using the webfetch tool to simulate a web search (similar to "WebSearch") and see what happens. I’ll use Google as the search engine to demonstrate this.
I will fetch a Google search for a test query: https://www.google.com/search?q=how+does+WebSearch+API+work and check if I am able to retrieve the results. Once I have the result (or if I encounter a failure), I’ll explain to you what happened and why.
Let’s begin by fetching this Google search URL.
% WebFetch https://www.google.com/search?q=how+does+WebSearch+API+work
The webfetch tool attempted to load the Google search results page, but instead of providing the actual content, Google returned a redirect page with instructions to "Click here if you haven't been redirected." This is a common anti-bot and web scraping defense.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions