Skip to content

Conversation

@seanmcguire12
Copy link
Member

why

  • so we can stop getting captcha'd in simple_google_search

what changed

  • added URLs to google homepage clone

test plan

  • this is it

@changeset-bot
Copy link

changeset-bot bot commented Jun 2, 2025

⚠️ No Changeset found

Latest commit: 1e06c93

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Copy link
Contributor

@greptile-apps greptile-apps bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PR Summary

Updates the simple_google_search eval task to use a cloned Google site hosted on GitHub Pages instead of the actual Google search page to avoid CAPTCHA issues during testing.

  • Changed URL in evals/tasks/simple_google_search.ts to use browserbase.github.io/stagehand-eval-sites/sites/google/ instead of google.com
  • Updated expected result URL to match the cloned site's structure
  • Core search functionality remains identical - typing 'OpenAI' and clicking search
  • Test verifies correct navigation to the cloned results page

1 file(s) reviewed, no comment(s)
Edit PR Review Bot Settings | Greptile

@seanmcguire12 seanmcguire12 merged commit 912947f into main Jun 2, 2025
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants