Non interactive leaf elements are now included in the LLMs context #8
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
why
Let's say you're trying to automate buying peelers (a common occurance) and so you tell your trusty LLM to navigate to the peeler page and buy one. But on this peeler website, their call to action to add to cart is actually disjoint from the copy describing the peeler, so it doesn't know which check out button adds the peeler!
Previously, stagehand only looked at interactive elements but this breaks down pretty easily. The new approach is to include interactive and leaf elements (things that hold text). While this brings way more content to the LLM, we still have plenty of tools in our tool box to slim and chunk the dom down more as needed
what changed
test plan
Run evals, i'll run them more once we upgrade on braintrust