Vouch request — implement web_scrape tool (#5052) #5106
priyansh19
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi maintainers 👋
I'd like to contribute an implementation of #5052 (Add tool:
web_scrape) and am requesting a vouch so I can open the PR (per CONTRIBUTING).What I've done so far: cloned the repo and traced the tool architecture. Tools are classes implementing
AgentTool<schema, Details>inpackages/coding-agent/src/tools/, registered in the factory map intools/index.tsand listed intools/builtin-names.ts, and gated by asettings.get(...)flag (mirroring the existingweb_searchtool).Proposed approach for
web_scrape:WebScrapeToolinpackages/coding-agent/src/tools/web-scrape.ts, modeled onWebSearchTool.tools/index.ts(web_scrape: s => new WebScrapeTool(s)) and add it tobuiltin-names.ts.web_scrape.enabled+ backend key settings, following theweb_searchpattern.src/prompts/tools/, focused tests, and a changelog entry.This targets the issue's pain point — the
readtool and acurlfallback both failing on JS-heavy or access-blocking pages — without the heavy Firecrawl CLI file-dump flow.Could a maintainer
!vouch @priyansh19so I can open the PR? Happy to adjust scope or backend choices first. Thanks!Beta Was this translation helpful? Give feedback.
All reactions