Repository navigation
Initial release
π v0.1.0 β Initial Release
β¨ Features
π§ scrape-docs CLI
Scrape documentation sites into clean Markdown using:
requests+BeautifulSoup- Optional rotating proxies (HTTP/SOCKS)
- Full ScraperAPI support:
- JS rendering (
--render) - Geo-targeting (
--country) - Sticky sessions (
--session)
- JS rendering (
- Depth limiting, path restriction, and dry-run mode
- Auto-retries with proxy fallback
π copy-docs CLI
Copy scraped documentation folders from a centralized archive into your projectβs /docs folder β useful for providing local context to GitHub Copilot Chat.
π¨βπ» Developer-Focused Features
- Uses
.envfile for config (e.g.SCRAPERAPI_KEY) - Automatically creates
.envfrom.env.exampleon first run - Project uses
pyproject.toml(PEP 517/518 compliant) - Designed for integration with
create-t3-appand Copilot workflows