Release v1.2.0
[1.2.0] - 2025-06-30
Added
- Batch crawl API support for processing multiple URLs in a single request
- Comprehensive sitemap API with improved functionality:
- Dedicated methods for creating, retrieving, listing, and deleting sitemap requests
- Support for different output formats (JSON, Markdown, Graph) via
getSitemapResults - Real-time monitoring with event streaming via
monitorSitemapRequest
- New
getCrawlRequestSitemapmethod to retrieve sitemap data from a crawl request with format options - Example code demonstrating batch crawl and sitemap API usage in the examples directory
Changed
- Updated streaming implementation to use Axios streams instead of Fetch API for better Node.js compatibility
- Improved test suite organization with clear categorization (Core API, Crawl API, Search API, Sitemap API)
- Enhanced error handling in tests and async operations
Fixed
- Fixed type issues with SitemapOptions and enum usage in tests
- Improved test reliability for asynchronous streaming operations
- Better handling of potentially long-running operations in examples
Deprecated
downloadResult- Use alternative methods for downloading result datadownloadSitemap- Use the newgetCrawlRequestSitemapmethod with JSON formatdownloadSitemapGraph- Use the newgetCrawlRequestSitemapmethod with Graph formatdownloadSitemapMarkdown- Use the newgetCrawlRequestSitemapmethod with Markdown format
Full Changelog: v1.1.1...v1.2.0