fix: removed bless-crawl module #29
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
There was a problem hiding this comment.
Pull Request Overview
This PR removes the bless-crawl feature entirely from the Blockless SDK to streamline the codebase and simplify dependencies. The removal eliminates web scraping functionality that was previously available through the BLESS network's browser nodes.
- Removes the
bless-crawlfeature flag and its associated dependencies (htmd,kuchikiki,regex) - Deletes the entire
bless_crawlmodule including HTML transformation and markdown conversion functionality - Removes the web scraping example that demonstrated the feature usage
Reviewed Changes
Copilot reviewed 6 out of 6 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
Cargo.toml |
Removes bless-crawl feature definition and its dependencies |
src/lib.rs |
Removes conditional compilation of the bless_crawl module |
src/bless_crawl/mod.rs |
Deletes the main bless_crawl module with scraping functionality |
src/bless_crawl/html_transform.rs |
Removes HTML transformation utilities |
src/bless_crawl/html_to_markdown.rs |
Removes HTML to Markdown conversion functionality |
examples/web-scrape.rs |
Deletes the web scraping example code |
uditdc
approved these changes
Jul 15, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This pull request removes the
bless-crawlfeature entirely from the SDK, along with its associated dependencies, modules, and examples. The changes streamline the codebase by eliminating unused functionality and simplifying the dependency graph.Removal of
bless-crawlfeature:Cargo.toml: Removed thebless-crawlfeature and its dependencies (htmd,kuchikiki,regex). Updated thedefaultfeature set to excludebless-crawl. [1] [2] [3]examples/web-scrape.rs: Deleted the web scraping example that demonstrated the use of thebless-crawlfeature.src/bless_crawl/html_to_markdown.rs: Removed the module responsible for converting HTML to Markdown, including its associated functions and tests.src/bless_crawl/html_transform.rs: Deleted the module for transforming HTML, including its options, error handling, and tests.src/lib.rs: Removed thebless_crawlmodule from the library's feature set.