Skip to content

Update shaba/litecrawl to v0.1.3#2605

Merged
crazywoola merged 1 commit into
langgenius:mainfrom
shaba:update-litecrawl
Jun 26, 2026
Merged

Update shaba/litecrawl to v0.1.3#2605
crazywoola merged 1 commit into
langgenius:mainfrom
shaba:update-litecrawl

Conversation

@shaba

@shaba shaba commented Jun 25, 2026

Copy link
Copy Markdown
Contributor

Plugin Submission Form

1. Metadata

2. Submission Type

  • New plugin submission
  • Version update for existing plugin

3. Description

Version update to 0.1.3. Bug fix: sitemap scope is now derived from the crawl URL (its own directory or an explicit path prefix), never from docs-root auto-discovery. On documentation sites whose sitemap pages live at the root (e.g. VitePress wikis), discovery could match a generic path such as /wiki/ that returns 200, which then filtered out every real sitemap entry; the JS-rendered SPA yielded no BFS links, so a crawl returned only the start page. The sitemap is now tried first, scoped to the given URL; find_docs_root + BFS remain only the no-sitemap fallback, now hardened with a catch-all / soft-404 guard. Verified on a 479-page VitePress wiki (previously 1 page).

4. Checklist

  • I have read and followed the Publish to Dify Marketplace guidelines
  • I have read and comply with the Plugin Developer Agreement
  • I confirm my plugin works properly on both Dify Community Edition and Cloud Version
  • I confirm my plugin has been thoroughly tested for completeness and functionality
  • My plugin brings new value to Dify

5. Documentation Checklist

  • Step-by-step setup instructions
  • Detailed usage instructions
  • All required APIs and credentials are clearly listed
  • Connection requirements and configuration details

@crazywoola crazywoola left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ LGTM

Decision: Approve

Local Check Results

Check Status Detail Required action
PR content language ✅ Pass PR title/body CJK ratio=0.0% (zh=0, en=1188, ignored_zh=0, allowed_zh<=0) None.
Project structure ✅ Pass All expected files present: manifest.yaml, README.md, PRIVACY.md. _assets/: yes. None.
Manifest author ✅ Pass author is valid. None.
Icon validation ✅ Pass icon exists: _assets/icon.svg None.
Version check ✅ Pass version 0.1.3 is available. None.
README language ✅ Pass README.md CJK ratio=0.0% (zh=0, en=1367, allowed_zh<=0) None.
PRIVACY.md ✅ Pass PRIVACY.md exists and is non-empty. None.
Dependency install ✅ Pass requirements installed successfully. None.
dify_plugin version ✅ Pass dify_plugin version 0.9.0 satisfies >= 0.9.0. None.
Install test ✅ Pass plugin install test passed. None.
Packaging test ✅ Pass packaging check passed. None.

@crazywoola crazywoola merged commit 4782aea into langgenius:main Jun 26, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants