You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
v1.1 - Enhanced Link Detection and Custom Exclusion Paths
Improved Link Detection: The crawler now captures more comprehensive links, ensuring better coverage of inner pages, especially those dynamically generated or deeply nested within the website's structure.
Exclude Non-HTML Resources: Automatically excludes URLs pointing to non-HTML resources such as .css, .js, .png, .jpg, and other media files, ensuring the sitemap focuses on actual web pages.
Custom Exclusion Paths: Added a prompt for users to specify paths to exclude from the crawl. This feature allows users to filter out irrelevant or unnecessary sections of the website, like /feed/, /admin/, etc.
Enhanced XML Sitemap Formatting: The sitemap XML is now pretty-printed for improved readability, making it easier to review and edit in text editors like VS Code.
