Optimize code performance, better error handling

[Tnixc]

mostly the same perf but faster in high file counts

This pull request introduces significant improvements to error handling, code robustness, and performance, particularly in the handling of file processing and concurrency. The most notable change is the parallelization of file processing in the process_pages function using the Rayon library, which should lead to better performance on multi-core systems. Additionally, the code now includes more defensive programming practices, such as early returns and improved error messages, making it more reliable and easier to debug.

Performance Improvements:

• Parallelized file processing in process_pages using the Rayon library, replacing manual thread management and channels for improved performance and code simplicity. Added rayon as a dependency in Cargo.toml. [1] [2] [3] [4]

Error Handling and Robustness:

• Improved error handling in several places, including more robust handling of file path operations, better error messages, and early returns on failure (e.g., when failing to strip prefixes or convert paths to strings). [1] [2] [3] [4]
• Defensive programming: Added early returns in component, template, and markdown processing functions when no matches are found, reducing unnecessary computation and potential errors. [1] [2] [3]

Code Quality and Readability:

• Replaced .unwrap() calls with safer alternatives (such as .unwrap_or, .unwrap_or_else, or pattern matching) throughout the codebase, reducing the risk of panics and improving code clarity. [1] [2] [3] [4] [5] [6] [7]
• Improved error reporting in the websocket and watcher setup, providing more informative messages and preventing panics on failure. [1] [2]

Miscellaneous:

• Removed the unused generate.sh script, cleaning up the repository.

These changes collectively make the codebase more robust, maintainable, and performant.