v0.0.5-beta.5

   🚀 Features

• Add maxTokens and overlapSize to extraction config; integrate js-tiktoken and marked for token counting and markdown processing  -  by @OSpoon (d9c2a)
• Enhance document processing with token-aware AST splitting and atomic block protection  -  by @OSpoon (b9df3)
• Optimize text splitting logic for efficiency and improve test data for better coverage  -  by @OSpoon (ec0da)
• Optimize text splitting logic for better performance and handle large texts more efficiently  -  by @OSpoon (e5078)

    View changes on GitHub