Fixes
fix: Workaround for #9164 (#9168)
fix: Workaround for #9164 (#9168)
This pull request updates the word splitter to improve its handling of long or complex words and adds new test cases to ensure correct behavior. The main changes include increasing the allowed number of skipped breaks and attempts for word splitting, updating test cases to cover additional scenarios, and adjusting ignored words in the dictionary tests.
Word splitting improvements:
- Increased the maximum number of skipped breaks (
maxSkippedBreaks) from 8 to 16 and set a new maximum number of attempts (maxAttempts) to 64,000 inwordSplitter.tsto better handle complex word splitting cases. - Removed the local
maxAttemptslimit in thesplitIntoWordsfunction, relying instead on the new global constant.
Test enhancements:
- Updated the ignored words in the dictionary test to include a new Base64 string (
QmFzZTY0IHN0cmluZyBvZiB0ZXh0IGhlcmU) and usedcspell:disable/cspell:enablecomments for clarity. - Added a new test case to validate splitting of the string
'QmFzZTY0IHN0cmluZyBvZiB0ZXh0IGhlcmU.access'in the word splitter tests.