Changes
- feat: add configurable maxContentLength option
- docs: add badges and standard sections to README
- Added snyk badge
maxContentLength Option
Previously content was truncated at 2000 characters, causing search terms that appear later on long pages to not be indexed. The new maxContentLength option defaults to 10000 characters and can be configured per-project.
Console warnings are now displayed when content is truncated, listing affected URLs and their original character counts.