This release adds HTML support and fixes several bugs that were silently losing text from indexed documents.
- HTML files (
.html,.htm,.xhtml) can now be indexed. Addsemanticsearch.NewHTMLStrategy()to your strategy list - Pages are split by their headings, so results carry the headings they sit under. Tags, scripts, styles, and navigation menus never reach the index
- Fixed a bug where a heading with no paragraph text under it was dropped completely, which left documents like lab reports and spec sheets almost unsearchable. This affected Markdown, Word, and PDF too
- Fixed a bug where a section's heading was left out when its text was turned into a vector. A section titled "Refunds" whose text reads "Within five business days" is now findable by searching for refunds
- Fixed garbled PDF extraction, where letters came out spaced apart or a line was broken into pieces. Across a 60 file corpus this recovered 686 more words and removed 3289 stray single letters
- Fixed PDFs that fake bold by drawing text twice, which produced doubled letters