Docs search: tweak results ranking so release notes have lower priority

[thibaudcolas]

Related: Site-wide search #1499. We want to tweak documentation search results so searches like "TextChoices" favor reference documentation over release notes.

Tasks:

• Review and share common search queries in access logs / Postgres
• @pauloxnet suggest possible query to retrieve useful results
• Review rankings for top N queries
• Decide how to proceed with ranking

[thibaudcolas]

Assigning to @bmispelon to provide analytics on search from access logs / Postgres stats, for other contributors to review.

[pauloxnet]

As we saw with Jack it will help more to be able to extract the various sections titles from the HTML content of the Document and rate them separately.

Actually we already are using the toc key in the JSON generated by Sphinx , which contains the titles of all the paragraphs. In the web page you can see the list under "Contents" title.

[sarahboyce]

Note that our documentation is structured in folders and this is likely to remain very stable (changing breaks urls)
The release notes are in a folder, as are the reference docs, how tos etc.

We could add a filter for search results based off these folders. In my head I picture that after a search, on the search result page there are pills with each category that existed in the search. If you click on one, it becomes an "only results in that category" filter and the other categories are grayed out and inactive. When clicking on those it toggles and there could be a clear filter link. That way you could click to see "only reference docs"

I think we can tweak the ranking but we need to be careful when people are specifically searching for release notes. This might be able to let folks refine their search easier without being completely reliant on our ranking calculation