fix: hot-fix algolia search

[henryh0x1]

Describe Your Changes

• Following issue Algolia search results PAGE not returning any results facebook/docusaurus#6693, the reason is crawler search data doesn't have a data type for the docusaurus tag. Thus, if turn on contextualSearch search, result will be not found and turn off contextualSearch, only modal search works well, full page search e.g jan.ai/search will not working.

• Solution:

• Re-implement the crawler code and added the docusaurus tag.
• Created new indices jan_docs for crawling data based on this new implementation
• Modify docusaurus.config.js with indexName: "jan_docs", and contextualSearch: true,

Fixes Issues

• Closes bug: Jan.ai - Show all search results return "No results were found" #1675

Preview

Self Checklist

• Added relevant comments, esp in complex areas
• Updated docs (for bug fixes / features)
• Created issues for follow-up changes or refactoring needed

[github-actions]

Preview URL: https://74b2b5ed.jan-qn8.pages.dev

[Van-QA]

LGTM