Retrieval models supporting Arabic

[Fatima-Haouari]

Hi,
Could you please help regarding the below:
Is there any models that supports retrieval for Arabic language other than BM25? how about neural retrieval models?

[lintool]

You might be interested in Mr.TyDi, which includes Arabic:
https://github.com/castorini/mr.tydi

[Fatima-Haouari]

Thanks a lot for sharing this. Kindly help regarding the below:
I already used pyserini to create the sparse index but looking at the link you shared it seems I can create the dense index also using pyserini but bot really clear to me how to do so with for my own collection.

[Fatima-Haouari]

I was following this link
I have these specific questions:

1. If my collection is in json files as required for sparse indexing. Can I use it for dense indexing or different files format is needed.
2. Do we have to specify --fields
3. I believe --delimiter "\n\n" is not valid for json files
4. I am getting this error regarding the model raise HTTPError(http_error_msg, response=self)
   requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/api/models/models/mdpr-context-encoder

[lintool]

Renamed model: https://huggingface.co/castorini/mdpr-passage-nq