Problem updating faiss-search-example (General problems with indexers , ref_indexer and ContainerPea)

[JoanFM]

Describe the bug
I have been trying to update faiss-search-example (jina-ai/examples#318) and I am struggling to get it right.

So the problem is related to workspace ref_indexers and ContainerPea

Let me try to explain in detail:

• At index time NumpyIndexer is working with index_workspace as workspace, there it serializes itself to indexer_workspace/wrapidx.bin

• At query time, the docker image is started mapping volume indexer_workspace (but the problem is that inside docker this path is not proper with respect to workspace inside the docker image (from where jina pod entrypoint is run). Then there is a missmatch of the workspace stored in wrapidx.bin and the one that FaissIndexer should work on.

• At query time NumpyIndexer is passed as ref_indexer to the FaissIndexer, and the index_abspath is extracted from the ref_indexer which is not considering where the volume is mapped.

As my experience, this problem has 2 sides of the story:

• We should think of providing more freedom to the user on what folder is mapping and where it will be mapped inside the container.

• Have more clarity in from where the ContainerPea is working (absolute, relative, etc...)

• Is the fact that we are using workspace as our base for hub image could conflict with the workspace with indexer files?

EXTRA PROPOSAL:
Create an extra examples test for faiss-search-example

[jina-bot]

This issue is stale because it has been open 20 days with no activity. Remove stale label or comment or this will be closed in 4 days

[JoanFM]

Reopening issue. Will do a double check and update example te confirm

[JoanFM]

Closed by #1596

Example rewritten in jina-ai/examples#318