Haystack in AWS: Handler for type Flattened

[pallie97]

Hello. I am trying to use AWS OpenSearch Service (version: OpenSearch1.0) for my document store -- I am using JupyterLab with Python 3.7 and the latest Haystack version. When I try to create the document store in my notebook with OpenSearchDocumentStore(), I receive the following error:

RequestError(400, 'mapper_parsing_exception', 'No handler for type [flattened] declared on field [answer]').

I am unsure if this is an AWS issue or if it's something the Haystack community can help me with. I have tried setting index_type = 'hnsw' in the OpenSearchDocumentStore constructor and also tested different versions of ElasticSearch in AWS, but still get the same error.

I appreciate any help, thanks!

[ZanSara]

Hello! Sorry for the late reply. This might be related to a big change we've done recently to Haystack core classes (#1590), so while I try to replicate your issue, can you try with the 0.10 release instead of the latest master, and see if the problem persists? That would help us a lot to narrow down the source of the problem.

[pallie97]

I switched my Haystack release to 0.10, but kept all other variables as stated above. The problem appears to be resolved!
I would be happy to help troubleshoot on the latest version if necessary.

Thank you very much!

[ZanSara]

Great to hear! I'm going to change this discussion into an issue then, so we can track it better 👍

[ZanSara]

If you have any insights that can help us, let us know in the related issue: #1607

[jawaffles]

Great to hear! I'm going to change this discussion into an issue then, so we can track it better 👍

Are there any versions past 1.0 of Haystack that works with Opensearch? AWS recently shifted to opensearch so it would be really nice to use Haystacks more recent features with opensearch.