Default Elasticsearch index mappings.

[j-bennet]

Closes https://github.com/elastic/enterprise-search-team/issues/2610

Adds index mappings for connectors and crawler indices to support relevance tuning in App Search (pretty much ports elastic/connectors-ruby#131 to python).

The added index mappings + settings are not used anywhere right now. For the next step, I would need some guidance. Should these settings be used in connectors-python library, if so, where? Should they be used by a user that uses our library? Do we want another action in the CLI to initialize an index with these mappings / settings? Or perhaps just add documentation about these settings into README?

Usage:

In [1]: from elasticsearch import Elasticsearch

In [3]: client = Elasticsearch('http://localhost:9200', basic_auth=('elastic','changeme'))

In [4]: from templates.elasticsearch.index.mappings import IndexMappings

In [5]: from templates.elasticsearch.index.settings import IndexSettings

In [7]: mappings = IndexMappings.default_text_fields_mappings(is_connectors_index=True)

In [9]: settings = IndexSettings(language_code='fr', analysis_icu=False).to_hash()

In [10]: client.indices.create(index='search-my-index', settings=settings, mappings=mappings)
Out[10]: ObjectApiResponse({'acknowledged': True, 'shards_acknowledged': True, 'index': 'my-test-connectors'})

TODO:

• finish unit tests for utils.elasticsearch.index.settings.IndexSettings

Checklists

Pre-Review Checklist

• Covered the changes with automated tests
• Tested the changes locally

Related Pull Requests

elastic/connectors-ruby#131

[seanstory]

😲 wow, that was fast. Awesome!

[seanstory]

MVP

[tarekziade]

Thanks for this work @j-bennet

I think what we could do is plug your work into byoc.BYOConnector.sync when it calls prepare_index

I will add a new issue to list the possible steps to do this

[tarekziade]

#28