You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Suppose two types of documents are stored in CouchDB. The document types can be detected somehow, e.g. by reading a field's valud. The user wants to index the different document types as different types in a single ElasticSearch index, or in multiple ElasticSearch indices, or both.
Currently, the only way to do this is to setup two rivers, one for each type, with appropriate filters to filter the corresponding document types from CouchDB. This hits performance, as CouchDB will have to read all documents twice. If there are more than two document types, this gets even worse.
So I'm suggesting to allow to somehow set the _type and _index values so that the indexing could be accomplished with a single river.
We will allow for a custom script to set _type and _index (probably based on the document content), and if set, those values will be used instead of the default ones.
And, while we are at it, allow for _routing as well.
The text was updated successfully, but these errors were encountered:
Suppose two types of documents are stored in CouchDB. The document types can be detected somehow, e.g. by reading a field's valud. The user wants to index the different document types as different types in a single ElasticSearch index, or in multiple ElasticSearch indices, or both.
Currently, the only way to do this is to setup two rivers, one for each type, with appropriate filters to filter the corresponding document types from CouchDB. This hits performance, as CouchDB will have to read all documents twice. If there are more than two document types, this gets even worse.
So I'm suggesting to allow to somehow set the _type and _index values so that the indexing could be accomplished with a single river.
We will allow for a custom script to set
_type
and_index
(probably based on the document content), and if set, those values will be used instead of the default ones.And, while we are at it, allow for
_routing
as well.The text was updated successfully, but these errors were encountered: