-
Notifications
You must be signed in to change notification settings - Fork 22
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
_id doesn't make it through to elasticSearch #12
Comments
The document id is not passed because you need to tell the elasticsearch plugin which field to pass. See: https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#plugins-outputs-elasticsearch-document_id The document id from couchdb is automatically put in the |
Thanks for the speedy reply - sadly I'm not winning yet. I can get The full config is: |
I use |
klingsor83 - that did it. Thanks very much. |
Sorry for omitting the |
I have Logstash consuming CouchDB's _changes api, and outputting to ElasticSearch.
The _id field from the original CouchDB document is lost on it's way into ElasticSearch. Underscore fields are ES meta fields. ES assigns a new _id, and the original is lost.
My use case is that I should have a set of results coming back from ES, then my client can subscribe (by _id) to the one they want to replicate (from couchDB). Without the _id, this scenario falls flat.
There is a keep_revision flag https://www.elastic.co/guide/en/logstash/current/plugins-inputs-couchdb_changes.html#plugins-inputs-couchdb_changes-keep_revision
Could we have either a keep_id flag (similar to keep_revision), or a means to map an incoming '_id' to an outgoing 'id' property in Logstash in order to avoid the underscore prefix overlap and allow ES to retain the key detail of the document?
The text was updated successfully, but these errors were encountered: