Ingest API

[Bargs]

This feature was removed from 5.0. It does not currently have a target release because it will most likely require some changes.

Related to #3709

Goal is to provide API endpoints for the creation of Kibana index patterns and index templates. These will be implemented in the Kibana server.

Here is a rough initial stab at what the endpoints might look like:

POST /api/kibana/ingest
Create a new index pattern and template.

Requires the JSON formatted index pattern in the body of the request.
Properties include:

• title: String (Required)
• timeFieldName: String (optional, only needed for time based index patterns)
• intervalName: String
• fields: Object (optional, auto-generated if missing and existing indexes match pattern)
• fieldFormatMap: Object (optional, map of non-default formatters to user for fields)

Need a place for mapping info. This might go in the fields object, or it might go in a separate property like fieldFormatMap

Title will be used as the document ID.

DELETE /api/kibana/ingest/{id}
Delete an index pattern and its template.

[ltutar]

+1 for this feature

[dj-wasabi]

+1 👍

[bvoss]

+1

[acs]

+1

[trekr5]

Hi,

Is this endpoint now available for Kibana?

[Bargs]

Hi @trekr5

This feature is still in progress and hasn't been merged yet.

[d7h]

+1

[samcday]

Hey @Bargs - we super-duper want this feature. How far through implementation are you? Would love to roll up our sleeves and help if your bandwidth is split across other duties.

[Bargs]

Hi @samcday, the implementation for this is almost complete. You can follow its progress in my PR #5213

[Slach]

+1

[ydixken]

+1 thanks!

[DanyC97]

on which release will this make it ?

[Bargs]

It's been merged into master, so 5.0.

[DanyC97]

@Bargs oh i see...shame as i believe is long way till will be released. I was hopping will get into current minor 4.x release

[ltutar]

+1 for minor 4.x. release

[brhahlen]

+1

[FireDrunk]

Very cool indeed if this would be possible for 4.x.minors!

[rabbenhuis]

+1 for minor 4.x. release

[ProgressiveAstronaut]

Great ! We'll be very excited once it is available!

[schmandforke]

hey,

is this feature available in Kibana 5.x ? You added the label but i found no further documentation about that API call.
I think this is a very essential feature for automation purpose.

Thanks

[Bargs]

Hi @schmandforke, this feature was removed from 5.0. It does not currently have a target release because it will most likely require some changes.

[schmandforke]

Hey @Bargs,

found a solution to realize this:

curl 'http://{KIBANASERVER}:{KIBANAPORT}/es_admin/.kibana/index-pattern/foobar-*/_create' -XPOST -H 'Content-Type: application/json' -H 'Accept: application/json, text/plain, */*' -H 'kbn-version: 5.2.0' --data-binary '{"title":"foobar-*","timeFieldName":"@timestamp"}'

I actually not know, how long this route will exists, but by now - it works like a charm ;-)

Thanks

[Bargs]

@schmandforke that's just a proxy for ES requests that we have in the Kibana backend. It's no different than sending the same request to elasticsearch directly. We'd like to get rid of the proxy eventually, but I don't think it will go away any time soon.

[rocket-ron]

+1 for this feature - very badly needed.

Realizing that this has been put aside for the moment, a good substitute might be an unofficial gist showing curl commands to do things like add an index pattern or create a scripted field, etc.

[falkenbt]

Here's a very simple example for creating index patterns and setting a default by (ab)using the Kibana "Api":
https://gist.github.com/falkenbt/cace7f0bd1329d18699c022242491857

[sandstrom]

If you would prefer a method for loading dashboards and indexpatterns from the file-system (for use with Chef, Puppet, Salt, etc) please vouch for it here: #2310