Elasticsearchwriter: support Elasticsearch 8.0

[pdolinic]

Describe the bug

[2022-02-22 18:18:51 +0100] critical/ElasticsearchWriter: Error: 'no handler found for uri [/icinga2-2022.02.22/doc/_bulk] and method [POST]'. Unexpected response code 400 from URL 'http://ip.ip.ip.ip:9200/icinga2-2022.02.22/doc/_bulk'

To Reproduce

1. Install Elasticsearch 8.0
2. Activate Elasticsearchwriter
3. Check Output from "tail -f /var/log/icinga2/icinga2.log"

Expected behavior

Logs should not throw "critical/ElasticsearchWriter: Error: 'no handler found for uri"

Your Environment

• Version used (icinga2 --version): version: 2.13.2-1
• Operating System and version: RHEL8
• Enabled features (icinga2 feature list): api checker command elasticsearch ido-mysql mainlog notification
• Icinga Web 2 version and modules (System - About): 2.9.5

Additional context

"8.0 introduces several breaking changes to the Elasticsearch REST APIs... To make this process easier, we’ve added support for 7.x compatibility headers to our REST APIs. In many cases, these optional headers let you make 7.x-compatible requests to an 8.0 cluster and receive 7.x-compatible responses.. "

Sources:

https://www.elastic.co/guide/en/elasticsearch/reference/current/release-highlights.html
https://www.elastic.co/guide/en/elasticsearch/reference/8.0/rest-api-compatibility.html
https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html

[cductive]

Hi,
I'm experiencing the same behavior with my implementation. Both the my Icinga2 and ELK setups are on separate VMs in the same network. I'm hoping someone can explain why this is happening and how to resolve it.

[zidludwig]

I'd need a update of this feature too!

[ThomasPause]

Hi,
experienced the same behaviour.

@pdolinic @cductive @zidludwig:
Suggestion for a fix:
just delete line 467 in this file:
https://github.com/Icinga/icinga2/blob/master/lib/perfdata/elasticsearchwriter.cpp

@Al2Klimov
for stable feature implementation maybe make the document type configurable and, if empty, leave it out in this line.
With this the code should be compatible with ElasticSearch 5-8 and OpenSearch 1 and 2.

[carraroj]

ref/NC/775717

[manny4566]

Hi, i have the same error with my Elasticsearchwriter test installation.
I think the problem is still existing or? Can somebody give me a feedback or a solution, if exists? Or the state of the issue?
Elastic v8.5.3

Thank you

[manny4566]

Hi, i have the same error with my Elasticsearchwriter test installation. I think the problem is still existing or? Can somebody give me a feedback or a solution, if exists? Or the state of the issue? Elastic v8.5.3

Thank you

Maybe the Problem is, that the Module try to create a index under the path "xxx/doc/_bulk"
Maybe "xxx/_doc" is correct under Elastic v8.

[FreeSoftwareServers]

Any update on this?