ElasticSearch migration codesprint January 2024

Participants

• Jose Garcia
• Juan Luis Rodriguez Ponce
• Francois Prunayre

Sponsors

• BRGM
• EEA
• titellus
• GeoCat BV

Agenda

The main goal of this sprint is to migrate to ElasticSearch 8

• Migrate to ES 8 Java client https://github.com/geonetwork/core-geonetwork/pull/7599
• Update elasticsearch maven plugin for integration test and improve memory usage
• Refactor to improve future migration (ES interactions are done with HTTP Proxy and Java API)
  • Move ES Java code to EsSearchManager
• Docker configuration update
• Compatibility with version 7
  • https://discuss.elastic.co/t/java-api-client-8-x-with-elasticsearch-7-x/318000 recommends migration
  • Test > 7.15 ok
  • Test 7.5.2 not supported

2024-01-08T08:41:14,205 ERROR [geonetwork.index] - Could not connect to index 'gn-records'. Error is method [PUT], host [http://localhost:9200], URI [/gn-records], status line [HTTP/1.1 406 Not Acceptable]
{"error":"Content-Type header [application/vnd.elasticsearch+json; compatible-with=8] is not supported","status":406}. Is the index server  up and running?
2024-01-08T08:41:14,205 ERROR [geonetwork.index] - Error during index creation. Error is: Could not connect to index 'gn-records'. Error is method [PUT], host [http://localhost:9200], URI [/gn-records], status line [HTTP/1.1 406 Not Acceptable]
{"error":"Content-Type header [application/vnd.elasticsearch+json; compatible-with=8] is not supported","status":406}. Is the index server  up and running?

Future work:

• Use EsSearchManager in HttpProxy ?
• Add model for the index document (Continue work made in https://github.com/geonetwork/geonetwork-microservices/tree/main/modules/library/common-index-model/src/main/java/org/fao/geonet/index/model/gn ?)