Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add option do disable log payloads indexation #2952

Closed
brasseld opened this issue Nov 28, 2019 · 0 comments
Closed

Add option do disable log payloads indexation #2952

brasseld opened this issue Nov 28, 2019 · 0 comments

Comments

@brasseld
Copy link
Member

@brasseld brasseld commented Nov 28, 2019

When the logging condition is true, the gateway is storing:

  • Request headers + payload
  • Response headers + payload

Since #2053 the payload is defined as a keyword for being able to search logs base on payloads.

This results with issues for large payloads:

09:19:30.692 [vert.x-eventloop-thread-0] [] ERROR i.g.e.client.http.HttpClient - An error occurs while indexing data into ES: indice[gravitee-log-2019.11.13] error[Document contains at least one immense term in field="client-response.body" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped.  Please correct the analyzer to not produce such terms.  The prefix of the first immense term is: '[123, 10, 32, 34, 101, 120, 112, 101, 114, 116, 79, 112, 105, 110, 105, 111, 110, 115, 34, 58, 32, 91, 10, 32, 123, 10, 32, 34, 101, 120]...', original message: bytes can be at most 32766 in length; got 49023]

We should provide a way to enable / disable payload indexation

@brasseld brasseld added this to the APIM - 1.30.x milestone Nov 28, 2019
brasseld added a commit to gravitee-io/gravitee-elasticsearch that referenced this issue Dec 4, 2019
NicolasGeraud added a commit to gravitee-io/gravitee-elasticsearch that referenced this issue Dec 5, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
API Management
Awaiting triage
2 participants
You can’t perform that action at this time.