Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration tests to validate data going to OpenSearch #3678

Closed
dlvenable opened this issue Nov 16, 2023 · 0 comments · Fixed by #3685
Closed

Integration tests to validate data going to OpenSearch #3678

dlvenable opened this issue Nov 16, 2023 · 0 comments · Fixed by #3685
Assignees
Labels
maintenance Issues to help maintain the project, such as improving builds, testing, etc.
Milestone

Comments

@dlvenable
Copy link
Member

Is your feature request related to a problem? Please describe.

We were recently concerned that Data Prepper was sending invalid data to OpenSearch. It turns out we don't have test cases to verify many different data combinations are correctly sent to OpenSearch.

Describe the solution you'd like

Create new tests in the OpenSearch integration tests (OpenSearchIT) to test various data combinations.

Examples:

long

int

  • largest int value
  • smallest int value
  • other extreme values
  • null

boolean

  • true
  • false
  • null

string

  • Very large strings
  • Strings with special characters
  • Strings with alternate character sets (e.g. non-Latin languages)

double

  • large double values
  • smallest double values (fractional of 0)
  • both positive and negative
  • other extreme values
  • null

float

  • large double values
  • smallest double values (fractional of 0)
  • both positive and negative
  • other extreme values
  • null

Any other values that may possibly have issues being serialized or sent to OpenSearch.

@dlvenable dlvenable added untriaged maintenance Issues to help maintain the project, such as improving builds, testing, etc. and removed untriaged labels Nov 16, 2023
@dlvenable dlvenable added this to the v2.7 milestone Nov 16, 2023
@dlvenable dlvenable modified the milestones: v2.7, v2.6 Nov 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
maintenance Issues to help maintain the project, such as improving builds, testing, etc.
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

2 participants