Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

2.7 optimization fix #934

Open
wants to merge 88 commits into
base: main
Choose a base branch
from

Conversation

eirsep
Copy link
Member

@eirsep eirsep commented Mar 15, 2024

Description

[Describe what this change achieves]

Issues Resolved

[List any issues this PR will resolve]

Check List

  • New functionality includes testing.
    • All tests pass
  • New functionality has been documented.
    • New functionality has javadoc added
  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

opensearch-trigger-bot bot and others added 30 commits November 1, 2022 15:32
…nsearch-project#104)

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
(cherry picked from commit d1f62cc)

Co-authored-by: Surya Sashank Nistala <snistala@amazon.com>
…mon utils interface (opensearch-project#101) (opensearch-project#105)

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
…opensearch-project#106)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit bfb2b23)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…pensearch-project#108)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 95f8d9a)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…ct#111)

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
(cherry picked from commit 269be07)

Co-authored-by: Surya Sashank Nistala <snistala@amazon.com>
opensearch-project#120)

Signed-off-by: Raj Chakravarthi <raj@icedome.ca>
Signed-off-by: Subhobrata Dey <sbcd90@gmail.com>
…t#125)

* dns and cloudtrail mappings

Signed-off-by: Grant Haywood <grant@phaseshift.studio>

* add s3 mappings

Signed-off-by: Grant Haywood <grant@phaseshift.studio>

Signed-off-by: Grant Haywood <grant@phaseshift.studio>
(cherry picked from commit ee7f6fb)

Co-authored-by: phaseshiftg <115187865+phaseshiftg@users.noreply.github.com>
…) (opensearch-project#128)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit bb7ffb5)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…search-project#92) (opensearch-project#130)

Signed-off-by: Stevan Buzejic <stevan.buzejic@htecgroup.com>
(cherry picked from commit 2f0abe6)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
…#131) (opensearch-project#132)

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
(cherry picked from commit 1b36aa1)

Co-authored-by: Surya Sashank Nistala <snistala@amazon.com>
Signed-off-by: Grant Haywood <grant@phaseshift.studio>
opensearch-project#122) (opensearch-project#135)

* fixed GetFindings not searching all indices; fixed proper deletion of old history indices

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
(cherry picked from commit 8dd1c9f)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…#123) (opensearch-project#140)

* conflict resolve

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

* IT fixes

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>

Signed-off-by: Petar Dzepina <petar.dzepina@vroom.com>
Co-authored-by: Petar Dzepina <petar.dzepina@vroom.com>
(cherry picked from commit 4fba8fc)

Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
…nsearch-project#144)

Signed-off-by: Stevan Buzejic <stevan.buzejic@htecgroup.com>

Signed-off-by: Stevan Buzejic <stevan.buzejic@htecgroup.com>
Co-authored-by: Stevan Buzejic <stevan.buzejic@htecgroup.com>
(cherry picked from commit 68231e9)

Co-authored-by: Stevan Buzejic <30922513+stevanbz@users.noreply.github.com>
Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
…findings (opensearch-project#148) (opensearch-project#151)

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
(cherry picked from commit 2e44ff4)

Co-authored-by: Surya Sashank Nistala <snistala@amazon.com>
…) (opensearch-project#168)

Signed-off-by: Stevan Buzejic <stevan.buzejic@htecgroup.com>
…pensearch-project#177)

* fix for running windows integration tests

(cherry picked from commit b91c1f6)

Co-authored-by: Subhobrata Dey <sbcd90@gmail.com>
Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
…e case secure IT tests (opensearch-project#161) (opensearch-project#210)

Signed-off-by: Raj Chakravarthi <raj@icedome.ca>
AWSHurneyt and others added 18 commits April 17, 2023 23:02
Signed-off-by: AWSHurneyt <hurneyt@amazon.com>
(cherry picked from commit 2daf1d4)
…kport/backport-401-to-2.7

[Backport 2.7] Added 2.7 release notes.
…ect#416)

Signed-off-by: Petar Dzepina <petar.dzepina@gmail.com>
* auto expand replicas (opensearch-project#539)

Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
… no applied aliases (opensearch-project#765)

* Adding integ tests for empty mappings/aliases use-cases



* Fix unit tests for MappingsTraverser



---------

Signed-off-by: Megha Goyal <goyamegh@amazon.com>
…ect#745)

* remove wildcard



* changed wildcardtest



* fixed wildcards



* fixed wildcard query test



* fixed correlation engine tests



* fixed query backend tests



* clean up



* added two integration tests



---------

Signed-off-by: Joanne Wang <jowg@amazon.com>
…behavior (opensearch-project#843) (opensearch-project#908)

* Catch ArrayIndexOutOfBoundsException when detector is missing

Signed-off-by: Megha Goyal <goyamegh@amazon.com>

* Add a check on SearchHits.getHits() length

Signed-off-by: Megha Goyal <goyamegh@amazon.com>

* Remove index out of bounds exception

Signed-off-by: Megha Goyal <goyamegh@amazon.com>

---------

Signed-off-by: Megha Goyal <goyamegh@amazon.com>
(cherry picked from commit 0ef8543)

Co-authored-by: Megha Goyal <56077967+goyamegh@users.noreply.github.com>
…h, and endswith (opensearch-project#860) (opensearch-project#911)

* add validation for empty strings with contains, startswith and endswith modifiers

Signed-off-by: Joanne Wang <jowg@amazon.com>

* throw exception if empty string with contains, startswith, or endswith

Signed-off-by: Joanne Wang <jowg@amazon.com>

* change var name

Signed-off-by: Joanne Wang <jowg@amazon.com>

* add modifiers to log

Signed-off-by: Joanne Wang <jowg@amazon.com>

---------

Signed-off-by: Joanne Wang <jowg@amazon.com>
(cherry picked from commit f4ee7bb)

Co-authored-by: Joanne Wang <jowg@amazon.com>
Signed-off-by: Megha Goyal <goyamegh@amazon.com>
* fix detector writeTo() method missing fields

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

* fix test

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

---------

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
…ensearch-project#722)

* fix null query filter conversion from sigma to query string query

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

* fix rule to query conversion tests for null filter

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

* enhance test to verify non null doc doesnt match null query

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

---------

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
… no applied aliases

Signed-off-by: Megha Goyal <goyamegh@amazon.com>

* Adding integ tests for empty mappings/aliases use-cases

Signed-off-by: Megha Goyal <goyamegh@amazon.com>

* Fix unit tests for MappingsTraverser

Signed-off-by: Megha Goyal <goyamegh@amazon.com>

---------

Signed-off-by: Megha Goyal <goyamegh@amazon.com>
…emove blocking actionGet() calls (opensearch-project#873)

* pass query field names in doc level queries during monitor creation/updation

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

* remove actionGet() and change get index mapping call to event driven flow

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

* fix chained findings monitor

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

* add finding mappings

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

* remove test messages from logs

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

* revert build.gradle change

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>

---------

Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
riysaxen-amzn pushed a commit to riysaxen-amzn/security-analytics that referenced this pull request Mar 25, 2024
…) (opensearch-project#938)

(cherry picked from commit e0b7a5a7905b977e58d80e3b9134b14893d122b0)

* remove unneeded import

---------






* Stashed user together with it's roles



---------







* Added workflow execution logic (opensearch-project#850)

* Added workflow execution logic



* Adjusted code according to comments



* Updated version of the findings json



* Updating the workflow metadata in the case of updating flag set to false while the metadata alerady exist



* Added logging for workflow metadata update



* Added Rest Execute Workflow action



* Extended workflow context with workflowMetadataId. Adjusted the doc level monitor findings



* Updated conditions for unstashing the context when indexing and deleting the workflow



---------



* Added fix when executing the workflow and when chained findings index… (opensearch-project#890)



* Fixed deleting monitor workflow metadata (#882)

* Fixed deleting monitor metadata and workflow metadata.




* fix monitor metadata error from conflict resolution



* remove unused import



* remove rest execute workflow action



* increment schema version for findings mapping json



---------

Signed-off-by: Stevan Buzejic <buzejic.stevan@gmail.com>
Signed-off-by: Angie Zhang <langelzh@amazon.com>
Signed-off-by: Ashish Agrawal <ashisagr@amazon.com>
Signed-off-by: Surya Sashank Nistala <snistala@amazon.com>
Co-authored-by: Stevan Buzejic <buzejic.stevan@gmail.com>
Co-authored-by: Angie Zhang <langelzh@amazon.com>
Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com>
Co-authored-by: Petar Dzepina <petar.dzepina@gmail.com>
Co-authored-by: Ashish Agrawal <ashisagr@amazon.com>
@praveensameneni
Copy link
Member

@eirsep , can you please update/close the PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

9 participants