Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add regex matching to remove_field function #15131

Merged
merged 3 commits into from Apr 12, 2023
Merged

Conversation

patrickmann
Copy link
Contributor

Resolves #5653

remove_field performs regex match on the provided argument, so you can supply a field name or a regex pattern.
Any field matching the pattern will be removed.

@patrickmann patrickmann requested a review from a team April 3, 2023 14:32
@kodjo-anipah kodjo-anipah self-requested a review April 12, 2023 07:52
Copy link
Contributor

@kodjo-anipah kodjo-anipah left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kodjo-anipah kodjo-anipah merged commit 5c3eb57 into master Apr 12, 2023
4 checks passed
@kodjo-anipah kodjo-anipah deleted the removeFieldRegex branch April 12, 2023 08:43
todvora pushed a commit that referenced this pull request Apr 12, 2023
* add regex matching to remove_field

* update CL
todvora added a commit that referenced this pull request Apr 12, 2023
* datanode registers itself with opensearch REST endpoint uri

* code cleanup

* Updating yarn lockfile (#15132)

Co-authored-by: Gary Bot <garybot2@graylog.com>

* Fix isFreshInstallation preflight check (#15141)

* Fix isFreshInstallation preflight check

* added changelog

* removed outdated comment

* code cleanup

* Fix package name and use correct Java property value for log4j2 (#15144)

* Add undo reset button to encrypted form fields (#15147)

* Add undo reset button to encrypted form fields

* Also reset the file name

* Reference PRs in changelog

* Input form: Only reset title when initial title changes or modal is closed (#15154)

* Extended preflight check, added logging and adapted state machine transitions (#15149)

* Extended preflight check, added logging and adapted state machine transitions

* fixed opensearch preflight check

* fixed opensearch preflight check, add tests

* Fix OpenSearch permissions in data node tarball (#15158)

We tried to use fileSet/fileMode to make the OpenSearch config
permissions work when running OpenSearch with a different user.

That didn't work because the fileMode changed all files and removed the
executable bit from all executable scripts.

Now we use the Maven antrun plugin to set the permissions on the
OpenSearch files right after extraction.

* Bump webpack in /graylog2-web-interface/packages/graylog-web-plugin (#15159)

Bumps [webpack](https://github.com/webpack/webpack) from 5.77.0 to 5.78.0.
- [Release notes](https://github.com/webpack/webpack/releases)
- [Commits](webpack/webpack@v5.77.0...v5.78.0)

---
updated-dependencies:
- dependency-name: webpack
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Add CIDR Range lookup support to CSV file data adapters (#15016)

* Add CIDR Range lookup support to CSV file data adapters

* Convert JSX -> functional TSX

* Adds unit tests

* Support single IP keys

* Adapted default configuration, fixed logging, extended datanode.conf template (#15056)

Co-authored-by: Bernd Ahlers <bernd@users.noreply.github.com>

* Feat/4848 modal add to investigation (#15148)

* feat(4848): Adds buttons to open select investigation modal

* feat(4848): Implements AddEvidenceModal & fix for OverlayDropdown

* feat(4848): Adds tests

* feat(4848): Adds changelog

* feat(4848): Adds missing license header

* Implement node heartbeats without server-side scripting. (#15160)

* Implement node heartbeats without server-side scripting.

* Adding backwards compatibility.

* Removing unused method.

* Don't pass JAVA_HOME environment variable to OpenSearch process (#15166)

The OpenSearch process should use its bundled JVM version.

* Bump eslint-plugin-compat (#15169)

Bumps [eslint-plugin-compat](https://github.com/amilajack/eslint-plugin-compat) from 4.1.2 to 4.1.4.
- [Release notes](https://github.com/amilajack/eslint-plugin-compat/releases)
- [Changelog](https://github.com/amilajack/eslint-plugin-compat/blob/main/CHANGELOG.md)
- [Commits](amilajack/eslint-plugin-compat@v4.1.2...v4.1.4)

---
updated-dependencies:
- dependency-name: eslint-plugin-compat
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @tanstack/react-query (#15179)

Bumps [@tanstack/react-query](https://github.com/tanstack/query) from 4.28.0 to 4.29.1.
- [Release notes](https://github.com/tanstack/query/releases)
- [Commits](TanStack/query@v4.28.0...v4.29.1)

---
updated-dependencies:
- dependency-name: "@tanstack/react-query"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump typescript in /graylog2-web-interface/packages/graylog-web-plugin (#15173)

Bumps [typescript](https://github.com/Microsoft/TypeScript) from 5.0.3 to 5.0.4.
- [Release notes](https://github.com/Microsoft/TypeScript/releases)
- [Commits](microsoft/TypeScript@v5.0.3...v5.0.4)

---
updated-dependencies:
- dependency-name: typescript
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump eslint in /graylog2-web-interface/packages/eslint-config-graylog (#15174)

Bumps [eslint](https://github.com/eslint/eslint) from 8.37.0 to 8.38.0.
- [Release notes](https://github.com/eslint/eslint/releases)
- [Changelog](https://github.com/eslint/eslint/blob/main/CHANGELOG.md)
- [Commits](eslint/eslint@v8.37.0...v8.38.0)

---
updated-dependencies:
- dependency-name: eslint
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump puppeteer from 19.8.0 to 19.8.5 in /graylog2-web-interface (#15170)

Bumps [puppeteer](https://github.com/puppeteer/puppeteer) from 19.8.0 to 19.8.5.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/release-please-config.json)
- [Commits](puppeteer/puppeteer@puppeteer-v19.8.0...puppeteer-v19.8.5)

---
updated-dependencies:
- dependency-name: puppeteer
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @typescript-eslint/eslint-plugin (#15181)

Bumps [@typescript-eslint/eslint-plugin](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/eslint-plugin) from 5.57.1 to 5.58.0.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/eslint-plugin/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v5.58.0/packages/eslint-plugin)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/eslint-plugin"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bump @types/react in /graylog2-web-interface/packages/graylog-web-plugin (#15178)

Bumps [@types/react](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/react) from 18.0.33 to 18.0.34.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/react)

---
updated-dependencies:
- dependency-name: "@types/react"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Bootstrapping preflight UI build. (#15138)

* Adding preflight build config and targets.

* Emitting and copying preflight assets from separate dir.

* Run preflight build from maven.

* Adding license headers.

* Removing duplicate `div#app-root`.

* Merging multiple plugin executions.

* Bump @typescript-eslint/parser (#15180)

Bumps [@typescript-eslint/parser](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/parser) from 5.57.1 to 5.58.0.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/parser/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v5.58.0/packages/parser)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/parser"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Security update to shiro-core 1.11.0 (#15187)

* Security update to shiro-core 1.11.0

Release notes:

- https://shiro.apache.org/blog/2023/01/13/apache-shiro-1110-released.html
- https://shiro.apache.org/blog/2022/11/19/apache-shiro-1101-released.html
- https://shiro.apache.org/blog/2022/10/10/apache-shiro-1100-released.html
- https://shiro.apache.org/blog/2022/06/28/apache-shiro-191-released.html
- https://shiro.apache.org/blog/2022/03/22/apache-shiro-190-released.html
- https://shiro.apache.org/blog/2021/v1.8.0.html
- https://shiro.apache.org/blog/2021/v1.7.1.html
- https://shiro.apache.org/blog/2020/v1.7.0.html
- https://shiro.apache.org/blog/2020/v1.6.0.html
- https://shiro.apache.org/blog/2020/05/03/apache-shiro-1.5.3-released.html

Fixed CVEs:

- CVE-2022-32532 - Doesn't affect Graylog because we don't run in a
  servlet container
- CVE-2022-40664 - Doesn't affect Graylog because we don't run in a
  servlet container
- CVE-2023-22602 - Doesn't affect Graylog because the issue is Spring
  Boot specific

* Add changelog

* Update netty from 4.1.84 to 4.1.91 (#15186)

netty-tcnative from 2.0.54 to 2.0.59

fixed CVEs

- HAProxyMessageDecoder Stack Exhaustion DoS (CVE-2022-41881)
- HTTP Response splitting from assigning header value iterator (CVE-2022-41915)

* 1.Fixed when using OSHI library to get cpu load is always 0. (#15183)

2.Fixed getting CPU frequency could be negative because CPU frequency could exceed Int max value.

* Update json-path to 2.8.0 to fix a security issue in json-smart (#15190)

* Update json-path to 2.8.0 to fix a security issue in json-smart

Fixes CVE-2023-1370 in the json-smart transitive dependency.

* Add changelog

* Fix "Add to query" value action for dashboard widgets. (#15182)

* Fix "Add to query" value action for dashboard widgets.

* Add few simple tests for "add to query" value action.

* Add test to ensure "Add to query" works on dashboards if global override is undefined.

* Cleanup code

* Fix error.

* Updating yarn lockfile (#15162)

Co-authored-by: Gary Bot <garybot2@graylog.com>

* Add regex matching to remove_field function (#15131)

* add regex matching to remove_field

* update CL

* Configuration Form Makeover (#15025)

* Add sidebar and only show selected configuration section

* Extract calls for Search and MessageProcessorsConfig into their component

* Migrate SidecarConfig to typescript and fetch config data in component

* Migrate EventsConfig to typescript and move fetch logic into component

* Move fetch logic to UrlWhitelist component

* Move fetch logic to Permissions component and use store in Searches config

* Use store in MessageProcessorConfig

* Use store in SidecarConfig

* Use store in EventsConfig

* Use store in UrlWhiteListConfig

* Use store in IndexSetsDefaultsConfig

* Use store in UserConfig

* Clean up ConfigurationPage component and create component for plugins

* Fix tests and make sections more narrow

* Fix SearchConfig after merge and add typing to MessageProcessorConfig

* Disable eslint warning for error boundary

* Adjust headlines

* Add missing license headers

* Add changelog

* Move changelog file to correct folder

* Add arrow to plugins nav item in configurations page

* Format with correct eslint config

* Use same text for submit and cancel button for IndexSetsDefaultsConfig

* Make sure the sidebars have the same width

* Extract Icons to styled components

* NodePingPeriodical registers node in init

---------

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Gary Bot <garybot2@graylog.com>
Co-authored-by: Bernd Ahlers <bernd@users.noreply.github.com>
Co-authored-by: Laura <grotlue@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Zack King <91903901+kingzacko1@users.noreply.github.com>
Co-authored-by: Ezequiel Lopez <105670363+zeeklop@users.noreply.github.com>
Co-authored-by: Dennis Oelkers <dennis@graylog.com>
Co-authored-by: Marco Pfatschbacher <marco@graylog.com>
Co-authored-by: panxt <15639727428@163.com>
Co-authored-by: Linus Pahl <linus@graylog.com>
Co-authored-by: Patrick Mann <patrickmann@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Allow remove_field() function to take a regular expression or glob
2 participants