-
Notifications
You must be signed in to change notification settings - Fork 236
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fields with a state of DROP on normalization failure #2267
Fields with a state of DROP on normalization failure #2267
Commits on Feb 7, 2024
-
Fields with a state of DROP on normalization failure are not written …
…to the index but are still preserved in the event.
Configuration menu - View commit details
-
Copy full SHA for 6f55333 - Browse repository at this point
Copy the full SHA 6f55333View commit details
Commits on Feb 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 2911976 - Browse repository at this point
Copy the full SHA 2911976View commit details -
updated common-utils submodule and updated quickstart docker to not c…
…lean up old images
Configuration menu - View commit details
-
Copy full SHA for 0fd8475 - Browse repository at this point
Copy the full SHA 0fd8475View commit details -
Configuration menu - View commit details
-
Copy full SHA for 93ddde2 - Browse repository at this point
Copy the full SHA 93ddde2View commit details -
Enforce term limits during EdgeQueries (#2274)
* Enforce term limits during EdgeQueries * Update error message * Fix EdgeQuery maxQueryTerms setting
Configuration menu - View commit details
-
Copy full SHA for 4c51cb6 - Browse repository at this point
Copy the full SHA 4c51cb6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3e80d99 - Browse repository at this point
Copy the full SHA 3e80d99View commit details -
Added remote edge query logic and tests (#2250)
* Added remote edge query logic and tests * factored the BaseRemoteQueryLogic out of the remote edge and event instances
Configuration menu - View commit details
-
Copy full SHA for 262cdde - Browse repository at this point
Copy the full SHA 262cddeView commit details -
Updates to try and avoid hanging ivarators (#2093)
* Updates to try and avoid hanging ivarators * fixed configuration issues of the thread pools * Updates to allow value to be set via properties.
Configuration menu - View commit details
-
Copy full SHA for 35561c1 - Browse repository at this point
Copy the full SHA 35561c1View commit details -
Clearing noisy logs in start-loader (#2258)
* Cleaning noisy logs in start-loader * Removing tracer log calls * Adjusting logs for additional loader * Small adjustment to echo --------- Co-authored-by: pcagbu <pcagbu@ip-10-113-15-132.evoforge.org>
Configuration menu - View commit details
-
Copy full SHA for 7afbc59 - Browse repository at this point
Copy the full SHA 7afbc59View commit details -
- added git pre-push hook to ensure code is formatted properly Co-authored-by: Christopher Gross cogross <christopher.gross@red-drum.com>
Configuration menu - View commit details
-
Copy full SHA for 8a05595 - Browse repository at this point
Copy the full SHA 8a05595View commit details -
Use the pluginEnvironment instead of AccumuloConfiguration as the (#2200
Configuration menu - View commit details
-
Copy full SHA for 13f196e - Browse repository at this point
Copy the full SHA 13f196eView commit details -
Enrich 'i' and 'ri' rows in metadata table with event date (#2094)
* Enrich 'i' and 'ri' rows in metadata table with event date Modify the generation of 'i' (indexed rows) and 'ri' (reverse indexed rows) in the metadata table such that the column qualifier contains the event date. This is required as a first step to support efforts for issue #825 so that we can identify dates when an event was ingested and included in a frequency count for an associated 'f' row, but was not indexed. * Add counts to 'i' and 'ri' rows
Configuration menu - View commit details
-
Copy full SHA for cf9d8cf - Browse repository at this point
Copy the full SHA cf9d8cfView commit details -
Configuration menu - View commit details
-
Copy full SHA for efb4e28 - Browse repository at this point
Copy the full SHA efb4e28View commit details -
#2226 - fix javadoc warnings (#2232)
* fix javadoc warnings --------- Co-authored-by: Christopher Gross cogross <christopher.gross@red-drum.com>
Configuration menu - View commit details
-
Copy full SHA for 05a4a12 - Browse repository at this point
Copy the full SHA 05a4a12View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4a92fa8 - Browse repository at this point
Copy the full SHA 4a92fa8View commit details -
2170 - update dependencies (#2176)
* 2170 - update dependencies --------- Co-authored-by: Christopher Gross cogross <christopher.gross@red-drum.com>
Configuration menu - View commit details
-
Copy full SHA for 6fbd222 - Browse repository at this point
Copy the full SHA 6fbd222View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2f370d3 - Browse repository at this point
Copy the full SHA 2f370d3View commit details -
Improved SSDeep ingest and query test framework (#2230)
* Replaced custom Tuple2 implementation with ImmutablePair from commons-lang3 * Includes complete ingest testframework for SSDeep data that includes both shard data and ssdeepIndex data. * Cleans up some sins of the past related to the faceted query logic leaking into the test framework. * Adds protoype datawave ingest SSDeepIndexHandler, good enough for testing at this point. * Trimmed pom for ssdeep-ingest to minimum dependency set * Reorganized package structure to keep ssdeep code/tests together * Moved SSDeepQueryTest to common package * Fix parent pom version for ingest-ssdeep and static version for ssdeep-common * Addressed comments from code review
Configuration menu - View commit details
-
Copy full SHA for 2a269b3 - Browse repository at this point
Copy the full SHA 2a269b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for cd3f1e1 - Browse repository at this point
Copy the full SHA cd3f1e1View commit details -
Fix pruning logic for IngestTypePruningVisitor after removal of JexlN…
…odes.children() method
Configuration menu - View commit details
-
Copy full SHA for 464b2db - Browse repository at this point
Copy the full SHA 464b2dbView commit details -
Re-introduce RebuildingScannerTestHelper to QueryTestTableHelper (#2279)
* @jwomeara observed that the `QueryTestTableHelper` was no longer using the `RebuildingScannerTestHelper`, and was using a regular `InMemoryInstance` instead, so we were not testing teardowns and interrupts. * Updated `RebuildingScannerTestHelper` to use `AccumuloClient` instead of `AccumuloConnection` incorporating changes from the `feature/queryMicroservices` branch * The only test broken by this is the `SSDeepIngestQueryTest`, so `@Ignore`-ing for now until that test can be fixed by me. Co-authored-by: Whitney O'Meara <jwomeara@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for c046a45 - Browse repository at this point
Copy the full SHA c046a45View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6be206a - Browse repository at this point
Copy the full SHA 6be206aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 81d1cb3 - Browse repository at this point
Copy the full SHA 81d1cb3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 13ef78b - Browse repository at this point
Copy the full SHA 13ef78bView commit details -
Configuration menu - View commit details
-
Copy full SHA for fad9276 - Browse repository at this point
Copy the full SHA fad9276View commit details -
Configuration menu - View commit details
-
Copy full SHA for 66aa834 - Browse repository at this point
Copy the full SHA 66aa834View commit details -
Configuration menu - View commit details
-
Copy full SHA for c6ab9c7 - Browse repository at this point
Copy the full SHA c6ab9c7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 06b9fe2 - Browse repository at this point
Copy the full SHA 06b9fe2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d46590 - Browse repository at this point
Copy the full SHA 0d46590View commit details -
Configuration menu - View commit details
-
Copy full SHA for e356252 - Browse repository at this point
Copy the full SHA e356252View commit details -
Add junit-bom depedency and use version of junit-bom for explicit jup…
…iter and vintage dependencies
Configuration menu - View commit details
-
Copy full SHA for a29c463 - Browse repository at this point
Copy the full SHA a29c463View commit details -
Configuration menu - View commit details
-
Copy full SHA for ffb87b3 - Browse repository at this point
Copy the full SHA ffb87b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for a801876 - Browse repository at this point
Copy the full SHA a801876View commit details -
Configuration menu - View commit details
-
Copy full SHA for ea86d85 - Browse repository at this point
Copy the full SHA ea86d85View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2360406 - Browse repository at this point
Copy the full SHA 2360406View commit details -
add junit-jupiter-engine to common-test
add junit-jupiter-engine to warehouse-common remove jupiter-api from warehouse pom restore jupitier-api to ws-client pom
Configuration menu - View commit details
-
Copy full SHA for 7d497f1 - Browse repository at this point
Copy the full SHA 7d497f1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 684cab9 - Browse repository at this point
Copy the full SHA 684cab9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2c62646 - Browse repository at this point
Copy the full SHA 2c62646View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b9c1bf - Browse repository at this point
Copy the full SHA 5b9c1bfView commit details -
Configuration menu - View commit details
-
Copy full SHA for e77f54c - Browse repository at this point
Copy the full SHA e77f54cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 36956c6 - Browse repository at this point
Copy the full SHA 36956c6View commit details -
remove duplicate junit-jupiter-engine dependency from warehouse-commo…
…n pom, add jupiter-engine and vintage-engine to failsafe plugins in webservices and warehouse pom
Configuration menu - View commit details
-
Copy full SHA for 7e356d1 - Browse repository at this point
Copy the full SHA 7e356d1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 97c7b60 - Browse repository at this point
Copy the full SHA 97c7b60View commit details -
re #2270: Iimplementation of a record filter for the ingest processing (
#2271) * Created an event predicate for discarding events during ingest processing * Created a discard interval and future discard interval predicates * Updated tests to test hit and miss on the interval predicates * Add default for DISCARD_FUTURE_INTERVAL event Co-authored-by: foster33 <lukefos62@gmail.com> Co-authored-by: Keith Ratcliffe <ratcliffe.keith@gmail.com> Co-authored-by: hlgp <hlgp@users.noreply.github.com> Co-authored-by: palindrome <31748527+hlgp@users.noreply.github.com> Co-authored-by: matthpeterson <matt.peterson@tibertechnologies.com>
Configuration menu - View commit details
-
Copy full SHA for 6470036 - Browse repository at this point
Copy the full SHA 6470036View commit details -
Configuration menu - View commit details
-
Copy full SHA for dcb6a28 - Browse repository at this point
Copy the full SHA dcb6a28View commit details -
Make the configcheck module optional as it is a separate utility not (#…
…2283) required in the main datawave builds
Configuration menu - View commit details
-
Copy full SHA for cbbfa38 - Browse repository at this point
Copy the full SHA cbbfa38View commit details -
Fields with a state of DROP on normalization failure are not written …
…to the index but are still preserved in the event.
Configuration menu - View commit details
-
Copy full SHA for 81a66c8 - Browse repository at this point
Copy the full SHA 81a66c8View commit details -
Merge branch 'integration' into 2266-drop-state-for-normalization-fai…
…lure-incorrectly-removes-the-field-from-the-event-as-well
Configuration menu - View commit details
-
Copy full SHA for 7ae8d9c - Browse repository at this point
Copy the full SHA 7ae8d9cView commit details
Commits on Feb 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for abf29bd - Browse repository at this point
Copy the full SHA abf29bdView commit details -
Configuration menu - View commit details
-
Copy full SHA for caa0632 - Browse repository at this point
Copy the full SHA caa0632View commit details -
Merge remote-tracking branch 'origin/2266-drop-state-for-normalizatio…
…n-failure-incorrectly-removes-the-field-from-the-event-as-well' into 2266-drop-state-for-normalization-failure-incorrectly-removes-the-field-from-the-event-as-well
Configuration menu - View commit details
-
Copy full SHA for 8499d97 - Browse repository at this point
Copy the full SHA 8499d97View commit details -
Configuration menu - View commit details
-
Copy full SHA for 41ef8f3 - Browse repository at this point
Copy the full SHA 41ef8f3View commit details