{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":399527623,"defaultBranch":"main","name":"data-prepper","ownerLogin":"dlvenable","currentUserCanPush":false,"isFork":true,"isEmpty":false,"createdAt":"2021-08-24T16:05:22.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/293424?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1721231366.0","currentOid":""},"activityList":{"items":[{"before":null,"after":"ca0bb431b730c49dc9c4dd559d7ee1ed0fb42640","ref":"refs/heads/histogram-startTime-bug","pushedAt":"2024-07-17T15:49:26.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Fixes a bug with HistogramAggregateAction where the startTime may be incorrect. This was discovered by a flaky test.\n\nThe HistogramAggregateAction was incorrectly using the current time as the start time for the aggregation when creating the group. The very first event's time was overridden by the current system time. If this event had the earliest time, then the overall histogram would never get the correct start time. This is fixed by removing an errant line. I also added a unit test to directly test this failure scenario.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Fixes a bug with HistogramAggregateAction where the startTime may be …"}},{"before":null,"after":"d2c513847a5799954ce8ae3f07be9bf885ea64e3","ref":"refs/heads/4575-sqs-shutdown","pushedAt":"2024-07-17T13:39:58.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Improve the SQS shutdown process such that it does not prevent the pipeline from shutting down and no longer results in failures. Resolves #4575\n\nThe previous approach to shutting down the SQS thread closed the SqsClient. However, with acknowledgments enabled, asynchronous callbacks would result in further attempts to either ChangeVisibilityTimeout or DeleteMessages. These were failing because the client was closed. Also, the threads would remain and prevent Data Prepper from correctly shutting down. With this change, we correctly stop each processing thread. Then we close the client. Additionally, the SqsWorker now checks that it is not stopped before attempting to change the message visibility or delete messages.\n\nAdditionally, I found some missing test cases. Also, modifying this code and especially unit testing it is becoming more difficult, so I performed some refactoring to move message parsing out of the SqsWorker.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Improve the SQS shutdown process such that it does not prevent the pi…"}},{"before":null,"after":"f926f5a58bfd16b7ca9ce4a0b855a4008e978f5d","ref":"refs/heads/log-generator-source-flaky","pushedAt":"2024-07-16T22:06:23.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Using Awaitility and mocks in the LogGeneratorSourceTest to attempt to improve reliability.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Using Awaitility and mocks in the LogGeneratorSourceTest to attempt t…"}},{"before":null,"after":"9440324c2817cebd79c7012a4109637341234577","ref":"refs/heads/4737-hold_forever-sink","pushedAt":"2024-07-16T21:30:22.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Adds the hold_forever sink which will not release EventHandles. Resolves #4737.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Adds the hold_forever sink which will not release EventHandles. Resolves"}},{"before":null,"after":"350aaa61a36921203ebab086a90eeca47eb98a75","ref":"refs/heads/jackson-2.17.2","pushedAt":"2024-07-16T20:33:49.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Updates Jackson to 2.17.2. Related to #4729.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Updates Jackson to 2.17.2. Related to opensearch-project#4729."}},{"before":null,"after":"d67a2a78923d4424baa4158fa266a258db5251f1","ref":"refs/heads/triaging-minor-fixes","pushedAt":"2024-07-16T20:17:07.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Corrects the TRIAGING.md with a video meeting since we currently use Chime.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Corrects the TRIAGING.md with a video meeting since we currently use …"}},{"before":"5b7880c55f238e9ed4a1e39e553e18a6785972e1","after":null,"ref":"refs/heads/gradle-8.8-jvm-launcher","pushedAt":"2024-07-15T21:32:17.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"}},{"before":"c101b275849157b9c3594c568e4d118b8d2b2c21","after":null,"ref":"refs/heads/cves-python","pushedAt":"2024-07-15T21:31:47.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"}},{"before":null,"after":"7be2853ad37a5933f3df84704f2607551d00f670","ref":"refs/heads/poc-variable-expansion-prefix","pushedAt":"2024-07-15T21:23:48.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Initial POC for a way to improve logging for variable expansion prefixes.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Initial POC for a way to improve logging for variable expansion prefi…"}},{"before":"1ea308bfde80215231942b91f47eecbc7b5a0cfa","after":"c09a8ee9dd43ab0c0f23ec384640122c265c6def","ref":"refs/heads/main","pushedAt":"2024-07-15T20:39:20.000Z","pushType":"push","commitsCount":5,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Updating the Python dependencies to resolve CVEs. Resolves #4715, #4713, 4714. (#4733)\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Updating the Python dependencies to resolve CVEs. Resolves opensearch…"}},{"before":"8a1a41626b59b45debd77e7acecf2e6b8dec7c29","after":"1ea308bfde80215231942b91f47eecbc7b5a0cfa","ref":"refs/heads/main","pushedAt":"2024-07-15T14:44:57.000Z","pushType":"push","commitsCount":10,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"MAINT: backfill doc into json property for trim_string (#4728)\n\n* MAINT: backfill doc into json property for trim_string\r\n\r\nSigned-off-by: George Chen ","shortMessageHtmlLink":"MAINT: backfill doc into json property for trim_string (opensearch-pr…"}},{"before":null,"after":"c101b275849157b9c3594c568e4d118b8d2b2c21","ref":"refs/heads/cves-python","pushedAt":"2024-07-12T17:22:04.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Updating the Python dependencies to resolve CVEs. Resolves #4715, #4713, 4714.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Updating the Python dependencies to resolve CVEs. Resolves opensearch…"}},{"before":"b2710a98b4f09b81f80e3f049659308d0b608632","after":null,"ref":"refs/heads/zookeeper-removal","pushedAt":"2024-07-12T14:18:55.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"}},{"before":"3a96584c8fa3fc5d1047fb856795c3125e0253bb","after":null,"ref":"refs/heads/mockito-5","pushedAt":"2024-07-12T14:18:33.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"}},{"before":"7570ebb064e738edba4b57da1480dbcd3fb5ba59","after":null,"ref":"refs/heads/lambda-sink-flaky","pushedAt":"2024-07-12T14:18:25.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"}},{"before":"b1cf22ac1a57d1d6752636030a12b3c24347a7f0","after":"5b7880c55f238e9ed4a1e39e553e18a6785972e1","ref":"refs/heads/gradle-8.8-jvm-launcher","pushedAt":"2024-07-12T14:15:02.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Fixed a randomly failing test in BlockingBufferTests where a value 0 caused an IllegalArgumentException.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Fixed a randomly failing test in BlockingBufferTests where a value 0 …"}},{"before":"7337a21c1a02a954e84484cf20194adb952f0732","after":"b1cf22ac1a57d1d6752636030a12b3c24347a7f0","ref":"refs/heads/gradle-8.8-jvm-launcher","pushedAt":"2024-07-12T00:27:09.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Use only microsecond precision time when comparing the times in the event_json codec. These tests are failing now on Java 17 and 21 with precision errors.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Use only microsecond precision time when comparing the times in the e…"}},{"before":"05e660404354e3853dd185da4d4fc448b902de3a","after":"7337a21c1a02a954e84484cf20194adb952f0732","ref":"refs/heads/gradle-8.8-jvm-launcher","pushedAt":"2024-07-11T23:05:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Remove the log4j-jpl logger because now in Java 17 and 21 it writes to stdout.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Remove the log4j-jpl logger because now in Java 17 and 21 it writes t…"}},{"before":"2ded41ad8609cd28b819ae49b063817c5509c06a","after":"05e660404354e3853dd185da4d4fc448b902de3a","ref":"refs/heads/gradle-8.8-jvm-launcher","pushedAt":"2024-07-11T23:01:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Remove a Gradle configuration which is causing test logging in Gradle's stdout. This is too much noise.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Remove a Gradle configuration which is causing test logging in Gradle…"}},{"before":"9a48186e63f6b9592891911bd540785768107ec3","after":"2ded41ad8609cd28b819ae49b063817c5509c06a","ref":"refs/heads/gradle-8.8-jvm-launcher","pushedAt":"2024-07-11T18:51:28.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Fix Java 21 support in the AbstractSink by removing usage of Thread::stop which now always throws an UnsupportedOperationException.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Fix Java 21 support in the AbstractSink by removing usage of Thread::…"}},{"before":"253e59245fd9c39c959c1c8caaeff1b226a5a0ab","after":"8a1a41626b59b45debd77e7acecf2e6b8dec7c29","ref":"refs/heads/main","pushedAt":"2024-07-11T18:18:47.000Z","pushType":"push","commitsCount":6,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Mockito 5 (#4712)\n\nMockito 5\r\n\r\n* Synchronize the MetricsTestUtil methods to avoid test failures.\r\n* Create a copy of the collections to remove in MetricsTestUtil.\r\n* Updated two tests to JUnit 5 and to use mocks instead of actual metrics. Updates to MetricsTestUtil to provide clarity on NPEs.\r\n\r\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Mockito 5 (opensearch-project#4712)"}},{"before":null,"after":"9a48186e63f6b9592891911bd540785768107ec3","ref":"refs/heads/gradle-8.8-jvm-launcher","pushedAt":"2024-07-11T14:59:43.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Run tests on the current JVM rather than always using Java 11 for the tests. This fixes a problem with our current GitHub tests where we are running against only Java 11 even though we want to run against different Java versions (11, 17, 21). Updates the Gradle version to 8.8.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Run tests on the current JVM rather than always using Java 11 for the…"}},{"before":null,"after":"7570ebb064e738edba4b57da1480dbcd3fb5ba59","ref":"refs/heads/lambda-sink-flaky","pushedAt":"2024-07-10T22:26:34.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Updates to the AWS Lambda Sink tests to fix a flaky test. Also adds SLF4J logging for these tests.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Updates to the AWS Lambda Sink tests to fix a flaky test. Also adds S…"}},{"before":"77dff3d08f67315e3dccbc0915ecaa3b5a389297","after":"3a96584c8fa3fc5d1047fb856795c3125e0253bb","ref":"refs/heads/mockito-5","pushedAt":"2024-07-09T20:56:25.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Updated two tests to JUnit 5 and to use mocks instead of actual metrics. Updates to MetricsTestUtil to provide clarity on NPEs.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Updated two tests to JUnit 5 and to use mocks instead of actual metri…"}},{"before":"28c6b5cff03312ea18f2257134cbd39ef0ec1fd7","after":"77dff3d08f67315e3dccbc0915ecaa3b5a389297","ref":"refs/heads/mockito-5","pushedAt":"2024-07-09T19:17:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Create a copy of the collections to remove in MetricsTestUtil.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Create a copy of the collections to remove in MetricsTestUtil."}},{"before":"5023df5bc7de5ed243b33cbe6667a9bfd3a7eeb3","after":"28c6b5cff03312ea18f2257134cbd39ef0ec1fd7","ref":"refs/heads/mockito-5","pushedAt":"2024-07-09T18:27:39.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Synchronize the MetricsTestUtil methods to avoid test failures.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Synchronize the MetricsTestUtil methods to avoid test failures."}},{"before":null,"after":"5023df5bc7de5ed243b33cbe6667a9bfd3a7eeb3","ref":"refs/heads/mockito-5","pushedAt":"2024-07-08T23:42:48.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Mockito 5\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Mockito 5"}},{"before":"39c74dba4398406b814f2f20df5d97fe45aabd08","after":"253e59245fd9c39c959c1c8caaeff1b226a5a0ab","ref":"refs/heads/main","pushedAt":"2024-07-08T22:18:35.000Z","pushType":"push","commitsCount":4,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Introducing delete input configuration option for some parsers (#4702)\n\n* Introduced delete_source configuration option to give flexibility for the user to drop the raw source record if they don't want to propagate it downstream\r\n\r\nSigned-off-by: Santhosh Gandhe <1909520+san81@users.noreply.github.com>\r\n\r\n* addressing review comments\r\n\r\nSigned-off-by: Santhosh Gandhe <1909520+san81@users.noreply.github.com>\r\n\r\n* added delete_source option to other similar parser classes\r\n\r\nSigned-off-by: Santhosh Gandhe <1909520+san81@users.noreply.github.com>\r\n\r\n---------\r\n\r\nSigned-off-by: Santhosh Gandhe <1909520+san81@users.noreply.github.com>","shortMessageHtmlLink":"Introducing delete input configuration option for some parsers (opens…"}},{"before":"06c74f6c7d24b00e5db926afd911e4c818e9c48a","after":null,"ref":"refs/heads/code-of-conduct-update","pushedAt":"2024-07-03T21:46:03.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"}},{"before":null,"after":"b2710a98b4f09b81f80e3f049659308d0b608632","ref":"refs/heads/zookeeper-removal","pushedAt":"2024-07-03T20:41:57.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dlvenable","name":"David Venable","path":"/dlvenable","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/293424?s=80&v=4"},"commit":{"message":"Removes Zookeeper from Data Prepper. This was a transitive dependency from Hadoop.\n\nSigned-off-by: David Venable ","shortMessageHtmlLink":"Removes Zookeeper from Data Prepper. This was a transitive dependency…"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEggWsoQA","startCursor":null,"endCursor":null}},"title":"Activity · dlvenable/data-prepper"}