ADX-252 Local kubernetes provider #23153
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Co-authored-by: pducolin <45568537+pducolin@users.noreply.github.com>
…dog-agent into kfairise/kindvm-provisioner
KevinFairise2
changed the title
KevinFairise2
added
changelog/no-changelog
[deprecated] team/agent-platform
qa/no-code-change
KevinFairise2
changed the title
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #23153 +/- ##
===========================================
- Coverage 45.02% 26.17% -18.85%
===========================================
Files 2325 13 -2312
Lines 267460 489 -266971
===========================================
- Hits 120423 128 -120295
+ Misses 137460 343 -137117
+ Partials 9577 18 -9559
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
KevinFairise2
force-pushed
the
kfairise/local-kind
branch
from
5534fb3
to
05b433c
Compare
kangyili
approved these changes
May 24, 2024
|
/merge |
|
🚂 MergeQueue Pull request added to the queue. There are 2 builds ahead! (estimated merge in less than 1h) Use |
|
/merge |
|
🚂 MergeQueue Pull request added to the queue. There are 3 builds ahead! (estimated merge in less than 2h) Use |
akarpz
added a commit
that referenced
this pull request
May 29, 2024
commit 7ff60b0875bba5ce9e3a835f00b0172646612795
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:29:29 2024 -0400
reorganize tracer code
commit bb505ec443134e3280adfd754c1bbb8ced0524d4
Merge: ad9cc589ac 2948aa9015
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:16:36 2024 -0400
Merge branch 'main' into akarpowich/perf_test_failed_conns
commit ad9cc589ac8b3e349d566390789bdb167848993a
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:14:04 2024 -0400
reset file to origin
commit 4ae857f43f6894f69a7504e9b5104f7702019f42
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:12:48 2024 -0400
fix again
commit 2a6aaffe736d3eae587b233694b26c081fe3bce5
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:09:42 2024 -0400
reset random go mod changes
commit fb9c7f1f14fd9acef65d8de6b511aff6162e3528
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:02:36 2024 -0400
clean up tests
commit f1704601b6e00483511370b3549fdc99b05c1944
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 17:56:57 2024 -0400
fix race condition
commit 2948aa9015c2098bf1d0a972b9d729c0d9da2f86
Author: Stanley Liu <stanley.liu@datadoghq.com>
Date: Wed May 29 17:03:31 2024 -0400
Implement metrics for infraattributesprocessor (#25711)
* Initial version
* Rename tagenrichmentprocessor to infraattributesprocessor
* Fix merge
* Rename config_logs_strict
* Add tagger component
* Fix tests and lint
* tidy
* Refactor to tag multiple entities
* Rename
* Temp update mapping go attributes
* tidy
* Update attributes mapping
* Fix resource metrics loop, add more tests
* Update attributes to v0.16.1
* Update attributes to v0.16.1
* Add container_image_metadata
* generate licenses
* Rename
* Fix merge conflicts
* generate deps
commit 22e4ec14be7ed7f99f7bcf0ea44e983d5e9c792d
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:55:04 2024 -0400
increment telemetry
commit 09badae964ebd13ea68d1c86ecca169fc26edb0c
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:42:03 2024 -0400
telemetry for failure matches
commit 3c28e38bf37f143bc25296e7c7bae2f76c8af592
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:33:27 2024 -0400
rename failure buffer
commit c7efe438c39710cd1698e3408279107916744d26
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Wed May 29 19:05:26 2024 +0200
[kubernetes/apiserver] Initialize metadata controller properly (#26070)
commit 2844cfb492ff89e404e0b0cc052b07807660f483
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Wed May 29 18:24:31 2024 +0200
[CWS] windows multi approvers (#26067)
* ensure old approvers are not kept after policy reloading
* add new approver capabilities for other FRIM event types
* ensure we take into account all event basenames for approvers
* ensure approver are able to skip event types with no active rule
* add test for approver mechanism
* disable approvers in `TestETWFileNotifications`
commit 3c1ea9978176c16e6303a5702c14f9c4602cdb08
Author: Sylvain Afchain <safchain@gmail.com>
Date: Wed May 29 18:18:10 2024 +0200
[CWS] add hash action (#25870)
commit d1233c56a45a2f4f069360d9a2e424e5c56fb302
Author: Dustin Long <me@dustmop.io>
Date: Wed May 29 12:01:45 2024 -0400
Move alternative otel collector implementations into new component layout (#25836)
Co-authored-by: GustavoCaso <gustavo.caso@datadoghq.com>
commit 26ab9b5f65ca31dde78eb6684fb378b29dc7e334
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 11:58:22 2024 -0400
remove old evict logic and add new test
commit f2791932596d085ac42d6273a1f8fbf65ccc6086
Author: Bryce Kahle <bryce.kahle@datadoghq.com>
Date: Wed May 29 08:42:11 2024 -0700
replace slashes in gitlab section id (#26034)
Fixes section id for junit file uploads
commit 46b14bcd5a74badd542392f74a3c98dc093a3ad9
Author: Kacper <89013263+kacper-murzyn@users.noreply.github.com>
Date: Wed May 29 17:41:56 2024 +0200
last_stable updated to 7.54.0 (#26068)
* last_stable updated to 7.54.0
* Update release.json
commit e9713c0a90879a4cd2d09db777b0e9c10998ca90
Author: Paul Laffon <paul.laffon@datadoghq.com>
Date: Wed May 29 17:41:46 2024 +0200
[DJM-251] Add new parameter djm_config.enabled to enable Data Jobs Monitoring (#25846)
* Add new parameter djm_config.enabled to enable Data Jobs Monitoring
* rst uses double backticks
Co-authored-by: Vickenty Fesunov <vickenty@users.noreply.github.com>
---------
Co-authored-by: Vickenty Fesunov <vickenty@users.noreply.github.com>
commit ebeee88c4ff5fa92d2bdf4207ea499efa40641f5
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 14:43:02 2024 +0000
Build the docs when the workflow is modified (#26050)
commit 3cbeb226ec15e661902487b0b2ea9fe79c55ae1f
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Wed May 29 16:41:32 2024 +0200
avoid systemd conflicts (#25944)
Co-authored-by: arbll <arthur.bellal@datadoghq.com>
commit 38fc5b1807b62b15e0017ad452f9f25b14e3983b
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Wed May 29 16:22:44 2024 +0200
[CWS] replace tracepoint hook with kprobes for mmap event (#26015)
commit 553bb7f6513d682442f0b692ab6a2e6e810e91b3
Author: agent-platform-auto-pr[bot] <153269286+agent-platform-auto-pr[bot]@users.noreply.github.com>
Date: Wed May 29 14:16:35 2024 +0000
Changelog updates for 7.54.0 release (#26043) (#26064)
Co-authored-by: kacper-murzyn <89013263+kacper-murzyn@users.noreply.github.com>
commit 4302a8a569e7d4b5b26e0b55546951eaecc07ca7
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 16:04:15 2024 +0200
usm: kafka: Support fetch v12 (#25812)
* usm: kafka: Use unsigned loop counter
This allows some compiler optimzations and avoids a "looks like the BPF
stack limit of 512 bytes is exceeded" error when more code is added to
the classification functions.
* usm: kafka: test: Make unused fields non-zero
Set some unparsed fields in the packets to non-zero values for easier
debugging when packet parsing goes wrong and reads from wrong offsets.
* usm: kafka: test: Pass FetchRequest to buildMessages
To allow the request to be customized per test.
* usm: kafka: test: Pass in API version
Pass in the API version as a parameter to the raw tests, so that
different API versions can be tested.
* usm: kafka: test: Test different versions in raw test
Test some versions which have specific conditions.
* usm: kafka: test: Allow topic to be customized
* usm: kafka: test: Add test for large topic name
* usm: kafka: test: Add test for many topics
* usm: kafka: test: Add raw test for many partitions
* usm: kafka: test: Handle flexible header
* usm: kafka: Pass in version number to parsing tests
* usm: kafka: Support Fetch v12
Add support for v12 of the Fetch API. The main change is the use of
varints and addition of tagged values. While that change itself is
fairly straightforward, the need to parse varints caused the programs to
exceed the instruction size supported by older kernels (4096
instructions), so the programs had to be split into separate programs
for pre-v12 and v12, as well as to do the parsing in two steps in
separate programs: a first step to parse the locations of the record
batches arrays, and a second step to parse the list of found locations.
The split between pre-v12 and v12 is simple and handled by informing the
compiler about the bounds of the versions, and then depending on it to
eliminate the unused branches. The split of the parsing into two steps
requires code to handle the transition between the two steps correctly.
Also mainly due to code size restrictions on older kernels (even after
the above optimizations), the following limitations are currently
present:
- A maximum of four bytes of varints are supported
- The tagged values fields are always assumed to be empty
* usm: kafka: test: Check for errors from LookupMaxKeyVersion
* usm: kafka: Remove leftover comment
* usm: kafka: remove unused cgo type
* usm: kafka: Remove passing of level
* usm: kafka: Add comment to parse_varint_u16()
* usm: kafka: Fix u16 varint check
The second byte's MSB should only be checked if the first byte has the
MSB set, since otherwise the second byte is unrelated to the varint.
* usm: kafka: Rename topic_name_size_tmp to topic_name_size_raw
* usm: kafka: Handle splits in header
We were previously not handling this mainly due to code size
restrictions, but with the program split this can be supported.
* usm: kafka: Make read_with_remainder generic
Remove the copy/pasted code and make read_with_remainder() generic with
the use of a function pointer. The function pointer will be folded at
compile time by the compiler. The instruction count is unchanged before
and after this patch.
* usm: kafka: Remove unused nonrestartable functions
* usm: kafka: Remove _restartable suffix
Now that we only have restartable readers, remove the redundant suffix.
* usm: kafka: Validate zero tagged fields when possible
* usm: kafka: Remove __read_varint indirection
* usm: kafka: Allow varint bytes to be customized per location
To reduce code size by limiting iterations wherever it makes sense.
* usm: kafka: Customize varint bytes per location
* usm: kafka: Clarify N-1 operation in varints
* usm: kafka: Rename tmp2 variable
* usm: kafka: Add comment about flexible
* usm: kafka: Skip varint number of topics
* usm: kafka: Check zero tagged fields in request
* usm: kafka: Use 64 bits for varint results
* usm: kafka: Add comment about uninitialized variable
* usm: kafka: test: Fix teardown
The telemetry test assigns to the client in the context multiple times,
so some of the clients are never torn down, leading to issues with tests
run later (such as for example the still-running clients attempting to
connect to the raw server while the raw tests are executed afterward).
commit 66dfa7ceff7d8f465dec4590eb2a1dfec85c3022
Author: jedupau <72938258+jedupau@users.noreply.github.com>
Date: Wed May 29 16:02:53 2024 +0200
use the cache container (#26066)
commit d25878205e9203bb5a7ec86f70a21177f0bdba9c
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:59:50 2024 +0200
[CONTINT-3702] fix(sbom): Fix mount path retrieval from overlayfs (#25886)
* Get mounts from overlayfs snapshotter, similarly as what is done in MountImage
* prefer opts.UseMount, remove unused NoCache opts, use cache only when scanning images
* move scan from snapshotter out of the default function
commit 3c91826bbbd4f254365024eb5dc60f82753efca6
Author: Yang Song <songy23@users.noreply.github.com>
Date: Wed May 29 09:35:53 2024 -0400
[OTEL-1720] Add an API in pkg/trace/stats that converts eligible OTLP spans to the input to APM stats concentrator. (#23503)
commit 6db250af895cb5f30bcee6d444ca3e65e553f589
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:35:45 2024 +0200
update gomod (#26065)
commit de91510cb89337a9c649a2b082e585dbdc7c2add
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:35:39 2024 +0200
[CONTINT-4105] Support arbitrary container-ids to collect container metrics (#25515)
* Collect cgroup path in workloadmeta
* Implement the container filter
* Update TestDump
* release note
* fix dogstatsd test using a mock workloadmeta with no implemented methods
* support the case of an empty cgroup path
* Update releasenotes/notes/support-arbitrary-container-id-cc0efdf7c156b7ad.yaml
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
* mention that the path is relative
* Remove no-lint comments
* remove the unsubscribe
* Move trie to its own package
* Add code comments to explain about suffix matching and make sure we only populate the Trie if the regex does not match
* add test cases for cgroupfs / systemd
* update protobuf
---------
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
commit 91aa08c0f34114f4ca3794ae7e4898f8c37a5a25
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Wed May 29 15:35:33 2024 +0200
use a dedicated variable to force a lower compression level (#26044)
* use a dedicated variable to force a lower compression level
Using the maximal compression level on armhf jobs will attempt to
allocate more than 32bits binaries can address.
* use a more flexible approach for forcing compression level
* rename variable
* fix method name
commit c0bcfd8169843c3b35d3ce83cc34716b4e50d0bd
Author: Stephen Wakely <fungus.humungus@gmail.com>
Date: Wed May 29 14:27:50 2024 +0100
Add zstd compression level option (#25261)
* Add zstd compression level option.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Set level on stream compression.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Log on zstd
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove printf
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove spurious import.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Add unit test for compression level.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove zstd dependency from config and rename option to include zstd
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Linter errors
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Revert version change for otel.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
---------
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
commit e79613843b013779fb6c7740a2dc32f9ed433d5c
Author: Ofek Lev <ofekmeister@gmail.com>
Date: Wed May 29 08:31:09 2024 -0400
Remove outdated documentation (#26037)
commit 40f9f7916c78dd13705e4248276a5779d8ec8ab6
Author: Julien Lebot <julien.lebot@datadoghq.com>
Date: Wed May 29 14:26:51 2024 +0200
[Fleet Automation] Add support for Windows in fleet installer (#25186)
* Try with symlinks on Windows
* First pass
* Revert to using UNIX sockets on Windows
* Allow passing parameters to install command
* fix bootstrapper compilation issue
* Fix windows installer error handling
* Use HTTP instead of UNIX sockets
* Revert "Use HTTP instead of UNIX sockets"
This reverts commit 1ee4e46630390f7236b4c9173a823199045acc89.
* Refactor installer paths
* Generate the OCI package
* Only package the Agent 7 in OCI
* Generate package in pipeline
* Fix linux compilation
* progress
* Fix merge conflicts
* Fix powershell script to generate OCI packages
* Fix source directory
* Fix deploy
* Fix deploy
* remove helper
* Invert calls and add return error to function
* Linter
* Update comments
* Add missing argument
* Only include windows registry on windows
* Add missing error
* Add missing arg
* Fix linux compilation errors
* Fix last error
* Fix linux unit tests
* Address review comments
* Update pkg/fleet/installer/installer.go
Co-authored-by: Arthur Bellal <arthur.bellal@datadoghq.com>
---------
Co-authored-by: Arthur Bellal <arthur.bellal@datadoghq.com>
commit 3a58984242dec80a5a7aa89cf763776fa78ee97a
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Wed May 29 12:42:27 2024 +0200
feat(releasing): Create release candidate on automatic schedules (#26001)
commit d4705fa89155d6c304c257c6903c8e2835bd973f
Author: Mister Yo (Maxime Riaud) <65339037+misteriaud@users.noreply.github.com>
Date: Wed May 29 12:24:23 2024 +0200
[ASCII-1393] improve GUI auth flow (#24800)
* replace gui security mechanism with authToken->accessToken JWT mechanism
* typo sessionID
* fix lint issue
* rename authToken to loginToken and create dedicated endpoint
* use single-use intentToken and homemade hmac signed accessToken
* update accessToken payload by adding expirationTime
* replace bad external package
* add token prefix, update gorilla http router
* update systray launch-gui function
* add GUI_session_expiration param
* add release note
* use nil ApiEndpointProvider and update some comments/docs
commit c435f967d9d52981a9edbfc86a1c1fd24f67f84a
Author: Paul <paul.coignet@datadoghq.com>
Date: Wed May 29 11:49:34 2024 +0200
[FA] Add default log source to file logs (#25816)
* Add log source
* Add integration name
* Include container environment
* Address revies
* Address review
* Add commnet
commit 50183e00416eab4be894d2533ef48201ac21e54a
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 11:45:08 2024 +0200
usm: kafka: test: Correct assertion message (#26049)
HTTP and Kafka were mixed up in the message.
commit b9e111e5c83a4fe5db20be024705ee4d8c3f17ae
Author: Vickenty Fesunov <vickenty@users.noreply.github.com>
Date: Wed May 29 11:44:58 2024 +0200
Fix time sampler tests (#25977)
Run tests with the intended tags store settings rather than always
using no-op store.
commit e1fc869376d3eb0c366883dd2284f695c584796c
Author: val06 <valeri.pliskin@datadoghq.com>
Date: Wed May 29 10:42:38 2024 +0100
small typo fix (#26055)
commit 843506e44554322e5fdf72bd84da77b7c5852530
Author: Célian Raimbault <161456554+CelianR@users.noreply.github.com>
Date: Wed May 29 11:42:21 2024 +0200
Improve agent-platform-ops alerts (#25882)
* tmp
* [rfc-team-notifications-1] Reworked logic
* [rfc-team-notifications-1] Initial PR info
* Implemented send_notification with new method
* wip
* Fixed more tests
* Fixed more tests
* Fixed all tests
* s3: Updated file name and bucket
* [team-notifications-1] Added test script
* [team-notifications-1] Updated notif
* [team-notifications-1] Fixed lint
* [team-notifications-1] Fixed notify job executions json
* [team-notifications-1] Test
* [team-notifications-1] Test
* [team-notifications-1] Test
* [team-notifications-1] Removed tests, cleaned code
* [team-notifications-1] Removed tests, cleaned code
* [rfc-team-notifications-1] Applied suggestions
* [rfc-team-notifications-1] Added commit sha to job executions
* [rfc-team-notifications] Applied suggestions
* [rfc-team-notifications] Applied suggestions
* [rfc-team-notifications] Applied suggestions
commit 34c6de12a0623c4a4f9bca542f56b96fed22c3f3
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Wed May 29 11:20:20 2024 +0200
[workloadmeta/collectors/remote] Handle unsupported kinds (#26052)
commit c4dd4acce76abe7af4e1703345fbdaba35e22bf2
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Wed May 29 11:41:06 2024 +0300
[USM] Support postgres alter operation (#25931)
* support alter operation
* support marshal for alter
* added test to TestFormatPostgresStats for alter
* update to main and fix test
commit 7e1459b9dc235abfdff10ebc8bf4455982cb16f6
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 10:27:19 2024 +0200
usm: kafka: test: Fix teardown (#26029)
The telemetry test assigns to the client in the context multiple times,
so some of the clients are never torn down, leading to issues with tests
run later (such as for example the still-running clients attempting to
connect to the raw server while the raw tests are executed afterward).
commit 966f573bb70a5ba9a080b8f18e51208e50d918bc
Author: Kevin Fairise <132568982+KevinFairise2@users.noreply.github.com>
Date: Wed May 29 10:15:51 2024 +0200
ADX-252 Local kubernetes provider (#23153)
* Create kindvm provider and kindvm host
* Create kindvm scenario test
* Use test-infra commit
* Update test/new-e2e/examples/kindvm_test.go
Co-authored-by: pducolin <45568537+pducolin@users.noreply.github.com>
* Address suggestions
* WIP
* Address suggestions
* Rename KubernetesHost to Kubernetes
* Tidy
* Update test
* Rename kind test
* Fix linter
* Update go + runner image
* Tidy
* Create local kind provisioner
* Bump deps
* Update init of fakeintake to use clientURL if provided
* Update local kind provider to deploy a local fakeintake
* Exclude fakeintake container from log collection
* Remove useless commented code
* Remove newline
* Remove useless options
* Update test-infra
* Tidy
* Remove deleted field
* WIP
* Create example and last fixes
* Fix K8SApp signature change
* Fix release name change
* Fix release name change
* Update test-infra version
* Fix test-infra bump issues
* Tidy
* Pass provider in eks provider
* Enable autoscaling
* Bump test-infra to fix quote
* Fix orchestrator test
* Fix orchestrator test
* Final bump of test-infra
---------
Co-authored-by: pducolin <45568537+pducolin@users.noreply.github.com>
commit 8bce778f1c2597ad724420c5d76fb8ecad4714fe
Author: Andrea Marziali <marziali.andrea@gmail.com>
Date: Wed May 29 10:15:46 2024 +0200
[service discovery] fix minor python module use cases (#26026)
Co-authored-by: jonbodner <jon.bodner@datadoghq.com>
commit a9f51824ae913c875c8c39f187aa91b124b99de2
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Wed May 29 10:15:41 2024 +0200
remove deadlock in dca client (#26038)
commit 6a5c08afbd6c50b2b622b82cca59b3c7d3fd22dd
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 07:39:52 2024 +0000
Rename `devagent` to `deva` (#26042)
commit ac86be5ddd507b383224101b6736c08da8e72678
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Wed May 29 09:23:20 2024 +0200
remove env (#26041)
commit 4a49dae97a30986a503a8baabe7fced012c812ea
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 07:04:24 2024 +0000
Run the tidy hook only on modified packages (#26008)
* Run the tidy hook only on modified packages
* address
* address
* missing tidy_all
commit f125445e8e75058fbf588dedecec00b5a1c11466
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Wed May 29 08:05:33 2024 +0200
feat(ci): Introduce a new task to guess the owner of a github issue (#25953)
This initial version is just guessing using keywords in the issue
description. This will be enhanced with a call from a ML model. The task
will be called in a github action
commit 168f81555e7c509437092f4b390e8032f9a00c0a
Author: Minyi Zhu <minyi.zhu@datadoghq.com>
Date: Tue May 28 21:11:07 2024 -0400
[CONTP-61] remove global variables in tagger (#25804)
* remove global variables in tagger
* fix unit test
commit 8ddd5ff6a4176fb77c5cc3e460eed5552ce8ac99
Merge: ae32666488 1eb4f52e9f
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 20:24:28 2024 -0400
Merge branch 'main' into akarpowich/perf_test_failed_conns
commit 1eb4f52e9f8215e9e96dc5a6964f001f6cf80029
Author: Keisuke Umegaki <41987730+keisku@users.noreply.github.com>
Date: Wed May 29 07:25:54 2024 +0900
Enable to set the buffering config of Lambda Logs API via env vars (#25923)
* Enable set the buffering config of Lambda Logs API via env vars
* fix envVarToInt
* Update add-lambda-logs-api-buffering-configs-ba8b5ad40eb6a62d.yaml
Co-authored-by: Kari Halsted <12926135+kayayarai@users.noreply.github.com>
---------
Co-authored-by: Kari Halsted <12926135+kayayarai@users.noreply.github.com>
commit 9e8e0c4345c58e7ccd0ac119c66dd43b5be5f97b
Author: Dustin Long <me@dustmop.io>
Date: Tue May 28 17:58:59 2024 -0400
Bump viper version to v1.13.4 (#26017)
* Bump viper to v1.13.4, which includes fix for url keys in maps
* go fmt config_test.go
* Unit test for config, now that viper flakiness is fixed
* Bump viper version in more packages
commit deb1e7c0f2c0111b6f7ec4446d614ef1bb70b293
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 23:48:26 2024 +0300
[USM] Support postgres delete operation (#25930)
Co-authored-by: guyarb <guy20495@gmail.com>
commit 7b264b60b9bcebe163e0055aaeafa45b7143f7e0
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 21:46:25 2024 +0200
Fix gen-config-from-ci-pipeline (#26025)
commit ae32666488f1f4709e6126882d8a232bb9b1ddbf
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 14:58:47 2024 -0400
remove more debug logs
commit ed5e6576112068763605963ecd4187527397da4a
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 20:31:40 2024 +0200
Revert "split dogstatsd build and packaging (#26002)" (#26033)
This reverts commit fddbf0e64d13dcb93889deaead0097402129e72c.
commit 62532f669db6fedc6e01c67ae51535226039afa9
Author: Tal Usvyatsky <18072279+TalUsvyatsky@users.noreply.github.com>
Date: Tue May 28 14:11:35 2024 -0400
reuse DD_ENHANCED_METRICS instead of separate env var (#26023)
commit 49ee3df65fc9a2fe100cb20f56ac511d17c78e68
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 19:39:47 2024 +0200
CI: increase available disk space for windows tests containers (#26027)
commit fddbf0e64d13dcb93889deaead0097402129e72c
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 18:59:08 2024 +0200
split dogstatsd build and packaging (#26002)
* split dogstatsd build and packaging
* remove reference to deleted file
commit ae6a9f20952b2f4ca75a4362f56049db35a652fc
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 12:48:02 2024 -0400
remove debug logs
commit 705d2319ec980ac882423c8ea13f25acf3d5ce10
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Tue May 28 18:46:45 2024 +0200
[CWS] fix imds tests on opensuse kernels (#26019)
* skip imds tests on opensuse
* add missing doc comment
commit 326f455a9ca7d3ebeabc646708d915609106e4c4
Author: Vincent Boulineau <58430298+vboulineau@users.noreply.github.com>
Date: Tue May 28 18:35:04 2024 +0200
Add generation of events on autoscaling actions (#25937)
commit bc760cf313bacc28e2cffc6481558f27bc40ea70
Author: NouemanKHAL <noueman.khalikine@datadoghq.com>
Date: Tue May 28 18:20:31 2024 +0200
Improve log messages of the NTP check (#25705)
* Update cloud provider NTP detection log message and level down to Debug
* Improve log error message failed to get clock offset output format
* add defaultDatadogPool var and improve debug log message to print the default hosts
* Change local defined servers log message level to DEBUG and improve
output format
* add single info log message with the final NTP hosts that will be used by the check
* remove error count
* change cloudproviders log level back to INFO
* reno
commit 67297fa6082a471f2429e4867d4417be62e1dd71
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 18:03:15 2024 +0200
[ASCII-1801] Remove testify from remaining builds (#25956)
* refactor: move MockCheckParams behind test flag to remove imports
* refactor: move NewProcessDataWithMockProbe behind test flag to remove imports
* refactor: move parseRFC3339Time behind test build tag
* refactor: move mockSCM behind test build tag
commit f91613d588cf4c2427b9294603977358765da6fe
Author: Sylvain Afchain <safchain@gmail.com>
Date: Tue May 28 17:59:14 2024 +0200
[CWS] use regular syscall hooks for kill action (#25961)
* [CWS] use regular syscall hookpoint for kill action
* move helper
* add related syscalls
commit b00415145c97082cba12db3c6490d3bb889ed452
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 11:36:57 2024 -0400
increase client expiry for timeout test
commit fa09d0b49f646e198a3b7d71d3270c68f0818acd
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Tue May 28 17:27:43 2024 +0200
fix(inv): ci_lint required additional arguments to detect failures (#26018)
commit 9a410bbe97bfa8c28697b727e876402398d809a4
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 18:27:27 2024 +0300
increase coverage of postgres operations (#25942)
commit bbd248918d9096155f39e4c281328e7f47d9e6df
Author: Guillaume Fournier <36961134+Gui774ume@users.noreply.github.com>
Date: Tue May 28 17:27:14 2024 +0200
[CSM] Don't attach sys_exit tracepoint when not needed (#26012)
commit 3fd699553161ac709cebef56210b1ae07d7d1dcb
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 17:26:18 2024 +0200
split iot-agent build and packaging (#25963)
* split iot agent build and packaging
* generate iot agent init scripts during packaging
* clarify the build/packaging separation
* fix init script generation for suse
* fix duplicated keys
* fix pipeline config on MQ
commit fdf8f9eeb10817c6c576bb0be0327a772f283e44
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 17:24:58 2024 +0200
[EBPF] Improve error control in KMT setup tasks (#26014)
* Improve error control
* Improve error control in compiler start
* Typo fix
commit d6c720a8ec59ceb414930f758d780e4ed9e8d54a
Author: maxime mouial <hush-hush@users.noreply.github.com>
Date: Tue May 28 16:33:55 2024 +0200
Migrate config.Datadog from global to function (#25332)
* Replace 'config.Datadog' global by a function to retrieve the config
The globals 'pkg/config.Datadog' and 'pkg/config/setup.Datadog' have
been replace by a function 'Datadog()' to access the global config.
This is the first step toward preventing a race condition accessing the
config before initialization was possible. This also pave the way toward
a complete migration of pkg/config to component.
Finally, this removes the last blocker for the creation of a dedicated
package for pkg/config/mock.go.
* Remove double import of 'pkg/config" under different names
* Change 'config.Datadog' global to a function
This commit only contains change done by 'uber-go/gopatch' software using the
following patch:
@@
var config identifier
@@
import config "github.com/DataDog/datadog-agent/pkg/config"
-config.Datadog
+config.Datadog()
@@
var config identifier
@@
import config "github.com/DataDog/datadog-agent/pkg/config/setup"
-config.Datadog
+config.Datadog()
* Fix tests following 'Datadog' global update to function
Changing 'pkg/config.Datadog' to a function instead of a copy of
'pkg/config/setup.Datadog' broke some test (we now have a single
global instead of two).
* Adding doc strings
* Update after rebase on main
commit 3e7275789614e8cc4e3f4b89baa44e7ab3023e47
Author: Kevin Maillet <48228696+kevinmaillet@users.noreply.github.com>
Date: Tue May 28 09:46:50 2024 -0400
targets migration (#26010)
commit c438dc206a70a0d75469656ce66076985672e457
Author: Sylvain Afchain <safchain@gmail.com>
Date: Tue May 28 15:03:19 2024 +0200
[CWS] add syscall context (#25768)
* [CWS] add syscall context
* add chdir test
* add chmod syscall context
* make arg a bit more dynamic
* fix linters
* use dedicated fields
* use ref
* use a ring buff approach
* disable on ebpfless
commit b410850b7d9d9ee84936086ffb181fb74a6fc651
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 15:55:09 2024 +0300
fixed usm encoding protocols CODEOWNERS (#25932)
commit be8177a0766a87aca26ab8e319c70db1506f6525
Author: Célian Raimbault <161456554+CelianR@users.noreply.github.com>
Date: Tue May 28 14:37:26 2024 +0200
Add task to create new go module (#25006)
* [go-create-module] Create modules
(wip) Trying linter_windows-x64 with unmodified modules.py file
[go-create-module] Sorted modules
[go-create-module] Sorted modules
* create-module: Added modules.py
* [create-module] Applied suggestions
* [go-create-module] Fixed reviews (windows support)
commit 452cf0353f7e749a8e61101c58eafe2aa80bcf00
Author: Kevin Fairise <132568982+KevinFairise2@users.noreply.github.com>
Date: Tue May 28 14:21:55 2024 +0200
Enable strict check mode fakeintake client (#25964)
commit 278472622ba2c67ada19c2c7363df7258dc608b8
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Tue May 28 14:16:23 2024 +0200
[CONTP-142] Remove GetVersion method from DCAClientInterface interface (#25960)
* Remove GetVersion method from DCAClientInterface interface
* PR review
commit aa18acb43d066b09d693d78570c76f8f257d97d0
Author: Guillaume Pagnoux <Yumasi@users.noreply.github.com>
Date: Tue May 28 14:11:17 2024 +0200
USM: add AMQP classification on top of TLS (#25578)
* amqp: testutils: add TLS support for AMQP server
* amqp: testutils: add client support for TLS
* classification: tls: add AMQP classification
* tests: classification: tls: add AMQP tests
* amqp: testutil: client: ask server for ack on publishes
commit cd1078a72a02bf69a29bdf812c5bb1b7dc9dee3c
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Tue May 28 14:03:58 2024 +0200
fix(pre-commit): Check on modified files only (#26000)
commit 7a36388b1b956bd2e5e61efd032c9ae53d76877b
Author: Thibaud Cheruy <thibaud.cheruy@datadoghq.com>
Date: Tue May 28 13:56:25 2024 +0200
[NDM] Add GetHardwareStates method to cisco sdwan client (#26005)
* Add GetHardwareStates method to cisco sdwan client
* typo
commit 7debf30a42aaffddafffaa3f619469c47b98b1e6
Author: Guy Arbitman <guy20495@gmail.com>
Date: Tue May 28 13:57:30 2024 +0300
usm: postgres: support parse (#25965)
* usm: postgres: support parse
* usm: postgres: Split parse message handling to a tail call
* usm: postgres: Reduce complexity for kernel 4.14
* Added documentation
commit 7fd78070b3cf9a31a6c891013ebf7ce32d46f9e4
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Tue May 28 10:20:19 2024 +0000
Log the invoke task as json (#25997)
commit a022f412b173ad8a562fc02f88d159f65e0e0761
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Tue May 28 11:45:57 2024 +0200
fix bug in kubemetadata collector (#25941)
commit 61cdfb3d25ce9d4563adf355bdccce97f2bdd090
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 11:34:35 2024 +0200
Fix test summary on failure (#25999)
commit f181fade8a1342b39062b4876ed0a4806b4dbdf0
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 11:22:54 2024 +0200
refactor: remove glob dependency from serverless (#25939)
commit 7a2a2f74db938c0c9e2df5535720b23580d350fa
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 10:59:53 2024 +0200
fix(golang-deps-diff): explictly export CGO_ENABLED to also include cgo deps (#25950)
commit 5c05eac2ee1bb7e52dc869e8c4c98a987b537a99
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 10:54:56 2024 +0200
Avoid flakiness in test (#25978)
commit 602e6b511ed24f995481b7143b184e2f5abc322b
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 10:54:51 2024 +0200
Detect if libvirtd is in sbin but not in PATH (#25975)
commit 506a99c9f74467c540e86c03ca8da3251f016afa
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Tue May 28 08:54:47 2024 +0000
Refactor the get_running_modes function and add tests (#25998)
* Refactor the get_running_modes function and add tests
* Refactor the get_running_modes function and add tests
* clear
commit 7a35afa62518c93185667a997c98e40ad0aac2da
Author: Alex Lopez <alex.lopez.zorzano@gmail.com>
Date: Tue May 28 10:01:09 2024 +0200
Add gems caching to remaining jobs (#25946)
commit 381ad0c7dd912cfdc975d11395a33189b90e025e
Author: Usama Saqib <usamasaqib.96@live.com>
Date: Tue May 28 10:01:04 2024 +0200
Setup embedded BTFs before running tests (#25848)
* setup btfs
* update platforms
* lint-python
commit 72eb439b0a3d8bcfe60bfa0fffb4f444f7069f46
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Tue May 28 09:30:15 2024 +0200
usm: kafka: test: Make checks more robust (#25969)
* usm: kafka: test: Simplify Eventually checks
Use EventuallyWithT() which allows to assert different conditions
separately and thus prints better errors messages (such as the compared
values in case the assertion fails). Also, get rid of the PrintableInt
usage since it does not add value here.
* usm: kafka: test: Combine stats wait and validation
The separation of waiting for the stats and verifying them in two
different steps is racy for the case when there are multiple events
involved (eg. multiple requests/responses) since if the events get
flushed (for example, due to the flush hook in the netif_receive_skb
tracepoint), then the first condition will be satisfied but not the
second one.
commit c90350ca75ab8794df4e08451bea72882029dc7c
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 23:23:50 2024 -0700
[windows][cws] add approvers (#25924)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* [windows][CWS] Modify channel behavior.
First of several performance fixes.
Modifies the channel used to submit events to the CWS processor.
Was a blocking, unbuffered channel. This is now runtime configurable.
The configuration is not intended to be changed by customers, but to make it easier
to tune with a/b testing internally.
Overall changes:
- defaults to non-blocking channel. This prevents events from backing up
into ETW. Also allows clearer notion of what events were dropped. When
they back up into ETW, all we know is a count of dropped events;
- sets a default channel size. This allows a small amount of buffering to
smooth out slight bursts in ETW notifications. The default right now
is fairly small to prevent large memory usage. intended to be tuned over time.
- allows ability to configure etw max buffers. This is also for tuning,
and our default (0) is to use the system default.
* [windows][cws] restrict ETW message flow
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
* [windows][cws] Re-add approvers for windows
This is a resubmit of a previous PR to implement basic approvers for windows.
* fix space
* lint
commit 146079e3289ac8ae294ecf7ea898c66aa37f6c5e
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:56:05 2024 -0400
dump client map
commit 260277840d9748204b0284134a51e34f5fb2eba9
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:53:26 2024 -0400
fix test log
commit 6d46488b2e4ecfbac9b4cee636dd0aedb6519873
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:51:50 2024 -0400
more debugs
commit 016ef3021bf0b496a387d73173c7e41a61458d9f
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 20:37:34 2024 -0700
[windows][cws] restrict ETW message flow (#25922)
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
commit 598907fe13b5afa82f750f21ca18ded0dcedc612
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 22:59:33 2024 -0400
rework logs
commit 593ea271b25422e66599d49e7bfba01a2fcc0ae7
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 19:36:34 2024 -0700
[windows][CWS] Modify channel behavior. (#25920)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* [windows][CWS] Modify channel behavior.
First of several performance fixes.
Modifies the channel used to submit events to the CWS processor.
Was a blocking, unbuffered channel. This is now runtime configurable.
The configuration is not intended to be changed by customers, but to make it easier
to tune with a/b testing internally.
Overall changes:
- defaults to non-blocking channel. This prevents events from backing up
into ETW. Also allows clearer notion of what events were dropped. When
they back up into ETW, all we know is a count of dropped events;
- sets a default channel size. This allows a small amount of buffering to
smooth out slight bursts in ETW notifications. The default right now
is fairly small to prevent large memory usage. intended to be tuned over time.
- allows ability to configure etw max buffers. This is also for tuning,
and our default (0) is to use the system default.
* [windows][cws] restrict ETW message flow
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
* fix space
commit af2a72d0a51a685c40a7d47b10d0463343098ce6
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 21:53:36 2024 -0400
client lookup logs and disable fentry
commit 350f4b9bbc104188c6519c406f7e4cda221cc683
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 20:48:33 2024 -0400
don't mark tcp failures as empty
commit fa837bbc2c969733dbd5050d8734a85611ac3959
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 18:59:48 2024 -0400
added logs to state code
commit 33ef3373fb3f44d277d14f28645cb329a343f7a3
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 18:08:06 2024 -0400
more logs plus rework tcp_done probe
commit 6b4637badcd8c2cbf9b39ad01c171e11a4edaf9e
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 17:06:48 2024 -0400
add more debugs yay
commit f4c6ae5a438feaae59e6a066139aae80514b8d9a
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 12:16:12 2024 -0700
[windows][CWS] Update the statistics that are collected. (#25919)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* ....
commit 67ab7b6a0cf2983bb70772f67d63cac70efff1ad
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 15:08:35 2024 -0400
add more debug logs
commit a7c2138cbd2ddd69de64ffca7b8a4bc4a543746f
Author: Arthur Bellal <arthur.bellal@datadoghq.com>
Date: Mon May 27 18:51:02 2024 +0200
(fleet) fix bootstrap telemetry (#25970)
commit 73da815e13790ae82c4f4eb12fd1e18ade73fcbd
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 18:35:25 2024 +0200
[CWS] copy clang-bpf and llc-bpf inside docker test container (#25967)
commit 17af8062daa32174a4a7ea5e9d63975d1cf2895b
Author: Sylvain Afchain <safchain@gmail.com>
Date: Mon May 27 17:32:22 2024 +0200
[CWS] add an option to enable raw syscall for enforcement (#25959)
commit b7dda6bea5d354b6abe54fc675419c833e120c1f
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 17:31:12 2024 +0200
[CWS] add `/workload-list` api routes and associated subcommands to security agent (#25905)
* [CWS] add `/workload-list/{short,verbose}` api routes to security agent
* add `workload-list` subcommand
* make sure we use the config component instead of the global variable
* simplify by using only one route, with a query param
* add test for workloadURL
* update CODEOWNERS
commit eb3ed4b7c67ff77bcc5656e9342c80aac42c82b7
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Mon May 27 16:53:36 2024 +0200
Split agent builds & packaging (#25885)
* move the init script in theiw own software definition
This dill simplify generating what's needed during the packaging stage
instead of generating everything and removing files during the packaging
* package-artifacts: handle multiple archives
This will happen when we package binaries and debug symbols
* reorder pkg_metrics and packaging stage
* split datadog-agent build and packaging
* add a special case for heroku for now
* simplify build/package logic
* fixups for installer
* tmp omnibus branch
* share more common config
* fixup installer
* only package scripts for intermediate artifact
* fixup installer
* adapt to change on omnibus side
* switch back to a pinned omnibus commit
* fix from review
* move init script copy in the scope they belong to
commit 65f9e9ffc6e9701920d14611f53155e4616d40b8
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:41 2024 +0200
[EBPF] Show a summary of the results in the kmt.test task (#25903)
* Show test summary
* Show legend
* Improve spacing
commit f50ca3b9239472e50d5c21be90fb716c9f7a8913
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:36 2024 +0200
Unify KMT setup (#25904)
commit b4ec2b8baf817e6cd4611625e9700351188e234a
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:05 2024 +0200
Only perform the check for local images (#25958)
commit e5d8e9d42f55baf059d7bee6c3e3bfc050931ad2
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 16:25:55 2024 +0200
[kubernetes/helpers] Move stringInRuneset func (#25952)
commit deb9b60954eef9347d9fff796df2ba56049b3d3a
Author: Sylvain Baubeau <sylvain.baubeau@datadoghq.com>
Date: Mon May 27 16:25:49 2024 +0200
Do not stop walking on permission errors (#25911)
commit f821fcb52d67fab4201afbd90870d31fc118f538
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 15:37:59 2024 +0200
Revert "fix(installer): chown installer run path to dd-agent (#25880)" (#25955)
This reverts commit 6b3d202f342cb84b0ab329b4287a792dd77647cd.
commit 491ba6d573291ab80f4173592a256dfb09fd3757
Author: Gustavo Caso <gustavo.caso@datadoghq.com>
Date: Mon May 27 15:15:46 2024 +0200
[ASCII-1802] Ensure that API endpoint provider are filter before being use (#25943)
* Ensure that API endpoint provider are filter before being use
* convert api.EndpointProvider into an interface
* add test to validate we filter out nil endpoints
commit acd0a26e72260b1d23dd8b48d8b07d20fb4d6a97
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 15:00:49 2024 +0200
[CWS] move creation of new tcclassifier to separate goroutine (#25918)
commit f656b7c07cf46f18c49e075224f540e7ed15db60
Author: Mister Yo (Maxime Riaud) <65339037+misteriaud@users.noreply.github.com>
Date: Mon May 27 15:00:45 2024 +0200
[ASCII-1622] Prevent deadlock for status and flare command (#25861)
* adding 15sec timeout for IPC requests between sub-Agent and core-Agent
* add release note
* Update releasenotes/notes/fix-flare-genereation-deadlock-b40fca3c82469d40.yaml
Co-authored-by: Pierre Gimalac <pierre.gimalac@datadoghq.com>
* use configuration setting for timeout duration
* use preexisting "server_timeout" config setting instead of "subagent_config_fetch_timeout"
* multiply config duration by seconds
---------
Co-authored-by: Pierre Gimalac <pierre.gimalac@datadoghq.com>
commit 36fb86660b903731f3aef90ddd0270c346f60eb9
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 14:41:06 2024 +0200
[workloadmeta/collectors/remote] Make filter configurable (#25945)
* [workloadmeta/filter] Add Kinds()
* [workloadmeta/proto] Add function to convert Filter
* [workloadmeta/collectors/remote] Make filter configurable
commit 6f60aae57ecc8180ac41157d37294e9b8c1e8255
Author: pducolin <45568537+pducolin@users.noreply.github.com>
Date: Mon May 27 14:41:00 2024 +0200
[e2e] generic environment in host and docker host envs (#25668)
* [e2e] move aws environment to provider parameters
* [e2e] move environment to run params
a cloud environment cannot be reused
* [e2e] add description to RunParams
commit ffc947fe84f3fd0caebbdb6c179f61a454cee0de
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Mon May 27 14:38:55 2024 +0200
fix test path (#25947)
* fix test path
* fix
commit 387c900d29edbc281946b5467cb138200296727e
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Mon May 27 14:38:23 2024 +0200
fix(invoke_ut): Trigger the custom_task UT, fix them and minor changes to enable test discovery in vscode (#25912)
commit d9593607bdd942f2c17fbab1ed4cf35d959a2655
Author: Guy Arbitman <guy20495@gmail.com>
Date: Mon May 27 15:24:54 2024 +0300
[USMON-910] Introduce postgres TLS monitoring (#25729)
* usm: postgres: Convert plaintext version to use pktbuf syntax
The migration is a prelimanary step to sharing the code between plaintext and TLS version of postgres
monitoring.
* usm: postgres: Extract main processing logic into a function
* usm: tls: Add PostgresTLS enum
* usm: postgres: Implement TLS probes
* usm: postgres: tests: Extend TestDecoding to support both plaintext and TLS modes
* usm: Fixed documentation and naming
commit 00c839d463aaa324a4684edc25f5a591f46c8f54
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 14:04:45 2024 +0200
[EBPF] Fix parsing of verifier log register state in modern kernels (#25724)
* Refactor register parsing code
* Test existing line parse behavior
* Support register state just after instruction
* Increase test coverage
* Fix linter
* Register state now is the state *after* execution
commit e9cf0d8c9c2ea0c95eea914aca86d057edcfece5
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Mon May 27 14:02:57 2024 +0200
chore(serverless): remove testify from build (#25940)
commit 25d996db5fe5aeaca8f0440660dbb74d5fbc26cf
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 12:32:16 2024 +0200
fix(installer): Don't report tmp extract dirs as repositories (#25902)
commit e1accdad30bda4b00fbdc4244b03ebbcf94ad7a3
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 12:21:54 2024 +0200
[CWS] implement user path discarders on Windows (#25891)
commit 233064852add1d1e9cf39eeeba8226df38980e44
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Mon May 27 12:21:50 2024 +0200
[ASCII-1595] Make serverless use a no-op implementation of `dogstatsd/replay` (#25548)
* feat: make serverless use no-op impl of dsd-replay
* chore: update serverless dependency list
commit f7b9c1fbe6522e073d2602b451c83e0bc5aa35d9
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Mon May 27 12:15:16 2024 +0200
e2e: fix pipeline ID env variable in readme (#25938)
commit 80cf6f399d03fe91533e4ca2486dd678e7996d56
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 10:00:05 2024 +0000
Configure pre-commit hooks to be compatible with `devagent` (#25910)
* pre-commit with devagent
* address
commit cbb3706fc389be6b5a366c46d5090c484408174f
Author: maxime mouial <hush-hush@users.noreply.github.com>
Date: Mon May 27 11:53:39 2024 +0200
simplify configuration layer in inventoryagent (#25138)
commit 4f989f4bc610247bc6abec82a9c9e69d34d6eca3
Author: Guy Arbitman <guy20495@gmail.com>
Date: Mon May 27 12:53:14 2024 +0300
usm: Introduce a method to move data_off of a pktbuf (#25928)
* usm: ebpf: Add method to modify the offset of the pktbuf
* usm: ebpf: Fix wrong calculation
We get the offset as a function argument, thus no need to read from data_off + offset
commit a897ee47121418dccc5e7c18632145f2764d7535
Author: jedupau <72938258+jedupau@users.noreply.github.com>
Date: Mon May 27 11:44:30 2024 +0200
[NDMII-2654][snmp] store devices tags on disk with mock directory (#25887)
* snmp: store tags on disk
* ndm: write tags in cache only at launch
* fix tests
* add returns on read from cache method
* add comment for test
commit 18bc7d2e2ad59eecda18b6e33d0f1dc2bc4dc99e
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 09:41:44 2024 +0000
Add a `lint` option to `get_modified_packages` (#25935)
commit 6b3d202f342cb84b0ab329b4287a792dd77647cd
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 11:11:09 2024 +0200
fix(installer): chown installer run path to dd-agent (#25880)
commit 1dbd2a144f804b08a32eeb8cb25d28bccb7fc524
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Mon May 27 11:06:47 2024 +0200
add dotnet log (#25927)
commit af0d4da5189f71e7c7fea734db325e62d7238af4
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 11:00:53 2024 +0200
[kubernetes/metadata] Use workloadmeta instead of a node informer (#25615)
* [workloadmeta] Add ListKubernetesNodes()
* [kubernetes/metadata] Use workloadmeta instead of node informer
* [kubernetes] Extract controllers into a separate package
The controllers code was in the "apiserver" package and now depends on
workloadmeta, but workloadmeta also depends apiserver. Creating a new
"controllers" package solves this issue.
* [kubernetes/apiserver/controllers] Make things private when possible
* Review comments
commit f6d0c587696f58748dc04a5d4fd7ec54ee235f23
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 08:30:19 2024 +0000
Add the Python version to the `invoke` monitoring (#25934)
commit 7bf54a19d2684a1c197099339aa9c7da03775cd8
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Mon May 27 10:16:26 2024 +0200
fix(ci): Change the logic on junit upload job (#25850)
* refactor small methods
* change the junit upload logic to upload per team
First iterate on all xml to sort them by team
Then call upload on each team folder
Added tests
Muted all unittest that logged in stdout, pending a logger
implementation
* Use a pool instead of a for loop for performances
* codereview: minor fixes
* [ACIX-277] Upload a tag to sort tests by pipeline source
commit d3032058188faa3917e33ca5a8e87ae2a03015a1
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 09:58:05 2024 +0200
sync and update docker functional tests image (#25917)
commit 494da1371201be72d683a1b93596b7d9aa695e59
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 09:58:00 2024 +0200
test(installer): Add tests for injector upgrade paths (#25853)
* upgrade(installer): Support force non install
* fix db
* tests(installer): Implement upgrade tests tests (injector deb <-> oci)
* nit
commit 47d682557c651798b51b29d3e1f5f74064dde772
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 22:37:05 2024 -0400
use proper helper for failed conns check
commit b7bf05117d13d68d884e98bd721ccf63ade26417
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 22:35:53 2024 -0400
only clear map if failed conns enabled
commit bb9a0b2513f1149f140b39a5d25364b9cabc3297
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 20:13:08 2024 -0400
make matching code member of map type
commit 620fd4ccc8e32bf91e7af2057893d450e5c10c75
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 19:58:48 2024 -0400
add cachelike behavior to failed conn map
commit 90c924d61d34942a6e5e0d9223e9f0caf8fc9875
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Sun May 26 17:20:54 2024 +0000
Detect if the invoke command is running with PyApp (#25906)
* Detect if the invoke command is running with PyApp
* Update tasks/custom_task/custom_task.py
* Update tasks/custom_task/custom_task.py
commit bf83f431d9ac6cf800210dde60ed078453746f3f
Author: Guy Arbitman <guy20495@gmail.com>
Date: Sun May 26 15:33:57 2024 +0300
[USMON-934] postgres tls classification (#25925)
* usm: gotls: Add testing capabilities to support TLS classification tests
We add:
- skipIfGoTLSNotSupported method which skips a test if go-tls monitoring is not supported on a machine / configuration
- goTLSAttachPID and goTLSDetachPID helpers which wraps GoTLSAttachPID and GoTLSDetachPID. The wrappers meant to ease reading the tests
- goTLSDetacherWrapper and goTLSAttacherWrapper which meant to wrap preTracer and postTracer, and allow easy reusing of same setup in
the TLS classification tests.
- SetGoTLSExcludeSelf method which allows to modify the value of the configuration GoTLSExcludeSelf at runtime, to allow
relevant tests to enable self-hooking
* usm: postgres: tests: Server supports TLS
* usm: postgres: tests: Change client to support connection options
* usm: postgres: tests: Handle error 'address already in use'
* usm: tests: Added documentation
commit 0246518c068b39715a2e3d07eaece1bcee1f2087
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 11:15:19 2024 -0400
clean up matching locks
commit d0b647bcb646076ba11398a169e28eabcea58a3e
Author: Alexandre Yang <alexandre.yang@datadoghq.com>
Date: Sat May 25 08:54:30 2024 +0200
[network-path] Add service (#25892)
* [network-path] Add service
* Add source and destination service
* fix test
commit 3224c95a55bc82b1b9b7ed85f7e3286284f688c9
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 02:51:08 2024 -0400
disabled failed conns by default
commit 4c8c861af80f2f0d9424f62f3d2a86c4e3f93f69
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 02:29:51 2024 -0400
uncomment map delete
commit 2ac190dd0ca15af07e05f541177cb4d4ecff8fc1
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 19:10:58 2024 -0400
remove user timeout value
commit e5b69ff8a31b2c377aefaf638186fff88f7ee27b
Author: Keisuke Umegaki <41987730+keisku@users.noreply.github.com>
Date: Sat May 25 07:50:46 2024 +0900
Improve logging in the Lambda Logs API handler (#25878)
* Improve error handling in Lambda Logs API handler
* reno new
* ignore io.ReadAll() error since we handle it later
commit 7a8b0cf8bcf3540dd8446b3392d3110612848bf2
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Fri May 24 15:32:31 2024 -0700
[windows][CWS] consolidate windows probe initialization. (#25916)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
commit 6ec1386ef4c379af64cfa1b90b920609f1b3e361
Author: Yang Song <songy23@users.noreply.github.com>
Date: Fri May 24 18:25:10 2024 -0400
[OASIS-37] Move collector internal/datadog to Agent as modules (#25841)
* [OASIS-12] Move OTel statsd metrics client to agent
* [OASIS-12] Move OTel ingester to agent
* Format
* lint
* Rename ingester to statsprocessor
commit e19773f96565662a14fad551d5be0dee5e668ef7
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Fri May 24 14:42:35 2024 -0700
[windows][etw] add ability to filter etw messages by ID (#25875)
* add inclusion/exclusion list to ETW component
* gofmt
* review feedback
commit 3d414e9ee058f778e8aa47dbe3fb41bbfd894c41
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 17:29:01 2024 -0400
skip linter
commit 31fc3c39285825f66624d7a5ceda0af1130bafd5
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 14:29:31 2024 -0400
fix test compile
commit 7ac9c8b8595235bdf9a3ed457d0095100251c451
Author: Gustavo Caso <gustavo.caso@datadoghq.com>
Date: Fri May 24 19:49:35 2024 +0200
[ASCII-1796] Move list dependency test to python (#25866)
Co-authored-by: pgimalac <pierre.gimalac@datadoghq.com>
commit d0487e7eeb5f92128edb9720cb781315b1dce23c
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 13:29:48 2024 -0400
skip timeout test on prebuilt
commit 4510cafe0382a65ac614f3726bc31032be8d1145
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 13:12:55 2024 -0400
rework ebpf code to handle timeouts
commit 2beb26aded7274a40a25aa764365881293225819
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Fri May 24 18:17:50 2024 +0200
[ASCII-1613] Split `dogstatsd/replay` into new component hierarchy (#25512)
* refactor: move component and exported symbols to def folder
* refactor: move Mock interface and module to their own directories
* refactor: move fx related functions in fx directory
* refactor: move impl to its own directory
* refactor: remove CapPool global variable
* fix: review comments about mock
* fix: review comments about package naming
* chore: rename replaydef imports to replay
* chore: update serverless dependency list
commit 5b9f9aa80608ef9294da08b219bd5b0ccbd3df67
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Fri May 24 18:17:46 2024 +0200
fix(tools): Set the correct jira project name for telemetry and analytics team (#25907)
commit 5e790668711cccec9d24e55046745571ce9fad1a
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Fri May 24 17:50:53 2024 +0200
[ASCII-1790] Send metrics with number of go dependencies for each build (#25854)
* feat: send metrics with number of go dependencies for each build
* fix: add CGO_ENABLED env
* refactor: move constant metric names to globals
commit d9ff65e15240ec2416d945a9df67ea33049ef73c
Author: Arthur Bellal <arthur.bellal@datadoghq.com>
Date: Fri May 24 16:04:42 2024 +0200
(fleet) install the agent oci by default when remote updates are enabled (#25898)
commit 37030bc81b6f3d82f0a7ada71c33ac1661df9928
Author: Alexandre Menasria <47357713+amenasria@users.noreply.github.com>
Date: Fri May 24 16…
akarpz
added a commit
that referenced
this pull request
May 29, 2024
commit 7ff60b0875bba5ce9e3a835f00b0172646612795
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:29:29 2024 -0400
reorganize tracer code
commit bb505ec443134e3280adfd754c1bbb8ced0524d4
Merge: ad9cc589ac 2948aa9015
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:16:36 2024 -0400
Merge branch 'main' into akarpowich/perf_test_failed_conns
commit ad9cc589ac8b3e349d566390789bdb167848993a
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:14:04 2024 -0400
reset file to origin
commit 4ae857f43f6894f69a7504e9b5104f7702019f42
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:12:48 2024 -0400
fix again
commit 2a6aaffe736d3eae587b233694b26c081fe3bce5
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:09:42 2024 -0400
reset random go mod changes
commit fb9c7f1f14fd9acef65d8de6b511aff6162e3528
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:02:36 2024 -0400
clean up tests
commit f1704601b6e00483511370b3549fdc99b05c1944
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 17:56:57 2024 -0400
fix race condition
commit 2948aa9015c2098bf1d0a972b9d729c0d9da2f86
Author: Stanley Liu <stanley.liu@datadoghq.com>
Date: Wed May 29 17:03:31 2024 -0400
Implement metrics for infraattributesprocessor (#25711)
* Initial version
* Rename tagenrichmentprocessor to infraattributesprocessor
* Fix merge
* Rename config_logs_strict
* Add tagger component
* Fix tests and lint
* tidy
* Refactor to tag multiple entities
* Rename
* Temp update mapping go attributes
* tidy
* Update attributes mapping
* Fix resource metrics loop, add more tests
* Update attributes to v0.16.1
* Update attributes to v0.16.1
* Add container_image_metadata
* generate licenses
* Rename
* Fix merge conflicts
* generate deps
commit 22e4ec14be7ed7f99f7bcf0ea44e983d5e9c792d
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:55:04 2024 -0400
increment telemetry
commit 09badae964ebd13ea68d1c86ecca169fc26edb0c
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:42:03 2024 -0400
telemetry for failure matches
commit 3c28e38bf37f143bc25296e7c7bae2f76c8af592
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:33:27 2024 -0400
rename failure buffer
commit c7efe438c39710cd1698e3408279107916744d26
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Wed May 29 19:05:26 2024 +0200
[kubernetes/apiserver] Initialize metadata controller properly (#26070)
commit 2844cfb492ff89e404e0b0cc052b07807660f483
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Wed May 29 18:24:31 2024 +0200
[CWS] windows multi approvers (#26067)
* ensure old approvers are not kept after policy reloading
* add new approver capabilities for other FRIM event types
* ensure we take into account all event basenames for approvers
* ensure approver are able to skip event types with no active rule
* add test for approver mechanism
* disable approvers in `TestETWFileNotifications`
commit 3c1ea9978176c16e6303a5702c14f9c4602cdb08
Author: Sylvain Afchain <safchain@gmail.com>
Date: Wed May 29 18:18:10 2024 +0200
[CWS] add hash action (#25870)
commit d1233c56a45a2f4f069360d9a2e424e5c56fb302
Author: Dustin Long <me@dustmop.io>
Date: Wed May 29 12:01:45 2024 -0400
Move alternative otel collector implementations into new component layout (#25836)
Co-authored-by: GustavoCaso <gustavo.caso@datadoghq.com>
commit 26ab9b5f65ca31dde78eb6684fb378b29dc7e334
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 11:58:22 2024 -0400
remove old evict logic and add new test
commit f2791932596d085ac42d6273a1f8fbf65ccc6086
Author: Bryce Kahle <bryce.kahle@datadoghq.com>
Date: Wed May 29 08:42:11 2024 -0700
replace slashes in gitlab section id (#26034)
Fixes section id for junit file uploads
commit 46b14bcd5a74badd542392f74a3c98dc093a3ad9
Author: Kacper <89013263+kacper-murzyn@users.noreply.github.com>
Date: Wed May 29 17:41:56 2024 +0200
last_stable updated to 7.54.0 (#26068)
* last_stable updated to 7.54.0
* Update release.json
commit e9713c0a90879a4cd2d09db777b0e9c10998ca90
Author: Paul Laffon <paul.laffon@datadoghq.com>
Date: Wed May 29 17:41:46 2024 +0200
[DJM-251] Add new parameter djm_config.enabled to enable Data Jobs Monitoring (#25846)
* Add new parameter djm_config.enabled to enable Data Jobs Monitoring
* rst uses double backticks
Co-authored-by: Vickenty Fesunov <vickenty@users.noreply.github.com>
---------
Co-authored-by: Vickenty Fesunov <vickenty@users.noreply.github.com>
commit ebeee88c4ff5fa92d2bdf4207ea499efa40641f5
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 14:43:02 2024 +0000
Build the docs when the workflow is modified (#26050)
commit 3cbeb226ec15e661902487b0b2ea9fe79c55ae1f
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Wed May 29 16:41:32 2024 +0200
avoid systemd conflicts (#25944)
Co-authored-by: arbll <arthur.bellal@datadoghq.com>
commit 38fc5b1807b62b15e0017ad452f9f25b14e3983b
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Wed May 29 16:22:44 2024 +0200
[CWS] replace tracepoint hook with kprobes for mmap event (#26015)
commit 553bb7f6513d682442f0b692ab6a2e6e810e91b3
Author: agent-platform-auto-pr[bot] <153269286+agent-platform-auto-pr[bot]@users.noreply.github.com>
Date: Wed May 29 14:16:35 2024 +0000
Changelog updates for 7.54.0 release (#26043) (#26064)
Co-authored-by: kacper-murzyn <89013263+kacper-murzyn@users.noreply.github.com>
commit 4302a8a569e7d4b5b26e0b55546951eaecc07ca7
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 16:04:15 2024 +0200
usm: kafka: Support fetch v12 (#25812)
* usm: kafka: Use unsigned loop counter
This allows some compiler optimzations and avoids a "looks like the BPF
stack limit of 512 bytes is exceeded" error when more code is added to
the classification functions.
* usm: kafka: test: Make unused fields non-zero
Set some unparsed fields in the packets to non-zero values for easier
debugging when packet parsing goes wrong and reads from wrong offsets.
* usm: kafka: test: Pass FetchRequest to buildMessages
To allow the request to be customized per test.
* usm: kafka: test: Pass in API version
Pass in the API version as a parameter to the raw tests, so that
different API versions can be tested.
* usm: kafka: test: Test different versions in raw test
Test some versions which have specific conditions.
* usm: kafka: test: Allow topic to be customized
* usm: kafka: test: Add test for large topic name
* usm: kafka: test: Add test for many topics
* usm: kafka: test: Add raw test for many partitions
* usm: kafka: test: Handle flexible header
* usm: kafka: Pass in version number to parsing tests
* usm: kafka: Support Fetch v12
Add support for v12 of the Fetch API. The main change is the use of
varints and addition of tagged values. While that change itself is
fairly straightforward, the need to parse varints caused the programs to
exceed the instruction size supported by older kernels (4096
instructions), so the programs had to be split into separate programs
for pre-v12 and v12, as well as to do the parsing in two steps in
separate programs: a first step to parse the locations of the record
batches arrays, and a second step to parse the list of found locations.
The split between pre-v12 and v12 is simple and handled by informing the
compiler about the bounds of the versions, and then depending on it to
eliminate the unused branches. The split of the parsing into two steps
requires code to handle the transition between the two steps correctly.
Also mainly due to code size restrictions on older kernels (even after
the above optimizations), the following limitations are currently
present:
- A maximum of four bytes of varints are supported
- The tagged values fields are always assumed to be empty
* usm: kafka: test: Check for errors from LookupMaxKeyVersion
* usm: kafka: Remove leftover comment
* usm: kafka: remove unused cgo type
* usm: kafka: Remove passing of level
* usm: kafka: Add comment to parse_varint_u16()
* usm: kafka: Fix u16 varint check
The second byte's MSB should only be checked if the first byte has the
MSB set, since otherwise the second byte is unrelated to the varint.
* usm: kafka: Rename topic_name_size_tmp to topic_name_size_raw
* usm: kafka: Handle splits in header
We were previously not handling this mainly due to code size
restrictions, but with the program split this can be supported.
* usm: kafka: Make read_with_remainder generic
Remove the copy/pasted code and make read_with_remainder() generic with
the use of a function pointer. The function pointer will be folded at
compile time by the compiler. The instruction count is unchanged before
and after this patch.
* usm: kafka: Remove unused nonrestartable functions
* usm: kafka: Remove _restartable suffix
Now that we only have restartable readers, remove the redundant suffix.
* usm: kafka: Validate zero tagged fields when possible
* usm: kafka: Remove __read_varint indirection
* usm: kafka: Allow varint bytes to be customized per location
To reduce code size by limiting iterations wherever it makes sense.
* usm: kafka: Customize varint bytes per location
* usm: kafka: Clarify N-1 operation in varints
* usm: kafka: Rename tmp2 variable
* usm: kafka: Add comment about flexible
* usm: kafka: Skip varint number of topics
* usm: kafka: Check zero tagged fields in request
* usm: kafka: Use 64 bits for varint results
* usm: kafka: Add comment about uninitialized variable
* usm: kafka: test: Fix teardown
The telemetry test assigns to the client in the context multiple times,
so some of the clients are never torn down, leading to issues with tests
run later (such as for example the still-running clients attempting to
connect to the raw server while the raw tests are executed afterward).
commit 66dfa7ceff7d8f465dec4590eb2a1dfec85c3022
Author: jedupau <72938258+jedupau@users.noreply.github.com>
Date: Wed May 29 16:02:53 2024 +0200
use the cache container (#26066)
commit d25878205e9203bb5a7ec86f70a21177f0bdba9c
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:59:50 2024 +0200
[CONTINT-3702] fix(sbom): Fix mount path retrieval from overlayfs (#25886)
* Get mounts from overlayfs snapshotter, similarly as what is done in MountImage
* prefer opts.UseMount, remove unused NoCache opts, use cache only when scanning images
* move scan from snapshotter out of the default function
commit 3c91826bbbd4f254365024eb5dc60f82753efca6
Author: Yang Song <songy23@users.noreply.github.com>
Date: Wed May 29 09:35:53 2024 -0400
[OTEL-1720] Add an API in pkg/trace/stats that converts eligible OTLP spans to the input to APM stats concentrator. (#23503)
commit 6db250af895cb5f30bcee6d444ca3e65e553f589
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:35:45 2024 +0200
update gomod (#26065)
commit de91510cb89337a9c649a2b082e585dbdc7c2add
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:35:39 2024 +0200
[CONTINT-4105] Support arbitrary container-ids to collect container metrics (#25515)
* Collect cgroup path in workloadmeta
* Implement the container filter
* Update TestDump
* release note
* fix dogstatsd test using a mock workloadmeta with no implemented methods
* support the case of an empty cgroup path
* Update releasenotes/notes/support-arbitrary-container-id-cc0efdf7c156b7ad.yaml
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
* mention that the path is relative
* Remove no-lint comments
* remove the unsubscribe
* Move trie to its own package
* Add code comments to explain about suffix matching and make sure we only populate the Trie if the regex does not match
* add test cases for cgroupfs / systemd
* update protobuf
---------
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
commit 91aa08c0f34114f4ca3794ae7e4898f8c37a5a25
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Wed May 29 15:35:33 2024 +0200
use a dedicated variable to force a lower compression level (#26044)
* use a dedicated variable to force a lower compression level
Using the maximal compression level on armhf jobs will attempt to
allocate more than 32bits binaries can address.
* use a more flexible approach for forcing compression level
* rename variable
* fix method name
commit c0bcfd8169843c3b35d3ce83cc34716b4e50d0bd
Author: Stephen Wakely <fungus.humungus@gmail.com>
Date: Wed May 29 14:27:50 2024 +0100
Add zstd compression level option (#25261)
* Add zstd compression level option.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Set level on stream compression.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Log on zstd
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove printf
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove spurious import.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Add unit test for compression level.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove zstd dependency from config and rename option to include zstd
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Linter errors
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Revert version change for otel.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
---------
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
commit e79613843b013779fb6c7740a2dc32f9ed433d5c
Author: Ofek Lev <ofekmeister@gmail.com>
Date: Wed May 29 08:31:09 2024 -0400
Remove outdated documentation (#26037)
commit 40f9f7916c78dd13705e4248276a5779d8ec8ab6
Author: Julien Lebot <julien.lebot@datadoghq.com>
Date: Wed May 29 14:26:51 2024 +0200
[Fleet Automation] Add support for Windows in fleet installer (#25186)
* Try with symlinks on Windows
* First pass
* Revert to using UNIX sockets on Windows
* Allow passing parameters to install command
* fix bootstrapper compilation issue
* Fix windows installer error handling
* Use HTTP instead of UNIX sockets
* Revert "Use HTTP instead of UNIX sockets"
This reverts commit 1ee4e46630390f7236b4c9173a823199045acc89.
* Refactor installer paths
* Generate the OCI package
* Only package the Agent 7 in OCI
* Generate package in pipeline
* Fix linux compilation
* progress
* Fix merge conflicts
* Fix powershell script to generate OCI packages
* Fix source directory
* Fix deploy
* Fix deploy
* remove helper
* Invert calls and add return error to function
* Linter
* Update comments
* Add missing argument
* Only include windows registry on windows
* Add missing error
* Add missing arg
* Fix linux compilation errors
* Fix last error
* Fix linux unit tests
* Address review comments
* Update pkg/fleet/installer/installer.go
Co-authored-by: Arthur Bellal <arthur.bellal@datadoghq.com>
---------
Co-authored-by: Arthur Bellal <arthur.bellal@datadoghq.com>
commit 3a58984242dec80a5a7aa89cf763776fa78ee97a
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Wed May 29 12:42:27 2024 +0200
feat(releasing): Create release candidate on automatic schedules (#26001)
commit d4705fa89155d6c304c257c6903c8e2835bd973f
Author: Mister Yo (Maxime Riaud) <65339037+misteriaud@users.noreply.github.com>
Date: Wed May 29 12:24:23 2024 +0200
[ASCII-1393] improve GUI auth flow (#24800)
* replace gui security mechanism with authToken->accessToken JWT mechanism
* typo sessionID
* fix lint issue
* rename authToken to loginToken and create dedicated endpoint
* use single-use intentToken and homemade hmac signed accessToken
* update accessToken payload by adding expirationTime
* replace bad external package
* add token prefix, update gorilla http router
* update systray launch-gui function
* add GUI_session_expiration param
* add release note
* use nil ApiEndpointProvider and update some comments/docs
commit c435f967d9d52981a9edbfc86a1c1fd24f67f84a
Author: Paul <paul.coignet@datadoghq.com>
Date: Wed May 29 11:49:34 2024 +0200
[FA] Add default log source to file logs (#25816)
* Add log source
* Add integration name
* Include container environment
* Address revies
* Address review
* Add commnet
commit 50183e00416eab4be894d2533ef48201ac21e54a
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 11:45:08 2024 +0200
usm: kafka: test: Correct assertion message (#26049)
HTTP and Kafka were mixed up in the message.
commit b9e111e5c83a4fe5db20be024705ee4d8c3f17ae
Author: Vickenty Fesunov <vickenty@users.noreply.github.com>
Date: Wed May 29 11:44:58 2024 +0200
Fix time sampler tests (#25977)
Run tests with the intended tags store settings rather than always
using no-op store.
commit e1fc869376d3eb0c366883dd2284f695c584796c
Author: val06 <valeri.pliskin@datadoghq.com>
Date: Wed May 29 10:42:38 2024 +0100
small typo fix (#26055)
commit 843506e44554322e5fdf72bd84da77b7c5852530
Author: Célian Raimbault <161456554+CelianR@users.noreply.github.com>
Date: Wed May 29 11:42:21 2024 +0200
Improve agent-platform-ops alerts (#25882)
* tmp
* [rfc-team-notifications-1] Reworked logic
* [rfc-team-notifications-1] Initial PR info
* Implemented send_notification with new method
* wip
* Fixed more tests
* Fixed more tests
* Fixed all tests
* s3: Updated file name and bucket
* [team-notifications-1] Added test script
* [team-notifications-1] Updated notif
* [team-notifications-1] Fixed lint
* [team-notifications-1] Fixed notify job executions json
* [team-notifications-1] Test
* [team-notifications-1] Test
* [team-notifications-1] Test
* [team-notifications-1] Removed tests, cleaned code
* [team-notifications-1] Removed tests, cleaned code
* [rfc-team-notifications-1] Applied suggestions
* [rfc-team-notifications-1] Added commit sha to job executions
* [rfc-team-notifications] Applied suggestions
* [rfc-team-notifications] Applied suggestions
* [rfc-team-notifications] Applied suggestions
commit 34c6de12a0623c4a4f9bca542f56b96fed22c3f3
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Wed May 29 11:20:20 2024 +0200
[workloadmeta/collectors/remote] Handle unsupported kinds (#26052)
commit c4dd4acce76abe7af4e1703345fbdaba35e22bf2
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Wed May 29 11:41:06 2024 +0300
[USM] Support postgres alter operation (#25931)
* support alter operation
* support marshal for alter
* added test to TestFormatPostgresStats for alter
* update to main and fix test
commit 7e1459b9dc235abfdff10ebc8bf4455982cb16f6
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 10:27:19 2024 +0200
usm: kafka: test: Fix teardown (#26029)
The telemetry test assigns to the client in the context multiple times,
so some of the clients are never torn down, leading to issues with tests
run later (such as for example the still-running clients attempting to
connect to the raw server while the raw tests are executed afterward).
commit 966f573bb70a5ba9a080b8f18e51208e50d918bc
Author: Kevin Fairise <132568982+KevinFairise2@users.noreply.github.com>
Date: Wed May 29 10:15:51 2024 +0200
ADX-252 Local kubernetes provider (#23153)
* Create kindvm provider and kindvm host
* Create kindvm scenario test
* Use test-infra commit
* Update test/new-e2e/examples/kindvm_test.go
Co-authored-by: pducolin <45568537+pducolin@users.noreply.github.com>
* Address suggestions
* WIP
* Address suggestions
* Rename KubernetesHost to Kubernetes
* Tidy
* Update test
* Rename kind test
* Fix linter
* Update go + runner image
* Tidy
* Create local kind provisioner
* Bump deps
* Update init of fakeintake to use clientURL if provided
* Update local kind provider to deploy a local fakeintake
* Exclude fakeintake container from log collection
* Remove useless commented code
* Remove newline
* Remove useless options
* Update test-infra
* Tidy
* Remove deleted field
* WIP
* Create example and last fixes
* Fix K8SApp signature change
* Fix release name change
* Fix release name change
* Update test-infra version
* Fix test-infra bump issues
* Tidy
* Pass provider in eks provider
* Enable autoscaling
* Bump test-infra to fix quote
* Fix orchestrator test
* Fix orchestrator test
* Final bump of test-infra
---------
Co-authored-by: pducolin <45568537+pducolin@users.noreply.github.com>
commit 8bce778f1c2597ad724420c5d76fb8ecad4714fe
Author: Andrea Marziali <marziali.andrea@gmail.com>
Date: Wed May 29 10:15:46 2024 +0200
[service discovery] fix minor python module use cases (#26026)
Co-authored-by: jonbodner <jon.bodner@datadoghq.com>
commit a9f51824ae913c875c8c39f187aa91b124b99de2
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Wed May 29 10:15:41 2024 +0200
remove deadlock in dca client (#26038)
commit 6a5c08afbd6c50b2b622b82cca59b3c7d3fd22dd
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 07:39:52 2024 +0000
Rename `devagent` to `deva` (#26042)
commit ac86be5ddd507b383224101b6736c08da8e72678
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Wed May 29 09:23:20 2024 +0200
remove env (#26041)
commit 4a49dae97a30986a503a8baabe7fced012c812ea
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 07:04:24 2024 +0000
Run the tidy hook only on modified packages (#26008)
* Run the tidy hook only on modified packages
* address
* address
* missing tidy_all
commit f125445e8e75058fbf588dedecec00b5a1c11466
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Wed May 29 08:05:33 2024 +0200
feat(ci): Introduce a new task to guess the owner of a github issue (#25953)
This initial version is just guessing using keywords in the issue
description. This will be enhanced with a call from a ML model. The task
will be called in a github action
commit 168f81555e7c509437092f4b390e8032f9a00c0a
Author: Minyi Zhu <minyi.zhu@datadoghq.com>
Date: Tue May 28 21:11:07 2024 -0400
[CONTP-61] remove global variables in tagger (#25804)
* remove global variables in tagger
* fix unit test
commit 8ddd5ff6a4176fb77c5cc3e460eed5552ce8ac99
Merge: ae32666488 1eb4f52e9f
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 20:24:28 2024 -0400
Merge branch 'main' into akarpowich/perf_test_failed_conns
commit 1eb4f52e9f8215e9e96dc5a6964f001f6cf80029
Author: Keisuke Umegaki <41987730+keisku@users.noreply.github.com>
Date: Wed May 29 07:25:54 2024 +0900
Enable to set the buffering config of Lambda Logs API via env vars (#25923)
* Enable set the buffering config of Lambda Logs API via env vars
* fix envVarToInt
* Update add-lambda-logs-api-buffering-configs-ba8b5ad40eb6a62d.yaml
Co-authored-by: Kari Halsted <12926135+kayayarai@users.noreply.github.com>
---------
Co-authored-by: Kari Halsted <12926135+kayayarai@users.noreply.github.com>
commit 9e8e0c4345c58e7ccd0ac119c66dd43b5be5f97b
Author: Dustin Long <me@dustmop.io>
Date: Tue May 28 17:58:59 2024 -0400
Bump viper version to v1.13.4 (#26017)
* Bump viper to v1.13.4, which includes fix for url keys in maps
* go fmt config_test.go
* Unit test for config, now that viper flakiness is fixed
* Bump viper version in more packages
commit deb1e7c0f2c0111b6f7ec4446d614ef1bb70b293
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 23:48:26 2024 +0300
[USM] Support postgres delete operation (#25930)
Co-authored-by: guyarb <guy20495@gmail.com>
commit 7b264b60b9bcebe163e0055aaeafa45b7143f7e0
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 21:46:25 2024 +0200
Fix gen-config-from-ci-pipeline (#26025)
commit ae32666488f1f4709e6126882d8a232bb9b1ddbf
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 14:58:47 2024 -0400
remove more debug logs
commit ed5e6576112068763605963ecd4187527397da4a
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 20:31:40 2024 +0200
Revert "split dogstatsd build and packaging (#26002)" (#26033)
This reverts commit fddbf0e64d13dcb93889deaead0097402129e72c.
commit 62532f669db6fedc6e01c67ae51535226039afa9
Author: Tal Usvyatsky <18072279+TalUsvyatsky@users.noreply.github.com>
Date: Tue May 28 14:11:35 2024 -0400
reuse DD_ENHANCED_METRICS instead of separate env var (#26023)
commit 49ee3df65fc9a2fe100cb20f56ac511d17c78e68
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 19:39:47 2024 +0200
CI: increase available disk space for windows tests containers (#26027)
commit fddbf0e64d13dcb93889deaead0097402129e72c
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 18:59:08 2024 +0200
split dogstatsd build and packaging (#26002)
* split dogstatsd build and packaging
* remove reference to deleted file
commit ae6a9f20952b2f4ca75a4362f56049db35a652fc
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 12:48:02 2024 -0400
remove debug logs
commit 705d2319ec980ac882423c8ea13f25acf3d5ce10
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Tue May 28 18:46:45 2024 +0200
[CWS] fix imds tests on opensuse kernels (#26019)
* skip imds tests on opensuse
* add missing doc comment
commit 326f455a9ca7d3ebeabc646708d915609106e4c4
Author: Vincent Boulineau <58430298+vboulineau@users.noreply.github.com>
Date: Tue May 28 18:35:04 2024 +0200
Add generation of events on autoscaling actions (#25937)
commit bc760cf313bacc28e2cffc6481558f27bc40ea70
Author: NouemanKHAL <noueman.khalikine@datadoghq.com>
Date: Tue May 28 18:20:31 2024 +0200
Improve log messages of the NTP check (#25705)
* Update cloud provider NTP detection log message and level down to Debug
* Improve log error message failed to get clock offset output format
* add defaultDatadogPool var and improve debug log message to print the default hosts
* Change local defined servers log message level to DEBUG and improve
output format
* add single info log message with the final NTP hosts that will be used by the check
* remove error count
* change cloudproviders log level back to INFO
* reno
commit 67297fa6082a471f2429e4867d4417be62e1dd71
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 18:03:15 2024 +0200
[ASCII-1801] Remove testify from remaining builds (#25956)
* refactor: move MockCheckParams behind test flag to remove imports
* refactor: move NewProcessDataWithMockProbe behind test flag to remove imports
* refactor: move parseRFC3339Time behind test build tag
* refactor: move mockSCM behind test build tag
commit f91613d588cf4c2427b9294603977358765da6fe
Author: Sylvain Afchain <safchain@gmail.com>
Date: Tue May 28 17:59:14 2024 +0200
[CWS] use regular syscall hooks for kill action (#25961)
* [CWS] use regular syscall hookpoint for kill action
* move helper
* add related syscalls
commit b00415145c97082cba12db3c6490d3bb889ed452
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 11:36:57 2024 -0400
increase client expiry for timeout test
commit fa09d0b49f646e198a3b7d71d3270c68f0818acd
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Tue May 28 17:27:43 2024 +0200
fix(inv): ci_lint required additional arguments to detect failures (#26018)
commit 9a410bbe97bfa8c28697b727e876402398d809a4
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 18:27:27 2024 +0300
increase coverage of postgres operations (#25942)
commit bbd248918d9096155f39e4c281328e7f47d9e6df
Author: Guillaume Fournier <36961134+Gui774ume@users.noreply.github.com>
Date: Tue May 28 17:27:14 2024 +0200
[CSM] Don't attach sys_exit tracepoint when not needed (#26012)
commit 3fd699553161ac709cebef56210b1ae07d7d1dcb
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 17:26:18 2024 +0200
split iot-agent build and packaging (#25963)
* split iot agent build and packaging
* generate iot agent init scripts during packaging
* clarify the build/packaging separation
* fix init script generation for suse
* fix duplicated keys
* fix pipeline config on MQ
commit fdf8f9eeb10817c6c576bb0be0327a772f283e44
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 17:24:58 2024 +0200
[EBPF] Improve error control in KMT setup tasks (#26014)
* Improve error control
* Improve error control in compiler start
* Typo fix
commit d6c720a8ec59ceb414930f758d780e4ed9e8d54a
Author: maxime mouial <hush-hush@users.noreply.github.com>
Date: Tue May 28 16:33:55 2024 +0200
Migrate config.Datadog from global to function (#25332)
* Replace 'config.Datadog' global by a function to retrieve the config
The globals 'pkg/config.Datadog' and 'pkg/config/setup.Datadog' have
been replace by a function 'Datadog()' to access the global config.
This is the first step toward preventing a race condition accessing the
config before initialization was possible. This also pave the way toward
a complete migration of pkg/config to component.
Finally, this removes the last blocker for the creation of a dedicated
package for pkg/config/mock.go.
* Remove double import of 'pkg/config" under different names
* Change 'config.Datadog' global to a function
This commit only contains change done by 'uber-go/gopatch' software using the
following patch:
@@
var config identifier
@@
import config "github.com/DataDog/datadog-agent/pkg/config"
-config.Datadog
+config.Datadog()
@@
var config identifier
@@
import config "github.com/DataDog/datadog-agent/pkg/config/setup"
-config.Datadog
+config.Datadog()
* Fix tests following 'Datadog' global update to function
Changing 'pkg/config.Datadog' to a function instead of a copy of
'pkg/config/setup.Datadog' broke some test (we now have a single
global instead of two).
* Adding doc strings
* Update after rebase on main
commit 3e7275789614e8cc4e3f4b89baa44e7ab3023e47
Author: Kevin Maillet <48228696+kevinmaillet@users.noreply.github.com>
Date: Tue May 28 09:46:50 2024 -0400
targets migration (#26010)
commit c438dc206a70a0d75469656ce66076985672e457
Author: Sylvain Afchain <safchain@gmail.com>
Date: Tue May 28 15:03:19 2024 +0200
[CWS] add syscall context (#25768)
* [CWS] add syscall context
* add chdir test
* add chmod syscall context
* make arg a bit more dynamic
* fix linters
* use dedicated fields
* use ref
* use a ring buff approach
* disable on ebpfless
commit b410850b7d9d9ee84936086ffb181fb74a6fc651
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 15:55:09 2024 +0300
fixed usm encoding protocols CODEOWNERS (#25932)
commit be8177a0766a87aca26ab8e319c70db1506f6525
Author: Célian Raimbault <161456554+CelianR@users.noreply.github.com>
Date: Tue May 28 14:37:26 2024 +0200
Add task to create new go module (#25006)
* [go-create-module] Create modules
(wip) Trying linter_windows-x64 with unmodified modules.py file
[go-create-module] Sorted modules
[go-create-module] Sorted modules
* create-module: Added modules.py
* [create-module] Applied suggestions
* [go-create-module] Fixed reviews (windows support)
commit 452cf0353f7e749a8e61101c58eafe2aa80bcf00
Author: Kevin Fairise <132568982+KevinFairise2@users.noreply.github.com>
Date: Tue May 28 14:21:55 2024 +0200
Enable strict check mode fakeintake client (#25964)
commit 278472622ba2c67ada19c2c7363df7258dc608b8
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Tue May 28 14:16:23 2024 +0200
[CONTP-142] Remove GetVersion method from DCAClientInterface interface (#25960)
* Remove GetVersion method from DCAClientInterface interface
* PR review
commit aa18acb43d066b09d693d78570c76f8f257d97d0
Author: Guillaume Pagnoux <Yumasi@users.noreply.github.com>
Date: Tue May 28 14:11:17 2024 +0200
USM: add AMQP classification on top of TLS (#25578)
* amqp: testutils: add TLS support for AMQP server
* amqp: testutils: add client support for TLS
* classification: tls: add AMQP classification
* tests: classification: tls: add AMQP tests
* amqp: testutil: client: ask server for ack on publishes
commit cd1078a72a02bf69a29bdf812c5bb1b7dc9dee3c
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Tue May 28 14:03:58 2024 +0200
fix(pre-commit): Check on modified files only (#26000)
commit 7a36388b1b956bd2e5e61efd032c9ae53d76877b
Author: Thibaud Cheruy <thibaud.cheruy@datadoghq.com>
Date: Tue May 28 13:56:25 2024 +0200
[NDM] Add GetHardwareStates method to cisco sdwan client (#26005)
* Add GetHardwareStates method to cisco sdwan client
* typo
commit 7debf30a42aaffddafffaa3f619469c47b98b1e6
Author: Guy Arbitman <guy20495@gmail.com>
Date: Tue May 28 13:57:30 2024 +0300
usm: postgres: support parse (#25965)
* usm: postgres: support parse
* usm: postgres: Split parse message handling to a tail call
* usm: postgres: Reduce complexity for kernel 4.14
* Added documentation
commit 7fd78070b3cf9a31a6c891013ebf7ce32d46f9e4
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Tue May 28 10:20:19 2024 +0000
Log the invoke task as json (#25997)
commit a022f412b173ad8a562fc02f88d159f65e0e0761
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Tue May 28 11:45:57 2024 +0200
fix bug in kubemetadata collector (#25941)
commit 61cdfb3d25ce9d4563adf355bdccce97f2bdd090
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 11:34:35 2024 +0200
Fix test summary on failure (#25999)
commit f181fade8a1342b39062b4876ed0a4806b4dbdf0
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 11:22:54 2024 +0200
refactor: remove glob dependency from serverless (#25939)
commit 7a2a2f74db938c0c9e2df5535720b23580d350fa
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 10:59:53 2024 +0200
fix(golang-deps-diff): explictly export CGO_ENABLED to also include cgo deps (#25950)
commit 5c05eac2ee1bb7e52dc869e8c4c98a987b537a99
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 10:54:56 2024 +0200
Avoid flakiness in test (#25978)
commit 602e6b511ed24f995481b7143b184e2f5abc322b
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 10:54:51 2024 +0200
Detect if libvirtd is in sbin but not in PATH (#25975)
commit 506a99c9f74467c540e86c03ca8da3251f016afa
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Tue May 28 08:54:47 2024 +0000
Refactor the get_running_modes function and add tests (#25998)
* Refactor the get_running_modes function and add tests
* Refactor the get_running_modes function and add tests
* clear
commit 7a35afa62518c93185667a997c98e40ad0aac2da
Author: Alex Lopez <alex.lopez.zorzano@gmail.com>
Date: Tue May 28 10:01:09 2024 +0200
Add gems caching to remaining jobs (#25946)
commit 381ad0c7dd912cfdc975d11395a33189b90e025e
Author: Usama Saqib <usamasaqib.96@live.com>
Date: Tue May 28 10:01:04 2024 +0200
Setup embedded BTFs before running tests (#25848)
* setup btfs
* update platforms
* lint-python
commit 72eb439b0a3d8bcfe60bfa0fffb4f444f7069f46
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Tue May 28 09:30:15 2024 +0200
usm: kafka: test: Make checks more robust (#25969)
* usm: kafka: test: Simplify Eventually checks
Use EventuallyWithT() which allows to assert different conditions
separately and thus prints better errors messages (such as the compared
values in case the assertion fails). Also, get rid of the PrintableInt
usage since it does not add value here.
* usm: kafka: test: Combine stats wait and validation
The separation of waiting for the stats and verifying them in two
different steps is racy for the case when there are multiple events
involved (eg. multiple requests/responses) since if the events get
flushed (for example, due to the flush hook in the netif_receive_skb
tracepoint), then the first condition will be satisfied but not the
second one.
commit c90350ca75ab8794df4e08451bea72882029dc7c
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 23:23:50 2024 -0700
[windows][cws] add approvers (#25924)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* [windows][CWS] Modify channel behavior.
First of several performance fixes.
Modifies the channel used to submit events to the CWS processor.
Was a blocking, unbuffered channel. This is now runtime configurable.
The configuration is not intended to be changed by customers, but to make it easier
to tune with a/b testing internally.
Overall changes:
- defaults to non-blocking channel. This prevents events from backing up
into ETW. Also allows clearer notion of what events were dropped. When
they back up into ETW, all we know is a count of dropped events;
- sets a default channel size. This allows a small amount of buffering to
smooth out slight bursts in ETW notifications. The default right now
is fairly small to prevent large memory usage. intended to be tuned over time.
- allows ability to configure etw max buffers. This is also for tuning,
and our default (0) is to use the system default.
* [windows][cws] restrict ETW message flow
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
* [windows][cws] Re-add approvers for windows
This is a resubmit of a previous PR to implement basic approvers for windows.
* fix space
* lint
commit 146079e3289ac8ae294ecf7ea898c66aa37f6c5e
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:56:05 2024 -0400
dump client map
commit 260277840d9748204b0284134a51e34f5fb2eba9
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:53:26 2024 -0400
fix test log
commit 6d46488b2e4ecfbac9b4cee636dd0aedb6519873
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:51:50 2024 -0400
more debugs
commit 016ef3021bf0b496a387d73173c7e41a61458d9f
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 20:37:34 2024 -0700
[windows][cws] restrict ETW message flow (#25922)
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
commit 598907fe13b5afa82f750f21ca18ded0dcedc612
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 22:59:33 2024 -0400
rework logs
commit 593ea271b25422e66599d49e7bfba01a2fcc0ae7
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 19:36:34 2024 -0700
[windows][CWS] Modify channel behavior. (#25920)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* [windows][CWS] Modify channel behavior.
First of several performance fixes.
Modifies the channel used to submit events to the CWS processor.
Was a blocking, unbuffered channel. This is now runtime configurable.
The configuration is not intended to be changed by customers, but to make it easier
to tune with a/b testing internally.
Overall changes:
- defaults to non-blocking channel. This prevents events from backing up
into ETW. Also allows clearer notion of what events were dropped. When
they back up into ETW, all we know is a count of dropped events;
- sets a default channel size. This allows a small amount of buffering to
smooth out slight bursts in ETW notifications. The default right now
is fairly small to prevent large memory usage. intended to be tuned over time.
- allows ability to configure etw max buffers. This is also for tuning,
and our default (0) is to use the system default.
* [windows][cws] restrict ETW message flow
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
* fix space
commit af2a72d0a51a685c40a7d47b10d0463343098ce6
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 21:53:36 2024 -0400
client lookup logs and disable fentry
commit 350f4b9bbc104188c6519c406f7e4cda221cc683
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 20:48:33 2024 -0400
don't mark tcp failures as empty
commit fa837bbc2c969733dbd5050d8734a85611ac3959
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 18:59:48 2024 -0400
added logs to state code
commit 33ef3373fb3f44d277d14f28645cb329a343f7a3
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 18:08:06 2024 -0400
more logs plus rework tcp_done probe
commit 6b4637badcd8c2cbf9b39ad01c171e11a4edaf9e
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 17:06:48 2024 -0400
add more debugs yay
commit f4c6ae5a438feaae59e6a066139aae80514b8d9a
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 12:16:12 2024 -0700
[windows][CWS] Update the statistics that are collected. (#25919)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* ....
commit 67ab7b6a0cf2983bb70772f67d63cac70efff1ad
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 15:08:35 2024 -0400
add more debug logs
commit a7c2138cbd2ddd69de64ffca7b8a4bc4a543746f
Author: Arthur Bellal <arthur.bellal@datadoghq.com>
Date: Mon May 27 18:51:02 2024 +0200
(fleet) fix bootstrap telemetry (#25970)
commit 73da815e13790ae82c4f4eb12fd1e18ade73fcbd
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 18:35:25 2024 +0200
[CWS] copy clang-bpf and llc-bpf inside docker test container (#25967)
commit 17af8062daa32174a4a7ea5e9d63975d1cf2895b
Author: Sylvain Afchain <safchain@gmail.com>
Date: Mon May 27 17:32:22 2024 +0200
[CWS] add an option to enable raw syscall for enforcement (#25959)
commit b7dda6bea5d354b6abe54fc675419c833e120c1f
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 17:31:12 2024 +0200
[CWS] add `/workload-list` api routes and associated subcommands to security agent (#25905)
* [CWS] add `/workload-list/{short,verbose}` api routes to security agent
* add `workload-list` subcommand
* make sure we use the config component instead of the global variable
* simplify by using only one route, with a query param
* add test for workloadURL
* update CODEOWNERS
commit eb3ed4b7c67ff77bcc5656e9342c80aac42c82b7
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Mon May 27 16:53:36 2024 +0200
Split agent builds & packaging (#25885)
* move the init script in theiw own software definition
This dill simplify generating what's needed during the packaging stage
instead of generating everything and removing files during the packaging
* package-artifacts: handle multiple archives
This will happen when we package binaries and debug symbols
* reorder pkg_metrics and packaging stage
* split datadog-agent build and packaging
* add a special case for heroku for now
* simplify build/package logic
* fixups for installer
* tmp omnibus branch
* share more common config
* fixup installer
* only package scripts for intermediate artifact
* fixup installer
* adapt to change on omnibus side
* switch back to a pinned omnibus commit
* fix from review
* move init script copy in the scope they belong to
commit 65f9e9ffc6e9701920d14611f53155e4616d40b8
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:41 2024 +0200
[EBPF] Show a summary of the results in the kmt.test task (#25903)
* Show test summary
* Show legend
* Improve spacing
commit f50ca3b9239472e50d5c21be90fb716c9f7a8913
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:36 2024 +0200
Unify KMT setup (#25904)
commit b4ec2b8baf817e6cd4611625e9700351188e234a
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:05 2024 +0200
Only perform the check for local images (#25958)
commit e5d8e9d42f55baf059d7bee6c3e3bfc050931ad2
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 16:25:55 2024 +0200
[kubernetes/helpers] Move stringInRuneset func (#25952)
commit deb9b60954eef9347d9fff796df2ba56049b3d3a
Author: Sylvain Baubeau <sylvain.baubeau@datadoghq.com>
Date: Mon May 27 16:25:49 2024 +0200
Do not stop walking on permission errors (#25911)
commit f821fcb52d67fab4201afbd90870d31fc118f538
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 15:37:59 2024 +0200
Revert "fix(installer): chown installer run path to dd-agent (#25880)" (#25955)
This reverts commit 6b3d202f342cb84b0ab329b4287a792dd77647cd.
commit 491ba6d573291ab80f4173592a256dfb09fd3757
Author: Gustavo Caso <gustavo.caso@datadoghq.com>
Date: Mon May 27 15:15:46 2024 +0200
[ASCII-1802] Ensure that API endpoint provider are filter before being use (#25943)
* Ensure that API endpoint provider are filter before being use
* convert api.EndpointProvider into an interface
* add test to validate we filter out nil endpoints
commit acd0a26e72260b1d23dd8b48d8b07d20fb4d6a97
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 15:00:49 2024 +0200
[CWS] move creation of new tcclassifier to separate goroutine (#25918)
commit f656b7c07cf46f18c49e075224f540e7ed15db60
Author: Mister Yo (Maxime Riaud) <65339037+misteriaud@users.noreply.github.com>
Date: Mon May 27 15:00:45 2024 +0200
[ASCII-1622] Prevent deadlock for status and flare command (#25861)
* adding 15sec timeout for IPC requests between sub-Agent and core-Agent
* add release note
* Update releasenotes/notes/fix-flare-genereation-deadlock-b40fca3c82469d40.yaml
Co-authored-by: Pierre Gimalac <pierre.gimalac@datadoghq.com>
* use configuration setting for timeout duration
* use preexisting "server_timeout" config setting instead of "subagent_config_fetch_timeout"
* multiply config duration by seconds
---------
Co-authored-by: Pierre Gimalac <pierre.gimalac@datadoghq.com>
commit 36fb86660b903731f3aef90ddd0270c346f60eb9
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 14:41:06 2024 +0200
[workloadmeta/collectors/remote] Make filter configurable (#25945)
* [workloadmeta/filter] Add Kinds()
* [workloadmeta/proto] Add function to convert Filter
* [workloadmeta/collectors/remote] Make filter configurable
commit 6f60aae57ecc8180ac41157d37294e9b8c1e8255
Author: pducolin <45568537+pducolin@users.noreply.github.com>
Date: Mon May 27 14:41:00 2024 +0200
[e2e] generic environment in host and docker host envs (#25668)
* [e2e] move aws environment to provider parameters
* [e2e] move environment to run params
a cloud environment cannot be reused
* [e2e] add description to RunParams
commit ffc947fe84f3fd0caebbdb6c179f61a454cee0de
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Mon May 27 14:38:55 2024 +0200
fix test path (#25947)
* fix test path
* fix
commit 387c900d29edbc281946b5467cb138200296727e
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Mon May 27 14:38:23 2024 +0200
fix(invoke_ut): Trigger the custom_task UT, fix them and minor changes to enable test discovery in vscode (#25912)
commit d9593607bdd942f2c17fbab1ed4cf35d959a2655
Author: Guy Arbitman <guy20495@gmail.com>
Date: Mon May 27 15:24:54 2024 +0300
[USMON-910] Introduce postgres TLS monitoring (#25729)
* usm: postgres: Convert plaintext version to use pktbuf syntax
The migration is a prelimanary step to sharing the code between plaintext and TLS version of postgres
monitoring.
* usm: postgres: Extract main processing logic into a function
* usm: tls: Add PostgresTLS enum
* usm: postgres: Implement TLS probes
* usm: postgres: tests: Extend TestDecoding to support both plaintext and TLS modes
* usm: Fixed documentation and naming
commit 00c839d463aaa324a4684edc25f5a591f46c8f54
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 14:04:45 2024 +0200
[EBPF] Fix parsing of verifier log register state in modern kernels (#25724)
* Refactor register parsing code
* Test existing line parse behavior
* Support register state just after instruction
* Increase test coverage
* Fix linter
* Register state now is the state *after* execution
commit e9cf0d8c9c2ea0c95eea914aca86d057edcfece5
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Mon May 27 14:02:57 2024 +0200
chore(serverless): remove testify from build (#25940)
commit 25d996db5fe5aeaca8f0440660dbb74d5fbc26cf
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 12:32:16 2024 +0200
fix(installer): Don't report tmp extract dirs as repositories (#25902)
commit e1accdad30bda4b00fbdc4244b03ebbcf94ad7a3
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 12:21:54 2024 +0200
[CWS] implement user path discarders on Windows (#25891)
commit 233064852add1d1e9cf39eeeba8226df38980e44
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Mon May 27 12:21:50 2024 +0200
[ASCII-1595] Make serverless use a no-op implementation of `dogstatsd/replay` (#25548)
* feat: make serverless use no-op impl of dsd-replay
* chore: update serverless dependency list
commit f7b9c1fbe6522e073d2602b451c83e0bc5aa35d9
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Mon May 27 12:15:16 2024 +0200
e2e: fix pipeline ID env variable in readme (#25938)
commit 80cf6f399d03fe91533e4ca2486dd678e7996d56
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 10:00:05 2024 +0000
Configure pre-commit hooks to be compatible with `devagent` (#25910)
* pre-commit with devagent
* address
commit cbb3706fc389be6b5a366c46d5090c484408174f
Author: maxime mouial <hush-hush@users.noreply.github.com>
Date: Mon May 27 11:53:39 2024 +0200
simplify configuration layer in inventoryagent (#25138)
commit 4f989f4bc610247bc6abec82a9c9e69d34d6eca3
Author: Guy Arbitman <guy20495@gmail.com>
Date: Mon May 27 12:53:14 2024 +0300
usm: Introduce a method to move data_off of a pktbuf (#25928)
* usm: ebpf: Add method to modify the offset of the pktbuf
* usm: ebpf: Fix wrong calculation
We get the offset as a function argument, thus no need to read from data_off + offset
commit a897ee47121418dccc5e7c18632145f2764d7535
Author: jedupau <72938258+jedupau@users.noreply.github.com>
Date: Mon May 27 11:44:30 2024 +0200
[NDMII-2654][snmp] store devices tags on disk with mock directory (#25887)
* snmp: store tags on disk
* ndm: write tags in cache only at launch
* fix tests
* add returns on read from cache method
* add comment for test
commit 18bc7d2e2ad59eecda18b6e33d0f1dc2bc4dc99e
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 09:41:44 2024 +0000
Add a `lint` option to `get_modified_packages` (#25935)
commit 6b3d202f342cb84b0ab329b4287a792dd77647cd
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 11:11:09 2024 +0200
fix(installer): chown installer run path to dd-agent (#25880)
commit 1dbd2a144f804b08a32eeb8cb25d28bccb7fc524
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Mon May 27 11:06:47 2024 +0200
add dotnet log (#25927)
commit af0d4da5189f71e7c7fea734db325e62d7238af4
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 11:00:53 2024 +0200
[kubernetes/metadata] Use workloadmeta instead of a node informer (#25615)
* [workloadmeta] Add ListKubernetesNodes()
* [kubernetes/metadata] Use workloadmeta instead of node informer
* [kubernetes] Extract controllers into a separate package
The controllers code was in the "apiserver" package and now depends on
workloadmeta, but workloadmeta also depends apiserver. Creating a new
"controllers" package solves this issue.
* [kubernetes/apiserver/controllers] Make things private when possible
* Review comments
commit f6d0c587696f58748dc04a5d4fd7ec54ee235f23
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 08:30:19 2024 +0000
Add the Python version to the `invoke` monitoring (#25934)
commit 7bf54a19d2684a1c197099339aa9c7da03775cd8
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Mon May 27 10:16:26 2024 +0200
fix(ci): Change the logic on junit upload job (#25850)
* refactor small methods
* change the junit upload logic to upload per team
First iterate on all xml to sort them by team
Then call upload on each team folder
Added tests
Muted all unittest that logged in stdout, pending a logger
implementation
* Use a pool instead of a for loop for performances
* codereview: minor fixes
* [ACIX-277] Upload a tag to sort tests by pipeline source
commit d3032058188faa3917e33ca5a8e87ae2a03015a1
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 09:58:05 2024 +0200
sync and update docker functional tests image (#25917)
commit 494da1371201be72d683a1b93596b7d9aa695e59
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 09:58:00 2024 +0200
test(installer): Add tests for injector upgrade paths (#25853)
* upgrade(installer): Support force non install
* fix db
* tests(installer): Implement upgrade tests tests (injector deb <-> oci)
* nit
commit 47d682557c651798b51b29d3e1f5f74064dde772
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 22:37:05 2024 -0400
use proper helper for failed conns check
commit b7bf05117d13d68d884e98bd721ccf63ade26417
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 22:35:53 2024 -0400
only clear map if failed conns enabled
commit bb9a0b2513f1149f140b39a5d25364b9cabc3297
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 20:13:08 2024 -0400
make matching code member of map type
commit 620fd4ccc8e32bf91e7af2057893d450e5c10c75
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 19:58:48 2024 -0400
add cachelike behavior to failed conn map
commit 90c924d61d34942a6e5e0d9223e9f0caf8fc9875
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Sun May 26 17:20:54 2024 +0000
Detect if the invoke command is running with PyApp (#25906)
* Detect if the invoke command is running with PyApp
* Update tasks/custom_task/custom_task.py
* Update tasks/custom_task/custom_task.py
commit bf83f431d9ac6cf800210dde60ed078453746f3f
Author: Guy Arbitman <guy20495@gmail.com>
Date: Sun May 26 15:33:57 2024 +0300
[USMON-934] postgres tls classification (#25925)
* usm: gotls: Add testing capabilities to support TLS classification tests
We add:
- skipIfGoTLSNotSupported method which skips a test if go-tls monitoring is not supported on a machine / configuration
- goTLSAttachPID and goTLSDetachPID helpers which wraps GoTLSAttachPID and GoTLSDetachPID. The wrappers meant to ease reading the tests
- goTLSDetacherWrapper and goTLSAttacherWrapper which meant to wrap preTracer and postTracer, and allow easy reusing of same setup in
the TLS classification tests.
- SetGoTLSExcludeSelf method which allows to modify the value of the configuration GoTLSExcludeSelf at runtime, to allow
relevant tests to enable self-hooking
* usm: postgres: tests: Server supports TLS
* usm: postgres: tests: Change client to support connection options
* usm: postgres: tests: Handle error 'address already in use'
* usm: tests: Added documentation
commit 0246518c068b39715a2e3d07eaece1bcee1f2087
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 11:15:19 2024 -0400
clean up matching locks
commit d0b647bcb646076ba11398a169e28eabcea58a3e
Author: Alexandre Yang <alexandre.yang@datadoghq.com>
Date: Sat May 25 08:54:30 2024 +0200
[network-path] Add service (#25892)
* [network-path] Add service
* Add source and destination service
* fix test
commit 3224c95a55bc82b1b9b7ed85f7e3286284f688c9
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 02:51:08 2024 -0400
disabled failed conns by default
commit 4c8c861af80f2f0d9424f62f3d2a86c4e3f93f69
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 02:29:51 2024 -0400
uncomment map delete
commit 2ac190dd0ca15af07e05f541177cb4d4ecff8fc1
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 19:10:58 2024 -0400
remove user timeout value
commit e5b69ff8a31b2c377aefaf638186fff88f7ee27b
Author: Keisuke Umegaki <41987730+keisku@users.noreply.github.com>
Date: Sat May 25 07:50:46 2024 +0900
Improve logging in the Lambda Logs API handler (#25878)
* Improve error handling in Lambda Logs API handler
* reno new
* ignore io.ReadAll() error since we handle it later
commit 7a8b0cf8bcf3540dd8446b3392d3110612848bf2
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Fri May 24 15:32:31 2024 -0700
[windows][CWS] consolidate windows probe initialization. (#25916)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
commit 6ec1386ef4c379af64cfa1b90b920609f1b3e361
Author: Yang Song <songy23@users.noreply.github.com>
Date: Fri May 24 18:25:10 2024 -0400
[OASIS-37] Move collector internal/datadog to Agent as modules (#25841)
* [OASIS-12] Move OTel statsd metrics client to agent
* [OASIS-12] Move OTel ingester to agent
* Format
* lint
* Rename ingester to statsprocessor
commit e19773f96565662a14fad551d5be0dee5e668ef7
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Fri May 24 14:42:35 2024 -0700
[windows][etw] add ability to filter etw messages by ID (#25875)
* add inclusion/exclusion list to ETW component
* gofmt
* review feedback
commit 3d414e9ee058f778e8aa47dbe3fb41bbfd894c41
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 17:29:01 2024 -0400
skip linter
commit 31fc3c39285825f66624d7a5ceda0af1130bafd5
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 14:29:31 2024 -0400
fix test compile
commit 7ac9c8b8595235bdf9a3ed457d0095100251c451
Author: Gustavo Caso <gustavo.caso@datadoghq.com>
Date: Fri May 24 19:49:35 2024 +0200
[ASCII-1796] Move list dependency test to python (#25866)
Co-authored-by: pgimalac <pierre.gimalac@datadoghq.com>
commit d0487e7eeb5f92128edb9720cb781315b1dce23c
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 13:29:48 2024 -0400
skip timeout test on prebuilt
commit 4510cafe0382a65ac614f3726bc31032be8d1145
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 13:12:55 2024 -0400
rework ebpf code to handle timeouts
commit 2beb26aded7274a40a25aa764365881293225819
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Fri May 24 18:17:50 2024 +0200
[ASCII-1613] Split `dogstatsd/replay` into new component hierarchy (#25512)
* refactor: move component and exported symbols to def folder
* refactor: move Mock interface and module to their own directories
* refactor: move fx related functions in fx directory
* refactor: move impl to its own directory
* refactor: remove CapPool global variable
* fix: review comments about mock
* fix: review comments about package naming
* chore: rename replaydef imports to replay
* chore: update serverless dependency list
commit 5b9f9aa80608ef9294da08b219bd5b0ccbd3df67
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Fri May 24 18:17:46 2024 +0200
fix(tools): Set the correct jira project name for telemetry and analytics team (#25907)
commit 5e790668711cccec9d24e55046745571ce9fad1a
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Fri May 24 17:50:53 2024 +0200
[ASCII-1790] Send metrics with number of go dependencies for each build (#25854)
* feat: send metrics with number of go dependencies for each build
* fix: add CGO_ENABLED env
* refactor: move constant metric names to globals
commit d9ff65e15240ec2416d945a9df67ea33049ef73c
Author: Arthur Bellal <arthur.bellal@datadoghq.com>
Date: Fri May 24 16:04:42 2024 +0200
(fleet) install the agent oci by default when remote updates are enabled (#25898)
commit 37030bc81b6f3d82f0a7ada71c33ac1661df9928
Author: Alexandre Menasria <47357713+amenasria@users.noreply.github.com>
Date: Fri May 24 16…
akarpz
added a commit
that referenced
this pull request
May 30, 2024
commit 7ff60b0875bba5ce9e3a835f00b0172646612795
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:29:29 2024 -0400
reorganize tracer code
commit bb505ec443134e3280adfd754c1bbb8ced0524d4
Merge: ad9cc589ac 2948aa9015
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:16:36 2024 -0400
Merge branch 'main' into akarpowich/perf_test_failed_conns
commit ad9cc589ac8b3e349d566390789bdb167848993a
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:14:04 2024 -0400
reset file to origin
commit 4ae857f43f6894f69a7504e9b5104f7702019f42
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:12:48 2024 -0400
fix again
commit 2a6aaffe736d3eae587b233694b26c081fe3bce5
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:09:42 2024 -0400
reset random go mod changes
commit fb9c7f1f14fd9acef65d8de6b511aff6162e3528
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 19:02:36 2024 -0400
clean up tests
commit f1704601b6e00483511370b3549fdc99b05c1944
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 17:56:57 2024 -0400
fix race condition
commit 2948aa9015c2098bf1d0a972b9d729c0d9da2f86
Author: Stanley Liu <stanley.liu@datadoghq.com>
Date: Wed May 29 17:03:31 2024 -0400
Implement metrics for infraattributesprocessor (#25711)
* Initial version
* Rename tagenrichmentprocessor to infraattributesprocessor
* Fix merge
* Rename config_logs_strict
* Add tagger component
* Fix tests and lint
* tidy
* Refactor to tag multiple entities
* Rename
* Temp update mapping go attributes
* tidy
* Update attributes mapping
* Fix resource metrics loop, add more tests
* Update attributes to v0.16.1
* Update attributes to v0.16.1
* Add container_image_metadata
* generate licenses
* Rename
* Fix merge conflicts
* generate deps
commit 22e4ec14be7ed7f99f7bcf0ea44e983d5e9c792d
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:55:04 2024 -0400
increment telemetry
commit 09badae964ebd13ea68d1c86ecca169fc26edb0c
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:42:03 2024 -0400
telemetry for failure matches
commit 3c28e38bf37f143bc25296e7c7bae2f76c8af592
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 14:33:27 2024 -0400
rename failure buffer
commit c7efe438c39710cd1698e3408279107916744d26
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Wed May 29 19:05:26 2024 +0200
[kubernetes/apiserver] Initialize metadata controller properly (#26070)
commit 2844cfb492ff89e404e0b0cc052b07807660f483
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Wed May 29 18:24:31 2024 +0200
[CWS] windows multi approvers (#26067)
* ensure old approvers are not kept after policy reloading
* add new approver capabilities for other FRIM event types
* ensure we take into account all event basenames for approvers
* ensure approver are able to skip event types with no active rule
* add test for approver mechanism
* disable approvers in `TestETWFileNotifications`
commit 3c1ea9978176c16e6303a5702c14f9c4602cdb08
Author: Sylvain Afchain <safchain@gmail.com>
Date: Wed May 29 18:18:10 2024 +0200
[CWS] add hash action (#25870)
commit d1233c56a45a2f4f069360d9a2e424e5c56fb302
Author: Dustin Long <me@dustmop.io>
Date: Wed May 29 12:01:45 2024 -0400
Move alternative otel collector implementations into new component layout (#25836)
Co-authored-by: GustavoCaso <gustavo.caso@datadoghq.com>
commit 26ab9b5f65ca31dde78eb6684fb378b29dc7e334
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Wed May 29 11:58:22 2024 -0400
remove old evict logic and add new test
commit f2791932596d085ac42d6273a1f8fbf65ccc6086
Author: Bryce Kahle <bryce.kahle@datadoghq.com>
Date: Wed May 29 08:42:11 2024 -0700
replace slashes in gitlab section id (#26034)
Fixes section id for junit file uploads
commit 46b14bcd5a74badd542392f74a3c98dc093a3ad9
Author: Kacper <89013263+kacper-murzyn@users.noreply.github.com>
Date: Wed May 29 17:41:56 2024 +0200
last_stable updated to 7.54.0 (#26068)
* last_stable updated to 7.54.0
* Update release.json
commit e9713c0a90879a4cd2d09db777b0e9c10998ca90
Author: Paul Laffon <paul.laffon@datadoghq.com>
Date: Wed May 29 17:41:46 2024 +0200
[DJM-251] Add new parameter djm_config.enabled to enable Data Jobs Monitoring (#25846)
* Add new parameter djm_config.enabled to enable Data Jobs Monitoring
* rst uses double backticks
Co-authored-by: Vickenty Fesunov <vickenty@users.noreply.github.com>
---------
Co-authored-by: Vickenty Fesunov <vickenty@users.noreply.github.com>
commit ebeee88c4ff5fa92d2bdf4207ea499efa40641f5
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 14:43:02 2024 +0000
Build the docs when the workflow is modified (#26050)
commit 3cbeb226ec15e661902487b0b2ea9fe79c55ae1f
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Wed May 29 16:41:32 2024 +0200
avoid systemd conflicts (#25944)
Co-authored-by: arbll <arthur.bellal@datadoghq.com>
commit 38fc5b1807b62b15e0017ad452f9f25b14e3983b
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Wed May 29 16:22:44 2024 +0200
[CWS] replace tracepoint hook with kprobes for mmap event (#26015)
commit 553bb7f6513d682442f0b692ab6a2e6e810e91b3
Author: agent-platform-auto-pr[bot] <153269286+agent-platform-auto-pr[bot]@users.noreply.github.com>
Date: Wed May 29 14:16:35 2024 +0000
Changelog updates for 7.54.0 release (#26043) (#26064)
Co-authored-by: kacper-murzyn <89013263+kacper-murzyn@users.noreply.github.com>
commit 4302a8a569e7d4b5b26e0b55546951eaecc07ca7
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 16:04:15 2024 +0200
usm: kafka: Support fetch v12 (#25812)
* usm: kafka: Use unsigned loop counter
This allows some compiler optimzations and avoids a "looks like the BPF
stack limit of 512 bytes is exceeded" error when more code is added to
the classification functions.
* usm: kafka: test: Make unused fields non-zero
Set some unparsed fields in the packets to non-zero values for easier
debugging when packet parsing goes wrong and reads from wrong offsets.
* usm: kafka: test: Pass FetchRequest to buildMessages
To allow the request to be customized per test.
* usm: kafka: test: Pass in API version
Pass in the API version as a parameter to the raw tests, so that
different API versions can be tested.
* usm: kafka: test: Test different versions in raw test
Test some versions which have specific conditions.
* usm: kafka: test: Allow topic to be customized
* usm: kafka: test: Add test for large topic name
* usm: kafka: test: Add test for many topics
* usm: kafka: test: Add raw test for many partitions
* usm: kafka: test: Handle flexible header
* usm: kafka: Pass in version number to parsing tests
* usm: kafka: Support Fetch v12
Add support for v12 of the Fetch API. The main change is the use of
varints and addition of tagged values. While that change itself is
fairly straightforward, the need to parse varints caused the programs to
exceed the instruction size supported by older kernels (4096
instructions), so the programs had to be split into separate programs
for pre-v12 and v12, as well as to do the parsing in two steps in
separate programs: a first step to parse the locations of the record
batches arrays, and a second step to parse the list of found locations.
The split between pre-v12 and v12 is simple and handled by informing the
compiler about the bounds of the versions, and then depending on it to
eliminate the unused branches. The split of the parsing into two steps
requires code to handle the transition between the two steps correctly.
Also mainly due to code size restrictions on older kernels (even after
the above optimizations), the following limitations are currently
present:
- A maximum of four bytes of varints are supported
- The tagged values fields are always assumed to be empty
* usm: kafka: test: Check for errors from LookupMaxKeyVersion
* usm: kafka: Remove leftover comment
* usm: kafka: remove unused cgo type
* usm: kafka: Remove passing of level
* usm: kafka: Add comment to parse_varint_u16()
* usm: kafka: Fix u16 varint check
The second byte's MSB should only be checked if the first byte has the
MSB set, since otherwise the second byte is unrelated to the varint.
* usm: kafka: Rename topic_name_size_tmp to topic_name_size_raw
* usm: kafka: Handle splits in header
We were previously not handling this mainly due to code size
restrictions, but with the program split this can be supported.
* usm: kafka: Make read_with_remainder generic
Remove the copy/pasted code and make read_with_remainder() generic with
the use of a function pointer. The function pointer will be folded at
compile time by the compiler. The instruction count is unchanged before
and after this patch.
* usm: kafka: Remove unused nonrestartable functions
* usm: kafka: Remove _restartable suffix
Now that we only have restartable readers, remove the redundant suffix.
* usm: kafka: Validate zero tagged fields when possible
* usm: kafka: Remove __read_varint indirection
* usm: kafka: Allow varint bytes to be customized per location
To reduce code size by limiting iterations wherever it makes sense.
* usm: kafka: Customize varint bytes per location
* usm: kafka: Clarify N-1 operation in varints
* usm: kafka: Rename tmp2 variable
* usm: kafka: Add comment about flexible
* usm: kafka: Skip varint number of topics
* usm: kafka: Check zero tagged fields in request
* usm: kafka: Use 64 bits for varint results
* usm: kafka: Add comment about uninitialized variable
* usm: kafka: test: Fix teardown
The telemetry test assigns to the client in the context multiple times,
so some of the clients are never torn down, leading to issues with tests
run later (such as for example the still-running clients attempting to
connect to the raw server while the raw tests are executed afterward).
commit 66dfa7ceff7d8f465dec4590eb2a1dfec85c3022
Author: jedupau <72938258+jedupau@users.noreply.github.com>
Date: Wed May 29 16:02:53 2024 +0200
use the cache container (#26066)
commit d25878205e9203bb5a7ec86f70a21177f0bdba9c
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:59:50 2024 +0200
[CONTINT-3702] fix(sbom): Fix mount path retrieval from overlayfs (#25886)
* Get mounts from overlayfs snapshotter, similarly as what is done in MountImage
* prefer opts.UseMount, remove unused NoCache opts, use cache only when scanning images
* move scan from snapshotter out of the default function
commit 3c91826bbbd4f254365024eb5dc60f82753efca6
Author: Yang Song <songy23@users.noreply.github.com>
Date: Wed May 29 09:35:53 2024 -0400
[OTEL-1720] Add an API in pkg/trace/stats that converts eligible OTLP spans to the input to APM stats concentrator. (#23503)
commit 6db250af895cb5f30bcee6d444ca3e65e553f589
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:35:45 2024 +0200
update gomod (#26065)
commit de91510cb89337a9c649a2b082e585dbdc7c2add
Author: AliDatadog <125997632+AliDatadog@users.noreply.github.com>
Date: Wed May 29 15:35:39 2024 +0200
[CONTINT-4105] Support arbitrary container-ids to collect container metrics (#25515)
* Collect cgroup path in workloadmeta
* Implement the container filter
* Update TestDump
* release note
* fix dogstatsd test using a mock workloadmeta with no implemented methods
* support the case of an empty cgroup path
* Update releasenotes/notes/support-arbitrary-container-id-cc0efdf7c156b7ad.yaml
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
* mention that the path is relative
* Remove no-lint comments
* remove the unsubscribe
* Move trie to its own package
* Add code comments to explain about suffix matching and make sure we only populate the Trie if the regex does not match
* add test cases for cgroupfs / systemd
* update protobuf
---------
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
commit 91aa08c0f34114f4ca3794ae7e4898f8c37a5a25
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Wed May 29 15:35:33 2024 +0200
use a dedicated variable to force a lower compression level (#26044)
* use a dedicated variable to force a lower compression level
Using the maximal compression level on armhf jobs will attempt to
allocate more than 32bits binaries can address.
* use a more flexible approach for forcing compression level
* rename variable
* fix method name
commit c0bcfd8169843c3b35d3ce83cc34716b4e50d0bd
Author: Stephen Wakely <fungus.humungus@gmail.com>
Date: Wed May 29 14:27:50 2024 +0100
Add zstd compression level option (#25261)
* Add zstd compression level option.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Set level on stream compression.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Log on zstd
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Tidy
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove printf
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove spurious import.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Add unit test for compression level.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Remove zstd dependency from config and rename option to include zstd
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Linter errors
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
* Revert version change for otel.
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
---------
Signed-off-by: Stephen Wakely <fungus.humungus@gmail.com>
commit e79613843b013779fb6c7740a2dc32f9ed433d5c
Author: Ofek Lev <ofekmeister@gmail.com>
Date: Wed May 29 08:31:09 2024 -0400
Remove outdated documentation (#26037)
commit 40f9f7916c78dd13705e4248276a5779d8ec8ab6
Author: Julien Lebot <julien.lebot@datadoghq.com>
Date: Wed May 29 14:26:51 2024 +0200
[Fleet Automation] Add support for Windows in fleet installer (#25186)
* Try with symlinks on Windows
* First pass
* Revert to using UNIX sockets on Windows
* Allow passing parameters to install command
* fix bootstrapper compilation issue
* Fix windows installer error handling
* Use HTTP instead of UNIX sockets
* Revert "Use HTTP instead of UNIX sockets"
This reverts commit 1ee4e46630390f7236b4c9173a823199045acc89.
* Refactor installer paths
* Generate the OCI package
* Only package the Agent 7 in OCI
* Generate package in pipeline
* Fix linux compilation
* progress
* Fix merge conflicts
* Fix powershell script to generate OCI packages
* Fix source directory
* Fix deploy
* Fix deploy
* remove helper
* Invert calls and add return error to function
* Linter
* Update comments
* Add missing argument
* Only include windows registry on windows
* Add missing error
* Add missing arg
* Fix linux compilation errors
* Fix last error
* Fix linux unit tests
* Address review comments
* Update pkg/fleet/installer/installer.go
Co-authored-by: Arthur Bellal <arthur.bellal@datadoghq.com>
---------
Co-authored-by: Arthur Bellal <arthur.bellal@datadoghq.com>
commit 3a58984242dec80a5a7aa89cf763776fa78ee97a
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Wed May 29 12:42:27 2024 +0200
feat(releasing): Create release candidate on automatic schedules (#26001)
commit d4705fa89155d6c304c257c6903c8e2835bd973f
Author: Mister Yo (Maxime Riaud) <65339037+misteriaud@users.noreply.github.com>
Date: Wed May 29 12:24:23 2024 +0200
[ASCII-1393] improve GUI auth flow (#24800)
* replace gui security mechanism with authToken->accessToken JWT mechanism
* typo sessionID
* fix lint issue
* rename authToken to loginToken and create dedicated endpoint
* use single-use intentToken and homemade hmac signed accessToken
* update accessToken payload by adding expirationTime
* replace bad external package
* add token prefix, update gorilla http router
* update systray launch-gui function
* add GUI_session_expiration param
* add release note
* use nil ApiEndpointProvider and update some comments/docs
commit c435f967d9d52981a9edbfc86a1c1fd24f67f84a
Author: Paul <paul.coignet@datadoghq.com>
Date: Wed May 29 11:49:34 2024 +0200
[FA] Add default log source to file logs (#25816)
* Add log source
* Add integration name
* Include container environment
* Address revies
* Address review
* Add commnet
commit 50183e00416eab4be894d2533ef48201ac21e54a
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 11:45:08 2024 +0200
usm: kafka: test: Correct assertion message (#26049)
HTTP and Kafka were mixed up in the message.
commit b9e111e5c83a4fe5db20be024705ee4d8c3f17ae
Author: Vickenty Fesunov <vickenty@users.noreply.github.com>
Date: Wed May 29 11:44:58 2024 +0200
Fix time sampler tests (#25977)
Run tests with the intended tags store settings rather than always
using no-op store.
commit e1fc869376d3eb0c366883dd2284f695c584796c
Author: val06 <valeri.pliskin@datadoghq.com>
Date: Wed May 29 10:42:38 2024 +0100
small typo fix (#26055)
commit 843506e44554322e5fdf72bd84da77b7c5852530
Author: Célian Raimbault <161456554+CelianR@users.noreply.github.com>
Date: Wed May 29 11:42:21 2024 +0200
Improve agent-platform-ops alerts (#25882)
* tmp
* [rfc-team-notifications-1] Reworked logic
* [rfc-team-notifications-1] Initial PR info
* Implemented send_notification with new method
* wip
* Fixed more tests
* Fixed more tests
* Fixed all tests
* s3: Updated file name and bucket
* [team-notifications-1] Added test script
* [team-notifications-1] Updated notif
* [team-notifications-1] Fixed lint
* [team-notifications-1] Fixed notify job executions json
* [team-notifications-1] Test
* [team-notifications-1] Test
* [team-notifications-1] Test
* [team-notifications-1] Removed tests, cleaned code
* [team-notifications-1] Removed tests, cleaned code
* [rfc-team-notifications-1] Applied suggestions
* [rfc-team-notifications-1] Added commit sha to job executions
* [rfc-team-notifications] Applied suggestions
* [rfc-team-notifications] Applied suggestions
* [rfc-team-notifications] Applied suggestions
commit 34c6de12a0623c4a4f9bca542f56b96fed22c3f3
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Wed May 29 11:20:20 2024 +0200
[workloadmeta/collectors/remote] Handle unsupported kinds (#26052)
commit c4dd4acce76abe7af4e1703345fbdaba35e22bf2
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Wed May 29 11:41:06 2024 +0300
[USM] Support postgres alter operation (#25931)
* support alter operation
* support marshal for alter
* added test to TestFormatPostgresStats for alter
* update to main and fix test
commit 7e1459b9dc235abfdff10ebc8bf4455982cb16f6
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Wed May 29 10:27:19 2024 +0200
usm: kafka: test: Fix teardown (#26029)
The telemetry test assigns to the client in the context multiple times,
so some of the clients are never torn down, leading to issues with tests
run later (such as for example the still-running clients attempting to
connect to the raw server while the raw tests are executed afterward).
commit 966f573bb70a5ba9a080b8f18e51208e50d918bc
Author: Kevin Fairise <132568982+KevinFairise2@users.noreply.github.com>
Date: Wed May 29 10:15:51 2024 +0200
ADX-252 Local kubernetes provider (#23153)
* Create kindvm provider and kindvm host
* Create kindvm scenario test
* Use test-infra commit
* Update test/new-e2e/examples/kindvm_test.go
Co-authored-by: pducolin <45568537+pducolin@users.noreply.github.com>
* Address suggestions
* WIP
* Address suggestions
* Rename KubernetesHost to Kubernetes
* Tidy
* Update test
* Rename kind test
* Fix linter
* Update go + runner image
* Tidy
* Create local kind provisioner
* Bump deps
* Update init of fakeintake to use clientURL if provided
* Update local kind provider to deploy a local fakeintake
* Exclude fakeintake container from log collection
* Remove useless commented code
* Remove newline
* Remove useless options
* Update test-infra
* Tidy
* Remove deleted field
* WIP
* Create example and last fixes
* Fix K8SApp signature change
* Fix release name change
* Fix release name change
* Update test-infra version
* Fix test-infra bump issues
* Tidy
* Pass provider in eks provider
* Enable autoscaling
* Bump test-infra to fix quote
* Fix orchestrator test
* Fix orchestrator test
* Final bump of test-infra
---------
Co-authored-by: pducolin <45568537+pducolin@users.noreply.github.com>
commit 8bce778f1c2597ad724420c5d76fb8ecad4714fe
Author: Andrea Marziali <marziali.andrea@gmail.com>
Date: Wed May 29 10:15:46 2024 +0200
[service discovery] fix minor python module use cases (#26026)
Co-authored-by: jonbodner <jon.bodner@datadoghq.com>
commit a9f51824ae913c875c8c39f187aa91b124b99de2
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Wed May 29 10:15:41 2024 +0200
remove deadlock in dca client (#26038)
commit 6a5c08afbd6c50b2b622b82cca59b3c7d3fd22dd
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 07:39:52 2024 +0000
Rename `devagent` to `deva` (#26042)
commit ac86be5ddd507b383224101b6736c08da8e72678
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Wed May 29 09:23:20 2024 +0200
remove env (#26041)
commit 4a49dae97a30986a503a8baabe7fced012c812ea
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Wed May 29 07:04:24 2024 +0000
Run the tidy hook only on modified packages (#26008)
* Run the tidy hook only on modified packages
* address
* address
* missing tidy_all
commit f125445e8e75058fbf588dedecec00b5a1c11466
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Wed May 29 08:05:33 2024 +0200
feat(ci): Introduce a new task to guess the owner of a github issue (#25953)
This initial version is just guessing using keywords in the issue
description. This will be enhanced with a call from a ML model. The task
will be called in a github action
commit 168f81555e7c509437092f4b390e8032f9a00c0a
Author: Minyi Zhu <minyi.zhu@datadoghq.com>
Date: Tue May 28 21:11:07 2024 -0400
[CONTP-61] remove global variables in tagger (#25804)
* remove global variables in tagger
* fix unit test
commit 8ddd5ff6a4176fb77c5cc3e460eed5552ce8ac99
Merge: ae32666488 1eb4f52e9f
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 20:24:28 2024 -0400
Merge branch 'main' into akarpowich/perf_test_failed_conns
commit 1eb4f52e9f8215e9e96dc5a6964f001f6cf80029
Author: Keisuke Umegaki <41987730+keisku@users.noreply.github.com>
Date: Wed May 29 07:25:54 2024 +0900
Enable to set the buffering config of Lambda Logs API via env vars (#25923)
* Enable set the buffering config of Lambda Logs API via env vars
* fix envVarToInt
* Update add-lambda-logs-api-buffering-configs-ba8b5ad40eb6a62d.yaml
Co-authored-by: Kari Halsted <12926135+kayayarai@users.noreply.github.com>
---------
Co-authored-by: Kari Halsted <12926135+kayayarai@users.noreply.github.com>
commit 9e8e0c4345c58e7ccd0ac119c66dd43b5be5f97b
Author: Dustin Long <me@dustmop.io>
Date: Tue May 28 17:58:59 2024 -0400
Bump viper version to v1.13.4 (#26017)
* Bump viper to v1.13.4, which includes fix for url keys in maps
* go fmt config_test.go
* Unit test for config, now that viper flakiness is fixed
* Bump viper version in more packages
commit deb1e7c0f2c0111b6f7ec4446d614ef1bb70b293
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 23:48:26 2024 +0300
[USM] Support postgres delete operation (#25930)
Co-authored-by: guyarb <guy20495@gmail.com>
commit 7b264b60b9bcebe163e0055aaeafa45b7143f7e0
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 21:46:25 2024 +0200
Fix gen-config-from-ci-pipeline (#26025)
commit ae32666488f1f4709e6126882d8a232bb9b1ddbf
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 14:58:47 2024 -0400
remove more debug logs
commit ed5e6576112068763605963ecd4187527397da4a
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 20:31:40 2024 +0200
Revert "split dogstatsd build and packaging (#26002)" (#26033)
This reverts commit fddbf0e64d13dcb93889deaead0097402129e72c.
commit 62532f669db6fedc6e01c67ae51535226039afa9
Author: Tal Usvyatsky <18072279+TalUsvyatsky@users.noreply.github.com>
Date: Tue May 28 14:11:35 2024 -0400
reuse DD_ENHANCED_METRICS instead of separate env var (#26023)
commit 49ee3df65fc9a2fe100cb20f56ac511d17c78e68
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 19:39:47 2024 +0200
CI: increase available disk space for windows tests containers (#26027)
commit fddbf0e64d13dcb93889deaead0097402129e72c
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 18:59:08 2024 +0200
split dogstatsd build and packaging (#26002)
* split dogstatsd build and packaging
* remove reference to deleted file
commit ae6a9f20952b2f4ca75a4362f56049db35a652fc
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 12:48:02 2024 -0400
remove debug logs
commit 705d2319ec980ac882423c8ea13f25acf3d5ce10
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Tue May 28 18:46:45 2024 +0200
[CWS] fix imds tests on opensuse kernels (#26019)
* skip imds tests on opensuse
* add missing doc comment
commit 326f455a9ca7d3ebeabc646708d915609106e4c4
Author: Vincent Boulineau <58430298+vboulineau@users.noreply.github.com>
Date: Tue May 28 18:35:04 2024 +0200
Add generation of events on autoscaling actions (#25937)
commit bc760cf313bacc28e2cffc6481558f27bc40ea70
Author: NouemanKHAL <noueman.khalikine@datadoghq.com>
Date: Tue May 28 18:20:31 2024 +0200
Improve log messages of the NTP check (#25705)
* Update cloud provider NTP detection log message and level down to Debug
* Improve log error message failed to get clock offset output format
* add defaultDatadogPool var and improve debug log message to print the default hosts
* Change local defined servers log message level to DEBUG and improve
output format
* add single info log message with the final NTP hosts that will be used by the check
* remove error count
* change cloudproviders log level back to INFO
* reno
commit 67297fa6082a471f2429e4867d4417be62e1dd71
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 18:03:15 2024 +0200
[ASCII-1801] Remove testify from remaining builds (#25956)
* refactor: move MockCheckParams behind test flag to remove imports
* refactor: move NewProcessDataWithMockProbe behind test flag to remove imports
* refactor: move parseRFC3339Time behind test build tag
* refactor: move mockSCM behind test build tag
commit f91613d588cf4c2427b9294603977358765da6fe
Author: Sylvain Afchain <safchain@gmail.com>
Date: Tue May 28 17:59:14 2024 +0200
[CWS] use regular syscall hooks for kill action (#25961)
* [CWS] use regular syscall hookpoint for kill action
* move helper
* add related syscalls
commit b00415145c97082cba12db3c6490d3bb889ed452
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Tue May 28 11:36:57 2024 -0400
increase client expiry for timeout test
commit fa09d0b49f646e198a3b7d71d3270c68f0818acd
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Tue May 28 17:27:43 2024 +0200
fix(inv): ci_lint required additional arguments to detect failures (#26018)
commit 9a410bbe97bfa8c28697b727e876402398d809a4
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 18:27:27 2024 +0300
increase coverage of postgres operations (#25942)
commit bbd248918d9096155f39e4c281328e7f47d9e6df
Author: Guillaume Fournier <36961134+Gui774ume@users.noreply.github.com>
Date: Tue May 28 17:27:14 2024 +0200
[CSM] Don't attach sys_exit tracepoint when not needed (#26012)
commit 3fd699553161ac709cebef56210b1ae07d7d1dcb
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Tue May 28 17:26:18 2024 +0200
split iot-agent build and packaging (#25963)
* split iot agent build and packaging
* generate iot agent init scripts during packaging
* clarify the build/packaging separation
* fix init script generation for suse
* fix duplicated keys
* fix pipeline config on MQ
commit fdf8f9eeb10817c6c576bb0be0327a772f283e44
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 17:24:58 2024 +0200
[EBPF] Improve error control in KMT setup tasks (#26014)
* Improve error control
* Improve error control in compiler start
* Typo fix
commit d6c720a8ec59ceb414930f758d780e4ed9e8d54a
Author: maxime mouial <hush-hush@users.noreply.github.com>
Date: Tue May 28 16:33:55 2024 +0200
Migrate config.Datadog from global to function (#25332)
* Replace 'config.Datadog' global by a function to retrieve the config
The globals 'pkg/config.Datadog' and 'pkg/config/setup.Datadog' have
been replace by a function 'Datadog()' to access the global config.
This is the first step toward preventing a race condition accessing the
config before initialization was possible. This also pave the way toward
a complete migration of pkg/config to component.
Finally, this removes the last blocker for the creation of a dedicated
package for pkg/config/mock.go.
* Remove double import of 'pkg/config" under different names
* Change 'config.Datadog' global to a function
This commit only contains change done by 'uber-go/gopatch' software using the
following patch:
@@
var config identifier
@@
import config "github.com/DataDog/datadog-agent/pkg/config"
-config.Datadog
+config.Datadog()
@@
var config identifier
@@
import config "github.com/DataDog/datadog-agent/pkg/config/setup"
-config.Datadog
+config.Datadog()
* Fix tests following 'Datadog' global update to function
Changing 'pkg/config.Datadog' to a function instead of a copy of
'pkg/config/setup.Datadog' broke some test (we now have a single
global instead of two).
* Adding doc strings
* Update after rebase on main
commit 3e7275789614e8cc4e3f4b89baa44e7ab3023e47
Author: Kevin Maillet <48228696+kevinmaillet@users.noreply.github.com>
Date: Tue May 28 09:46:50 2024 -0400
targets migration (#26010)
commit c438dc206a70a0d75469656ce66076985672e457
Author: Sylvain Afchain <safchain@gmail.com>
Date: Tue May 28 15:03:19 2024 +0200
[CWS] add syscall context (#25768)
* [CWS] add syscall context
* add chdir test
* add chmod syscall context
* make arg a bit more dynamic
* fix linters
* use dedicated fields
* use ref
* use a ring buff approach
* disable on ebpfless
commit b410850b7d9d9ee84936086ffb181fb74a6fc651
Author: Amit Slavin <108348428+amitslavin@users.noreply.github.com>
Date: Tue May 28 15:55:09 2024 +0300
fixed usm encoding protocols CODEOWNERS (#25932)
commit be8177a0766a87aca26ab8e319c70db1506f6525
Author: Célian Raimbault <161456554+CelianR@users.noreply.github.com>
Date: Tue May 28 14:37:26 2024 +0200
Add task to create new go module (#25006)
* [go-create-module] Create modules
(wip) Trying linter_windows-x64 with unmodified modules.py file
[go-create-module] Sorted modules
[go-create-module] Sorted modules
* create-module: Added modules.py
* [create-module] Applied suggestions
* [go-create-module] Fixed reviews (windows support)
commit 452cf0353f7e749a8e61101c58eafe2aa80bcf00
Author: Kevin Fairise <132568982+KevinFairise2@users.noreply.github.com>
Date: Tue May 28 14:21:55 2024 +0200
Enable strict check mode fakeintake client (#25964)
commit 278472622ba2c67ada19c2c7363df7258dc608b8
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Tue May 28 14:16:23 2024 +0200
[CONTP-142] Remove GetVersion method from DCAClientInterface interface (#25960)
* Remove GetVersion method from DCAClientInterface interface
* PR review
commit aa18acb43d066b09d693d78570c76f8f257d97d0
Author: Guillaume Pagnoux <Yumasi@users.noreply.github.com>
Date: Tue May 28 14:11:17 2024 +0200
USM: add AMQP classification on top of TLS (#25578)
* amqp: testutils: add TLS support for AMQP server
* amqp: testutils: add client support for TLS
* classification: tls: add AMQP classification
* tests: classification: tls: add AMQP tests
* amqp: testutil: client: ask server for ack on publishes
commit cd1078a72a02bf69a29bdf812c5bb1b7dc9dee3c
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Tue May 28 14:03:58 2024 +0200
fix(pre-commit): Check on modified files only (#26000)
commit 7a36388b1b956bd2e5e61efd032c9ae53d76877b
Author: Thibaud Cheruy <thibaud.cheruy@datadoghq.com>
Date: Tue May 28 13:56:25 2024 +0200
[NDM] Add GetHardwareStates method to cisco sdwan client (#26005)
* Add GetHardwareStates method to cisco sdwan client
* typo
commit 7debf30a42aaffddafffaa3f619469c47b98b1e6
Author: Guy Arbitman <guy20495@gmail.com>
Date: Tue May 28 13:57:30 2024 +0300
usm: postgres: support parse (#25965)
* usm: postgres: support parse
* usm: postgres: Split parse message handling to a tail call
* usm: postgres: Reduce complexity for kernel 4.14
* Added documentation
commit 7fd78070b3cf9a31a6c891013ebf7ce32d46f9e4
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Tue May 28 10:20:19 2024 +0000
Log the invoke task as json (#25997)
commit a022f412b173ad8a562fc02f88d159f65e0e0761
Author: Adel Haj Hassan <41540817+adel121@users.noreply.github.com>
Date: Tue May 28 11:45:57 2024 +0200
fix bug in kubemetadata collector (#25941)
commit 61cdfb3d25ce9d4563adf355bdccce97f2bdd090
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 11:34:35 2024 +0200
Fix test summary on failure (#25999)
commit f181fade8a1342b39062b4876ed0a4806b4dbdf0
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 11:22:54 2024 +0200
refactor: remove glob dependency from serverless (#25939)
commit 7a2a2f74db938c0c9e2df5535720b23580d350fa
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Tue May 28 10:59:53 2024 +0200
fix(golang-deps-diff): explictly export CGO_ENABLED to also include cgo deps (#25950)
commit 5c05eac2ee1bb7e52dc869e8c4c98a987b537a99
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 10:54:56 2024 +0200
Avoid flakiness in test (#25978)
commit 602e6b511ed24f995481b7143b184e2f5abc322b
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Tue May 28 10:54:51 2024 +0200
Detect if libvirtd is in sbin but not in PATH (#25975)
commit 506a99c9f74467c540e86c03ca8da3251f016afa
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Tue May 28 08:54:47 2024 +0000
Refactor the get_running_modes function and add tests (#25998)
* Refactor the get_running_modes function and add tests
* Refactor the get_running_modes function and add tests
* clear
commit 7a35afa62518c93185667a997c98e40ad0aac2da
Author: Alex Lopez <alex.lopez.zorzano@gmail.com>
Date: Tue May 28 10:01:09 2024 +0200
Add gems caching to remaining jobs (#25946)
commit 381ad0c7dd912cfdc975d11395a33189b90e025e
Author: Usama Saqib <usamasaqib.96@live.com>
Date: Tue May 28 10:01:04 2024 +0200
Setup embedded BTFs before running tests (#25848)
* setup btfs
* update platforms
* lint-python
commit 72eb439b0a3d8bcfe60bfa0fffb4f444f7069f46
Author: Vincent Whitchurch <vincent.whitchurch@datadoghq.com>
Date: Tue May 28 09:30:15 2024 +0200
usm: kafka: test: Make checks more robust (#25969)
* usm: kafka: test: Simplify Eventually checks
Use EventuallyWithT() which allows to assert different conditions
separately and thus prints better errors messages (such as the compared
values in case the assertion fails). Also, get rid of the PrintableInt
usage since it does not add value here.
* usm: kafka: test: Combine stats wait and validation
The separation of waiting for the stats and verifying them in two
different steps is racy for the case when there are multiple events
involved (eg. multiple requests/responses) since if the events get
flushed (for example, due to the flush hook in the netif_receive_skb
tracepoint), then the first condition will be satisfied but not the
second one.
commit c90350ca75ab8794df4e08451bea72882029dc7c
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 23:23:50 2024 -0700
[windows][cws] add approvers (#25924)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* [windows][CWS] Modify channel behavior.
First of several performance fixes.
Modifies the channel used to submit events to the CWS processor.
Was a blocking, unbuffered channel. This is now runtime configurable.
The configuration is not intended to be changed by customers, but to make it easier
to tune with a/b testing internally.
Overall changes:
- defaults to non-blocking channel. This prevents events from backing up
into ETW. Also allows clearer notion of what events were dropped. When
they back up into ETW, all we know is a count of dropped events;
- sets a default channel size. This allows a small amount of buffering to
smooth out slight bursts in ETW notifications. The default right now
is fairly small to prevent large memory usage. intended to be tuned over time.
- allows ability to configure etw max buffers. This is also for tuning,
and our default (0) is to use the system default.
* [windows][cws] restrict ETW message flow
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
* [windows][cws] Re-add approvers for windows
This is a resubmit of a previous PR to implement basic approvers for windows.
* fix space
* lint
commit 146079e3289ac8ae294ecf7ea898c66aa37f6c5e
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:56:05 2024 -0400
dump client map
commit 260277840d9748204b0284134a51e34f5fb2eba9
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:53:26 2024 -0400
fix test log
commit 6d46488b2e4ecfbac9b4cee636dd0aedb6519873
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 23:51:50 2024 -0400
more debugs
commit 016ef3021bf0b496a387d73173c7e41a61458d9f
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 20:37:34 2024 -0700
[windows][cws] restrict ETW message flow (#25922)
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
commit 598907fe13b5afa82f750f21ca18ded0dcedc612
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 22:59:33 2024 -0400
rework logs
commit 593ea271b25422e66599d49e7bfba01a2fcc0ae7
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 19:36:34 2024 -0700
[windows][CWS] Modify channel behavior. (#25920)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* [windows][CWS] Modify channel behavior.
First of several performance fixes.
Modifies the channel used to submit events to the CWS processor.
Was a blocking, unbuffered channel. This is now runtime configurable.
The configuration is not intended to be changed by customers, but to make it easier
to tune with a/b testing internally.
Overall changes:
- defaults to non-blocking channel. This prevents events from backing up
into ETW. Also allows clearer notion of what events were dropped. When
they back up into ETW, all we know is a count of dropped events;
- sets a default channel size. This allows a small amount of buffering to
smooth out slight bursts in ETW notifications. The default right now
is fairly small to prevent large memory usage. intended to be tuned over time.
- allows ability to configure etw max buffers. This is also for tuning,
and our default (0) is to use the system default.
* [windows][cws] restrict ETW message flow
Another performance enhancement, this PR builds on #25875 and
limits the messages that ETW will send us to the once we're specifically
looking to handle. Significantly reduces load on the system-probe
* fix space
commit af2a72d0a51a685c40a7d47b10d0463343098ce6
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 21:53:36 2024 -0400
client lookup logs and disable fentry
commit 350f4b9bbc104188c6519c406f7e4cda221cc683
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 20:48:33 2024 -0400
don't mark tcp failures as empty
commit fa837bbc2c969733dbd5050d8734a85611ac3959
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 18:59:48 2024 -0400
added logs to state code
commit 33ef3373fb3f44d277d14f28645cb329a343f7a3
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 18:08:06 2024 -0400
more logs plus rework tcp_done probe
commit 6b4637badcd8c2cbf9b39ad01c171e11a4edaf9e
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 17:06:48 2024 -0400
add more debugs yay
commit f4c6ae5a438feaae59e6a066139aae80514b8d9a
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Mon May 27 12:16:12 2024 -0700
[windows][CWS] Update the statistics that are collected. (#25919)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
* [windows][CWS] Update the statistics that are collected.
Add a general map for collecting which etw messages we receive and
which ones we actually process.
use a more general map so we don't have to update the stat every time
we add/remove one.
* ....
commit 67ab7b6a0cf2983bb70772f67d63cac70efff1ad
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Mon May 27 15:08:35 2024 -0400
add more debug logs
commit a7c2138cbd2ddd69de64ffca7b8a4bc4a543746f
Author: Arthur Bellal <arthur.bellal@datadoghq.com>
Date: Mon May 27 18:51:02 2024 +0200
(fleet) fix bootstrap telemetry (#25970)
commit 73da815e13790ae82c4f4eb12fd1e18ade73fcbd
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 18:35:25 2024 +0200
[CWS] copy clang-bpf and llc-bpf inside docker test container (#25967)
commit 17af8062daa32174a4a7ea5e9d63975d1cf2895b
Author: Sylvain Afchain <safchain@gmail.com>
Date: Mon May 27 17:32:22 2024 +0200
[CWS] add an option to enable raw syscall for enforcement (#25959)
commit b7dda6bea5d354b6abe54fc675419c833e120c1f
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 17:31:12 2024 +0200
[CWS] add `/workload-list` api routes and associated subcommands to security agent (#25905)
* [CWS] add `/workload-list/{short,verbose}` api routes to security agent
* add `workload-list` subcommand
* make sure we use the config component instead of the global variable
* simplify by using only one route, with a query param
* add test for workloadURL
* update CODEOWNERS
commit eb3ed4b7c67ff77bcc5656e9342c80aac42c82b7
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Mon May 27 16:53:36 2024 +0200
Split agent builds & packaging (#25885)
* move the init script in theiw own software definition
This dill simplify generating what's needed during the packaging stage
instead of generating everything and removing files during the packaging
* package-artifacts: handle multiple archives
This will happen when we package binaries and debug symbols
* reorder pkg_metrics and packaging stage
* split datadog-agent build and packaging
* add a special case for heroku for now
* simplify build/package logic
* fixups for installer
* tmp omnibus branch
* share more common config
* fixup installer
* only package scripts for intermediate artifact
* fixup installer
* adapt to change on omnibus side
* switch back to a pinned omnibus commit
* fix from review
* move init script copy in the scope they belong to
commit 65f9e9ffc6e9701920d14611f53155e4616d40b8
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:41 2024 +0200
[EBPF] Show a summary of the results in the kmt.test task (#25903)
* Show test summary
* Show legend
* Improve spacing
commit f50ca3b9239472e50d5c21be90fb716c9f7a8913
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:36 2024 +0200
Unify KMT setup (#25904)
commit b4ec2b8baf817e6cd4611625e9700351188e234a
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 16:37:05 2024 +0200
Only perform the check for local images (#25958)
commit e5d8e9d42f55baf059d7bee6c3e3bfc050931ad2
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 16:25:55 2024 +0200
[kubernetes/helpers] Move stringInRuneset func (#25952)
commit deb9b60954eef9347d9fff796df2ba56049b3d3a
Author: Sylvain Baubeau <sylvain.baubeau@datadoghq.com>
Date: Mon May 27 16:25:49 2024 +0200
Do not stop walking on permission errors (#25911)
commit f821fcb52d67fab4201afbd90870d31fc118f538
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 15:37:59 2024 +0200
Revert "fix(installer): chown installer run path to dd-agent (#25880)" (#25955)
This reverts commit 6b3d202f342cb84b0ab329b4287a792dd77647cd.
commit 491ba6d573291ab80f4173592a256dfb09fd3757
Author: Gustavo Caso <gustavo.caso@datadoghq.com>
Date: Mon May 27 15:15:46 2024 +0200
[ASCII-1802] Ensure that API endpoint provider are filter before being use (#25943)
* Ensure that API endpoint provider are filter before being use
* convert api.EndpointProvider into an interface
* add test to validate we filter out nil endpoints
commit acd0a26e72260b1d23dd8b48d8b07d20fb4d6a97
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 15:00:49 2024 +0200
[CWS] move creation of new tcclassifier to separate goroutine (#25918)
commit f656b7c07cf46f18c49e075224f540e7ed15db60
Author: Mister Yo (Maxime Riaud) <65339037+misteriaud@users.noreply.github.com>
Date: Mon May 27 15:00:45 2024 +0200
[ASCII-1622] Prevent deadlock for status and flare command (#25861)
* adding 15sec timeout for IPC requests between sub-Agent and core-Agent
* add release note
* Update releasenotes/notes/fix-flare-genereation-deadlock-b40fca3c82469d40.yaml
Co-authored-by: Pierre Gimalac <pierre.gimalac@datadoghq.com>
* use configuration setting for timeout duration
* use preexisting "server_timeout" config setting instead of "subagent_config_fetch_timeout"
* multiply config duration by seconds
---------
Co-authored-by: Pierre Gimalac <pierre.gimalac@datadoghq.com>
commit 36fb86660b903731f3aef90ddd0270c346f60eb9
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 14:41:06 2024 +0200
[workloadmeta/collectors/remote] Make filter configurable (#25945)
* [workloadmeta/filter] Add Kinds()
* [workloadmeta/proto] Add function to convert Filter
* [workloadmeta/collectors/remote] Make filter configurable
commit 6f60aae57ecc8180ac41157d37294e9b8c1e8255
Author: pducolin <45568537+pducolin@users.noreply.github.com>
Date: Mon May 27 14:41:00 2024 +0200
[e2e] generic environment in host and docker host envs (#25668)
* [e2e] move aws environment to provider parameters
* [e2e] move environment to run params
a cloud environment cannot be reused
* [e2e] add description to RunParams
commit ffc947fe84f3fd0caebbdb6c179f61a454cee0de
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Mon May 27 14:38:55 2024 +0200
fix test path (#25947)
* fix test path
* fix
commit 387c900d29edbc281946b5467cb138200296727e
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Mon May 27 14:38:23 2024 +0200
fix(invoke_ut): Trigger the custom_task UT, fix them and minor changes to enable test discovery in vscode (#25912)
commit d9593607bdd942f2c17fbab1ed4cf35d959a2655
Author: Guy Arbitman <guy20495@gmail.com>
Date: Mon May 27 15:24:54 2024 +0300
[USMON-910] Introduce postgres TLS monitoring (#25729)
* usm: postgres: Convert plaintext version to use pktbuf syntax
The migration is a prelimanary step to sharing the code between plaintext and TLS version of postgres
monitoring.
* usm: postgres: Extract main processing logic into a function
* usm: tls: Add PostgresTLS enum
* usm: postgres: Implement TLS probes
* usm: postgres: tests: Extend TestDecoding to support both plaintext and TLS modes
* usm: Fixed documentation and naming
commit 00c839d463aaa324a4684edc25f5a591f46c8f54
Author: Guillermo Julián <gjulianm@users.noreply.github.com>
Date: Mon May 27 14:04:45 2024 +0200
[EBPF] Fix parsing of verifier log register state in modern kernels (#25724)
* Refactor register parsing code
* Test existing line parse behavior
* Support register state just after instruction
* Increase test coverage
* Fix linter
* Register state now is the state *after* execution
commit e9cf0d8c9c2ea0c95eea914aca86d057edcfece5
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Mon May 27 14:02:57 2024 +0200
chore(serverless): remove testify from build (#25940)
commit 25d996db5fe5aeaca8f0440660dbb74d5fbc26cf
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 12:32:16 2024 +0200
fix(installer): Don't report tmp extract dirs as repositories (#25902)
commit e1accdad30bda4b00fbdc4244b03ebbcf94ad7a3
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 12:21:54 2024 +0200
[CWS] implement user path discarders on Windows (#25891)
commit 233064852add1d1e9cf39eeeba8226df38980e44
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Mon May 27 12:21:50 2024 +0200
[ASCII-1595] Make serverless use a no-op implementation of `dogstatsd/replay` (#25548)
* feat: make serverless use no-op impl of dsd-replay
* chore: update serverless dependency list
commit f7b9c1fbe6522e073d2602b451c83e0bc5aa35d9
Author: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Date: Mon May 27 12:15:16 2024 +0200
e2e: fix pipeline ID env variable in readme (#25938)
commit 80cf6f399d03fe91533e4ca2486dd678e7996d56
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 10:00:05 2024 +0000
Configure pre-commit hooks to be compatible with `devagent` (#25910)
* pre-commit with devagent
* address
commit cbb3706fc389be6b5a366c46d5090c484408174f
Author: maxime mouial <hush-hush@users.noreply.github.com>
Date: Mon May 27 11:53:39 2024 +0200
simplify configuration layer in inventoryagent (#25138)
commit 4f989f4bc610247bc6abec82a9c9e69d34d6eca3
Author: Guy Arbitman <guy20495@gmail.com>
Date: Mon May 27 12:53:14 2024 +0300
usm: Introduce a method to move data_off of a pktbuf (#25928)
* usm: ebpf: Add method to modify the offset of the pktbuf
* usm: ebpf: Fix wrong calculation
We get the offset as a function argument, thus no need to read from data_off + offset
commit a897ee47121418dccc5e7c18632145f2764d7535
Author: jedupau <72938258+jedupau@users.noreply.github.com>
Date: Mon May 27 11:44:30 2024 +0200
[NDMII-2654][snmp] store devices tags on disk with mock directory (#25887)
* snmp: store tags on disk
* ndm: write tags in cache only at launch
* fix tests
* add returns on read from cache method
* add comment for test
commit 18bc7d2e2ad59eecda18b6e33d0f1dc2bc4dc99e
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 09:41:44 2024 +0000
Add a `lint` option to `get_modified_packages` (#25935)
commit 6b3d202f342cb84b0ab329b4287a792dd77647cd
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 11:11:09 2024 +0200
fix(installer): chown installer run path to dd-agent (#25880)
commit 1dbd2a144f804b08a32eeb8cb25d28bccb7fc524
Author: Raphael Gavache <raphael.gavache@datadoghq.com>
Date: Mon May 27 11:06:47 2024 +0200
add dotnet log (#25927)
commit af0d4da5189f71e7c7fea734db325e62d7238af4
Author: David Ortiz <david.ortiz@datadoghq.com>
Date: Mon May 27 11:00:53 2024 +0200
[kubernetes/metadata] Use workloadmeta instead of a node informer (#25615)
* [workloadmeta] Add ListKubernetesNodes()
* [kubernetes/metadata] Use workloadmeta instead of node informer
* [kubernetes] Extract controllers into a separate package
The controllers code was in the "apiserver" package and now depends on
workloadmeta, but workloadmeta also depends apiserver. Creating a new
"controllers" package solves this issue.
* [kubernetes/apiserver/controllers] Make things private when possible
* Review comments
commit f6d0c587696f58748dc04a5d4fd7ec54ee235f23
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Mon May 27 08:30:19 2024 +0000
Add the Python version to the `invoke` monitoring (#25934)
commit 7bf54a19d2684a1c197099339aa9c7da03775cd8
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Mon May 27 10:16:26 2024 +0200
fix(ci): Change the logic on junit upload job (#25850)
* refactor small methods
* change the junit upload logic to upload per team
First iterate on all xml to sort them by team
Then call upload on each team folder
Added tests
Muted all unittest that logged in stdout, pending a logger
implementation
* Use a pool instead of a for loop for performances
* codereview: minor fixes
* [ACIX-277] Upload a tag to sort tests by pipeline source
commit d3032058188faa3917e33ca5a8e87ae2a03015a1
Author: Paul Cacheux <paul.cacheux@datadoghq.com>
Date: Mon May 27 09:58:05 2024 +0200
sync and update docker functional tests image (#25917)
commit 494da1371201be72d683a1b93596b7d9aa695e59
Author: Baptiste Foy <baptiste.foy@datadoghq.com>
Date: Mon May 27 09:58:00 2024 +0200
test(installer): Add tests for injector upgrade paths (#25853)
* upgrade(installer): Support force non install
* fix db
* tests(installer): Implement upgrade tests tests (injector deb <-> oci)
* nit
commit 47d682557c651798b51b29d3e1f5f74064dde772
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 22:37:05 2024 -0400
use proper helper for failed conns check
commit b7bf05117d13d68d884e98bd721ccf63ade26417
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 22:35:53 2024 -0400
only clear map if failed conns enabled
commit bb9a0b2513f1149f140b39a5d25364b9cabc3297
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 20:13:08 2024 -0400
make matching code member of map type
commit 620fd4ccc8e32bf91e7af2057893d450e5c10c75
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sun May 26 19:58:48 2024 -0400
add cachelike behavior to failed conn map
commit 90c924d61d34942a6e5e0d9223e9f0caf8fc9875
Author: Florent Clarret <florent.clarret@datadoghq.com>
Date: Sun May 26 17:20:54 2024 +0000
Detect if the invoke command is running with PyApp (#25906)
* Detect if the invoke command is running with PyApp
* Update tasks/custom_task/custom_task.py
* Update tasks/custom_task/custom_task.py
commit bf83f431d9ac6cf800210dde60ed078453746f3f
Author: Guy Arbitman <guy20495@gmail.com>
Date: Sun May 26 15:33:57 2024 +0300
[USMON-934] postgres tls classification (#25925)
* usm: gotls: Add testing capabilities to support TLS classification tests
We add:
- skipIfGoTLSNotSupported method which skips a test if go-tls monitoring is not supported on a machine / configuration
- goTLSAttachPID and goTLSDetachPID helpers which wraps GoTLSAttachPID and GoTLSDetachPID. The wrappers meant to ease reading the tests
- goTLSDetacherWrapper and goTLSAttacherWrapper which meant to wrap preTracer and postTracer, and allow easy reusing of same setup in
the TLS classification tests.
- SetGoTLSExcludeSelf method which allows to modify the value of the configuration GoTLSExcludeSelf at runtime, to allow
relevant tests to enable self-hooking
* usm: postgres: tests: Server supports TLS
* usm: postgres: tests: Change client to support connection options
* usm: postgres: tests: Handle error 'address already in use'
* usm: tests: Added documentation
commit 0246518c068b39715a2e3d07eaece1bcee1f2087
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 11:15:19 2024 -0400
clean up matching locks
commit d0b647bcb646076ba11398a169e28eabcea58a3e
Author: Alexandre Yang <alexandre.yang@datadoghq.com>
Date: Sat May 25 08:54:30 2024 +0200
[network-path] Add service (#25892)
* [network-path] Add service
* Add source and destination service
* fix test
commit 3224c95a55bc82b1b9b7ed85f7e3286284f688c9
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 02:51:08 2024 -0400
disabled failed conns by default
commit 4c8c861af80f2f0d9424f62f3d2a86c4e3f93f69
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Sat May 25 02:29:51 2024 -0400
uncomment map delete
commit 2ac190dd0ca15af07e05f541177cb4d4ecff8fc1
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 19:10:58 2024 -0400
remove user timeout value
commit e5b69ff8a31b2c377aefaf638186fff88f7ee27b
Author: Keisuke Umegaki <41987730+keisku@users.noreply.github.com>
Date: Sat May 25 07:50:46 2024 +0900
Improve logging in the Lambda Logs API handler (#25878)
* Improve error handling in Lambda Logs API handler
* reno new
* ignore io.ReadAll() error since we handle it later
commit 7a8b0cf8bcf3540dd8446b3392d3110612848bf2
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Fri May 24 15:32:31 2024 -0700
[windows][CWS] consolidate windows probe initialization. (#25916)
* [windows][CWS] consolidate windows probe initialization.
Refactor initialization of windows probe.
Solves problem that each time we add new structure member, needed to remember
to copy/paste the initialization to the tests, too.
* fix unneeded import in test
* fix initialization of tests
commit 6ec1386ef4c379af64cfa1b90b920609f1b3e361
Author: Yang Song <songy23@users.noreply.github.com>
Date: Fri May 24 18:25:10 2024 -0400
[OASIS-37] Move collector internal/datadog to Agent as modules (#25841)
* [OASIS-12] Move OTel statsd metrics client to agent
* [OASIS-12] Move OTel ingester to agent
* Format
* lint
* Rename ingester to statsprocessor
commit e19773f96565662a14fad551d5be0dee5e668ef7
Author: Derek Brown <derek.brown@datadoghq.com>
Date: Fri May 24 14:42:35 2024 -0700
[windows][etw] add ability to filter etw messages by ID (#25875)
* add inclusion/exclusion list to ETW component
* gofmt
* review feedback
commit 3d414e9ee058f778e8aa47dbe3fb41bbfd894c41
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 17:29:01 2024 -0400
skip linter
commit 31fc3c39285825f66624d7a5ceda0af1130bafd5
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 14:29:31 2024 -0400
fix test compile
commit 7ac9c8b8595235bdf9a3ed457d0095100251c451
Author: Gustavo Caso <gustavo.caso@datadoghq.com>
Date: Fri May 24 19:49:35 2024 +0200
[ASCII-1796] Move list dependency test to python (#25866)
Co-authored-by: pgimalac <pierre.gimalac@datadoghq.com>
commit d0487e7eeb5f92128edb9720cb781315b1dce23c
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 13:29:48 2024 -0400
skip timeout test on prebuilt
commit 4510cafe0382a65ac614f3726bc31032be8d1145
Author: Adam Karpowich <adam.karpowich@datadoghq.com>
Date: Fri May 24 13:12:55 2024 -0400
rework ebpf code to handle timeouts
commit 2beb26aded7274a40a25aa764365881293225819
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Fri May 24 18:17:50 2024 +0200
[ASCII-1613] Split `dogstatsd/replay` into new component hierarchy (#25512)
* refactor: move component and exported symbols to def folder
* refactor: move Mock interface and module to their own directories
* refactor: move fx related functions in fx directory
* refactor: move impl to its own directory
* refactor: remove CapPool global variable
* fix: review comments about mock
* fix: review comments about package naming
* chore: rename replaydef imports to replay
* chore: update serverless dependency list
commit 5b9f9aa80608ef9294da08b219bd5b0ccbd3df67
Author: Nicolas Schweitzer <nicolas.schweitzer@datadoghq.com>
Date: Fri May 24 18:17:46 2024 +0200
fix(tools): Set the correct jira project name for telemetry and analytics team (#25907)
commit 5e790668711cccec9d24e55046745571ce9fad1a
Author: Pierre Gimalac <pierre.gimalac@datadoghq.com>
Date: Fri May 24 17:50:53 2024 +0200
[ASCII-1790] Send metrics with number of go dependencies for each build (#25854)
* feat: send metrics with number of go dependencies for each build
* fix: add CGO_ENABLED env
* refactor: move constant metric names to globals
commit d9ff65e15240ec2416d945a9df67ea33049ef73c
Author: Arthur Bellal <arthur.bellal@datadoghq.com>
Date: Fri May 24 16:04:42 2024 +0200
(fleet) install the agent oci by default when remote updates are enabled (#25898)
commit 37030bc81b6f3d82f0a7ada71c33ac1661df9928
Author: Alexandre Menasria <47357713+amenasria@users.noreply.github.com>
Date: Fri May 24 16…
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Add a provider to use a local kind deployment, with a fakeintake deployed inside the same kind cluster
Note the provider should be used only for local testing, this is not intended to be used in the CI.
The local kind provisionner has few options, and the fakeintake cannot be configured at all.
Needs: DataDog/test-infra-definitions#647
The image and the test-infra version will be updated when the PR above is merged on test-infra
Motivation
While helping AML with their e2e tests, we found that iterating on Kubernetes based test is really slow. Spinning up the instance is slow even with kind because we first need to create the ec2 VM, install kind on it, and deploy the fakeintake.
It is also hard to iterate because some resources are often left overs and it is not straightforward to SSH into the instances created to understand what is going on
This provider should replicate the behavior of an e2e tests running in a Kubernetes cluster in the Cloud. But with the locally installed kind which makes everything faster and easier to debug.
Additional Notes
I will update runner image when the corresponding PR is merged on test-infra
Possible Drawbacks / Trade-offs
Describe how to test/QA your changes