Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NDM] Add NDM metadata support for Cisco ACI #17735

Merged
merged 33 commits into from
Jul 10, 2024
Merged

Conversation

zoedt
Copy link
Contributor

@zoedt zoedt commented Jun 4, 2024

What does this PR do?

https://datadoghq.atlassian.net/browse/NDMII-2651

This PR introduces methods that will submit NDM device and interface metadata to Event Platform (specifically to our ndm track in EP)

See document on Confluence for additional context and reasoning:
Cisco ACI Integration (metadata)

Motivation

We are looking to move existing Cisco ACI integration into NDM, this requires device and interface metadata for it to be processed and appear on our product

Additional Notes

How to QA

  1. Start a ddev env with env vars pointing to staging: ddev env start cisco_aci py3.11
  2. Edit the configuration for the Cisco ACI yaml (use the Cisco sandbox for Cisco ACI):
instances:
  - aci_url: https://sandboxapicdc.cisco.com
    username: admin
    pwd: "!v3G@!4@Y" # double quotes are necessary here
    tls_verify: false
  1. ddev env reload cisco_aci py3.11
  2. Check that the device / interface metadata is being returned / appears OK in staging

Review checklist (to be filled by reviewers)

  • Feature or bugfix MUST have appropriate tests (unit, integration, e2e)
  • Changelog entries must be created for modifications to shipped code
  • Add the qa/skip-qa label if the PR doesn't need to be tested during QA.
  • If you need to backport this PR to another branch, you can add the backport/<branch-name> label to the PR and it will automatically open a backport PR once this one is merged

Copy link

github-actions bot commented Jun 4, 2024

The validations job has failed; please review the Files changed tab for possible suggestions to resolve.

1 similar comment
Copy link

github-actions bot commented Jun 4, 2024

The validations job has failed; please review the Files changed tab for possible suggestions to resolve.

Copy link

github-actions bot commented Jun 5, 2024

The validations job has failed; please review the Files changed tab for possible suggestions to resolve.

@zoedt zoedt marked this pull request as ready for review June 6, 2024 13:03
@zoedt zoedt requested a review from a team as a code owner June 6, 2024 13:03
@zoedt zoedt requested a review from a team June 6, 2024 13:05
@zoedt zoedt force-pushed the zoe/cisco-aci-metadata branch 2 times, most recently from 1570bac to 163d168 Compare June 6, 2024 14:22
@zoedt zoedt force-pushed the zoe/cisco-aci-metadata branch 3 times, most recently from 2c4f88f to 35d3374 Compare June 7, 2024 16:14
Copy link

codecov bot commented Jun 7, 2024

Codecov Report

Attention: Patch coverage is 90.12346% with 24 lines in your changes missing coverage. Please review.

Project coverage is 89.46%. Comparing base (f800fbf) to head (c9f81a4).
Report is 161 commits behind head on master.

Additional details and impacted files
Flag Coverage Δ
active_directory 100.00% <ø> (+27.27%) ⬆️
activemq 52.80% <ø> (ø)
activemq_xml 82.31% <ø> (ø)
airflow 92.20% <ø> (?)
amazon_msk 88.91% <ø> (ø)
ambari 85.80% <ø> (ø)
apache 95.08% <ø> (ø)
arangodb 98.23% <ø> (ø)
argo_rollouts 90.00% <ø> (ø)
argo_workflows 87.87% <ø> (ø)
argocd 87.81% <ø> (ø)
aspdotnet 100.00% <ø> (ø)
avi_vantage 91.35% <ø> (ø)
azure_iot_edge 82.08% <ø> (ø)
boundary 100.00% <ø> (ø)
btrfs 82.91% <ø> (ø)
cacti 87.90% <ø> (ø)
calico 84.61% <ø> (ø)
cassandra 66.66% <ø> (ø)
cert_manager 77.41% <ø> (ø)
cilium 78.20% <ø> (+0.85%) ⬆️
cisco_aci 95.11% <91.21%> (-0.21%) ⬇️
citrix_hypervisor 87.50% <ø> (ø)
cloud_foundry_api 96.11% <ø> (ø)
cloudera 99.51% <ø> (+0.02%) ⬆️
cockroachdb 93.19% <ø> (ø)
consul 91.82% <ø> (ø)
coredns 94.61% <ø> (ø)
couch 94.74% <ø> (+0.35%) ⬆️
crio 89.79% <ø> (ø)
datadog_checks_base 89.68% <25.00%> (+0.84%) ⬆️
datadog_checks_dev 77.38% <ø> (+0.07%) ⬆️
datadog_checks_downloader 81.37% <ø> (ø)
datadog_cluster_agent 90.19% <ø> (ø)
dcgm 92.10% <ø> (ø)
ddev 87.93% <ø> (-0.01%) ⬇️
directory 95.68% <ø> (+0.64%) ⬆️
disk 89.34% <ø> (ø)
dns_check 93.33% <ø> (ø)
dotnetclr ?
druid 97.70% <ø> (ø)
ecs_fargate 83.52% <ø> (ø)
eks_fargate 94.05% <ø> (ø)
envoy 95.38% <ø> (+0.28%) ⬆️
esxi 93.05% <ø> (+0.15%) ⬆️
etcd 95.56% <ø> (ø)
external_dns 89.28% <ø> (ø)
fluentd 84.32% <ø> (-10.16%) ⬇️
fluxcd 88.31% <ø> (ø)
foundationdb 83.83% <ø> (ø)
gearmand ?
gitlab_runner 92.10% <ø> (ø)
go_expvar 92.73% <ø> (ø)
gunicorn 92.83% <ø> (+0.75%) ⬆️
harbor ?
hazelcast 92.39% <ø> (ø)
hdfs_datanode 89.74% <ø> (ø)
hdfs_namenode 86.72% <ø> (ø)
hive 51.42% <ø> (ø)
hivemq 61.90% <ø> (ø)
http_check 95.32% <ø> (+2.02%) ⬆️
hudi ?
ibm_ace 92.25% <ø> (?)
ibm_db2 86.87% <ø> (ø)
ibm_i 81.91% <ø> (ø)
ibm_mq 91.28% <ø> (ø)
ibm_was ?
ignite 46.66% <ø> (ø)
impala 97.97% <ø> (ø)
istio 78.14% <ø> (+0.51%) ⬆️
jboss_wildfly 47.36% <ø> (ø)
kafka 64.70% <ø> (ø)
karpenter 94.36% <ø> (ø)
kong 87.62% <ø> (ø)
kube_apiserver_metrics 97.74% <ø> (ø)
kube_controller_manager 97.89% <ø> (ø)
kube_dns 95.97% <ø> (ø)
kube_metrics_server 94.87% <ø> (ø)
kube_proxy 96.80% <ø> (ø)
kube_scheduler 97.92% <ø> (ø)
kubelet 91.01% <ø> (ø)
kubernetes_cluster_autoscaler 93.22% <ø> (ø)
kubernetes_state 89.50% <ø> (ø)
kyototycoon 85.96% <ø> (ø)
kyverno 81.81% <ø> (?)
lighttpd 83.64% <ø> (ø)
linkerd 85.22% <ø> (+1.13%) ⬆️
linux_proc_extras 96.22% <ø> (ø)
mapr 82.42% <ø> (ø)
mapreduce 82.08% <ø> (ø)
marathon 83.12% <ø> (ø)
mcache 93.50% <ø> (ø)
mesos_master 89.81% <ø> (+0.09%) ⬆️
mesos_slave 93.31% <ø> (ø)
nagios 89.01% <ø> (ø)
network 93.64% <ø> (+1.08%) ⬆️
nfsstat 95.20% <ø> (ø)
nginx 95.07% <ø> (+0.53%) ⬆️
nginx_ingress_controller 98.36% <ø> (ø)
nvidia_triton 88.52% <ø> (ø)
openldap 96.33% <ø> (ø)
openmetrics 98.08% <ø> (ø)
openstack 55.19% <ø> (ø)
openstack_controller 94.44% <ø> (+0.21%) ⬆️
pgbouncer 91.35% <ø> (ø)
php_fpm 90.53% <ø> (+0.82%) ⬆️
postfix 88.10% <ø> (ø)
powerdns_recursor 96.65% <ø> (ø)
presto 59.09% <ø> (ø)
process 85.61% <ø> (+0.61%) ⬆️
prometheus 94.17% <ø> (ø)
proxysql 98.97% <ø> (ø)
pulsar 100.00% <ø> (ø)
rabbitmq 95.37% <ø> (?)
ray 96.45% <ø> (ø)
rethinkdb 97.93% <ø> (ø)
riak 99.21% <ø> (ø)
riakcs 87.71% <ø> (-5.90%) ⬇️
scylla ?
silk 93.82% <ø> (ø)
singlestore 90.81% <ø> (ø)
snowflake 96.27% <ø> (ø)
solr 56.25% <ø> (ø)
spark 93.87% <ø> (-0.28%) ⬇️
squid 100.00% <ø> (ø)
ssh_check 91.58% <ø> (?)
statsd 87.36% <ø> (ø)
strimzi 89.78% <ø> (ø)
supervisord 89.78% <ø> (ø)
system_core 92.66% <ø> (ø)
system_swap 98.30% <ø> (ø)
tcp_check 90.39% <ø> (-1.19%) ⬇️
teamcity 88.57% <ø> (+3.17%) ⬆️
tekton 82.30% <ø> (ø)
teleport 99.61% <ø> (ø)
temporal 100.00% <ø> (ø)
teradata 94.05% <ø> (ø)
tls 92.02% <ø> (+0.86%) ⬆️
tokumx 57.52% <ø> (ø)
tomcat 60.41% <ø> (?)
torchserve 97.32% <ø> (ø)
traefik_mesh 76.75% <ø> (ø)
traffic_server 96.13% <ø> (ø)
twemproxy 79.56% <ø> (ø)
twistlock 80.47% <ø> (ø)
varnish 84.39% <ø> (+0.26%) ⬆️
vllm 93.10% <ø> (?)
vsphere ?
weaviate 76.27% <ø> (ø)
win32_event_log 82.67% <ø> (+1.11%) ⬆️
wmi_check 97.50% <ø> (ø)
yarn 89.52% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

@zoedt zoedt dismissed stale reviews from NouhaManai96 and FlorianVeaux via 0612e90 July 1, 2024 16:57
@zoedt
Copy link
Contributor Author

zoedt commented Jul 2, 2024

You can see the device metadata from the sandbox on staging here

description: Optional[str] = Field(default=None)
mac_address: Optional[str] = Field(default=None)
admin_status: Optional[AdminStatus] = Field(default=None)
oper_status: Optional[OperStatus] = Field(default=None)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just noticed we have an integration field for interface metadata too (see here)
Probably worth adding it here (i'll also have to add it to cisco sdwan 😅)

iliakur
iliakur previously approved these changes Jul 8, 2024
cisco_aci/datadog_checks/cisco_aci/fabric.py Outdated Show resolved Hide resolved

def submit_node_metadata(self, node_attrs, tags):
node = Node(attributes=node_attrs)
id_tags = ['namespace:{}'.format(self.namespace), 'system_ip:{}'.format(node.attributes.address)]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
id_tags = ['namespace:{}'.format(self.namespace), 'system_ip:{}'.format(node.attributes.address)]
id_tags = ['device_namespace:{}'.format(self.namespace), 'device_ip:{}'.format(node.attributes.address)]

Do we add the device_namespace and device_ip tags to all Cisco ACI metrics?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i have a separate ticket for that work ! i'm doing that in the bg, but if you prefer it all in one PR i can amend that!

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good for me to add it separately 👍 i think here we just want to ensure that the id tags can be used to filter metrics down to a specific device (so device_namespace:aaa, device_ip:bbb should work once we add common tags)

cisco_aci/datadog_checks/cisco_aci/fabric.py Outdated Show resolved Hide resolved
TCheruy
TCheruy previously approved these changes Jul 9, 2024
@zoedt zoedt merged commit b915f56 into master Jul 10, 2024
369 of 370 checks passed
@zoedt zoedt deleted the zoe/cisco-aci-metadata branch July 10, 2024 12:00
github-actions bot pushed a commit that referenced this pull request Jul 10, 2024
* Add support for sending device metadata

* Add unit test for device metadata, update fixture

* Add license header, changelogs

* Lint

* First pass at submitting interface metadata, cleanup for test fixtures

* Fix for py2.7 support

* Try to fix imports

* Deal with pydantic stuff py2.7

* Allow namespace for Cisco ACI devices, static var for vendor

* Update device metadata to use the correct fieldname, add pydantic model for EvP intake

* Sync the conf.yaml example

* Add device type and integration to device metadata, fix ID field name

* Update interface statuses

* Deal with device status (use fabricSt)

* Update get_eth_list to get operStatus, update all tests and fixtures

* Amend docs for namespace

* Batch events sent to EvP

* Add interface status metric

* Only add to list for >py3.0

* Update default value for vendor, yield for batch events, use device type other

* Add source field to device metadata tags

* Add enums for interface status

* Use correct track type for NDM metadata

* Amend device id tag, collect timestamp ms -> s

* Add interface integration field

* More generic method to send EvP event

* Add docstring for the EvP method

* Update interface tagging, remove system_ip tag

* Fix linting for submit event platform event

* Use interface ID tags b915f56
ravindrasojitra-crest pushed a commit to bhargavnariyanicrest/integrations-core that referenced this pull request Aug 5, 2024
* Add support for sending device metadata

* Add unit test for device metadata, update fixture

* Add license header, changelogs

* Lint

* First pass at submitting interface metadata, cleanup for test fixtures

* Fix for py2.7 support

* Try to fix imports

* Deal with pydantic stuff py2.7

* Allow namespace for Cisco ACI devices, static var for vendor

* Update device metadata to use the correct fieldname, add pydantic model for EvP intake

* Sync the conf.yaml example

* Add device type and integration to device metadata, fix ID field name

* Update interface statuses

* Deal with device status (use fabricSt)

* Update get_eth_list to get operStatus, update all tests and fixtures

* Amend docs for namespace

* Batch events sent to EvP

* Add interface status metric

* Only add to list for >py3.0

* Update default value for vendor, yield for batch events, use device type other

* Add source field to device metadata tags

* Add enums for interface status

* Use correct track type for NDM metadata

* Amend device id tag, collect timestamp ms -> s

* Add interface integration field

* More generic method to send EvP event

* Add docstring for the EvP method

* Update interface tagging, remove system_ip tag

* Fix linting for submit event platform event

* Use interface ID tags
Wyrine added a commit that referenced this pull request Sep 5, 2024
…tion v1.0.0 (#18084)

* Added Palo Alto Cortex XDR integration with assets

* Added date in CHANGELOG file

* Fixed pipeline suggestions

* Fixed pipeline suggestions

* Fixing log pipeline suggestions

* Reodered Groups for facets

* Added log pipeline result

* Fixing pipeline for log result

* Enhanced log pipeline result

* Fixing the log pipeline result

* Adding log output.

* Adding log pipeline result

* Updated log pipeline

* Updated README.md file with suggested changes

* Drop explain plan failures to debug level (#17974)

* Drop explain plan errors to debug logs.

* Changelog entry

* [mongo] Support auto-discover available databases for the monitored mongodb instance (#17959)

* autodiscover mongodb databases

* Add database autodiscovery support

* remove print

* only list authorized collections not views

* ignore collections from config when database autodiscovery is enabled

* add changelog

* update changelog

* fix license header

* update include list with deprecated dbnames

* fix test

* update comments

* update changelog

* return databases and count

* update readme

* update config description to dbnames

* Add collect of metrics for buffer cache usage (#17960)

The pg_buffercache extension provides a pg_buffercache view that give
a detailed report the usage of shared buffer: which relation is using
it, whether it's dirty and how many backends are pinning this buffer.

This patch adds the capacity to collect data from pg_buffercache to
provide visibility on shared buffer usage.

* [mongo] deprecate collStats command and use $collStats aggregation stage to collect collection metrics (#17961)

* use collStats aggregation pipeline to collect collection metrics

* add changelog

* sort metadata

* remove commented code

* update test results with new metrics

* Add ssl path option when building the librdkafka dependency  (#17957)

* add the prefix path

* commit

* commit

* commit

* add debug

* enable ssl

* enable ssl in prefix folder

* enable ssl in prefix folder

* set default ssl path

* set default ssl path

* set default ssl path

* set default ssl path

* set default ssl path

* linter

* linter

* Update dependency resolution (#17971)

Co-authored-by: iliakur <iliakur@users.noreply.github.com>

* Fix format issue with master pipeline flaky test management pr17910 (#17979)

* Add manual trigger for flaky test suite

* Mark envoy tests as flaky (#17985)

* [Release] Bumped vllm version to 1.0.0 (#17988)

* Switch back to the intial database while collecting schemas (#17978)

* Switch back to the intial database while collecting schemas

* Used finally

* Applied linter

* Port 7.56 releases to master (#17991)

* [Release] Bumped active_directory version to 2.1.1

* [Release] Bumped aerospike version to 2.2.2

* [Release] Bumped amazon_msk version to 4.9.0

* [Release] Bumped arangodb version to 2.2.2

* [Release] Bumped argo_rollouts version to 1.0.2

* [Release] Bumped argo_workflows version to 1.0.2

* [Release] Bumped argocd version to 2.4.2

* [Release] Bumped aspdotnet version to 2.1.1

* [Release] Bumped avi_vantage version to 4.2.2

* [Release] Bumped boundary version to 2.2.3

* [Release] Bumped calico version to 2.2.2

* [Release] Bumped cert_manager version to 4.1.2

* [Release] Bumped cilium version to 3.5.1

* [Release] Bumped cisco_aci version to 2.9.0

* [Release] Bumped clickhouse version to 3.6.0

* [Release] Bumped cockroachdb version to 3.3.2

* [Release] Bumped coredns version to 3.2.3

* [Release] Bumped datadog_checks_base version to 36.9.0

* [Release] Bumped datadog_checks_downloader version to 4.7.0

* [Release] Bumped dcgm version to 2.3.2

* [Release] Bumped dotnetclr version to 2.1.1

* [Release] Bumped envoy version to 3.5.1

* [Release] Bumped esxi version to 1.2.0

* [Release] Bumped etcd version to 6.2.2

* [Release] Bumped exchange_server version to 2.1.1

* [Release] Bumped fluxcd version to 1.2.2

* [Release] Bumped gitlab version to 7.3.2

* [Release] Bumped haproxy version to 5.2.2

* [Release] Bumped http_check version to 9.7.0

* [Release] Bumped hyperv version to 1.11.1

* [Release] Bumped iis version to 3.1.1

* [Release] Bumped impala version to 2.2.2

* [Release] Bumped istio version to 6.1.2

* [Release] Bumped kafka_consumer version to 4.5.0

* [Release] Bumped karpenter version to 1.4.1

* [Release] Bumped kong version to 3.2.2

* [Release] Bumped kubernetes_cluster_autoscaler version to 1.0.1

* [Release] Bumped linkerd version to 4.2.2

* [Release] Bumped mongo version to 6.7.0

* [Release] Bumped mysql version to 12.6.0

* [Release] Bumped nvidia_triton version to 1.2.2

* [Release] Bumped openmetrics version to 4.2.2

* [Release] Bumped postgres version to 19.0.0

* [Release] Bumped process version to 3.4.0

* [Release] Bumped pulsar version to 2.2.2

* [Release] Bumped rabbitmq version to 5.3.2

* [Release] Bumped ray version to 1.2.2

* [Release] Bumped redisdb version to 5.6.0

* [Release] Bumped scylla version to 2.7.2

* [Release] Bumped snowflake version to 5.7.0

* [Release] Bumped sqlserver version to 17.4.0

* [Release] Bumped strimzi version to 2.2.2

* [Release] Bumped tcp_check version to 4.9.0

* [Release] Bumped teamcity version to 4.3.0

* [Release] Bumped tekton version to 1.0.2

* [Release] Bumped temporal version to 2.2.2

* [Release] Bumped teradata version to 2.2.1

* [Release] Bumped tls version to 2.18.0

* [Release] Bumped torchserve version to 2.2.2

* [Release] Bumped traefik_mesh version to 1.0.1

* [Release] Bumped vault version to 4.2.1

* [Release] Bumped vsphere version to 7.6.0

* [Release] Bumped weaviate version to 2.3.3

* [Release] Bumped windows_performance_counters version to 2.1.1

* [Release] Bumped windows_service version to 4.9.1

* Allow pytest to return success when no tests are collected for flaky test suite (#17990)

* Manage no tests collected exit code 5 from pytest for flaky test suite
* Manage passing additional -m arguments to pytest in e2e test
* Avoid passing `all` to pytest (revert to initial state)

* Revert "Allow pytest to return success when no tests are collected for flaky test suite (#17990)"

This reverts commit dd5dd64.

* Update Logs Parsing rules for the Teleport Pipeline (#17955)

* make component name optional in the log prefix

* add two samples for missing component name logs

* update sample results

* [NDM][Cisco SD-WAN] Bold Cisco sdwan beta banner (#17941)

* Add Cisco sdwan beta banner

* trying smth

* bold

* Fixed the heat endpoint for the Openstack Controller (#17996)

* fixing the heat endpoint

* added a changelog

* addressed comments

* addressed comments

* lint

* kyverno setup (#17757)

* kyverno setup

* added python tests

* add tests

* ci sync

* validations

* changelog

* service checks

* validation

* validation

* sync ci

* lint

* ci sync

* classifier tags

* manifests

* clean up

---------

Co-authored-by: sguillen18 <seanguillen18@gmail.com>

* Enable manual triggering of dependency build & resolution (#17995)

* Enable manual triggering of dependency build & resolution

* Use default_branch instead of hardcoded branch name

Co-authored-by: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>

---------

Co-authored-by: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>

* Fix build-deps workflow yaml (#18002)

* Kyverno starting version should be 0.0.1 (#18001)

* [mongo] Properly handle the null value of waiting_for_latch in operation sampling (#17997)

* Release v1 of kyverno (#18005)

* [Release] Bumped kyverno version to 1.0.0

* [Release] Update metadata

* Emit dead/live toast rows as gauge (#18009)

* remove invalid filters (#18010)

* Sy/istio assets (#17998)

* WIP assets

* rec monitors

* rec monitors

* dash nits

* Update istio/assets/dashboards/overview.json

Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>

* Update istio/assets/dashboards/overview.json

Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>

* Update istio/assets/dashboards/overview.json

Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>

---------

Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>

* add default monitor for wincrashdetect (#18011)

* add default monitor for wincrashdetect

* review feedback

* missing field

* Update wincrashdetect/assets/monitors/windows_crash.json

Co-authored-by: May Lee <may.lee@datadoghq.com>

---------

Co-authored-by: May Lee <may.lee@datadoghq.com>

* Code Formatting Nit (#18012)

* Add tests for openmetrics counters (#18014)

- Confirm that we don't collect metrics that don't end in _total
- Confirm that forcing untyped metrics into counters works (see prev point tho)

* Remove SIT as code owners of checks downloader (#17992)

* remove SIT as code owners of checks downloader

the SIT team is not a core contributor to this software anymore

* remove Trishank as code owner

See #17992 (comment)

* Wrap pytest exit code to 0 when no tests are collected (#18003)

* Wrap pytest exit code to 0 when no tests are collected for flaky test suite as well as master
* Manage passing additional -m arguments to pytest in e2e test
* Pass `all` to pytest for e2e tests. 

By default e2e tests are checked for None as environment provided in command line args to set it to `all`. With additional args for pytest passed with `-m` flag, ddev cli misinterprets this as an environment name whereas it should be selecting `all` environments

* Rename classes to avoid pytest warnings (#18015)

Pytest tries to treat classes that start with 'Test' as tests. Helper class
names shouldn't start with 'Test' to avoid pytest complaining about them.

* [NDM] Add NDM metadata support for Cisco ACI (#17735)

* Add support for sending device metadata

* Add unit test for device metadata, update fixture

* Add license header, changelogs

* Lint

* First pass at submitting interface metadata, cleanup for test fixtures

* Fix for py2.7 support

* Try to fix imports

* Deal with pydantic stuff py2.7

* Allow namespace for Cisco ACI devices, static var for vendor

* Update device metadata to use the correct fieldname, add pydantic model for EvP intake

* Sync the conf.yaml example

* Add device type and integration to device metadata, fix ID field name

* Update interface statuses

* Deal with device status (use fabricSt)

* Update get_eth_list to get operStatus, update all tests and fixtures

* Amend docs for namespace

* Batch events sent to EvP

* Add interface status metric

* Only add to list for >py3.0

* Update default value for vendor, yield for batch events, use device type other

* Add source field to device metadata tags

* Add enums for interface status

* Use correct track type for NDM metadata

* Amend device id tag, collect timestamp ms -> s

* Add interface integration field

* More generic method to send EvP event

* Add docstring for the EvP method

* Update interface tagging, remove system_ip tag

* Fix linting for submit event platform event

* Use interface ID tags

* [LOGSC-1794] Change Logs assets file ownership to only Logs-backend (#17906)

* Move logs backend as only owner for logs asset files following incident 27749

* Make sure ownership is logs backend by being last item

* Remove use of python from process signatures (#18021)

* appset metric fix (#18018)

* appset metric fix

* changelogs

* Release base check (#18025)

* [Release] Bumped datadog_checks_base version to 36.10.0

* [Release] Update metadata

* Bump minimum base check version required. (#18028)

* [NDM] [Cisco ACI] Update dashboard (#17943)

* First pass to update Cisco ACI dashboard

* Add doc update suggestion to description

* Separate egress/ingress graphs, fix wrong metrics used

* add missing offering integration classifier tag to all listings (#18023)

* Add explanation to logs-only template (#18027)

* Finalize Agent release 7.55.0 (#18022)

Co-authored-by: steveny91 <steveny91@users.noreply.github.com>

* [datadog_cluster_agent] Add tagger and workloadmeta metrics (#18030)

* Add process signatures for vLLM (#17980)

* Add process signatures for vLLM

* fix manifest json

* feedback from processes team

* process sig as suggested by processes team

* enable public display for Traefik Mesh (#18032)

* [ecos 1459] Move all marketplace further reading readme sections to the manifest (#17721)

* Move all marketplace further reading readme sections to the manifest

* rerun script

* Update kafka/manifest.json

* Apply suggestions from code review

* Update openai/manifest.json

* Update snmp/manifest.json

* Update kafka/manifest.json

* Update spark/manifest.json

* re-run script

* Apply suggestions from code review

* Update voltdb/manifest.json

* Apply suggestions from code review

* Update voltdb/manifest.json

* Update snmp_f5/manifest.json

* Modify the indents of yaml in README.md (#17977)

* Add Network Path integration metadata (#17984)

Co-authored-by: Alicia Scott <aliciascott@users.noreply.github.com>

* Add network_path to codeowners (#18035)

* remove macOS support for network_path (#18034)

* [dbm] Handles group replication metrics for MySQL version < 8.0.2 (#18024)

* handle mysql group replication metrics for ver < 8.0.2

* updates tests

* renames vars, fixes tests

* adds changelog

* Add NDM as codeowners for Cisco ACI integration (#18036)

* Finalize Agent release 7.55.1 (#18040)

Co-authored-by: steveny91 <steveny91@users.noreply.github.com>

* vault ootb update (#18045)

* vault ootb update

* vault ootb update manifest

* Update vault_overview.json

* [mongo] Continue coll/index stats collection if user is not authorized to perform aggregation (#18044)

* Continue collection of coll stats if user is not authorized to perform collStats aggregation

* add changelog

* fix lint

* continue on index stats collection if user is not authorized

* update changelog

* Fix postgres extension settings collection (#18043)

* Improve log error for invalid ssl option in postgres config (#18047)

* minor fix (#18049)

* Sy/temporal fix (#18050)

* test fix

* changelog

* [NDM] [Cisco ACI] Add common NDM tags to metrics (#18017)

* Update interface status metric name to be more consistent with other metrics

* Add common NDM metric tags

* Add changelog

* Add missing common tags (device_id, device_hostname)

* [mongo] collect additional wiredtiger cache metrics (#18052)

* collect additional wiredtiger cache metrics

* add changelog

* Show descriptions of templates in ddev create help (#18039)

* Show descriptions of templates in ddev create help

* add changelog

* add more template descriptions

* Apply suggestions from code review

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* Update datadog_checks_dev/datadog_checks/dev/tooling/templates/integration/tile/README.md

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

---------

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* Add overview dashboard for vLLM (#17967)

* Add overview dashboard for vLLM

* Apply suggestions from code review

Co-authored-by: Heston Hoffman <heston.hoffman@datadoghq.com>

* Dashboard changes based on review

---------

Co-authored-by: Heston Hoffman <heston.hoffman@datadoghq.com>

* [NDM] [Cisco ACI] Update metrics metadata (#17981)

* Update metrics that have per second unit, update incorrect units

* Add new metric for interface status

* Update the port status metric to correspond to new name

* [Release] Bumped mongo version to 6.7.1 (#18061)

* Update vault_overview.json (#18055)

* Sy/om type override (#18054)

* Fix tests for openmetrics counter transformer

* Try dropping the '_total' restriction on metric samples

* add type override examples

* add test for type_override

* stricter test

* changelog

* remove f string

* remove f string

* spacing

* lint

* Update datadog_checks_base/changelog.d/18054.added

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Update datadog_checks_base/tests/base/checks/openmetrics/test_v2/test_transformers/test_type_override.py

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Update datadog_checks_base/tests/base/checks/openmetrics/test_v2/test_transformers/test_type_override.py

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Update datadog_checks_base/tests/base/checks/openmetrics/test_v2/test_transformers/test_type_override.py

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Update test_type_override.py

* lint

---------

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* update cURL from 8.4.0 to 8.7.1 (#18064)

* [NDM] Pin pysmi version for breaking generate traps DB tests (#18066)

* Pin pysmi version for integration tests

* Add changelog

* Fix misspelled database name (#18068)

* [mongo] rename dbms from mongodb to mongo (#18067)

* rename dbms to mongo

* add changelog

* fix test

* rename ootb dashboard (#18051)

* rename ootb dashboard

* rename json

* rename json

* rename json

* Add validation for versions in __about__.py and CHANGELOG (#18063)

* Add validation for versions in __about__.py and CHANGELOG

* add changelog

* try fix for windows path

* fix the other paths for windows tests

* Update dependency resolution (#18065)

Co-authored-by: chouquette <chouquette@users.noreply.github.com>

* [Release] Bumped mongo version to 6.7.2 (#18076)

* make windows crash detection docs publi (#18074)

* Start validating version in CI (#18077)

* Start validating version in CI

* Fix changelogs and ignore ddev

* [AGENT-11701] Fix TeamCity Integration (#18041)

* Handle project without builds

* Add changelog

* Refactor code

* Add comment

* Fix

* Update teamcity/changelog.d/18041.fixed

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

---------

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Sy/kyverno patch (#18088)

* rename metric

* changelog

* tests

* [SIEMINT-42] DDS: Mimecast: Crawler Integration Without Assets (#17864)

* Add mimecast crawler integration with no assets

* corrected description.

* Adding stanza in CODEOWNERS for mimecast integration and minor fix.

* Adding integration in labeler.yml

* [mysql] revert default read_timeout (#18097)

* revert default read_timeout

* add changelog

* Add global custom queries feature for postgres (#17993)

* Add global custom queries for postgres

* Add changelog entry

* Update config models

* Update instance config model

* [Release] Bumped kyverno version to 1.0.1 (#18095)

* process signature (#18092)

* Add schema collection to mysql (#17916)

* Add schema collection to mysql

* add schemas

* Added test dbs and tables

* Added indexes

* Adding foreign keys

* Fix submitter

* add test change

* Added the main test

* revert typos

* fixed indexes

* Add params to queries

* added unit tests

* added flavor field

* Changed index_name to name

* Changed fkeys query

* Changed partition query

* Normalise f_keys columns

* Applied linter

* Fixed comments

* Applied linter

* Fixed example

* Added a changelog

* Moved changelog

* synced data model

* Added a test for enabled logic

* Renamed to database data

* Add databases data

* added the changelog

* Added fields to columns query

* added subpartitions as separate fields

* Add fields to the table query

* Improved columns query

* Added table name to the FK key query

* Removed cardinality from index query as its dynamic

* Improved exception handling

* Added the base table condition

* ordered columns in f_key

* Added index schema

* improved partitions data

* fixed columns

* Applied linter

* Normalized tests

* Applied linter

* Fix tests for group

* Fixed for MariaDB

* Fixed tests for mariaDB

* update cisco sdwan monitor tags (#18102)

* [SIEMINT-69] DDS: Cisco Secure Endpoint: Crawler Integration Without Assets (#17865)

* Add Cisco Secure Endpoint Crawler Code with no assets

* Updated manifest.json

* Updated source_type_name in manifest

* Added CODEOWNERS for cisco secure endpoint

* Updated labeler.yml

* Updated as per PR comment

* Made changes in changelog file

---------

Co-authored-by: Ankita Rajput <ankita.rajput@CDSYS.LOCAL>
Co-authored-by: Nathan Adams <nathan.adams@datadoghq.com>

* SDBM-1074: Update sqlserver_db_not_sync.json (#18103)

* SDBM-1074: Update sqlserver_db_not_sync.json

Adjusting the description based on customer feedback

* Update sqlserver/assets/monitors/sqlserver_db_not_sync.json

Co-authored-by: Seth Samuel <seth.samuel@datadoghq.com>

---------

Co-authored-by: Seth Samuel <seth.samuel@datadoghq.com>

* Add Further Reading links (#18096)

* Add Further Reading link

* Add links

* Fix crash when no pg_stat_statements (#18081)

* recommended monitor (#18089)

* recommended monitor

* Update kyverno/assets/monitors/controller_drops.json

Co-authored-by: Esther Kim <esther.kim@datadoghq.com>

* Update kyverno/assets/monitors/controller_drops.json

Co-authored-by: Esther Kim <esther.kim@datadoghq.com>

---------

Co-authored-by: Esther Kim <esther.kim@datadoghq.com>

* [DOCS-7701] readme improvements for Istio and Aerospike (#18013)

* ad updates

* Apply suggestions from code review

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* Update README.md

---------

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* saved views (#18100)

* Update README.md (#18110)

* Initial feedback for vLLM dashboard (#18105)

* Initial feedback for vLLM dashboard

* Apply suggestions from code review

Co-authored-by: May Lee <may.lee@datadoghq.com>

* add description for process section

---------

Co-authored-by: May Lee <may.lee@datadoghq.com>

* Port releases for rc7 of 7.56 to master (#18114)

* [Release] Bumped mysql version to 12.6.1

* [Release] Bumped openstack_controller version to 6.8.1

* Update README.md (#18115)

* [SIEMINT-40] DDS: Sophos Central Cloud: Crawler Integration Without Assets (#17866)

* Add sophos central cloud crawler integration with no assets

* Adding description in menifest file.

* Adding stanza in CODEOWNERS.

* Fix source type name suggestion

* Update README.md (#18116)

* Update ECS Fargate about potential billing impact related to setting DD_HOSTNAME (#18031)

* added section to enable default metrics through jmxfetch

* update dd_hostname warning to include note about billing impact

* Update ecs_fargate/README.md

Co-authored-by: Alicia Scott <aliciascott@users.noreply.github.com>

---------

Co-authored-by: Alicia Scott <aliciascott@users.noreply.github.com>

* Fix integration dashboard json file name (cisco_secure_firewall/assets/dashboards/cisco_secure_firewall_threat_detection.json) (#18124)

* fixing space in file name

* modifying manifest

* Readd the API Key installation instructions (#18106)

* Readd the API Key installation instructions

* Remove links inside tabs

* Apply suggestions from code review

Co-authored-by: May Lee <may.lee@datadoghq.com>

---------

Co-authored-by: May Lee <may.lee@datadoghq.com>

* DDS: Palo Alto Cortex XDR: Crawler Integration Without Assets (#18107)

* Add palo alto cortex xdr integration with no asset

* Updated manifest file

* Made changes in title

* Removed angle brackets

---------

Co-authored-by: surabhipatel_crest <surabhi.patel@crestdatasys.com>
Co-authored-by: ravindrasojitra-crest <ravindra.sojitra@crestdata.ai>

* Minor change

* change logo of the integration.

* remove angle braces to fix integration sync issues (#18109)

* Finalize Agent release 7.55.2 (#18079)

Co-authored-by: steveny91 <steveny91@users.noreply.github.com>

* Log warning when failing to parse openmetrics response (#17514)

* Include input line in openmetrics parsing error

* Add changelog entry

---------

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* [NDM] [Cisco ACI] Add config flag for enabling sending metadata to NDM (#18099)

* Add the enable_ndm flag

* Check the flag is true before creating metadata and sending to NDM intake

* Always forget the changelog

* Rename config flag to send_ndm_metadata

* Refactor to use new flag name, helper fn to check to send NDM metadata

* Updated Dashboards

* Resolve Merge Conflicts.

* Resolve merge conflicts.

* Adding offering tag.

* Resolve merge conflicts.

* Updated dashboard design

* Updated new dashboard images

* Addressed minor review comment

---------

Co-authored-by: surabhipatel_crest <surabhi.patel@crestdatasys.com>
Co-authored-by: Alex Weisberger <alex.weisberger@datadoghq.com>
Co-authored-by: Zhengda Lu <zhengda.lu@datadoghq.com>
Co-authored-by: Anthonin Bonnefoy <anthonin.bonnefoy@datadoghq.com>
Co-authored-by: HadhemiDD <43783545+HadhemiDD@users.noreply.github.com>
Co-authored-by: agent-platform-auto-pr[bot] <153269286+agent-platform-auto-pr[bot]@users.noreply.github.com>
Co-authored-by: iliakur <iliakur@users.noreply.github.com>
Co-authored-by: vivek-datadog <131680079+vivek-datadog@users.noreply.github.com>
Co-authored-by: Vivekanand Ilango <vivekanand.ilango@datadoghq.com>
Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>
Co-authored-by: Boris Kozlov <kozlovb82@yahoo.fr>
Co-authored-by: NouemanKHAL <noueman.khalikine@datadoghq.com>
Co-authored-by: Thibaud Cheruy <thibaud.cheruy@datadoghq.com>
Co-authored-by: rahulkaukuntla <144174402+rahulkaukuntla@users.noreply.github.com>
Co-authored-by: Steven Yuen <steven.yuen@datadoghq.com>
Co-authored-by: sguillen18 <seanguillen18@gmail.com>
Co-authored-by: Alex Lopez <alex.lopez.zorzano@gmail.com>
Co-authored-by: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>
Co-authored-by: Derek Brown <derek.brown@datadoghq.com>
Co-authored-by: May Lee <may.lee@datadoghq.com>
Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
Co-authored-by: Cédric Van Rompay <97546950+cedricvanrompay-datadog@users.noreply.github.com>
Co-authored-by: zoe ✨ <9274242+zoedt@users.noreply.github.com>
Co-authored-by: Thibault Krebs <150821137+thibaultkrebs@users.noreply.github.com>
Co-authored-by: Daniel Tafoya <63120739+daniel-taf@users.noreply.github.com>
Co-authored-by: bgoldberg122 <ben.goldberg@datadoghq.com>
Co-authored-by: datadog-agent-integrations-bot[bot] <159767151+datadog-agent-integrations-bot[bot]@users.noreply.github.com>
Co-authored-by: steveny91 <steveny91@users.noreply.github.com>
Co-authored-by: David Ortiz <david.ortiz@datadoghq.com>
Co-authored-by: Kyle Neale <kyle.neale@datadoghq.com>
Co-authored-by: taromn <54003207+taromn@users.noreply.github.com>
Co-authored-by: Alexandre Yang <alexandre.yang@datadoghq.com>
Co-authored-by: Alicia Scott <aliciascott@users.noreply.github.com>
Co-authored-by: Alex Torres <alejandro.torres@datadoghq.com>
Co-authored-by: Seth Samuel <seth.samuel@datadoghq.com>
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
Co-authored-by: Heston Hoffman <heston.hoffman@datadoghq.com>
Co-authored-by: Jen Gilbert <jen.gilbert@datadoghq.com>
Co-authored-by: chouquette <chouquette@users.noreply.github.com>
Co-authored-by: Shanel Huang <shanel.huang@datadoghq.com>
Co-authored-by: dkirov-dd <166512750+dkirov-dd@users.noreply.github.com>
Co-authored-by: ravindrasojitra-crest <ravindra.sojitra@crestdata.ai>
Co-authored-by: Raj Madhaiyan <rajkamalhm@gmail.com>
Co-authored-by: ankitarajput-crest <ankita.rajput@crestdata.ai>
Co-authored-by: Ankita Rajput <ankita.rajput@CDSYS.LOCAL>
Co-authored-by: Nathan Adams <nathan.adams@datadoghq.com>
Co-authored-by: pierreln-dd <144696725+pierreln-dd@users.noreply.github.com>
Co-authored-by: Esther Kim <esther.kim@datadoghq.com>
Co-authored-by: cecilia saixue watt <cecilia.watt@datadoghq.com>
Co-authored-by: Heather Dinh <44285485+hdinh77@users.noreply.github.com>
Co-authored-by: Kirolos Shahat <kashahat@gmail.com>
Co-authored-by: Tommy Brunn <tommy.brunn@gmail.com>
github-actions bot pushed a commit that referenced this pull request Sep 5, 2024
…tion v1.0.0 (#18084)

* Added Palo Alto Cortex XDR integration with assets

* Added date in CHANGELOG file

* Fixed pipeline suggestions

* Fixed pipeline suggestions

* Fixing log pipeline suggestions

* Reodered Groups for facets

* Added log pipeline result

* Fixing pipeline for log result

* Enhanced log pipeline result

* Fixing the log pipeline result

* Adding log output.

* Adding log pipeline result

* Updated log pipeline

* Updated README.md file with suggested changes

* Drop explain plan failures to debug level (#17974)

* Drop explain plan errors to debug logs.

* Changelog entry

* [mongo] Support auto-discover available databases for the monitored mongodb instance (#17959)

* autodiscover mongodb databases

* Add database autodiscovery support

* remove print

* only list authorized collections not views

* ignore collections from config when database autodiscovery is enabled

* add changelog

* update changelog

* fix license header

* update include list with deprecated dbnames

* fix test

* update comments

* update changelog

* return databases and count

* update readme

* update config description to dbnames

* Add collect of metrics for buffer cache usage (#17960)

The pg_buffercache extension provides a pg_buffercache view that give
a detailed report the usage of shared buffer: which relation is using
it, whether it's dirty and how many backends are pinning this buffer.

This patch adds the capacity to collect data from pg_buffercache to
provide visibility on shared buffer usage.

* [mongo] deprecate collStats command and use $collStats aggregation stage to collect collection metrics (#17961)

* use collStats aggregation pipeline to collect collection metrics

* add changelog

* sort metadata

* remove commented code

* update test results with new metrics

* Add ssl path option when building the librdkafka dependency  (#17957)

* add the prefix path

* commit

* commit

* commit

* add debug

* enable ssl

* enable ssl in prefix folder

* enable ssl in prefix folder

* set default ssl path

* set default ssl path

* set default ssl path

* set default ssl path

* set default ssl path

* linter

* linter

* Update dependency resolution (#17971)

Co-authored-by: iliakur <iliakur@users.noreply.github.com>

* Fix format issue with master pipeline flaky test management pr17910 (#17979)

* Add manual trigger for flaky test suite

* Mark envoy tests as flaky (#17985)

* [Release] Bumped vllm version to 1.0.0 (#17988)

* Switch back to the intial database while collecting schemas (#17978)

* Switch back to the intial database while collecting schemas

* Used finally

* Applied linter

* Port 7.56 releases to master (#17991)

* [Release] Bumped active_directory version to 2.1.1

* [Release] Bumped aerospike version to 2.2.2

* [Release] Bumped amazon_msk version to 4.9.0

* [Release] Bumped arangodb version to 2.2.2

* [Release] Bumped argo_rollouts version to 1.0.2

* [Release] Bumped argo_workflows version to 1.0.2

* [Release] Bumped argocd version to 2.4.2

* [Release] Bumped aspdotnet version to 2.1.1

* [Release] Bumped avi_vantage version to 4.2.2

* [Release] Bumped boundary version to 2.2.3

* [Release] Bumped calico version to 2.2.2

* [Release] Bumped cert_manager version to 4.1.2

* [Release] Bumped cilium version to 3.5.1

* [Release] Bumped cisco_aci version to 2.9.0

* [Release] Bumped clickhouse version to 3.6.0

* [Release] Bumped cockroachdb version to 3.3.2

* [Release] Bumped coredns version to 3.2.3

* [Release] Bumped datadog_checks_base version to 36.9.0

* [Release] Bumped datadog_checks_downloader version to 4.7.0

* [Release] Bumped dcgm version to 2.3.2

* [Release] Bumped dotnetclr version to 2.1.1

* [Release] Bumped envoy version to 3.5.1

* [Release] Bumped esxi version to 1.2.0

* [Release] Bumped etcd version to 6.2.2

* [Release] Bumped exchange_server version to 2.1.1

* [Release] Bumped fluxcd version to 1.2.2

* [Release] Bumped gitlab version to 7.3.2

* [Release] Bumped haproxy version to 5.2.2

* [Release] Bumped http_check version to 9.7.0

* [Release] Bumped hyperv version to 1.11.1

* [Release] Bumped iis version to 3.1.1

* [Release] Bumped impala version to 2.2.2

* [Release] Bumped istio version to 6.1.2

* [Release] Bumped kafka_consumer version to 4.5.0

* [Release] Bumped karpenter version to 1.4.1

* [Release] Bumped kong version to 3.2.2

* [Release] Bumped kubernetes_cluster_autoscaler version to 1.0.1

* [Release] Bumped linkerd version to 4.2.2

* [Release] Bumped mongo version to 6.7.0

* [Release] Bumped mysql version to 12.6.0

* [Release] Bumped nvidia_triton version to 1.2.2

* [Release] Bumped openmetrics version to 4.2.2

* [Release] Bumped postgres version to 19.0.0

* [Release] Bumped process version to 3.4.0

* [Release] Bumped pulsar version to 2.2.2

* [Release] Bumped rabbitmq version to 5.3.2

* [Release] Bumped ray version to 1.2.2

* [Release] Bumped redisdb version to 5.6.0

* [Release] Bumped scylla version to 2.7.2

* [Release] Bumped snowflake version to 5.7.0

* [Release] Bumped sqlserver version to 17.4.0

* [Release] Bumped strimzi version to 2.2.2

* [Release] Bumped tcp_check version to 4.9.0

* [Release] Bumped teamcity version to 4.3.0

* [Release] Bumped tekton version to 1.0.2

* [Release] Bumped temporal version to 2.2.2

* [Release] Bumped teradata version to 2.2.1

* [Release] Bumped tls version to 2.18.0

* [Release] Bumped torchserve version to 2.2.2

* [Release] Bumped traefik_mesh version to 1.0.1

* [Release] Bumped vault version to 4.2.1

* [Release] Bumped vsphere version to 7.6.0

* [Release] Bumped weaviate version to 2.3.3

* [Release] Bumped windows_performance_counters version to 2.1.1

* [Release] Bumped windows_service version to 4.9.1

* Allow pytest to return success when no tests are collected for flaky test suite (#17990)

* Manage no tests collected exit code 5 from pytest for flaky test suite
* Manage passing additional -m arguments to pytest in e2e test
* Avoid passing `all` to pytest (revert to initial state)

* Revert "Allow pytest to return success when no tests are collected for flaky test suite (#17990)"

This reverts commit dd5dd64.

* Update Logs Parsing rules for the Teleport Pipeline (#17955)

* make component name optional in the log prefix

* add two samples for missing component name logs

* update sample results

* [NDM][Cisco SD-WAN] Bold Cisco sdwan beta banner (#17941)

* Add Cisco sdwan beta banner

* trying smth

* bold

* Fixed the heat endpoint for the Openstack Controller (#17996)

* fixing the heat endpoint

* added a changelog

* addressed comments

* addressed comments

* lint

* kyverno setup (#17757)

* kyverno setup

* added python tests

* add tests

* ci sync

* validations

* changelog

* service checks

* validation

* validation

* sync ci

* lint

* ci sync

* classifier tags

* manifests

* clean up

---------

Co-authored-by: sguillen18 <seanguillen18@gmail.com>

* Enable manual triggering of dependency build & resolution (#17995)

* Enable manual triggering of dependency build & resolution

* Use default_branch instead of hardcoded branch name

Co-authored-by: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>

---------

Co-authored-by: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>

* Fix build-deps workflow yaml (#18002)

* Kyverno starting version should be 0.0.1 (#18001)

* [mongo] Properly handle the null value of waiting_for_latch in operation sampling (#17997)

* Release v1 of kyverno (#18005)

* [Release] Bumped kyverno version to 1.0.0

* [Release] Update metadata

* Emit dead/live toast rows as gauge (#18009)

* remove invalid filters (#18010)

* Sy/istio assets (#17998)

* WIP assets

* rec monitors

* rec monitors

* dash nits

* Update istio/assets/dashboards/overview.json

Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>

* Update istio/assets/dashboards/overview.json

Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>

* Update istio/assets/dashboards/overview.json

Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>

---------

Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>

* add default monitor for wincrashdetect (#18011)

* add default monitor for wincrashdetect

* review feedback

* missing field

* Update wincrashdetect/assets/monitors/windows_crash.json

Co-authored-by: May Lee <may.lee@datadoghq.com>

---------

Co-authored-by: May Lee <may.lee@datadoghq.com>

* Code Formatting Nit (#18012)

* Add tests for openmetrics counters (#18014)

- Confirm that we don't collect metrics that don't end in _total
- Confirm that forcing untyped metrics into counters works (see prev point tho)

* Remove SIT as code owners of checks downloader (#17992)

* remove SIT as code owners of checks downloader

the SIT team is not a core contributor to this software anymore

* remove Trishank as code owner

See #17992 (comment)

* Wrap pytest exit code to 0 when no tests are collected (#18003)

* Wrap pytest exit code to 0 when no tests are collected for flaky test suite as well as master
* Manage passing additional -m arguments to pytest in e2e test
* Pass `all` to pytest for e2e tests.

By default e2e tests are checked for None as environment provided in command line args to set it to `all`. With additional args for pytest passed with `-m` flag, ddev cli misinterprets this as an environment name whereas it should be selecting `all` environments

* Rename classes to avoid pytest warnings (#18015)

Pytest tries to treat classes that start with 'Test' as tests. Helper class
names shouldn't start with 'Test' to avoid pytest complaining about them.

* [NDM] Add NDM metadata support for Cisco ACI (#17735)

* Add support for sending device metadata

* Add unit test for device metadata, update fixture

* Add license header, changelogs

* Lint

* First pass at submitting interface metadata, cleanup for test fixtures

* Fix for py2.7 support

* Try to fix imports

* Deal with pydantic stuff py2.7

* Allow namespace for Cisco ACI devices, static var for vendor

* Update device metadata to use the correct fieldname, add pydantic model for EvP intake

* Sync the conf.yaml example

* Add device type and integration to device metadata, fix ID field name

* Update interface statuses

* Deal with device status (use fabricSt)

* Update get_eth_list to get operStatus, update all tests and fixtures

* Amend docs for namespace

* Batch events sent to EvP

* Add interface status metric

* Only add to list for >py3.0

* Update default value for vendor, yield for batch events, use device type other

* Add source field to device metadata tags

* Add enums for interface status

* Use correct track type for NDM metadata

* Amend device id tag, collect timestamp ms -> s

* Add interface integration field

* More generic method to send EvP event

* Add docstring for the EvP method

* Update interface tagging, remove system_ip tag

* Fix linting for submit event platform event

* Use interface ID tags

* [LOGSC-1794] Change Logs assets file ownership to only Logs-backend (#17906)

* Move logs backend as only owner for logs asset files following incident 27749

* Make sure ownership is logs backend by being last item

* Remove use of python from process signatures (#18021)

* appset metric fix (#18018)

* appset metric fix

* changelogs

* Release base check (#18025)

* [Release] Bumped datadog_checks_base version to 36.10.0

* [Release] Update metadata

* Bump minimum base check version required. (#18028)

* [NDM] [Cisco ACI] Update dashboard (#17943)

* First pass to update Cisco ACI dashboard

* Add doc update suggestion to description

* Separate egress/ingress graphs, fix wrong metrics used

* add missing offering integration classifier tag to all listings (#18023)

* Add explanation to logs-only template (#18027)

* Finalize Agent release 7.55.0 (#18022)

Co-authored-by: steveny91 <steveny91@users.noreply.github.com>

* [datadog_cluster_agent] Add tagger and workloadmeta metrics (#18030)

* Add process signatures for vLLM (#17980)

* Add process signatures for vLLM

* fix manifest json

* feedback from processes team

* process sig as suggested by processes team

* enable public display for Traefik Mesh (#18032)

* [ecos 1459] Move all marketplace further reading readme sections to the manifest (#17721)

* Move all marketplace further reading readme sections to the manifest

* rerun script

* Update kafka/manifest.json

* Apply suggestions from code review

* Update openai/manifest.json

* Update snmp/manifest.json

* Update kafka/manifest.json

* Update spark/manifest.json

* re-run script

* Apply suggestions from code review

* Update voltdb/manifest.json

* Apply suggestions from code review

* Update voltdb/manifest.json

* Update snmp_f5/manifest.json

* Modify the indents of yaml in README.md (#17977)

* Add Network Path integration metadata (#17984)

Co-authored-by: Alicia Scott <aliciascott@users.noreply.github.com>

* Add network_path to codeowners (#18035)

* remove macOS support for network_path (#18034)

* [dbm] Handles group replication metrics for MySQL version < 8.0.2 (#18024)

* handle mysql group replication metrics for ver < 8.0.2

* updates tests

* renames vars, fixes tests

* adds changelog

* Add NDM as codeowners for Cisco ACI integration (#18036)

* Finalize Agent release 7.55.1 (#18040)

Co-authored-by: steveny91 <steveny91@users.noreply.github.com>

* vault ootb update (#18045)

* vault ootb update

* vault ootb update manifest

* Update vault_overview.json

* [mongo] Continue coll/index stats collection if user is not authorized to perform aggregation (#18044)

* Continue collection of coll stats if user is not authorized to perform collStats aggregation

* add changelog

* fix lint

* continue on index stats collection if user is not authorized

* update changelog

* Fix postgres extension settings collection (#18043)

* Improve log error for invalid ssl option in postgres config (#18047)

* minor fix (#18049)

* Sy/temporal fix (#18050)

* test fix

* changelog

* [NDM] [Cisco ACI] Add common NDM tags to metrics (#18017)

* Update interface status metric name to be more consistent with other metrics

* Add common NDM metric tags

* Add changelog

* Add missing common tags (device_id, device_hostname)

* [mongo] collect additional wiredtiger cache metrics (#18052)

* collect additional wiredtiger cache metrics

* add changelog

* Show descriptions of templates in ddev create help (#18039)

* Show descriptions of templates in ddev create help

* add changelog

* add more template descriptions

* Apply suggestions from code review

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* Update datadog_checks_dev/datadog_checks/dev/tooling/templates/integration/tile/README.md

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

---------

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* Add overview dashboard for vLLM (#17967)

* Add overview dashboard for vLLM

* Apply suggestions from code review

Co-authored-by: Heston Hoffman <heston.hoffman@datadoghq.com>

* Dashboard changes based on review

---------

Co-authored-by: Heston Hoffman <heston.hoffman@datadoghq.com>

* [NDM] [Cisco ACI] Update metrics metadata (#17981)

* Update metrics that have per second unit, update incorrect units

* Add new metric for interface status

* Update the port status metric to correspond to new name

* [Release] Bumped mongo version to 6.7.1 (#18061)

* Update vault_overview.json (#18055)

* Sy/om type override (#18054)

* Fix tests for openmetrics counter transformer

* Try dropping the '_total' restriction on metric samples

* add type override examples

* add test for type_override

* stricter test

* changelog

* remove f string

* remove f string

* spacing

* lint

* Update datadog_checks_base/changelog.d/18054.added

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Update datadog_checks_base/tests/base/checks/openmetrics/test_v2/test_transformers/test_type_override.py

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Update datadog_checks_base/tests/base/checks/openmetrics/test_v2/test_transformers/test_type_override.py

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Update datadog_checks_base/tests/base/checks/openmetrics/test_v2/test_transformers/test_type_override.py

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Update test_type_override.py

* lint

---------

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* update cURL from 8.4.0 to 8.7.1 (#18064)

* [NDM] Pin pysmi version for breaking generate traps DB tests (#18066)

* Pin pysmi version for integration tests

* Add changelog

* Fix misspelled database name (#18068)

* [mongo] rename dbms from mongodb to mongo (#18067)

* rename dbms to mongo

* add changelog

* fix test

* rename ootb dashboard (#18051)

* rename ootb dashboard

* rename json

* rename json

* rename json

* Add validation for versions in __about__.py and CHANGELOG (#18063)

* Add validation for versions in __about__.py and CHANGELOG

* add changelog

* try fix for windows path

* fix the other paths for windows tests

* Update dependency resolution (#18065)

Co-authored-by: chouquette <chouquette@users.noreply.github.com>

* [Release] Bumped mongo version to 6.7.2 (#18076)

* make windows crash detection docs publi (#18074)

* Start validating version in CI (#18077)

* Start validating version in CI

* Fix changelogs and ignore ddev

* [AGENT-11701] Fix TeamCity Integration (#18041)

* Handle project without builds

* Add changelog

* Refactor code

* Add comment

* Fix

* Update teamcity/changelog.d/18041.fixed

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

---------

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* Sy/kyverno patch (#18088)

* rename metric

* changelog

* tests

* [SIEMINT-42] DDS: Mimecast: Crawler Integration Without Assets (#17864)

* Add mimecast crawler integration with no assets

* corrected description.

* Adding stanza in CODEOWNERS for mimecast integration and minor fix.

* Adding integration in labeler.yml

* [mysql] revert default read_timeout (#18097)

* revert default read_timeout

* add changelog

* Add global custom queries feature for postgres (#17993)

* Add global custom queries for postgres

* Add changelog entry

* Update config models

* Update instance config model

* [Release] Bumped kyverno version to 1.0.1 (#18095)

* process signature (#18092)

* Add schema collection to mysql (#17916)

* Add schema collection to mysql

* add schemas

* Added test dbs and tables

* Added indexes

* Adding foreign keys

* Fix submitter

* add test change

* Added the main test

* revert typos

* fixed indexes

* Add params to queries

* added unit tests

* added flavor field

* Changed index_name to name

* Changed fkeys query

* Changed partition query

* Normalise f_keys columns

* Applied linter

* Fixed comments

* Applied linter

* Fixed example

* Added a changelog

* Moved changelog

* synced data model

* Added a test for enabled logic

* Renamed to database data

* Add databases data

* added the changelog

* Added fields to columns query

* added subpartitions as separate fields

* Add fields to the table query

* Improved columns query

* Added table name to the FK key query

* Removed cardinality from index query as its dynamic

* Improved exception handling

* Added the base table condition

* ordered columns in f_key

* Added index schema

* improved partitions data

* fixed columns

* Applied linter

* Normalized tests

* Applied linter

* Fix tests for group

* Fixed for MariaDB

* Fixed tests for mariaDB

* update cisco sdwan monitor tags (#18102)

* [SIEMINT-69] DDS: Cisco Secure Endpoint: Crawler Integration Without Assets (#17865)

* Add Cisco Secure Endpoint Crawler Code with no assets

* Updated manifest.json

* Updated source_type_name in manifest

* Added CODEOWNERS for cisco secure endpoint

* Updated labeler.yml

* Updated as per PR comment

* Made changes in changelog file

---------

Co-authored-by: Ankita Rajput <ankita.rajput@CDSYS.LOCAL>
Co-authored-by: Nathan Adams <nathan.adams@datadoghq.com>

* SDBM-1074: Update sqlserver_db_not_sync.json (#18103)

* SDBM-1074: Update sqlserver_db_not_sync.json

Adjusting the description based on customer feedback

* Update sqlserver/assets/monitors/sqlserver_db_not_sync.json

Co-authored-by: Seth Samuel <seth.samuel@datadoghq.com>

---------

Co-authored-by: Seth Samuel <seth.samuel@datadoghq.com>

* Add Further Reading links (#18096)

* Add Further Reading link

* Add links

* Fix crash when no pg_stat_statements (#18081)

* recommended monitor (#18089)

* recommended monitor

* Update kyverno/assets/monitors/controller_drops.json

Co-authored-by: Esther Kim <esther.kim@datadoghq.com>

* Update kyverno/assets/monitors/controller_drops.json

Co-authored-by: Esther Kim <esther.kim@datadoghq.com>

---------

Co-authored-by: Esther Kim <esther.kim@datadoghq.com>

* [DOCS-7701] readme improvements for Istio and Aerospike (#18013)

* ad updates

* Apply suggestions from code review

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* Update README.md

---------

Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>

* saved views (#18100)

* Update README.md (#18110)

* Initial feedback for vLLM dashboard (#18105)

* Initial feedback for vLLM dashboard

* Apply suggestions from code review

Co-authored-by: May Lee <may.lee@datadoghq.com>

* add description for process section

---------

Co-authored-by: May Lee <may.lee@datadoghq.com>

* Port releases for rc7 of 7.56 to master (#18114)

* [Release] Bumped mysql version to 12.6.1

* [Release] Bumped openstack_controller version to 6.8.1

* Update README.md (#18115)

* [SIEMINT-40] DDS: Sophos Central Cloud: Crawler Integration Without Assets (#17866)

* Add sophos central cloud crawler integration with no assets

* Adding description in menifest file.

* Adding stanza in CODEOWNERS.

* Fix source type name suggestion

* Update README.md (#18116)

* Update ECS Fargate about potential billing impact related to setting DD_HOSTNAME (#18031)

* added section to enable default metrics through jmxfetch

* update dd_hostname warning to include note about billing impact

* Update ecs_fargate/README.md

Co-authored-by: Alicia Scott <aliciascott@users.noreply.github.com>

---------

Co-authored-by: Alicia Scott <aliciascott@users.noreply.github.com>

* Fix integration dashboard json file name (cisco_secure_firewall/assets/dashboards/cisco_secure_firewall_threat_detection.json) (#18124)

* fixing space in file name

* modifying manifest

* Readd the API Key installation instructions (#18106)

* Readd the API Key installation instructions

* Remove links inside tabs

* Apply suggestions from code review

Co-authored-by: May Lee <may.lee@datadoghq.com>

---------

Co-authored-by: May Lee <may.lee@datadoghq.com>

* DDS: Palo Alto Cortex XDR: Crawler Integration Without Assets (#18107)

* Add palo alto cortex xdr integration with no asset

* Updated manifest file

* Made changes in title

* Removed angle brackets

---------

Co-authored-by: surabhipatel_crest <surabhi.patel@crestdatasys.com>
Co-authored-by: ravindrasojitra-crest <ravindra.sojitra@crestdata.ai>

* Minor change

* change logo of the integration.

* remove angle braces to fix integration sync issues (#18109)

* Finalize Agent release 7.55.2 (#18079)

Co-authored-by: steveny91 <steveny91@users.noreply.github.com>

* Log warning when failing to parse openmetrics response (#17514)

* Include input line in openmetrics parsing error

* Add changelog entry

---------

Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>

* [NDM] [Cisco ACI] Add config flag for enabling sending metadata to NDM (#18099)

* Add the enable_ndm flag

* Check the flag is true before creating metadata and sending to NDM intake

* Always forget the changelog

* Rename config flag to send_ndm_metadata

* Refactor to use new flag name, helper fn to check to send NDM metadata

* Updated Dashboards

* Resolve Merge Conflicts.

* Resolve merge conflicts.

* Adding offering tag.

* Resolve merge conflicts.

* Updated dashboard design

* Updated new dashboard images

* Addressed minor review comment

---------

Co-authored-by: surabhipatel_crest <surabhi.patel@crestdatasys.com>
Co-authored-by: Alex Weisberger <alex.weisberger@datadoghq.com>
Co-authored-by: Zhengda Lu <zhengda.lu@datadoghq.com>
Co-authored-by: Anthonin Bonnefoy <anthonin.bonnefoy@datadoghq.com>
Co-authored-by: HadhemiDD <43783545+HadhemiDD@users.noreply.github.com>
Co-authored-by: agent-platform-auto-pr[bot] <153269286+agent-platform-auto-pr[bot]@users.noreply.github.com>
Co-authored-by: iliakur <iliakur@users.noreply.github.com>
Co-authored-by: vivek-datadog <131680079+vivek-datadog@users.noreply.github.com>
Co-authored-by: Vivekanand Ilango <vivekanand.ilango@datadoghq.com>
Co-authored-by: Ilia Kurenkov <ilia.kurenkov@datadoghq.com>
Co-authored-by: Boris Kozlov <kozlovb82@yahoo.fr>
Co-authored-by: NouemanKHAL <noueman.khalikine@datadoghq.com>
Co-authored-by: Thibaud Cheruy <thibaud.cheruy@datadoghq.com>
Co-authored-by: rahulkaukuntla <144174402+rahulkaukuntla@users.noreply.github.com>
Co-authored-by: Steven Yuen <steven.yuen@datadoghq.com>
Co-authored-by: sguillen18 <seanguillen18@gmail.com>
Co-authored-by: Alex Lopez <alex.lopez.zorzano@gmail.com>
Co-authored-by: Hugo Beauzée-Luyssen <hugo.beauzee@datadoghq.com>
Co-authored-by: domalessi <111786334+domalessi@users.noreply.github.com>
Co-authored-by: Derek Brown <derek.brown@datadoghq.com>
Co-authored-by: May Lee <may.lee@datadoghq.com>
Co-authored-by: Austin Lai <76412946+alai97@users.noreply.github.com>
Co-authored-by: Cédric Van Rompay <97546950+cedricvanrompay-datadog@users.noreply.github.com>
Co-authored-by: zoe ✨ <9274242+zoedt@users.noreply.github.com>
Co-authored-by: Thibault Krebs <150821137+thibaultkrebs@users.noreply.github.com>
Co-authored-by: Daniel Tafoya <63120739+daniel-taf@users.noreply.github.com>
Co-authored-by: bgoldberg122 <ben.goldberg@datadoghq.com>
Co-authored-by: datadog-agent-integrations-bot[bot] <159767151+datadog-agent-integrations-bot[bot]@users.noreply.github.com>
Co-authored-by: steveny91 <steveny91@users.noreply.github.com>
Co-authored-by: David Ortiz <david.ortiz@datadoghq.com>
Co-authored-by: Kyle Neale <kyle.neale@datadoghq.com>
Co-authored-by: taromn <54003207+taromn@users.noreply.github.com>
Co-authored-by: Alexandre Yang <alexandre.yang@datadoghq.com>
Co-authored-by: Alicia Scott <aliciascott@users.noreply.github.com>
Co-authored-by: Alex Torres <alejandro.torres@datadoghq.com>
Co-authored-by: Seth Samuel <seth.samuel@datadoghq.com>
Co-authored-by: Bryce Eadie <bryce.eadie@datadoghq.com>
Co-authored-by: Heston Hoffman <heston.hoffman@datadoghq.com>
Co-authored-by: Jen Gilbert <jen.gilbert@datadoghq.com>
Co-authored-by: chouquette <chouquette@users.noreply.github.com>
Co-authored-by: Shanel Huang <shanel.huang@datadoghq.com>
Co-authored-by: dkirov-dd <166512750+dkirov-dd@users.noreply.github.com>
Co-authored-by: ravindrasojitra-crest <ravindra.sojitra@crestdata.ai>
Co-authored-by: Raj Madhaiyan <rajkamalhm@gmail.com>
Co-authored-by: ankitarajput-crest <ankita.rajput@crestdata.ai>
Co-authored-by: Ankita Rajput <ankita.rajput@CDSYS.LOCAL>
Co-authored-by: Nathan Adams <nathan.adams@datadoghq.com>
Co-authored-by: pierreln-dd <144696725+pierreln-dd@users.noreply.github.com>
Co-authored-by: Esther Kim <esther.kim@datadoghq.com>
Co-authored-by: cecilia saixue watt <cecilia.watt@datadoghq.com>
Co-authored-by: Heather Dinh <44285485+hdinh77@users.noreply.github.com>
Co-authored-by: Kirolos Shahat <kashahat@gmail.com>
Co-authored-by: Tommy Brunn <tommy.brunn@gmail.com> 387d0d7
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants