Skip to content

Avoid triggering all package tests on first commit of a backport branch#18876

Open
Copilot wants to merge 4 commits intomainfrom
copilot/avoid-triggering-all-package-tests
Open

Avoid triggering all package tests on first commit of a backport branch#18876
Copilot wants to merge 4 commits intomainfrom
copilot/avoid-triggering-all-package-tests

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented May 7, 2026

On the first push of a new backport branch, only CI infrastructure files change (.buildkite/, .github/workflows/, go.mod, etc.). Because no previous successful build exists yet, get_from_changeset() fell back to origin/${BUILDKITE_BRANCH}^, producing a diff that matched no non_package_patterns exclusions and marked every package as affected.

Change

  • .buildkite/scripts/common.shget_from_changeset(): when previous_successful_commit is "null" on a backport-* branch, set from="${BUILDKITE_COMMIT}" (identical to $to) instead of origin/${BUILDKITE_BRANCH}^, yielding an empty diff and no affected packages.
if [[ "${previous_successful_commit}" == "null" ]]; then
    if [[ "${BUILDKITE_BRANCH}" =~ ^backport- ]]; then
        # First push of a new backport branch: only CI infrastructure files
        # changed, no package code was modified — skip package testing.
        from="${BUILDKITE_COMMIT}"
    else
        from="origin/${BUILDKITE_BRANCH}^"
    fi
fi

The main branch fallback (origin/${BUILDKITE_BRANCH}^) is preserved unchanged.

Copilot AI changed the title [WIP] Fix CI to avoid triggering all package tests on backport branch Avoid triggering all package tests on first commit of a backport branch May 7, 2026
Copilot finished work on behalf of v1v May 7, 2026 14:12
Copilot AI requested a review from v1v May 7, 2026 14:12
@v1v v1v marked this pull request as ready for review May 7, 2026 16:12
@v1v v1v requested a review from a team as a code owner May 7, 2026 16:12
@v1v v1v requested a review from a team May 7, 2026 16:12
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 7, 2026

TL;DR

Check integrations netbox failed with exit status 1, but the provided job log only contains teardown/artifact-upload output and does not include the actual failing test/assertion. Immediate next step is to pull the failing JUnit/private logs for this step and identify the specific netbox test error before changing code.

Remediation

  • Retrieve the real failure detail from Buildkite artifacts/private logs for this exact step (at minimum build/test-results/netbox-system-*.xml and/or the full pre-teardown step log), then map the failing assertion to source.
  • Re-run the Check integrations netbox step after identifying the failing test to confirm whether this is deterministic or flaky.
Investigation details

Root Cause

The current evidence proves the step failed, but not why:

  • Log excerpt ends at stack teardown and artifact upload; no test assertion/stack trace is present.
  • Because the true failing assertion is missing, a code-level root cause cannot be confidently attributed from this data.

Additional relevant observation from code review:

  • In .buildkite/scripts/common.sh (get_from_changeset()), PR builds return early at lines 628-631 (origin/\$\{BUILDKITE_PULL_REQUEST_BASE_BRANCH}), so this PR’s new backport-* branch fallback block does not affect this PR build path.

Evidence

Verification

  • Not run locally: this CI step depends on Buildkite stack/test environment and the failing assertion is not present in the provided log bundle.

Follow-up

Once the exact failing assertion is available (from JUnit/private logs), remediation can be narrowed to either:

  1. test fix/data update (if assertion mismatch),
  2. package code fix (if runtime error), or
  3. retry/flake handling (if transient infra/test instability).

What is this? | From workflow: PR Buildkite Detective

Give us feedback! React with 🚀 if perfect, 👍 if helpful, 👎 if not.

@elastic-vault-github-plugin-prod
Copy link
Copy Markdown

elastic-vault-github-plugin-prod Bot commented May 7, 2026

🚀 Benchmarks report

Package abnormal_security 👍(4) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 5347.59 4329 -1018.59 (-19.05%) 💔
case 13888.89 10752.69 -3136.2 (-22.58%) 💔

Package activemq 👍(2) 💚(2) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
queue 111111.11 62500 -48611.11 (-43.75%) 💔

Package agentless_hello_world 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
mock_counter 500000 250000 -250000 (-50%) 💔

Package apache 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
error 3968.25 3003 -965.25 (-24.32%) 💔

Package apache_tomcat 👍(5) 💚(0) 💔(4)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
access 3246.75 1529.05 -1717.7 (-52.91%) 💔
cache 28571.43 15384.62 -13186.81 (-46.15%) 💔
catalina 12195.12 6134.97 -6060.15 (-49.69%) 💔
request 26315.79 21739.13 -4576.66 (-17.39%) 💔

Package armis 👍(0) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
device 1964.64 1543.21 -421.43 (-21.45%) 💔
vulnerability 2754.82 1828.15 -926.67 (-33.64%) 💔

Package atlassian_bitbucket 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 5263.16 3436.43 -1826.73 (-34.71%) 💔

Package atlassian_confluence 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 2475.25 1919.39 -555.86 (-22.46%) 💔

Package authentik 👍(0) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
group 9259.26 6329.11 -2930.15 (-31.65%) 💔
user 12820.51 8695.65 -4124.86 (-32.17%) 💔

Package aws_securityhub 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
finding 282.65 222.67 -59.98 (-21.22%) 💔

Package azure 👍(6) 💚(3) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
provisioning 11363.64 6711.41 -4652.23 (-40.94%) 💔
identity_protection 6250 5235.6 -1014.4 (-16.23%) 💔
platformlogs 5714.29 3676.47 -2037.82 (-35.66%) 💔

Package azure_frontdoor 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
access 2638.52 2127.66 -510.86 (-19.36%) 💔

Package azure_metrics 👍(0) 💚(2) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
compute_vm 200000 76923.08 -123076.92 (-61.54%) 💔
container_service 250000 200000 -50000 (-20%) 💔

Package azure_openai 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
metrics 500000 200000 -300000 (-60%) 💔

Package bluecoat 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
director 32258.06 18181.82 -14076.24 (-43.64%) 💔

Package carbon_black_cloud 👍(1) 💚(3) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
watchlist_hit 4761.9 3521.13 -1240.77 (-26.06%) 💔

Package carbonblack_edr 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 5076.14 3412.97 -1663.17 (-32.76%) 💔

Package ceph 👍(1) 💚(3) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
cluster_health 33333.33 18518.52 -14814.81 (-44.44%) 💔
osd_pool_stats 22727.27 16129.03 -6598.24 (-29.03%) 💔
osd_tree 23255.81 15625 -7630.81 (-32.81%) 💔

Package checkpoint_harmony_endpoint 👍(3) 💚(3) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
antibot 2604.17 2136.75 -467.42 (-17.95%) 💔

Package cisa_kevs 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
vulnerability 8849.56 7042.25 -1807.31 (-20.42%) 💔

Package cisco_duo 👍(2) 💚(2) 💔(4)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
activity 4761.9 3921.57 -840.33 (-17.65%) 💔
admin 6756.76 5128.21 -1628.55 (-24.1%) 💔
summary 50000 33333.33 -16666.67 (-33.33%) 💔
telephony 76923.08 41666.67 -35256.41 (-45.83%) 💔

Package cisco_meraki 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
events 333333.33 200000 -133333.33 (-40%) 💔

Package cisco_nexus 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 1636.66 1336.9 -299.76 (-18.32%) 💔

Package cisco_secure_email_gateway 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 1855.29 1371.74 -483.55 (-26.06%) 💔

Package citrix_adc 👍(2) 💚(1) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
lbvserver 8196.72 5434.78 -2761.94 (-33.7%) 💔
log 846.74 673.4 -173.34 (-20.47%) 💔
service 14285.71 10204.08 -4081.63 (-28.57%) 💔

Package claroty_ctd 👍(1) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
asset 1256.28 1060.45 -195.83 (-15.59%) 💔

Package claroty_xdome 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
alert 1019.37 685.87 -333.5 (-32.72%) 💔

Package cloudflare_logpush 👍(20) 💚(11) 💔(11)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
gateway_dns 5681.82 4672.9 -1008.92 (-17.76%) 💔
gateway_http 5235.6 4219.41 -1016.19 (-19.41%) 💔
page_shield_events 21276.6 13157.89 -8118.71 (-38.16%) 💔
access_request 8333.33 4273.5 -4059.83 (-48.72%) 💔
workers_trace 14492.75 8620.69 -5872.06 (-40.52%) 💔
http_request 1818.18 1501.5 -316.68 (-17.42%) 💔
sinkhole_http 7874.02 5917.16 -1956.86 (-24.85%) 💔
spectrum_event 5128.21 4347.83 -780.38 (-15.22%) 💔
dlp_forensic_copies 19607.84 14925.37 -4682.47 (-23.88%) 💔
dns 15625 10752.69 -4872.31 (-31.18%) 💔
dns_firewall 5714.29 3937.01 -1777.28 (-31.1%) 💔

Package couchbase 👍(4) 💚(5) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
bucket 17857.14 10989.01 -6868.13 (-38.46%) 💔

Package crowdstrike 👍(5) 💚(3) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
falcon 5780.35 3068.43 -2711.92 (-46.92%) 💔
host 3745.32 3119.15 -626.17 (-16.72%) 💔

Package cyberark_epm 👍(2) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
admin_audit 3300.33 2666.67 -633.66 (-19.2%) 💔
policyaudit_aggregated_event 3164.56 2433.09 -731.47 (-23.11%) 💔

Package cyera 👍(2) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
classification 9009.01 6289.31 -2719.7 (-30.19%) 💔
event 8771.93 5319.15 -3452.78 (-39.36%) 💔

Package darktrace 👍(0) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
ai_analyst_alert 786.78 571.76 -215.02 (-27.33%) 💔
model_breach_alert 898.47 718.39 -180.08 (-20.04%) 💔

Package elastic_agent 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
status_change_logs 333333.33 250000 -83333.33 (-25%) 💔

Package elastic_security 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
alert 1412.43 861.33 -551.1 (-39.02%) 💔

Package elasticsearch 👍(1) 💚(1) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
deprecation 7352.94 4694.84 -2658.1 (-36.15%) 💔
gc 5952.38 4405.29 -1547.09 (-25.99%) 💔
server 6134.97 4629.63 -1505.34 (-24.54%) 💔

Package endace 👍(0) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
flow 1612.9 1117.32 -495.58 (-30.73%) 💔
log 9009.01 5464.48 -3544.53 (-39.34%) 💔

Package entityanalytics_entra_id 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
entity 10526.32 6578.95 -3947.37 (-37.5%) 💔

Package eset_protect 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
device_task 8547.01 4149.38 -4397.63 (-51.45%) 💔

Package extrahop 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
investigation 4016.06 3236.25 -779.81 (-19.42%) 💔

Package forescout 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
host 4901.96 3378.38 -1523.58 (-31.08%) 💔

Package forgerock 👍(5) 💚(1) 💔(5)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
idm_core 62500 52631.58 -9868.42 (-15.79%) 💔
am_access 7633.59 5617.98 -2015.61 (-26.4%) 💔
am_activity 19230.77 15384.62 -3846.15 (-20%) 💔
am_core 11235.96 4347.83 -6888.13 (-61.3%) 💔
idm_authentication 50000 29411.76 -20588.24 (-41.18%) 💔

Package fortinet_fortimail 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 1114.83 788.02 -326.81 (-29.31%) 💔

Package gcp 👍(4) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
firewall 5524.86 4566.21 -958.65 (-17.35%) 💔
loadbalancing_logs 5319.15 4201.68 -1117.47 (-21.01%) 💔

Package github 👍(4) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
dependabot 7042.25 4807.69 -2234.56 (-31.73%) 💔

Package goflow2 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
sflow 3460.21 2906.98 -553.23 (-15.99%) 💔

Package google_workspace 👍(12) 💚(7) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
gcp 11764.71 9259.26 -2505.45 (-21.3%) 💔
user_accounts 30303.03 18867.92 -11435.11 (-37.74%) 💔
vault 14705.88 10869.57 -3836.31 (-26.09%) 💔

Package grafana 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
logs 7042.25 4672.9 -2369.35 (-33.64%) 💔

Package hadoop 👍(3) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
node_manager 25641.03 21739.13 -3901.9 (-15.22%) 💔

Package haproxy 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 1919.39 1587.3 -332.09 (-17.3%) 💔

Package hashicorp_vault 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 13513.51 6369.43 -7144.08 (-52.87%) 💔

Package ibm_qradar 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
offense 2958.58 2192.98 -765.6 (-25.88%) 💔

Package iis 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
access 1464.13 1162.79 -301.34 (-20.58%) 💔

Package island_browser 👍(3) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
user 14084.51 9900.99 -4183.52 (-29.7%) 💔

Package juniper_junos 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 90909.09 55555.56 -35353.53 (-38.89%) 💔

Package kafka 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 10638.3 8849.56 -1788.74 (-16.81%) 💔

Package keycloak 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 2375.3 1988.07 -387.23 (-16.3%) 💔

Package lastpass 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
user 4504.5 2985.07 -1519.43 (-33.73%) 💔

Package lyve_cloud 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 1298.7 936.33 -362.37 (-27.9%) 💔

Package m365_defender 👍(4) 💚(3) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
incident 1300.39 902.53 -397.86 (-30.6%) 💔

Package macos 👍(1) 💚(5) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
process_execution_monitoring 7042.25 5025.13 -2017.12 (-28.64%) 💔

Package microsoft_dhcp 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 34482.76 26315.79 -8166.97 (-23.68%) 💔

Package microsoft_dnsserver 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
analytical 2873.56 2277.9 -595.66 (-20.73%) 💔

Package microsoft_exchange_server 👍(0) 💚(3) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
messagetracking 11363.64 9615.38 -1748.26 (-15.38%) 💔

Package microsoft_intune 👍(0) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 2079 1694.92 -384.08 (-18.47%) 💔
managed_device 3134.8 2439.02 -695.78 (-22.2%) 💔

Package microsoft_sentinel 👍(0) 💚(2) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
alert 2688.17 2237.14 -451.03 (-16.78%) 💔

Package mimecast 👍(5) 💚(2) 💔(4)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
ttp_url_logs 13157.89 8474.58 -4683.31 (-35.59%) 💔
archive_search_logs 8695.65 5813.95 -2881.7 (-33.14%) 💔
audit_events 2941.18 2444.99 -496.19 (-16.87%) 💔
cloud_integrated_logs 12658.23 7633.59 -5024.64 (-39.69%) 💔

Package miniflux 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
feed_entry 1988.07 1494.77 -493.3 (-24.81%) 💔

Package mongodb 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 27777.78 21739.13 -6038.65 (-21.74%) 💔

Package mysql 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
slowlog 24390.24 19230.77 -5159.47 (-21.15%) 💔

Package neon_cyber 👍(0) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
detections 3039.51 2450.98 -588.53 (-19.36%) 💔
events 6493.51 3717.47 -2776.04 (-42.75%) 💔

Package netflow 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 7633.59 5882.35 -1751.24 (-22.94%) 💔

Package nextron_thor 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
thor_forwarding 3533.57 2222.22 -1311.35 (-37.11%) 💔

Package nginx 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
access 3039.51 1937.98 -1101.53 (-36.24%) 💔

Package nginx_ingress_controller 👍(0) 💚(1) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
access 2710.03 2173.91 -536.12 (-19.78%) 💔

Package nozomi_networks 👍(2) 💚(4) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
alert 1742.16 1275.51 -466.65 (-26.79%) 💔
health 15873.02 12658.23 -3214.79 (-20.25%) 💔

Package o365 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 2049.18 1326.26 -722.92 (-35.28%) 💔

Package o365_metrics 👍(13) 💚(3) 💔(5)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
outlook_activity 10526.32 6369.43 -4156.89 (-39.49%) 💔
sharepoint_site_usage_detail 5882.35 4694.84 -1187.51 (-20.19%) 💔
teams_user_activity_user_counts 7812.5 6535.95 -1276.55 (-16.34%) 💔
viva_engage_groups_activity_group_detail 6097.56 3937.01 -2160.55 (-35.43%) 💔
onedrive_usage_account_counts 9900.99 6944.44 -2956.55 (-29.86%) 💔

Package oracle 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
database_audit 20408.16 15873.02 -4535.14 (-22.22%) 💔

Package oracle_weblogic 👍(2) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
admin_server 20408.16 13333.33 -7074.83 (-34.67%) 💔
managed_server 29411.76 14084.51 -15327.25 (-52.11%) 💔

Package osquery 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
result 33333.33 27027.03 -6306.3 (-18.92%) 💔

Package panw_cortex_xdr 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
event 1132.5 910.75 -221.75 (-19.58%) 💔

Package ping_one 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 2915.45 2298.85 -616.6 (-21.15%) 💔

Package platform_observability 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
kibana_log 18181.82 12987.01 -5194.81 (-28.57%) 💔

Package prisma_cloud 👍(1) 💚(1) 💔(5)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
alert 2293.58 1908.4 -385.18 (-16.79%) 💔
audit 7633.59 4329 -3304.59 (-43.29%) 💔
host 1154.73 868.06 -286.67 (-24.83%) 💔
incident_audit 5128.21 3558.72 -1569.49 (-30.61%) 💔
misconfiguration 14285.71 9433.96 -4851.75 (-33.96%) 💔

Package proofpoint_essentials 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
threat 1694.92 1197.6 -497.32 (-29.34%) 💔

Package proofpoint_tap 👍(0) 💚(0) 💔(4)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
clicks_blocked 3267.97 1612.9 -1655.07 (-50.65%) 💔
clicks_permitted 6849.32 3703.7 -3145.62 (-45.93%) 💔
message_blocked 3322.26 2336.45 -985.81 (-29.67%) 💔
message_delivered 3703.7 3067.48 -636.22 (-17.18%) 💔

Package pulse_connect_secure 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 2518.89 2000 -518.89 (-20.6%) 💔

Package qualys_vmdr 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
user_activity 13888.89 9900.99 -3987.9 (-28.71%) 💔

Package rubrik 👍(8) 💚(1) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
node_statistics 10204.08 7692.31 -2511.77 (-24.62%) 💔
physical_hosts 43478.26 22727.27 -20750.99 (-47.73%) 💔
sla_domains 20408.16 11627.91 -8780.25 (-43.02%) 💔

Package salesforce 👍(3) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
login 19230.77 13157.89 -6072.88 (-31.58%) 💔

Package santa 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 2890.17 1483.68 -1406.49 (-48.66%) 💔

Package sentinel_one 👍(11) 💚(5) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
group 28985.51 10416.67 -18568.84 (-64.06%) 💔
threat_event 9165.9 6451.61 -2714.29 (-29.61%) 💔

Package sentinel_one_cloud_funnel 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
event 366.17 295.68 -70.49 (-19.25%) 💔

Package servicenow 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
event 5847.95 3773.58 -2074.37 (-35.47%) 💔

Package snyk 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
issues 4366.81 3144.65 -1222.16 (-27.99%) 💔

Package splunk 👍(0) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
alert 810.37 546.75 -263.62 (-32.53%) 💔
search 10416.67 6802.72 -3613.95 (-34.69%) 💔

Package squid 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 5586.59 3968.25 -1618.34 (-28.97%) 💔

Package sublime_security 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
message_event 14084.51 9009.01 -5075.5 (-36.04%) 💔

Package tanium 👍(3) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
action_history 13698.63 9523.81 -4174.82 (-30.48%) 💔
client_status 10869.57 6622.52 -4247.05 (-39.07%) 💔

Package tencent_cloud 👍(0) 💚(2) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 3401.36 2793.3 -608.06 (-17.88%) 💔
cos 4098.36 3448.28 -650.08 (-15.86%) 💔

Package ti_abusech 👍(4) 💚(3) 💔(5)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
sslblacklist 22271.71 17543.86 -4727.85 (-21.23%) 💔
ja3_fingerprints 23255.81 7645.26 -15610.55 (-67.13%) 💔
malwarebazaar 12987.01 10752.69 -2234.32 (-17.2%) 💔
sslblacklist 22271.71 17006.8 -5264.91 (-23.64%) 💔
url 12422.36 9643.2 -2779.16 (-22.37%) 💔

Package ti_anomali 👍(1) 💚(2) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
intelligence 3703.7 2801.12 -902.58 (-24.37%) 💔

Package ti_anyrun 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
ioc 3773.58 3086.42 -687.16 (-18.21%) 💔

Package ti_domaintools 👍(2) 💚(2) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
domainhotlist_feed 55555.56 33333.33 -22222.23 (-40%) 💔
nod_feed 76923.08 41666.67 -35256.41 (-45.83%) 💔

Package ti_eset 👍(4) 💚(2) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
ip 25000 11494.25 -13505.75 (-54.02%) 💔

Package ti_google_threat_intelligence 👍(3) 💚(11) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
malware 5524.86 3787.88 -1736.98 (-31.44%) 💔

Package ti_maltiverse 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
indicator 2680.97 1893.94 -787.03 (-29.36%) 💔

Package ti_rapid7_threat_command 👍(1) 💚(0) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
alert 4255.32 3344.48 -910.84 (-21.4%) 💔
ioc 3067.48 2551.02 -516.46 (-16.84%) 💔

Package tines 👍(1) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
time_saved 66666.67 52631.58 -14035.09 (-21.05%) 💔

Package tomcat 👍(0) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
log 90909.09 52631.58 -38277.51 (-42.11%) 💔

Package trellix_epo_cloud 👍(2) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
event 2247.19 1461.99 -785.2 (-34.94%) 💔

Package trend_micro_vision_one 👍(4) 💚(1) 💔(7)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
network_activity 5643.34 4587.16 -1056.18 (-18.72%) 💔
alert 4201.68 3273.32 -928.36 (-22.09%) 💔
audit 22222.22 7112.38 -15109.84 (-67.99%) 💔
network_activity 5643.34 4496.4 -1146.94 (-20.32%) 💔
alert 4201.68 2985.07 -1216.61 (-28.96%) 💔
audit 22222.22 8000 -14222.22 (-64%) 💔
detection 2512.56 2024.29 -488.27 (-19.43%) 💔

Package tychon 👍(12) 💚(1) 💔(6)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
features 3344.48 2739.73 -604.75 (-18.08%) 💔
arp 1231.53 1014.2 -217.33 (-17.65%) 💔
browser 1845.02 1373.63 -471.39 (-25.55%) 💔
ciphers 743.49 619.2 -124.29 (-16.72%) 💔
cpu 2652.52 2252.25 -400.27 (-15.09%) 💔
exposedservice 2512.56 2040.82 -471.74 (-18.78%) 💔

Package vectra_rux 👍(2) 💚(1) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
audit 3076.92 2109.7 -967.22 (-31.43%) 💔
detection_event 5780.35 4587.16 -1193.19 (-20.64%) 💔

Package vsphere 👍(3) 💚(3) 💔(2)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
cluster 32258.06 25000 -7258.06 (-22.5%) 💔
virtualmachine 52631.58 35714.29 -16917.29 (-32.14%) 💔

Package websphere_application_server 👍(0) 💚(1) 💔(3)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
jdbc 10204.08 6802.72 -3401.36 (-33.33%) 💔
session_manager 16666.67 9345.79 -7320.88 (-43.93%) 💔
threadpool 25641.03 10989.01 -14652.02 (-57.14%) 💔

Package windows 👍(4) 💚(1) 💔(5)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
windows_defender 10416.67 7042.25 -3374.42 (-32.39%) 💔
powershell_operational 2840.91 1479.29 -1361.62 (-47.93%) 💔
applocker_exe_and_dll 3164.56 2463.05 -701.51 (-22.17%) 💔
applocker_packaged_app_deployment 12500 8130.08 -4369.92 (-34.96%) 💔
applocker_packaged_app_execution 10526.32 8264.46 -2261.86 (-21.49%) 💔

Package zeek 👍(20) 💚(3) 💔(20)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
intel 43478.26 35714.29 -7763.97 (-17.86%) 💔
irc 43478.26 35714.29 -7763.97 (-17.86%) 💔
known_certs 50000 35714.29 -14285.71 (-28.57%) 💔
mysql 47619.05 38461.54 -9157.51 (-19.23%) 💔
notice 45454.55 34482.76 -10971.79 (-24.14%) 💔
capture_loss 16393.44 9090.91 -7302.53 (-44.55%) 💔
ntp 40000 30303.03 -9696.97 (-24.24%) 💔
ocsp 45454.55 24390.24 -21064.31 (-46.34%) 💔
radius 45454.55 23809.52 -21645.03 (-47.62%) 💔
signature 45454.55 38461.54 -6993.01 (-15.38%) 💔
sip 37037.04 27027.03 -10010.01 (-27.03%) 💔
smb_cmd 37037.04 21739.13 -15297.91 (-41.3%) 💔
smb_files 43478.26 16393.44 -27084.82 (-62.3%) 💔
snmp 43478.26 34482.76 -8995.5 (-20.69%) 💔
software 45454.55 34482.76 -10971.79 (-24.14%) 💔
ssh 43478.26 32258.06 -11220.2 (-25.81%) 💔
stats 40000 23255.81 -16744.19 (-41.86%) 💔
weird 50000 40000 -10000 (-20%) 💔
x509 14925.37 11904.76 -3020.61 (-20.24%) 💔
files 21739.13 18181.82 -3557.31 (-16.36%) 💔

Package zscaler_zia 👍(4) 💚(3) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
alerts 2808.99 2369.67 -439.32 (-15.64%) 💔

Package zscaler_zpa 👍(4) 💚(0) 💔(1)

Expand to view
Data stream Previous EPS New EPS Diff (%) Result
user_activity 2415.46 1841.62 -573.84 (-23.76%) 💔

To see the full report comment with /test benchmark fullreport

@Niceplace
Copy link
Copy Markdown
Contributor

@vinit-chauhan I have a clue why the netbox integration is failing, it's also happening on my PR, I'll repro locally and have a fix for it soon. This way you can be unblocked here as well

@elasticmachine
Copy link
Copy Markdown

elasticmachine commented May 7, 2026

⏳ Build in-progress, with failures

Failed CI Steps

History

cc @v1v @Copilot

@mrodm
Copy link
Copy Markdown
Collaborator

mrodm commented May 8, 2026

@vinit-chauhan I have a clue why the netbox integration is failing, it's also happening on my PR, I'll repro locally and have a fix for it soon. This way you can be unblocked here as well

@vinit-chauhan @Niceplace there is alreayd a opened PR for the netbox failures: #18679

@v1v
Copy link
Copy Markdown
Member

v1v commented May 8, 2026

https://github.com/elastic/integrations/tree/backport-test-branch

$ gh pr checkout 18876
$ gcb backport-test-branch
Switched to a new branch 'backport-test-branch'
$ git push upstream backport-test-branch

https://buildkite.com/elastic/integrations/builds/42550

@mrodm
Copy link
Copy Markdown
Collaborator

mrodm commented May 8, 2026

Latest packages failed in the buildkite build: https://buildkite.com/elastic/integrations/builds/42510 have already been reported as flaky tests:

So they are not related to this PR @v1v

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[CI][Backports] Avoid triggering all package tests on the first commit of a backport branch

5 participants