Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[integrations][Cloudflare Logpush] - Added local SQS queues per data stream, that will override the global queue if provided. #6053

Merged
merged 6 commits into from
May 12, 2023

Conversation

ShourieG
Copy link
Contributor

@ShourieG ShourieG commented May 2, 2023

Type of change

  • Enhancement

What does this PR do?

This PR adds support for optional local SQS queue urls in each data stream. These queue urls will override the global queue if provided. This will improve scalability for users as previously they would often at times be limited/bottlenecked by one queue.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Related issues

@ShourieG ShourieG requested a review from a team as a code owner May 2, 2023 08:00
@elasticmachine
Copy link

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

@elasticmachine
Copy link

elasticmachine commented May 2, 2023

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2023-05-12T06:42:15.597+0000

  • Duration: 19 min 1 sec

Test stats 🧪

Test Results
Failed 0
Passed 44
Skipped 0
Total 44

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@elasticmachine
Copy link

elasticmachine commented May 2, 2023

🌐 Coverage report

Name Metrics % (covered/total) Diff
Packages 100.0% (7/7) 💚
Files 100.0% (7/7) 💚 2.983
Classes 100.0% (7/7) 💚 2.983
Methods 100.0% (89/89) 💚 8.312
Lines 93.91% (2421/2578) 👍 1.866
Conditionals 100.0% (0/0) 💚

@ShourieG ShourieG requested a review from kcreddy May 2, 2023 10:07
@ShourieG
Copy link
Contributor Author

@kcreddy I've made the suggested changes.

@ShourieG ShourieG merged commit ae71591 into elastic:main May 12, 2023
@ShourieG ShourieG deleted the enhancement/cf_logpush branch May 12, 2023 07:42
@elasticmachine
Copy link

Package cloudflare_logpush - 1.3.0 containing this change is available at https://epr.elastic.co/search?package=cloudflare_logpush

chemamartinez added a commit to chemamartinez/integrations that referenced this pull request May 12, 2023
chemamartinez added a commit to chemamartinez/integrations that referenced this pull request May 15, 2023
chemamartinez added a commit to chemamartinez/integrations that referenced this pull request May 16, 2023
chemamartinez added a commit to chemamartinez/integrations that referenced this pull request May 19, 2023
P1llus pushed a commit that referenced this pull request Jun 20, 2023
* Add gateway_dns data stream for Cloudflare Logpush

* Add gateway_http data stream for Cloudflare Logpush

* Add gateway_network data stream for Cloudflare Logpush

* Add network_session data stream for Cloudflare Logpush

* Update new data streams with latest changes from #6164 and #6053

* Add casb_findings data stream for Cloudflare Logpush

* Add access_request data stream for Cloudflare Logpush

* Rename CASB sample log

* Add device_posture data stream for Cloudflare Logpush

* Update new data streams with latest changes from #6199

* Add requested changes for data streams

* Fix typo in network analytics pipeline

* Fix missing field in Device Posture pipeline

* Add dashboards for ZT events

* Fix the use of event.outcome and event.type

* Update Cloudflare Logpush dashboards

* Update pipeline and system tests

* Update Cloudflare Logpush screenshots

* Add screenshots to manifest

* Update preference in timestamp formats

* Increase Kibana version to 8.7.0

* Update some filters in cloudflare logpush dashboards
@andrewkroh andrewkroh added the Integration:cloudflare_logpush Cloudflare Logpush label Jul 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Enhance Cloudflare Logpush AWS Data Stream UI
5 participants