Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Cloudflare Logpush, Akamai] - Fixed bugs related to the gcs input #6164

Merged
merged 5 commits into from
May 11, 2023

Conversation

ShourieG
Copy link
Contributor

@ShourieG ShourieG commented May 11, 2023

Type of change

Please label this PR with one of the following labels, depending on the scope of your change:

  • Bug

What does this PR do?

This fixes a minor variable naming bug for the akamai & cloudflare logpush packages, that caused the input to stop after a
single pass.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Related issues

@elasticmachine
Copy link

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

@ShourieG ShourieG requested review from P1llus and kcreddy May 11, 2023 12:38
@elasticmachine
Copy link

elasticmachine commented May 11, 2023

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2023-05-11T18:09:11.158+0000

  • Duration: 19 min 11 sec

Test stats 🧪

Test Results
Failed 0
Passed 50
Skipped 0
Total 50

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@elasticmachine
Copy link

elasticmachine commented May 11, 2023

🌐 Coverage report

Name Metrics % (covered/total) Diff
Packages 100.0% (8/8) 💚
Files 100.0% (8/8) 💚 1.961
Classes 100.0% (8/8) 💚 1.961
Methods 100.0% (109/109) 💚 10.103
Lines 93.822% (2779/2962) 👎 -0.468
Conditionals 100.0% (0/0) 💚

Copy link
Contributor

@bhapas bhapas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add poll to system test config just to make sure this isn't fiddled with again

@ShourieG
Copy link
Contributor Author

@bhapas there are no system tests for the gcs or aws streams in akami or cloudflare, only tests using httpjson and http endpoint. The main reason is aws and gcs system tests will require implementing an emulator that can handle the respective SDK calls. Implementing this would be a separate task of it's own.

@ShourieG ShourieG merged commit bc21b73 into elastic:main May 11, 2023
@ShourieG ShourieG deleted the bugfix/gcs_akamai branch May 11, 2023 19:05
@elasticmachine
Copy link

Package akamai - 2.8.1 containing this change is available at https://epr.elastic.co/search?package=akamai

@elasticmachine
Copy link

Package cloudflare_logpush - 1.2.1 containing this change is available at https://epr.elastic.co/search?package=cloudflare_logpush

chemamartinez added a commit to chemamartinez/integrations that referenced this pull request May 12, 2023
chemamartinez added a commit to chemamartinez/integrations that referenced this pull request May 15, 2023
chemamartinez added a commit to chemamartinez/integrations that referenced this pull request May 16, 2023
chemamartinez added a commit to chemamartinez/integrations that referenced this pull request May 19, 2023
P1llus pushed a commit that referenced this pull request Jun 20, 2023
* Add gateway_dns data stream for Cloudflare Logpush

* Add gateway_http data stream for Cloudflare Logpush

* Add gateway_network data stream for Cloudflare Logpush

* Add network_session data stream for Cloudflare Logpush

* Update new data streams with latest changes from #6164 and #6053

* Add casb_findings data stream for Cloudflare Logpush

* Add access_request data stream for Cloudflare Logpush

* Rename CASB sample log

* Add device_posture data stream for Cloudflare Logpush

* Update new data streams with latest changes from #6199

* Add requested changes for data streams

* Fix typo in network analytics pipeline

* Fix missing field in Device Posture pipeline

* Add dashboards for ZT events

* Fix the use of event.outcome and event.type

* Update Cloudflare Logpush dashboards

* Update pipeline and system tests

* Update Cloudflare Logpush screenshots

* Add screenshots to manifest

* Update preference in timestamp formats

* Increase Kibana version to 8.7.0

* Update some filters in cloudflare logpush dashboards
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Cloudflare logpush, Akamai] - gcs input stream has variable naming bugs
6 participants