Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-enable secrets for packages disabled due to Kibana versions below … #9321

Merged
merged 8 commits into from Mar 13, 2024

Conversation

ritalwar
Copy link
Contributor

@ritalwar ritalwar commented Mar 10, 2024

Proposed commit message

Restore the secret for packages that were disabled because of Kibana versions below 8.12, as they were causing errors.

Secrets were reverted for older stack version earlier in this PR - #9279

Now it is enabled only for stack 8.12 onwards.

For Prometheus and CockroachDB it is enabled for version 8.12.1 onwards, due to mapping conflicts resolved in the Fleet plugin.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Related issues

@ritalwar ritalwar self-assigned this Mar 10, 2024
@ritalwar ritalwar requested a review from a team as a code owner March 10, 2024 09:12
@elasticmachine
Copy link

elasticmachine commented Mar 10, 2024

🚀 Benchmarks report

To see the full report comment with /test benchmark fullreport

@harnish-elastic harnish-elastic self-requested a review March 11, 2024 10:51
Copy link
Contributor

@aliabbas-elastic aliabbas-elastic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ritalwar I tried loading the integrations with default configs in 8.12.0 and 2 integrations (cockroachdb and prometheus) in 8.12.1 & I didn't face any errors loading the packages. LGTM for the changes !!

@lalit-satapathy
Copy link
Collaborator

@ritalwar, some packages are marked as: version: "^8.12.0" and some are marked as: version: "^8.12.1", what is the difference here?

@@ -1,3 +1,8 @@
- version: "1.9.0"
changes:
- description: Enable secrets with Kibana upgrade to 8.12, resolving errors.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The version should be 8.12.1 in changelog here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We're discussing offline about updating this changelog message for all packages, will adjust accordingly.

@ritalwar
Copy link
Contributor Author

@ritalwar, some packages are marked as: version: "^8.12.0" and some are marked as: version: "^8.12.1", what is the difference here?

In version 8.12.0 of Kibana, the Fleet plugin was refactored, fixing how dynamic mappings for integrations are generated. However, this change caused mapping conflicts during data ingestion, impacting integrations like Prometheus and CockroachDB. The issue was resolved in version 8.12.1, therefore an upgrade to this version for these packages. Detailed information here.

@lalit-satapathy
Copy link
Collaborator

@ritalwar, some packages are marked as: version: "^8.12.0" and some are marked as: version: "^8.12.1", what is the difference here?

In version 8.12.0 of Kibana, the Fleet plugin was refactored, fixing how dynamic mappings for integrations are generated. However, this change caused mapping conflicts during data ingestion, impacting integrations like Prometheus and CockroachDB. The issue was resolved in version 8.12.1, therefore an upgrade to this version for these packages. Detailed information here.

Ok, We are resolving the dynamic mapping issue in this PR as well? So it is only for prometheus type packages?

@ishleenk17
Copy link
Contributor

@ritalwar, some packages are marked as: version: "^8.12.0" and some are marked as: version: "^8.12.1", what is the difference here?

In version 8.12.0 of Kibana, the Fleet plugin was refactored, fixing how dynamic mappings for integrations are generated. However, this change caused mapping conflicts during data ingestion, impacting integrations like Prometheus and CockroachDB. The issue was resolved in version 8.12.1, therefore an upgrade to this version for these packages. Detailed information here.

Ok, We are resolving the dynamic mapping issue in this PR as well? So it is only for prometheus type packages?

Integrations using dynamic mappings would have this issue in 8.12

@lalit-satapathy
Copy link
Collaborator

@ritalwar, some packages are marked as: version: "^8.12.0" and some are marked as: version: "^8.12.1", what is the difference here?

In version 8.12.0 of Kibana, the Fleet plugin was refactored, fixing how dynamic mappings for integrations are generated. However, this change caused mapping conflicts during data ingestion, impacting integrations like Prometheus and CockroachDB. The issue was resolved in version 8.12.1, therefore an upgrade to this version for these packages. Detailed information here.

Ok, We are resolving the dynamic mapping issue in this PR as well? So it is only for prometheus type packages?

Integrations using dynamic mappings would have this issue in 8.12

Should that be mixed with this work? This will disable secrets for someone running just 8.12.0.

@ritalwar
Copy link
Contributor Author

Ok, We are resolving the dynamic mapping issue in this PR as well? So it is only for prometheus type packages?

We're not resolving the dynamic mapping issue, it's already fixed in this PR and available from version 8.12.1. Due to system test failures in 8.12.0, we had to upgrade to 8.12.1.

@ishleenk17
Copy link
Contributor

@ritalwar, some packages are marked as: version: "^8.12.0" and some are marked as: version: "^8.12.1", what is the difference here?

In version 8.12.0 of Kibana, the Fleet plugin was refactored, fixing how dynamic mappings for integrations are generated. However, this change caused mapping conflicts during data ingestion, impacting integrations like Prometheus and CockroachDB. The issue was resolved in version 8.12.1, therefore an upgrade to this version for these packages. Detailed information here.

Ok, We are resolving the dynamic mapping issue in this PR as well? So it is only for prometheus type packages?

Integrations using dynamic mappings would have this issue in 8.12

Should that be mixed with this work? This will disable secrets for someone running just 8.12.0.

The CI/CD would fail for these packages if the version is 8.12.
Either we have to force merge the packages, even though CI/CD fails for them? or resolve them with 8.12.1

@elasticmachine
Copy link

💚 Build Succeeded

History

cc @ritalwar

Copy link

Copy link
Contributor

@agithomas agithomas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@ritalwar ritalwar merged commit ffd6a5c into elastic:main Mar 13, 2024
5 checks passed
@elasticmachine
Copy link

Package activemq - 1.2.0 containing this change is available at https://epr.elastic.co/search?package=activemq

@elasticmachine
Copy link

Package apache_tomcat - 1.4.0 containing this change is available at https://epr.elastic.co/search?package=apache_tomcat

@elasticmachine
Copy link

Package azure_app_service - 0.3.0 containing this change is available at https://epr.elastic.co/search?package=azure_app_service

@elasticmachine
Copy link

Package azure_billing - 1.5.0 containing this change is available at https://epr.elastic.co/search?package=azure_billing

@elasticmachine
Copy link

Package azure_functions - 0.4.0 containing this change is available at https://epr.elastic.co/search?package=azure_functions

@elasticmachine
Copy link

Package cassandra - 1.12.0 containing this change is available at https://epr.elastic.co/search?package=cassandra

@elasticmachine
Copy link

Package ceph - 1.4.0 containing this change is available at https://epr.elastic.co/search?package=ceph

@elasticmachine
Copy link

Package citrix_adc - 1.4.0 containing this change is available at https://epr.elastic.co/search?package=citrix_adc

@elasticmachine
Copy link

Package cockroachdb - 1.9.0 containing this change is available at https://epr.elastic.co/search?package=cockroachdb

@elasticmachine
Copy link

Package golang - 1.4.0 containing this change is available at https://epr.elastic.co/search?package=golang

@elasticmachine
Copy link

Package kafka - 1.13.0 containing this change is available at https://epr.elastic.co/search?package=kafka

@elasticmachine
Copy link

Package kafka_log - 1.6.0 containing this change is available at https://epr.elastic.co/search?package=kafka_log

@elasticmachine
Copy link

Package mysql - 1.19.0 containing this change is available at https://epr.elastic.co/search?package=mysql

@elasticmachine
Copy link

Package nginx - 1.20.0 containing this change is available at https://epr.elastic.co/search?package=nginx

@elasticmachine
Copy link

Package oracle_weblogic - 1.5.0 containing this change is available at https://epr.elastic.co/search?package=oracle_weblogic

@elasticmachine
Copy link

Package postgresql - 1.19.0 containing this change is available at https://epr.elastic.co/search?package=postgresql

@elasticmachine
Copy link

Package prometheus - 1.15.0 containing this change is available at https://epr.elastic.co/search?package=prometheus

@elasticmachine
Copy link

Package prometheus_input - 0.4.0 containing this change is available at https://epr.elastic.co/search?package=prometheus_input

@elasticmachine
Copy link

Package rabbitmq - 1.13.0 containing this change is available at https://epr.elastic.co/search?package=rabbitmq

@elasticmachine
Copy link

Package salesforce - 0.14.0 containing this change is available at https://epr.elastic.co/search?package=salesforce

@elasticmachine
Copy link

Package spring_boot - 1.4.0 containing this change is available at https://epr.elastic.co/search?package=spring_boot

@elasticmachine
Copy link

Package websphere_application_server - 1.3.0 containing this change is available at https://epr.elastic.co/search?package=websphere_application_server

gizas pushed a commit that referenced this pull request Mar 13, 2024
#9321)

* Re-enable secrets for packages disabled due to Kibana versions below 8.10 errors.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants