Skip to content

[RELEASE] Release version 2.11.0 #3998

Closed

Description

@github-actions

Release OpenSearch and OpenSearch Dashboards 2.11.0

I noticed that a manifest was automatically created in manifests/2.11.0. Please follow the following checklist to make a release.

How to use this issue

This Release Issue

This issue captures the state of the OpenSearch release, its assignee (Release Manager) is responsible for driving the release. Please contact them or @mention them on this issue for help. There are linked issues on components of the release where individual components can be tracked. For more information check the the Release Process OpenSearch Guide.

Please refer to the following link for the release version dates: Release Schedule and Maintenance Policy.

OpenSearch 2.11.0 exit criteria status:

OpenSearch Status Description Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions 🟢 The perf test for 2.11.0 RC candidate would be automatically kicked off by this workflow Performance benchmark runs for this RC will be automatically initiated soon.
Documentation has been fully reviewed and signed off by the documentation community. 🟢
All integration tests are passing 🟢
Release blog is ready 🟢 Release blog has been finalized

OpenSearch dashboards 2.11.0 exit criteria status:

OpenSearch Dashboards Status Description Comments
Performance tests are run, results are posted to the release ticket and there no unexpected regressions 🟢 Performance tests are not executed for OpenSearch Dashboards   Performance tests are not executed for OpenSearch Dashboards
Documentation has been fully reviewed and signed off by the documentation community. 🟢
All integration tests are passing 🟢
Release blog is ready 🟢 Release blog has been finalized

Preparation

Campaigns

Release Branch and Version Increment - Ends Oct 04, 2023 - Owner: [Repository Owner, component release manager]

Code Complete - Ends Oct 04, 2023 5PM PST- Owner: [Repository Owner, component release manager, build release manager]

Release Candidate Creation and Testing - Starts Oct 05, 2023 - Owner: [Build release manager]

Performance testing validation - Starts Oct 05, 2023 - Owner: [Repository Owner, component release manager]

  • Post the benchmark-tests
  • Longevity tests do not show any issues.

Pre Release - TBD - Owner: [Build release manager]

Release - TBD - Owner: [Build release manager]

Release Checklist.


Release Checklist

Pre-Release activities

  • Promote Repos.
      • OS
      • OSD
  • Promote Artifacts.
      • Windows
      • Linux Debian
      • Linux RPM
      • Linux TAR
  • Consolidated Release Notes.

Release activities

  • Docker Promotion.
  • Release Validation part 1.
      • OpenSearch and OpenSearch Dashboard Validation.
      • Validate the native plugin installation.
  • Merge consolidated release notes PR.
  • Website and Documentation Changes.
      • Merge staging website PR.
      • Promote the website changes to prod.
      • Add website alert.
  • Release Validation part 2.
      • Validate the artifact download URL's and signatures.
  • Release Validation part 3.
      • Trigger the validation build (Search for Completed validation for <> in the logs).
  • Maven Promotion.
  • Publish blog posts.
  • Advertise on Social Media.
  • Post on public slack and Github Release issue.

Post-Release activities

  • Release Tags.
  • Input Manifest Update.
  • Decrease the Build Frequency.
  • OpenSearch Build Release notes.
  • Retrospective Issue.
  • Helm and Ansible Playbook release.
  • Upcoming Release Preparation.


Post Release

Components

OpenSearch

Component Issues tagged with 2.11.0
opensearch-project/OpenSearch#8754
opensearch-project/common-utils#496
opensearch-project/k-NN#995
opensearch-project/geospatial#357
opensearch-project/security#3028
opensearch-project/cross-cluster-replication#1080
opensearch-project/ml-commons#1141
opensearch-project/neural-search#224
opensearch-project/notifications#711
opensearch-project/observability#1576
opensearch-project/reporting#729
opensearch-project/sql#1882
opensearch-project/asynchronous-search#316
opensearch-project/anomaly-detection#964
opensearch-project/alerting#1047
opensearch-project/security-analytics#493
opensearch-project/index-management#860
opensearch-project/performance-analyzer#508

OpenSearch Dashboards

Component Issues tagged with 2.11.0
opensearch-project/OpenSearch-Dashboards#4584
opensearch-project/opensearch-dashboards-functional-test#766
opensearch-project/dashboards-observability#703
opensearch-project/dashboards-reporting#149
opensearch-project/dashboards-visualizations#212
opensearch-project/dashboards-query-workbench#96
opensearch-project/dashboards-maps#443
opensearch-project/anomaly-detection-dashboards-plugin#558
opensearch-project/ml-commons-dashboards#235
opensearch-project/index-management-dashboards-plugin#819
opensearch-project/dashboards-notifications#86
opensearch-project/alerting-dashboards-plugin#655
opensearch-project/security-analytics-dashboards-plugin#661
opensearch-project/security-dashboards-plugin#1519
opensearch-project/dashboards-search-relevance#253
Legend

Symbol Meaning
🟢 On track with overall release
🟡 Missed last milestone
🔴 Missed multiple milestones

Activity

  1. removed
    untriagedIssues that have not yet been triaged
    on Sep 12, 2023
  2. peterzhuamazon commented on Sep 22, 2023

    @peterzhuamazon
    Member

    Pending Issues:

    I can discuss both of these issues on the standup tomorrow.

    Thanks.

    PRs:

    Placeholder.

  3. pinned this issue on Oct 3, 2023
  4. rishabh6788 commented on Oct 6, 2023

    @rishabh6788
    Collaborator

    OpenSearch 8603 / OpenSearch Dashboards 6646 is ready for your test.

    OpenSearch - Build 8603
    OpenSearch Dashboards - Build 6646

    • Use the following Docker-Compose to setup a cluster

      docker-compose.yml

        
      version: '3'
      services:
        opensearch-node1:
          image: opensearchstaging/opensearch:2.11.0.8603
          container_name: opensearch-node1
          environment:
            - cluster.name=opensearch-cluster
            - node.name=opensearch-node1
            - discovery.seed_hosts=opensearch-node1,opensearch-node2
            - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
            - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
            - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
          ulimits:
            memlock:
              soft: -1
              hard: -1
            nofile:
              soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
              hard: 65536
          volumes:
            - opensearch-data1:/usr/share/opensearch/data
          ports:
            - 9200:9200
            - 9600:9600 # required for Performance Analyzer
          networks:
            - opensearch-net
        opensearch-node2:
          image: opensearchstaging/opensearch:2.11.0.8603
          container_name: opensearch-node2
          environment:
            - cluster.name=opensearch-cluster
            - node.name=opensearch-node2
            - discovery.seed_hosts=opensearch-node1,opensearch-node2
            - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
            - bootstrap.memory_lock=true
            - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
          ulimits:
            memlock:
              soft: -1
              hard: -1
            nofile:
              soft: 65536
              hard: 65536
          volumes:
            - opensearch-data2:/usr/share/opensearch/data
          networks:
            - opensearch-net
        opensearch-dashboards:
          image: opensearchstaging/opensearch-dashboards:2.11.0.6646
          container_name: opensearch-dashboards
          ports:
            - 5601:5601
          expose:
            - "5601"
          environment:
            OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
          networks:
            - opensearch-net
      volumes:
        opensearch-data1:
        opensearch-data2:
      

      networks:
      opensearch-net:

      • Download the above docker-compose.yml on your machine.
      • Get latest image versions docker-compose pull.
      • Start the cluster docker-compose up.
    • OpenSearch docker 2.11.0.8603

      • Start without security
        • Docker command docker pull opensearchstaging/opensearch:2.11.0.8603 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.11.0.8603
        • Connect command curl https://localhost:9200/
      • Start with security
        • Docker command docker pull opensearchstaging/opensearch:2.11.0.8603 && docker run -it -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:2.11.0.8603
        • Connect command curl --insecure https://admin:admin@localhost:9200/
    • OpenSearch-Dashboards docker 2.11.0.6646

      • Start without security
        • Docker command docker pull opensearchstaging/opensearch-dashboards:2.11.0.6646 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.11.0.6646
        • URL https://localhost:5601/
      • Start with security
        • Docker command docker pull opensearchstaging/opensearch-dashboards:2.11.0.6646 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.11.0.6646
        • URL https://localhost:5601/
    • Use TARs to deploy OpenSearch Manually

    Check how to install opensearch and dashboards on different platforms

  5. dhrubo-os commented on Oct 6, 2023

    @dhrubo-os

    For opensearch dashboard, both are marked as Start without security.
    Could you please check?

  6. rishabh6788 commented on Oct 6, 2023

    @rishabh6788
    Collaborator

    For opensearch dashboard, both are marked as Start without security. Could you please check?

    @dhrubo-os Thanks for catching that, updated.

  7. 14 remaining items

  8. hdhalter commented on Oct 10, 2023

    @hdhalter
    Contributor

    Documentation status: 6 Done, 8 in various stages of doc/tech review, 3 in backlog or in progress.

  9. rishabh6788 commented on Oct 11, 2023

    @rishabh6788
    Collaborator

    RC #5 OpenSearch 8634 / OpenSearch Dashboards 6658 is ready for your test.

    OpenSearch - Build 8634
    OpenSearch Dashboards - Build 6658

    • Use the following Docker-Compose to setup a cluster

      docker-compose.yml

        
      version: '3'
      services:
        opensearch-node1:
          image: opensearchstaging/opensearch:2.11.0.8634
          container_name: opensearch-node1
          environment:
            - cluster.name=opensearch-cluster
            - node.name=opensearch-node1
            - discovery.seed_hosts=opensearch-node1,opensearch-node2
            - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
            - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
            - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
          ulimits:
            memlock:
              soft: -1
              hard: -1
            nofile:
              soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
              hard: 65536
          volumes:
            - opensearch-data1:/usr/share/opensearch/data
          ports:
            - 9200:9200
            - 9600:9600 # required for Performance Analyzer
          networks:
            - opensearch-net
        opensearch-node2:
          image: opensearchstaging/opensearch:2.11.0.8634
          container_name: opensearch-node2
          environment:
            - cluster.name=opensearch-cluster
            - node.name=opensearch-node2
            - discovery.seed_hosts=opensearch-node1,opensearch-node2
            - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
            - bootstrap.memory_lock=true
            - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
          ulimits:
            memlock:
              soft: -1
              hard: -1
            nofile:
              soft: 65536
              hard: 65536
          volumes:
            - opensearch-data2:/usr/share/opensearch/data
          networks:
            - opensearch-net
        opensearch-dashboards:
          image: opensearchstaging/opensearch-dashboards:2.11.0.6658
          container_name: opensearch-dashboards
          ports:
            - 5601:5601
          expose:
            - "5601"
          environment:
            OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
          networks:
            - opensearch-net
      volumes:
        opensearch-data1:
        opensearch-data2:
      

      networks:
      opensearch-net:

      • Download the above docker-compose.yml on your machine.
      • Get latest image versions docker-compose pull.
      • Start the cluster docker-compose up.
    • OpenSearch docker 2.11.0.8634

      • Start without security
        • Docker command docker pull opensearchstaging/opensearch:2.11.0.8634 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.11.0.8634
        • Connect command curl https://localhost:9200/
      • Start with security
        • Docker command docker pull opensearchstaging/opensearch:2.11.0.8634 && docker run -it -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:2.11.0.8634
        • Connect command curl --insecure https://admin:admin@localhost:9200/
    • OpenSearch-Dashboards docker 2.11.0.6658

      • Start without security
        • Docker command docker pull opensearchstaging/opensearch-dashboards:2.11.0.6658 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.11.0.6658
        • URL https://localhost:5601/
      • Start with security
        • Docker command docker pull opensearchstaging/opensearch-dashboards:2.11.0.6658 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.11.0.6658
        • URL https://localhost:5601/
    • Use TARs to deploy OpenSearch Manually

    Check how to install opensearch and dashboards on different platforms

  10. rishabh6788 commented on Oct 11, 2023

    @rishabh6788
    Collaborator

    2.11.0 Performance comparison with 2.10.0

    There is no performance change between 2.11.0 and 2.10.0 on overall indexing and query metrics.

    http_logs (x64)

    http_logs_x64_compar_2023-10-11T20_02_23

    http_logs (arm64)

    http_logs_arm64_comp_2023-10-11T20_02_29

    nyc_taxis (x64)

    nyc_taxis_x64_compar_2023-10-11T20_02_03

    nyc_taxis (arm64)

    nyc_taxis_arm64_comp_2023-10-11T20_02_07

  11. rishabh6788 commented on Oct 12, 2023

    @rishabh6788
    Collaborator

    RC #6 OpenSearch 8641 / OpenSearch Dashboards 6660 is ready for your test.

    OpenSearch - Build 8641
    OpenSearch Dashboards - Build 6660

    • Use the following Docker-Compose to setup a cluster

      docker-compose.yml

        
      version: '3'
      services:
        opensearch-node1:
          image: opensearchstaging/opensearch:2.11.0.8641
          container_name: opensearch-node1
          environment:
            - cluster.name=opensearch-cluster
            - node.name=opensearch-node1
            - discovery.seed_hosts=opensearch-node1,opensearch-node2
            - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
            - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
            - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
          ulimits:
            memlock:
              soft: -1
              hard: -1
            nofile:
              soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
              hard: 65536
          volumes:
            - opensearch-data1:/usr/share/opensearch/data
          ports:
            - 9200:9200
            - 9600:9600 # required for Performance Analyzer
          networks:
            - opensearch-net
        opensearch-node2:
          image: opensearchstaging/opensearch:2.11.0.8641
          container_name: opensearch-node2
          environment:
            - cluster.name=opensearch-cluster
            - node.name=opensearch-node2
            - discovery.seed_hosts=opensearch-node1,opensearch-node2
            - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
            - bootstrap.memory_lock=true
            - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
          ulimits:
            memlock:
              soft: -1
              hard: -1
            nofile:
              soft: 65536
              hard: 65536
          volumes:
            - opensearch-data2:/usr/share/opensearch/data
          networks:
            - opensearch-net
        opensearch-dashboards:
          image: opensearchstaging/opensearch-dashboards:2.11.0.6660
          container_name: opensearch-dashboards
          ports:
            - 5601:5601
          expose:
            - "5601"
          environment:
            OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
          networks:
            - opensearch-net
      volumes:
        opensearch-data1:
        opensearch-data2:
      

      networks:
      opensearch-net:

      • Download the above docker-compose.yml on your machine.
      • Get latest image versions docker-compose pull.
      • Start the cluster docker-compose up.
    • OpenSearch docker 2.11.0.8641

      • Start without security
        • Docker command docker pull opensearchstaging/opensearch:2.11.0.8641 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.11.0.8641
        • Connect command curl https://localhost:9200/
      • Start with security
        • Docker command docker pull opensearchstaging/opensearch:2.11.0.8641 && docker run -it -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:2.11.0.8641
        • Connect command curl --insecure https://admin:admin@localhost:9200/
    • OpenSearch-Dashboards docker 2.11.0.6660

      • Start without security
        • Docker command docker pull opensearchstaging/opensearch-dashboards:2.11.0.6660 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.11.0.6660
        • URL https://localhost:5601/
      • Start with security
        • Docker command docker pull opensearchstaging/opensearch-dashboards:2.11.0.6660 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.11.0.6660
        • URL https://localhost:5601/
    • Use TARs to deploy OpenSearch Manually

    Check how to install opensearch and dashboards on different platforms

  12. rishabh6788 commented on Oct 12, 2023

    @rishabh6788
    Collaborator

    Integration Test Update

    All components integration tests are passing for OpenSearch. See https://build.ci.opensearch.org/blue/organizations/jenkins/integ-test/detail/integ-test/6345/pipeline

    alerting failed due to jenkins error and opensearch-reports failed due to flaky test. Re-ran tests for them and it passed. See https://build.ci.opensearch.org/blue/organizations/jenkins/integ-test/detail/integ-test/6346/pipeline/67/.

    For OpenSearch Dashboards below components are failing.

    • observabilityDashboards (without-security and with-security)
    • reportsDashboards (without-security)

    Attached are the log files for teams to take a look and take corrective action.
    observabilityDashboards-without-security.txt
    observabilityDashboards-with-security.txt
    reportsDashboards-without-security.txt

  13. rishabh6788 commented on Oct 13, 2023

    @rishabh6788
    Collaborator

    Final RC OpenSearch 8649 / OpenSearch Dashboards 6665 is ready for your test.

    OpenSearch - Build 8649
    OpenSearch Dashboards - Build 6665

    • Use the following Docker-Compose to setup a cluster

      docker-compose.yml

        
      version: '3'
      services:
        opensearch-node1:
          image: opensearchstaging/opensearch:2.11.0.8649
          container_name: opensearch-node1
          environment:
            - cluster.name=opensearch-cluster
            - node.name=opensearch-node1
            - discovery.seed_hosts=opensearch-node1,opensearch-node2
            - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
            - bootstrap.memory_lock=true # along with the memlock settings below, disables swapping
            - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m" # minimum and maximum Java heap size, recommend setting both to 50% of system RAM
          ulimits:
            memlock:
              soft: -1
              hard: -1
            nofile:
              soft: 65536 # maximum number of open files for the OpenSearch user, set to at least 65536 on modern systems
              hard: 65536
          volumes:
            - opensearch-data1:/usr/share/opensearch/data
          ports:
            - 9200:9200
            - 9600:9600 # required for Performance Analyzer
          networks:
            - opensearch-net
        opensearch-node2:
          image: opensearchstaging/opensearch:2.11.0.8649
          container_name: opensearch-node2
          environment:
            - cluster.name=opensearch-cluster
            - node.name=opensearch-node2
            - discovery.seed_hosts=opensearch-node1,opensearch-node2
            - cluster.initial_cluster_manager_nodes=opensearch-node1,opensearch-node2
            - bootstrap.memory_lock=true
            - "OPENSEARCH_JAVA_OPTS=-Xms512m -Xmx512m"
          ulimits:
            memlock:
              soft: -1
              hard: -1
            nofile:
              soft: 65536
              hard: 65536
          volumes:
            - opensearch-data2:/usr/share/opensearch/data
          networks:
            - opensearch-net
        opensearch-dashboards:
          image: opensearchstaging/opensearch-dashboards:2.11.0.6665
          container_name: opensearch-dashboards
          ports:
            - 5601:5601
          expose:
            - "5601"
          environment:
            OPENSEARCH_HOSTS: '["https://opensearch-node1:9200","https://opensearch-node2:9200"]'
          networks:
            - opensearch-net
      volumes:
        opensearch-data1:
        opensearch-data2:
      

      networks:
      opensearch-net:

      • Download the above docker-compose.yml on your machine.
      • Get latest image versions docker-compose pull.
      • Start the cluster docker-compose up.
    • OpenSearch docker 2.11.0.8649

      • Start without security
        • Docker command docker pull opensearchstaging/opensearch:2.11.0.8649 && docker run -it -p 9200:9200 -e "discovery.type=single-node" -e "DISABLE_SECURITY_PLUGIN=true" opensearchstaging/opensearch:2.11.0.8649
        • Connect command curl https://localhost:9200/
      • Start with security
        • Docker command docker pull opensearchstaging/opensearch:2.11.0.8649 && docker run -it -p 9200:9200 -e "discovery.type=single-node" opensearchstaging/opensearch:2.11.0.8649
        • Connect command curl --insecure https://admin:admin@localhost:9200/
    • OpenSearch-Dashboards docker 2.11.0.6665

      • Start without security
        • Docker command docker pull opensearchstaging/opensearch-dashboards:2.11.0.6665 && docker run -it --network="host" -e "DISABLE_SECURITY_DASHBOARDS_PLUGIN=true" opensearchstaging/opensearch-dashboards:2.11.0.6665
        • URL https://localhost:5601/
      • Start with security
        • Docker command docker pull opensearchstaging/opensearch-dashboards:2.11.0.6665 && docker run -it --network="host" opensearchstaging/opensearch-dashboards:2.11.0.6665
        • URL https://localhost:5601/
    • Use TARs to deploy OpenSearch Manually

    Check how to install opensearch and dashboards on different platforms

  14. bbarani commented on Oct 14, 2023

    @bbarani
    Member

    We are 🟢 for 2.11.0 release and it is scheduled to be released on Monday (Oct 16 2023).

    You can participate in release meeting using this link - https://opensearch.org/events/2023-1018-2-11-release-meetings/

  15. rishabh6788 commented on Oct 16, 2023

    @rishabh6788
    Collaborator
  16. rishabh6788 commented on Oct 16, 2023

    @rishabh6788
    Collaborator

    Created tags for OS and OSD.

    Updated 2.11.0 OS and OSD manifests #4133

  17. rishabh6788 commented on Oct 16, 2023

    @rishabh6788
    Collaborator

    We have successfully released 2.11.0.
    Please see #4061 retrospective issue to add your thoughts and feedback/improvements on this release.

  18. unpinned this issue on Oct 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions