Skip to content

Latest commit

 

History

History
1306 lines (1050 loc) · 86 KB

opensearch-release-notes-2.12.0.md

File metadata and controls

1306 lines (1050 loc) · 86 KB
Raw

OpenSearch and OpenSearch Dashboards 2.12.0 Release Notes

RELEASE HIGHLIGHTS

    OpenSearch 2.12.0 includes a number of features designed to increase performance for search and analytics applications as well as user experience enhancements and several new and enhanced machine learning tools. Experimental functionality includes the OpenSearch Assistant Toolkit for building interactive user experiences and new cross-cluster monitors. OpenSearch upgrades to Apache Lucene 9.9.2 with this release.

NEW FEATURES

  • Integration with Apache Spark lets you analyze all of your operational data in a single place using OpenSearch in combination with Apache Spark.
  • Conversational search is generally available, providing comprehensive functionality to build conversational experiences using OpenSearch’s lexical, vector, and hybrid search features.
  • New default processors for Amazon Bedrock text embedding connectors can reduce the effort required to build AI connectors.
  • You can now represent long documents as multiple vectors in a nested field with built-in chunking, eliminating the need to build custom processing logic in order to query documents represented as vector chunks.
  • Concurrent segment search is now generally available, giving you the option to query index segments in parallel at the shard level. This can deliver improved latency for many types of search queries.
  • Date histogram aggregations without sub-aggregations can now be transformed into and executed as range filters, offering a significant boost to search performance.
  • Multi-terms aggregations are now significantly faster for high-cardinality search terms, which offers improved performance for many prefix and wildcard queries.
  • A new match-only text field type, a variant of the text field, can help reduce storage costs while maintaining term and multi-term query performance.
  • The keyword, numeric, and IP field types can now be searched with doc_values queries. This type of query can decrease storage requirements for rarely accessed fields.
  • A new top N queries feature lets you track high-latency queries with an API.
  • Updates to the Discover tool in OpenSearch Dashboards include improvements to density, column order, sorting controls, and more. Users can now choose between the previously implemented Discover experience and the updated experience.

EXPERIMENTAL FEATURES

  • OpenSearch 2.12.0 includes the following experimental features. Experimental features are disabled by default. For instructions on how to enable them, refer to the documentation for the feature.
  • The OpenSearch Assistant Toolkit helps developers build generative AI experiences inside of OpenSearch Dashboards. With integrated natural language processing and context-aware features, developers can use this toolkit to apply generative AI to create interactive user experiences and extract insights from OpenSearch data.
  • A new agent framework added to ML Commons uses remote large language learning models (LLMs) for step-by-step problem-solving and can coordinate machine learning tools using LLMs. The framework includes a flow agent and a conversational agent in this release.
  • Users can now query multiple clusters with cross-cluster monitors through the Alerting plugin.
  • A new workflow engine lets you automate configurations for ML Commons resources, allowing you to set up machine learning resources to support AI use cases without the need to manually create resources or write custom scripts.

DEPRECATION NOTICE

CentOS7

    Please note that OpenSearch will deprecate support for CentOS Linux 7 as a continuous integration build image and supported operating system in an upcoming release, as CentOS Linux 7 will reach end-of-life on June 30, 2024 (see #notice). To view OpenSearch's compatible operating systems, visit #operating-system-compatibility.

RELEASE DETAILS

FEATURES

Opensearch Custom Codecs

  • Accessors for custom compression modes (#90)
  • Lucene 9.9.2 Upgrade (#12069)

Opensearch Flow Framework

  • Initial release of Flow Framework

Opensearch Geospatial

  • Add denylist ip config for datasource endpoint (#573)

Opensearch ML Common

  • Add cross encoder support (#1739)
  • Enable conversation memory feature flags (#2095)

Opensearch Neural Search

  • Add rerank processor interface and ml-commons reranker (#494)

Opensearch Observability

  • Add metric type (#1775)

Opensearch Security Analytics

  • Integrate threat intel feeds (#669)

Opensearch k-NN

  • Add parent join support for lucene knn #1182
  • Add parent join support for faiss hnsw #1398

Skills

  • Initial release of Skills

Dashboards Assistant

  • Feature

  • Set verbose to false (#131)

Dashboards Observability

  • Add redirect with error message if integrations template not found (#1418)
  • Enable data grid in Chatbot (#1383)
  • Support Query assist (#1369)
  • Allow patch on allowedRoles (#1144)
  • Enable ppl visualization in Chatbot (#1374)
  • Added HAProxy Integration (#1277)

Opensearch Alerting Dashboards Plugin

  • Implemented UI to support cross-cluster monitors configuration - experimental. (#871)

Opensearch Dashboards Reporting

  • Feature Use Timezone in Reports (#238)

Opensearch Dashboards Search Relevance

  • Add Ability to Select a Search Pipeline in Comparison Tool (#352) (#362)

Opensearch Query Workbench

  • Add materlized views, manual refresh option (#159)
  • Added changes for making tree view persistent (#153)
  • Support dark mode and session for sql (#165)
  • Update ppl editor readonly property (#248)
  • Support for multiple datasource sessions (#251)

Opensearch Security Analytics Dashboards

  • Cache date time filter in local storage (#848)
  • Show aliases in data source options for detector and correlation rule creation (#864)
  • Correlations page improvements (#855)

ENHANCEMENTS

Opensearch Alerting

  • Optimize doc-level monitor execution workflow for datastreams (#1302)
  • Inject namedWriteableRegistry during ser/deser of SearchMonitorAction (#1382)
  • Bulk index findings and sequentially invoke auto-correlations (#1355)
  • Implemented cross-cluster monitor support (#1404)

Opensearch Anomaly Detection

  • Add an AD transport client (#1111)
  • Add profile transport action to AD client (#1123)
  • Refactor client's getDetectorProfile to use GetAnomalyDetectorTransportAction (#1124)
  • Add ser/deser to get AD transport action request (#1150)

Opensearch Common Utils

  • add 'fields' parameter in doc level query object. (#546)
  • add fields param in toxcontent() for doc level query (#549)
  • Add User.isAdminDn to User class (#547)

Opensearch Index Management

  • Implemented filtering on the ISM eplain API (#1067)
  • Add more error notification at fail points (#1000)
  • [Feature] Support Transform as an ISM action (#760)
  • Set the rollover action to idempotent (#986)
  • Support switch aliases in shrink action. (#987)

Opensearch ML Common

  • Add register and deploy api in client (#1502)
  • Added create connector API for MLClient (#1506)
  • Added register model group API for MLClient (#1519)
  • Expose execute api for MLClient (#1541)
  • Add prefix to show the error is from remote service (#1515)
  • Fine tune predict API: read model from index directly (#1559)
  • Removed empty host check, inherently within httpHost object generation (#1599)
  • Cluster restart model auto redeploy (#1627)
  • Add new data fields in the memory layer and update tests (#1753)
  • Check if model id is null when undeploy (#2015)
  • Adds inputs validation for create memory (#2040)
  • Make response_field customizable in MLModelTool (#2043)
  • Add memory id and interation id for non-verbose (#2005)
  • Issue #1965: Remove logging of sensitive chat history (#2012)
  • Update memory if tool output needs to be included in response (#2018)
  • Disable dynamic mapping for config index (#2027)
  • Move allow model setting from rest to transport (#1977)
  • Fine tune connector process function (#1963)
  • Change model auto redeploy enabled to true (#1809)
  • Add auto expand replica settings to memories (#1824)
  • Add interaction id into execute response (#1825)
  • Add more methods to client (#1782)
  • Support charset input params and change default charset as utf8 (#1828)
  • Fine tune log message based on error type (#1842)
  • Stash thread context before running forward action (#1906)
  • Refine the error message on cluster status not ready scenario (#1931)
  • Add Request-Source header (#1892)
  • Add process function for bedrock (#1554)
  • send agent execution response after saving memory (#2066)
  • add conversational flow agent (#2069)

Opensearch Notifications

  • Improve security plugin enabling check (#792)

Opensearch Performance Analyzer

  • Add separate metric for cluster manager service events and metrics #579

Opensearch Security

  • Add additional sendRequestDecorate cases (#4007)
  • [BUG-2556] Add new DLS filtering test (#4001)
  • [Enhancement-3191] transport_enabled setting on an auth domain and authorizer may be unnecessary after transport client removal (#3966)
  • Update roles.yml with new API for experimental alerting plugin feature #4027 (#4029)
  • Admin role for Query insights plugin (#4022)
  • Validate 409s occur when multiple config updates happen simultaneously (#3962)
  • Protect config object from concurrent modification issues (#3956)
  • Add test coverage for ComplianceConfig (#3957)
  • Update security analytics roles to include custom log type cluster permissions (#3954)
  • Add logging for test LdapServer actions (#3942)
  • HeapBasedRateTracker uses time provider to allow simluating of time in unit tests (#3941)
  • Add additional logging around testShouldSearchAll tests (#3943)
  • Add permission for get workflow step (#3940)
  • Add additional ignore_headers audit configuration setting (#3926)
  • Update to Gradle 8.5 (#3919) (#3923)
  • Refactor SSL handler retrieval to use HttpChannel / TranportChannel APIs instead of typecasting (#3917) (#3922)
  • Improve messaging on how to set initial admin password (#3918)
  • Re-enable disabled PIT integration tests (#3914)
  • Switched to more reliable OpenSearch Lucene snapshot location (#3913)
  • Add deprecation check for jwt_header setting (#3896)
  • Add render search template as a cluster permission (#3689) (#3872)
  • Add flow framework system indices and roles (#3851) (#3880)
  • Search operation test flakiness fix (#3862)
  • Extracts demo configuration setup into a java tool, adds support for Bundled JDK for this tool and updates DEVELOPER_GUIDE.md (#3845)
  • SAML permissions changes in DynamicConfigModelV7 (#3853)
  • Add do not fail on forbidden test cases around the stats API (#3825) (#3828)

Opensearch k-NN

  • Increase Lucene max dimension limit to 16,000 #1346
  • Tuned default values for ef_search and ef_construction for better indexing and search performance for vector search #1353
  • Enabled Filtering on Nested Vector fields with top level filters #1372
  • Throw proper exception to invalid k-NN query #1380

SQL

Dashboards Observability

  • Updating app analytics jest and cypress tests (#1417)
  • Hide dot indices for query assist (#1413)
  • Optimize searches for integration data (#1406)
  • Add Index-based adaptor for integrations (#1399)
  • Optimize images in integrations repository (#1395)
  • JSON Catalog Reader for Integrations (#1392)
  • Improve lint workflow to avoid fast fail (#1384)
  • Stop filtering stats by for data grid (#1385)
  • Update notebooks snapshots and cypress (#1375)
  • Revise and edit PPL in-product documentation (#1368)
  • Refactor data sources cypress tests (#1351)
  • Separate linting rules for cypress (#1348)
  • Remove manual refresh for S3 integrations (#1227)
  • Notebook jest updates (#1346)
  • Sync dependencies with latest versions (#1345)
  • Removes Zeppelin code and docs (#1340)
  • Metrics explore updated with PromQL (#1303)
  • Updated naming convention for HAProxy Integration (#1284)
  • Style changes for rendering fullscreen data grid (#1279)

Opensearch Dashboards Search Relevance

  • Utilize EuiEmptyPrompt to represent empty state (#320) (#333)
  • Update results to display non-source fields in search comparison tool (#340 )(#354)

Opensearch Index Management Dashboards Plugin

  • sort by managed policy feature (#950)
  • Update background color in "state" block (#903)
  • Rename indices to indexes (#926)
  • adding cancel button to change policy (#919)

Opensearch Security Dashboards Plugin

  • Run SAML Multi Auth integration tests in Cypress (#1729) (#1749)
  • Add step to install dependencies prior to building (#1743) (#1747)
  • Add indices:data/read/search/template/render to cluster permissions dropdown (#1725) (#1732)
  • Run Security dashboards plugin from binary (#1734)
  • Run cypress-tests and cypress-tests-tenancy-disabled on Chrome (#1728) (#1733)
  • Cookie compression and splitting for JWT (#1651) (#1723)
  • Adds system index permission as allowed action under static drop down list (#1720)
  • Handle other permission group types (#1715) (#1718)
  • Implement nextUrl for OpenID Authentication (#1563) (#1701)
  • Cypress13 testing frame work for OIDC and SAML (#1691)
  • Added client certificate options to support mutual TLS for OpenID endpoint (#1650) (#1683)
  • Adds openid parameters (#1637) (#1677)
  • Show controls as read only based on tenant permissions (#1472) (#1670)
  • Add search pipeline action permissions (#1661) (#1663)
  • Add permissions for async query and patch datasource API (#1626) (#1630)

BUG FIXES

Opensearch Alerting

  • Don't attempt to parse workflow if it doesn't exist (#1346)
  • Set docData to empty string if actual is null (#1325)

Opensearch Custom Codecs

  • GA updates and minor BWC test cleanups (#105)

Opensearch Index Management

  • GET SM policies return empty list when ism config index does not exist (#1072)
  • Added minimum timeout for transforms search of 10 minutes (#1033)
  • Interval schedule should take start time from the request, should not… (#1040)
  • Added minimum for search.cancel_after_time_interval setting for rollups (#1026)
  • Interval schedule should take start time from the request, should not set it to the current time of request execution. (#1036)
  • added type check for pipeline aggregator types in Transform initialization (#1014)

Opensearch ML Common

  • Fix missing lombok version compilation failure issue (#1278)
  • Fix update connector API (#1484)
  • Fixes bugs in the Cohere Blueprint (#1505)
  • Fix register client API (#1561)
  • Fixing MachineLearningNodeClient create connector, deploy model, register model group actions (#1584)
  • Fix model/connector update API to address security concern (#1595)
  • Fixing class casting exception for MachineLearningNodeClient GetMLTask API (#1618)
  • Fix for controller error stack trace and tokenbucket (#1985)
  • Fix internal connector (#1992)
  • Fix argument pass (#1993)
  • Fix error code when failed to delete model (#2037)
  • Fix edge case for validate json method (#2045)
  • Fix long pending issue when deleting model (#2046)
  • Add escape method for process function (#2055)
  • Fix bug in delete empty memory (#1966)
  • Fix dup last trace (#1975)
  • Add a version filter to enable bwc in 2.12 (#1944)
  • Fix error message (#1976)
  • Fix string.format wrong parameter position (#1960)
  • Fix null taskId causing model undeploy issue (#1945)
  • Fix updating plugins.ml_commons.jvm_heap_memory_threshold takes no effect (#1946)
  • Fix compilation when backport (#1798)
  • Fix duplicate node if node has both data and ml role (#1830)
  • Fix partially response issue in profile API result (#1775)
  • Fix: RestStatus 500 returned ml validation (#1811)
  • Fix the hardcode password in IT (#1856)
  • Fix model not deploy issue under intensive prediction tasks (#1930)
  • Fix bug - not found agent index (#1867)
  • Issue #1787: Fixing connector endpoint returns index not found (#1885)
  • Issue #1878/#1879/#1880: Fixing index not found for model group/model/tasks (#1895)
  • Change searchResponse method to fix breaking change in managed service (#1917)
  • Adjust ListTool response format (#1912)
  • Issue #844: Add accessUserInformation to the plugin security policy (#1959)
  • Escape input data (#1974)
  • flow agent suggestions missing (#2064)
  • bug fix - tool parameters missing (#2065)
  • fix empty tool parameter issue (#2067)
  • tool uses original input (#2068)
  • update Unthrotized error code to 401 (#2076)
  • handle null value exceptions when arguments are missing or Null in caling RAG pipeline (#2079)
  • changing error message and error code (#2073) (#2086)
  • Fix bwc issue in remote prediction (#2085)

Opensearch Neural Search

  • Fixed exception for case when Hybrid query being wrapped into bool query (#490)
  • Hybrid query and nested type fields (#498)
  • Fixing multiple issues reported in #497 (#524)
  • Fix Flaky test reported in #433 (#533)
  • Enable support for default model id on HybridQueryBuilder (#541)
  • Fix Flaky test reported in #384 (#559)
  • Add validations for reranker requests per #555 (#562)

Opensearch Observability

  • Upgrade JSON to 20231013 to fix CVE-2023-5072 (#1750)
  • Bumping ktlint and resolving conflicts (#1792)

Opensearch Security

  • Fix Bug with Install demo configuration running in cluster mode with -y (#3936)
  • Allow TransportConfigUpdateAction when security config initialization has completed (#3810) (#3927)
  • Fix the CI / report-coverage check by switching to corresponding actions/upload-artifact@v4 (#3893) (#3895)

Opensearch Security Analytics

  • Fix for doc level query constructor change (#651)
  • Make threat intel async (#703)
  • Return empty response for empty mappings and no applied aliases (#724)
  • Fix threat intel plugin integ test (#774)
  • Use a common constant to specify the version for log type mappings (#708)
  • Sigma keywords field not handled correctly (#725)
  • Allow updation/deletion of custom log type if custom rule index is missing (#767)
  • Delete detector successfully if workflow is missing (#790)
  • fix null query filter conversion from sigma to query string query (#722)
  • add field based rules support in correlation engine (#737)
  • Reduce log level for informative message (#203)

Opensearch k-NN

  • Fix use-after-free case on nmslib search path #1305
  • Allow nested knn field mapping when train model #1318
  • Properly designate model state for actively training models when nodes crash or leave cluster #1317
  • Fix script score queries not getting cached #1367
  • Fix KNNScorer to apply boost #1403
  • Fix equals and hashCode methods for KNNQuery and KNNQueryBuilder #1397
  • Pass correct value on IDSelectorBitmap initialization #1444

SQL

Dashboards Assistant

  • Fix: comply with the field change of agent framework (#137)

Dashboards Observability

  • Change class name to decouple styling from discover (#1427)
  • Add modal for DQL language (#1422)
  • fixing panel PPL filters not being added (#1419)
  • Hide query assist UI if PPL agent is not created (#1400)
  • Fix trace link in event viewer (#1396)
  • Fix command syntax error for ppl_docs (#1372)
  • Update snapshots for upstream changes (#1353)
  • Fix for explorer data grid not paginating (#1140)
  • Update URL of create datasources, fix spacing(#1153)
  • Disable integration set up button if invalid (#1160)
  • Switch from toast to callout for integration set up failures (#1158)
  • Fix integration labeling to identify S3 integrations (#1165)
  • Correct date pass-through on Notebook Visualizations (#1327)
  • Fix for Notebook Observability Visualization loading (#1312)
  • Fix metrics loading loop (#1309)
  • Fix explorer stats function typing crash (#1429)

Opensearch Alerting Dashboards Plugin

  • Do not create Message component on every text change (#854)

Opensearch Dashboards Maps

  • Fixed maps tooltip display at dark mode#564

Opensearch Dashboards Notifications

  • Replaced wrongly formatted mock Slack URLs with properly formatted mock Slack URLs. (#139)
  • Replace all wrong Chime urls with correct ones (#144)
  • Fix: CI flow on windows main (#145)

Opensearch Dashboards Reporting

  • Update the dependencies in .babelrc (#260) Fix the bootstrap failure on the fresh run (#270)

Opensearch Dashboards Search Relevance

Opensearch Query Workbench

  • fixed create table async query bug (#158)
  • design changes for loading, changed the banner: (#170)
  • Make checkpoint mandatory, add watermark delay, minor UI fixes (#173)
  • UI fixes for loading state, empty tree, added toast for error, fixed no indicies error (#176)
  • Session update, minor fixes for acceleration flyout (#179)
  • Add backticks and remove ckpt for manual refresh in acceleration flyout (#183)
  • UI-bug fixes, added create query for MV (#182)
  • added fix for loading spinner issue for other database (#189)
  • Fix error handling for user w/o proper permissions (#195)
  • Add minutes option to acceleration (#249)
  • added changes for cancel query not being able to cancel (#256)

Opensearch Security Analytics Dashboards

  • Ask for mapping of threat intel feeds related fields only when threat intel is enabled (#849)
  • Add check for mappings view API call during create detector (#862)

Opensearch Security Dashboards Plugin

  • Fixes Short URL redirection for SAML login (#1744) (#1767)
  • Disable tenancy pop-ups when disabled or default tenant set (#1759) (#1763)
  • Fix cannot find module when import ResourceType in server from public folder (#1705) (#1716)
  • Fix copy link issue in Safari (#1633) (#1672)
  • Fix bug where custom permission groups are missing (#1636) (#1639)

INFRASTRUCTURE

Opensearch Alerting

  • Fix workflow security tests. (#1310)
  • Upgrade to Gradle 8.5 (#1369)

Opensearch Anomaly Detection

  • Update to Gradle 8.5 (#1131)
  • Remove default admin credentials (#1134)
  • Require JDK version for java spotless check (#1129)
  • Updated lucene snapshot url (#1146)
  • Fix build, update CVE-affected versions (#1102)

Opensearch Asynchronous Search

  • Updates admin credentials used in github workflow and upgrade to Gradle 8.5 (#522)

Opensearch Custom Codecs

  • Onboard jenkins prod docker images to github actions (#77)
  • Switch to ci-runner user for the checks (#82)
  • Add updateVersion gradle task from plugin template (#87)

Opensearch Index Management

  • Update admin credential in integration test (#1084)
  • Onboard jenkins prod docker images to github actions (#1025)
  • Improve security plugin enabling check (#1017)
  • Fixes password assignment for integTest when using remote cluster (#1091)
  • Accepts https as a property to set securityEnabled flag (#1100)

Opensearch ML Common

  • Onboarding Jenkins prod docker images to github ci check (#1566)
  • Add code coverage report for commons and memory modules (#1585)
  • Adding UT coverage for in-cache update and fine-tuning throttling feature (#1913)
  • Add tests for MLAgent Get and Delete (#1794)
  • Fix race confition in index initialization and RestUpdateConnector UT (#1857)
  • Fix failing flaky tests due to pytorch library not available for dependency plugins (#1886)
  • Adding tests for all the agent runners (#1792)
  • Update deprecated openAI mode in integration test and fix flaky tests (#1858)

Opensearch Neural Search

  • BWC tests for Neural Search (#515)
  • Github action to run integ tests in secure opensearch cluster (#535)
  • BWC tests for Multimodal search, Hybrid Search and Neural Sparse Search (#533)
  • Distribution bundle bwc tests ([#579])(opensearch-project/neural-search#579)

Opensearch Notifications

  • Fix integration test failure by allowing direct access to system index warning (#784)
  • Add github workflow to auto bump bwc version (#799)
  • Onboard prod jenkins docker image to github actions (#809)
  • Update Gradle to 8.5 (#824)

Opensearch Observability

  • Onboard jenkins prod docker images on github actions (#1763)

Opensearch Performance Analyzer

  • Update to Gradle 8.5 and Fixing CVE-2023-33202 #617

Opensearch Reporting

  • Bumping ktlint to 0.47.1 (#960)
  • upgrade gradle to 8.5 (#941)

Opensearch k-NN

  • Upgrade gradle to 8.4 1289
  • Refactor security testing to install from individual components #1307
  • Refactor integ tests that access model index #1423
  • Fix flaky model tests #1429

SQL

Dashboards Observability

  • Add FTR workflow for dashboards observability (#1334)
  • Fix no matching issue corner case for lint CI (#1326)
  • Add enforce-labels action (#1330)
  • Linter CI (#1313)
  • Refactor Cypress Workflow (#1299)

Opensearch Anomaly Detection Dashboards

  • Updating maintainers and code owners (#625)
  • Support github actions to run yarn build on build docker images (#620)
  • fix build error due to missing babel plugins (#661)
  • fix multiple CVEs (#675)

Opensearch Dashboards Reporting

  • Add E2E Cypress workflow for Dashboards Reporting (#262)

Opensearch Dashboards Search Relevance

  • Onboard jenkins prod docker images to github actions (#345) (#346)
  • Remove babel-proposal plugins (#355) (#357)

Opensearch Dashboards Visualizations

  • Onboard jenkins prod docker images to github actions (#287)
  • [CI/CD] Add Cypress e2e workflow for gantt chart (#298)
  • [CI/CD] Add FTR workflow for gantt chart plugin test (#306)
  • [CI/CD] Add eslint workflow (#316)

Opensearch Index Management Dashboards Plugin

  • Onboard jenkins prod docker images to github actions (#907)

Opensearch Query Workbench

  • Fix jest tests (#255)

Opensearch Security Analytics Dashboards

  • Add missing modules common and types (#875)
  • [Detector creation] UI workflow metrics (#865)

DOCUMENTATION

Opensearch Alerting

  • Added 2.12 release notes (#1408)

Opensearch Common Utils

  • Added 2.12.0.0 release notes (#585)

Opensearch Custom Codecs

  • Version 2.12 Release Notes (#110)

Opensearch Index Management

  • Version 2.12 Release Notes Draft (#1092)

Opensearch ML Common

  • Updated developer guide to include links for getting started with git (#1409)
  • Add triaging doc (#1250)
  • Add bedrock blueprint doc (#1501)
  • Add bedrock titan embedding model blueprint (#1527)
  • Fix bedrock embedding model blueprint (#1563)
  • Add openai embedding model blueprint (#1602)
  • Added Connector Blueprint for AI21 Labs Jurassic-2 Mid (#1617)
  • Update default model_access_mode for model group (#1677)
  • Add cohere version 3 embedding model (#1721)
  • Blueprint for multi-model titan model (#1729)
  • AI connector blueprint for the Aleph Alpha Luminous-Base Embedding Model (#2003)
  • Add tutorial doc for semantic search on amazon opensearch (#1928)
  • Add tutorial doc for semantic search with OpenAI embedding model (#1936)
  • Add connector blueprint for Azure OpenAI Embedding and Chat model (#2062)
  • Add updated Cohere Embedding blueprint (#2063)
  • add tutorial for conversational search (#2075)
  • Add Cohere Chat blueprint with RAG (#1991)

Opensearch Notifications

  • Add 2.12.0 release notes (#851)

Opensearch Security Analytics

  • Added 2.12.0 release notes. (#834)
  • Add developer guide (#791)

SQL

Dashboards Observability

  • Use approved svg from UX in (#1066)
  • add docker-compose.yml testing and readme for integration to 2.9 in (#923)
  • Correct doc link (#1336)
  • Integrations integration test fixes (#1331)

Opensearch Alerting Dashboards Plugin

  • Drafted 2.12 release notes. (#876)

Opensearch Dashboards Notifications

  • Drafted release notes. (#156)

Opensearch Dashboards Search Relevance

  • Updating CONTRIBUTING.md by adding DCO section (#337) (#341)
  • Update CONTRIBUTING.md by adding command for running tests to PR directions (#335) (#347)

Opensearch Index Management Dashboards Plugin

  • Version 2.12 Release Notes Draft (#971)

Opensearch Security Analytics Dashboards

  • Added release notes for 2.12.0 (#879)

MAINTENANCE

Opensearch Observability

  • Upgrade gradle to 8.5 (#1777)
  • Remove integration content (#1738)
  • Manually Force Secure logback Dependencies (#1795)

SECURITY

SQL

New Contributors

Full Changelog: https://github.com/opensearch-project/sql/compare/2.11.0.0...2.12.0.0

Opensearch Alerting

  • Increment version to 2.12.0-SNAPSHOT. (#1239)
  • Removed default admin credentials for alerting (#1399)
  • ipaddress lib upgrade as part of cve fix (#1397)

Opensearch Asynchronous Search

  • Increment version to 2.12.0 (#466)

Opensearch Common Utils

  • Increment version to 2.12.0-SNAPSHOT (#545)
  • Onboard prod jenkins docker image to github actions (#557)
  • Update Gradle to 8.4 (#560)
  • Add Java 11/17/21 matrix for build, test and integration checks (#561)
  • changed all usages of 'admin' as a password to something different (#581)
  • Update dependency com.pinterest:ktlint to 0.47.1 and fix CVE-2023-6378 (#585)

Opensearch Geospatial

  • Upgrade gradle to 8.4 (#596)
  • Update spotless and eclipse dependencies (#620)

Opensearch Index Management

  • Increment version to 2.12.0-SNAPSHOT (#996)
  • Update to Gradle 8.5 (#1069)
  • Upgrade ktlint to mitigate CVE-2023-6378 (#1095)

Opensearch Job Scheduler

  • Fix flaky tests (#556).
  • Use the build CI image in the Build and Test workflow (#534).
  • Upgrade gradle to 8.5 (#545).
  • Update release-drafter/release-drafter from 5 to 6 (#567).
  • Update peter-evans/create-issue-from-file from 4 to 5 (#566).
  • Update org.slf4j:slf4j-api from 2.0.7 to 2.0.11 (#570).
  • Update com.google.googlejavaformat:google-java-format from 1.17.0 to 1.19.2 (#555).
  • Update com.google.guava:guava from 32.1.2-jre to 32.1.3-jre (#530).
  • Update com.google.guava:failureaccess from 1.0.1 to 1.0.2 (#532).
  • Update com.netflix.nebula.ospackage from 11.5.0 to 11.6.0 (#551).
  • Update com.diffplug.spotless from 6.22.0 to 6.25.0 (#558).
  • Fix backport workflow (#533).
  • Enable publishPluginZipPublicationToMavenLocal gradle task to publish job-scheduler plugin zip to maven local (#584).

Opensearch ML Common

  • Add Austin and Henry as maintainer (#1579)
  • Updated version of awssdk (#1607)
  • Update Gradle to 8.4 (#1697)
  • Address CVE-2023-42503 (#1727)
  • Fix CVE-2023-2976 and upgrade guava to be consistent (#2013)
  • Fix CVE-2023-42503 due to djl models (#2016)
  • Add maintainer (#1952)
  • Updating maintainers list (#1938)
  • Bump Mockito dependencies (#1868)
  • Updated OpenSearch Lucene snapshot location (#1834)
  • Add kotlin stblib dependency for SearchAlertTool (#1861)
  • Update dependency com.jayway.jsonpath:json-path to v2.9.0 (#1956)
  • Update http package import for 2.x (#1957)
  • Update the lucene snapshot url (#2082)
  • removing skills first (#2089)

Opensearch Neural Search

  • Added support for jdk-21 (#500))
  • Update spotless and eclipse dependencies (#589)

Opensearch Notifications

  • Increment version to 2.12.0-SNAPSHOT (#780)
  • Update dependency org.json:json to v20231013 (#795)
  • Replace the TestMailServer to GreenMail server (#807)
  • Re-enable detekt (#796)
  • Removed default admin credentials. (#837)
  • Force logback to use 1.3.14 (#849)
  • Bump ktlint version to fix CVE (#850)

Opensearch Performance Analyzer

  • Remove redundant ClusterManagerThrottlingMetricsCollector #582
  • Update spotless to meet JDK-21 baseline #618

Opensearch Reporting

  • Onboard jenkins prod docker images to github actions (#924)

Opensearch Security

  • Bump org.apache.camel:camel-xmlsecurity from 3.22.0 to 3.22.1 (#4018)
  • Bump release-drafter/release-drafter from 5 to 6 (#4021)
  • Bump com.netflix.nebula.ospackage from 11.6.0 to 11.7.0 (#4019)
  • Bump org.junit.jupiter:junit-jupiter from 5.10.1 to 5.10.2 (#4020)
  • Bump jjwt_version from 0.12.4 to 0.12.5 (#4017)
  • Bump io.dropwizard.metrics:metrics-core from 4.2.24 to 4.2.25 (#3998)
  • Bump gradle/gradle-build-action from 2 to 3 (#4000)
  • Bump jjwt_version from 0.12.3 to 0.12.4 (#3999)
  • Bump spotless (6.24.0 -> 6.25.0) to bump eclipse resources (3.18 -> 3.19) (#3993)
  • Fix: remove unnecessary trailing slashes in APIs. (#3978)
  • Adds new ml-commons system indices to the list (#3974)
  • Bump io.dropwizard.metrics:metrics-core from 4.2.23 to 4.2.24 (#3970)
  • Bump com.fasterxml.woodstox:woodstox-core from 6.5.1 to 6.6.0 (#3969)
  • Bump com.diffplug.spotless from 6.23.3 to 6.24.0 (#3947)
  • Bump org.apache.camel:camel-xmlsecurity from 3.21.3 to 3.22.0 (#3906)
  • Bump com.google.errorprone:error_prone_annotations from 2.23.0 to 2.24.0 (#3897) (#3902)
  • Bump io.dropwizard.metrics:metrics-core from 4.2.22 to 4.2.23 (#3900)
  • Bump com.google.googlejavaformat:google-java-format from 1.18.1 to 1.19.1 (#3901)
  • Bump github/codeql-action from 2 to 3 (#3859) (#3867)
  • Bump org.apache.camel:camel-xmlsecurity from 3.21.2 to 3.21.3 (#3864)
  • Bump org.checkerframework:checker-qual from 3.40.0 to 3.42.0 (#3857) (#3866)
  • Bump com.flipkart.zjsonpatch:zjsonpatch from 0.4.14 to 0.4.16 (#3865)
  • Bump com.netflix.nebula.ospackage from 11.5.0 to 11.6.0 (#3863)

Opensearch Security Analytics

  • Increment to 2.12. (#771)
  • Onboard prod jenkins docker images to github actions (#710)
  • Match maintainer account username (#438)
  • Add to Codeowners (#726)
  • Fix codeowners to match maintainers (#783)
  • updated lucene MAX_DIMENSIONS path (#607)
  • Addresses changes related to default admin credentials (#832)
  • Upgrade Lucene Codec to Lucene99 + Upgrade to Gradle 8.5 (#800)
  • fix CVE-2023-2976 (#835)

Opensearch k-NN

  • Update developer guide to include M1 Setup #1222
  • Upgrade urllib to 1.26.17 #1278
  • Upgrade urllib to 1.26.18 #1319
  • Upgrade guava to 32.1.3 #1319
  • Bump lucene codec to 99 #1383
  • Update spotless and eclipse dependencies #1450

Opensearch Alerting Dashboards Plugin

  • Remove integtest.sh since it is not being used. (#849)
  • [AUTO] Increment version to 2.12.0.0 (#772)

Opensearch Dashboards Maps

  • Fix broken build and failing tests #572
  • Update dependencies to align with other plugins #575

Opensearch Dashboards Notifications

  • Increment version to 2.12.0.0 (#130)
  • Increase OSD start timeout for windows platform (#118)
  • Update to latest babel package name (#142)

Opensearch Dashboards Reporting

  • Add eslint workflow (#273) Sync dependencies with latest versions (#268) Onboard jenkins prod docker images to github actions (243)

Opensearch Dashboards Visualizations

  • Increment Version to 2.11.0 (#253)
  • Onboard Stylelint (#229)
  • Increment version to 2.12.0.0 (#272)
  • Rename the .babelrc file (#294)
  • Bump Cypress version from 5.0.0 to 12.8.1 (#296)
  • Sync dependencies with latest versions (#310)
  • Update jest snapshots & cypress tests (#314)
  • Move gantt-chart out from subdirectory (#321)

Opensearch Index Management Dashboards Plugin

  • Remove unused integtest.sh file (#954)
  • Increment version to 2.12.0.0 (#928)
  • Update the babel require (#935)
  • Update browserify-sign to fix cve-2023-46234 (#978)

Opensearch ML Commons Dashboards

  • Increment version to 2.12.0.0 (#279)

Opensearch Query Workbench

  • Increment version to 2.12.0.0 (#164)
  • Onboard Jenkins prod docker images to github actions (#198)
  • Bump Cypress to version 12 (#234)
  • Add E2E Cypress workflow for sql workbench (#235)
  • Add FTR workflow for sql workbench (#239)
  • Add eslint workflow (#245)
  • babel config change: (#1229)

Opensearch Security Analytics Dashboards

  • [AUTO] Increment version to 2.12.0.0 (#761)

Opensearch Security Dashboards Plugin

  • Removing Prerequisite Checks Workflow (#1757)
  • Addressing spelling mistakes in server code. (#1753) (#1754)
  • Moves eslint to devDependency and save yarn.lock file (#1746) (#1748)
  • Update cypress E2E workflow to reflect changes to default admin password (#1714) (#1719)
  • Pass in env variable and -t flag to set "admin" as the initial admin password (#1708)
  • Increment version to 2.12.0.0 (#1686)
  • Upgrade glob-parent to 5.1.2 and debug to 4.3.4 (#1685)
  • Check in yarn.lock for 2.x branch (#1671)
  • Different Values Pointing to Basic Auth, Need to Unify (#1619) (#1649)
  • Stabilize SAML integration test cases for security dashboard CIs (#1641) (#1654)
  • Update babel imports (#1652) (#1653)

REFACTORING

Opensearch Alerting

  • Reference get monitor and search monitor action / request / responses from common-utils (#1315)

Opensearch Common Utils

  • Move get monitor and search monitor action / request / responses to common-utils (#566)

Features

  • Implemented cross-cluster monitor support (#584)

Opensearch ML Common

  • Rename memory field names in responses (#2020)
  • Refactor memory layer APIs (#1890)

Opensearch Neural Search

  • Deprecate the max_token_score field in neural_sparse query clause (#478)
  • Added spotless check in the build (#515)

Opensearch Security Analytics

  • Refactored alert tests (#837)

SQL

Opensearch Dashboards Search Relevance

  • Add id attribute to search bar (#338) (#353)

New Contributors

  • @nung22 made their first contribution in #300

Opensearch Security Dashboards Plugin

  • Refactor cypress OIDC tests to use Run Cypress Tests action (#1755) (#1756)

EXPERIMENTAL

Opensearch ML Common

  • Update Model API (#1350)
  • Hidden model implementation (#1755)
  • Model & user level throttling (#1814)
  • Search agent api (#1826)
  • Add GetTool API and ListTools API (#1850)
  • Enable in-place update model (#1796)
  • Memory Manager and Update Memory Actions/APIs (#1776)
  • Add CatIndexTool (#1770)
  • Add search and singular APIs to conversation memory (#1720)
  • Memory interface in spi (#1771)
  • Tool interface (#1772)
  • Add get config api to retrieve root agent id (#1995)
  • Register agent rest and transport actions (#1801)
  • IndicesHandler and conversationIndexMemory (#1777)
  • Adding mlmodeltool and agent tool with tests (#1778)
  • Get and delete agent APIs (#1779)
  • Add register action request/response (#1780)
  • Add execute agent api; add load extension (#1810)
  • Add IndexMapping Tool (#1934)
  • Agent meta classes in common (#1759)
  • Agent framework disable/enable flag (#1994)
  • Do not allow non super admin users to undeploy hidden models (#1981)
  • System error handling (#2051)
  • Handling tool errors (#1881)
  • Changes to hidden model code to use OPENDISTRO_SECURITY_USER instad of ssl principal (#1897) (#1900)
  • Support regenerate for chatbot (#1823)
  • Update IndexMappingTool Description (#1998)
  • Add more user based permission check in Memory (#1935)
  • Update memory index name and add updated_time (#1793)
  • fine tune prompt;refactor conversational agent code (#2094)

Dashboards Assistant

  • Features