v3.0.0

Summary of changes:

• In this release, we have made several significant updates to improve write performance and user experience.
  • We have revised our implementation of key-value store that translates key-value pairs in the request to block layer data written to device.
  • Specifically, we have replaced RocksDB with an internal implementation of a hash-based key-value translator and a hint-based logical block manager sensitive to optimal NVMe drive IO boundary to improve write performance.
• For impacted users, these updates should provide a smoother, more intuitive experience with a noticeable improvement to write operation.
  • We have deprecated compaction and the requirement for written data to be compacted before reading to achieve maximum read performance is no longer needed.
  • We have introduced a new format tool called dss-formatter to format devices; similar to existing mkfs-blobfs tool which has now been deprecated.

Limitations

• Persistent key listing is not yet implemented. This will result in MinIO failing to return object listing after a reboot.
• Target startup time is presently longer than expected - and will be addressed in a future release.

What's Changed

• Support s3 bench build during client build by @velomatt in #41
• Add reusable gitlab workflows by @velomatt in #42
• Update defaults to run Gitlab pipeline on push to feature branch by @velomatt in #43
• Support Write Optimization feature build by @velomatt in #44
• Update commit id's for v3.0.0 release and update readme by @velomatt in #45
• Fix docker build scripts and docker dependency by @velomatt in #46

Full Changelog: v2.0.0...v3.0.0

v2.0.0

Gen2 Overview

• DSS can now be deployed with gen2 mode, which utilizes RDD (RDMA Data Direct).
  • This feature enables clients to transfer object data directly from DSS targets without the need to go through the MinIO servers.
  • This allows better performance, as well as improved network and memory resource utilization in the DSS Stack.
  • This feature is integrated with DSS Client APIs and allows for seamless integration with applications using the thin DSS client library.
• To deploy DSS with gen2 mode enabled, it is required that both front-end (in tcp_ip_list) and back-end (in rocev2_ip_list) IP addresses be from RDMA-enabled network interfaces. See dss-ansible README for details.
• dss-ansible will deploy DSS in "gen2" mode simply by setting gen2=true in your Ansible inventory file. The default value is false, which will deploy DSS in gen1 mode (not using the RDD feature, does not require RDMA front-end network).

What's Changed

• 18 add devtoolset 11 to dockerfile by @velomatt in #19
• Add docker build scripts by @velomatt in #22
• Added support for AWS SDK v1.9 by @grandsuri in #17
• Support multi-branch builds by @velomatt in #24
• add build-aws workflow by @velomatt in #26
• Update branch name logic for ECR image tag by @velomatt in #30
• Update DSS Dockerfile by @velomatt in #27
• Add support for multi-branch builds. by @velomatt in #31
• Added the flag -DBUILD_TESTING=OFF to cmake command to avoid compilation errors of unit tests by @grandsuri in #34
• Update Docker scripts by @velomatt in #33
• Changes to add deps to run unit tests for dss-sdk target to the Dockerfile by @snubatreus in #36
• Update commit ID's to latest tip of master by @velomatt in #37
• Update submodules for gen2 by @velomatt in #38
• Fix script dir link by @velomatt in #39
• v2.0.0 release by @velomatt in #40

New Contributors

• @grandsuri made their first contribution in #17
• @snubatreus made their first contribution in #36

Full Changelog: v1.0.0...v2.0.0

DSS v1.0.0

Initial public release

What's Changed

• Add Shellcheck Actions by @velomatt in #3
• Add Dockerfile by @velomatt in #9
• Add default owners by @velomatt in #11
• Set DSS Gen1 Commit IDs (1.0.0) by @velomatt in #12

New Contributors

• @velomatt made their first contribution in #3

Full Changelog: https://github.com/OpenMPDK/DSS/commits/v1.0.0

Artifact downloads:

aws-sdk-cpp-1.8.99-1.x86_64.rpm
dss_client-v1.0.0.tgz
dss-gcc510-5.1.0-0.centos7.8.x86_64.rpm
dss-minio-bin-v1.0.0.tgz
kernel-5.1.0-5.x86_64.rpm
kernel-devel-5.1.0-5.x86_64.rpm
kernel-headers-5.1.0-5.x86_64.rpm
mft-4.17.2-12.x86_64.rpm
nkv-datamover-v1.0.0.tgz
nkv-sdk-bin-v1.0.0.tgz
nkv-target-v1.0.0.tgz
nkvagent-0.1.0.414ef10-1.noarch.rpm
ufm-1.0.0.414ef10-1.noarch.rpm
ufmbroker-1.0.0.414ef10-1.noarch.rpm