added onedata

extreme-datacloud · Mar 17, 2020 · da8aae8 · da8aae8
1 parent 2b92e99
commit da8aae8
Show file tree

Hide file tree

Showing 3 changed files with 101 additions and 102 deletions.
diff --git a/source/releases/quasar/onedata/v19.02.1.rst b/source/releases/quasar/onedata/v19.02.1.rst
@@ -4,61 +4,56 @@ v19.02.1
 What’s new
 ~~~~~~~~~~
 
-The new versions provides many improvemenets and new features, from which the most important are:
+The new versions provides many improvemenets and new features, and in particular in the
+ context of the XDC project in order to support some of the use-cases:
+ * improvement of 'ls' operations in oneclient to provide better performance 
+ when there are many (>10k) files in a single directory.
+ * release of python bindings for onedata in a form of onedataFS (https://github.com/onedata/fs-onedatafs), allowed to greatly simplify and improve performance of programmatic operations on data located in Onedata space.
+ * specifficaly for the ECRIN use case:
+   * improvement of file indexing performance for scanning a 800k dataset 
+   provided by ECRIN
+ * CTA specific:
+   * the redesign of the changes stream API, to allow more fine-grained 
+   control over the steam, that benefits in faster changes stream, and less 
+   stress put on a oneprovider instance.
 
-* improvements in the metadata extraction, ingestion and manipulation
-* WebDAV support
-* improvied data monotoring API allowsing to monitor the changes in data and 
-  depending on the type of the change invoking actions, ie. data replication 
-* improved speed of indexing of large datasets
-* implementation of user defined data indexes, used for querring the data based on specyfic metadata
 
 List of RfCs
 ~~~~~~~~~~~~
 * Oneclient:
 
-   * VFS-4902 Added maximum upload size and connection pool size params
-   * VFS-4902 Added WebDAV helper
-   * VFS-4843 Adjusted default prefetch evaluation frequency
-   * VFS-4843 Optimized random read prefetch calculation
-   * VFS-4804 Fixed macaroon error handling
-   * VFS-4804 Fixed handshake error handling
-   * VFS-4804 Fixed reconnect
-   * VFS-4804 Removed rest based full file prefetch
-   * VFS-4741 Added sync block prefetch option
-   * VFS-4809 Added prefetch skipping for prefetched offsets
-   * VFS-4800 Fixed prefetch offset cache
-   * VFS-4800 Added block aligned prefetch offset cache
-   * VFS-4772 Align block prefetch offsets to cluster window size
-   * VFS-4660 Added synchronize block priority handling
-   * VFS-4656 Added cephrados helper
+   * VFS-5826 Increased events test connections
+   * VFS-5826 Added opendir and releasedir to OnedataFS
+     * Increased default metadata cache size
+     * Added support for opendir and releasedir
+     * Added persistent directory cache
+     * Added directory subscription cancelling
+   * VFS-5844 Refactored metadatacache to limit file subscriptions
+   * VFS-5965 Added option to emulate large available space
+
 
 * Oneprovider:
 
-   * VFS-4936 Add function to change space support size
-   * VFS-4830 add add_reduce function
-   * Updating GUI, including: VFS-4454-login-loader-close * VFS-4454 Fix hanging authorization loader spinner
-   * Upgrade rtransfer_link.
-   * Added support for webdav
-   * VFS-4936 Check if space exists when handling REST call
-   * VFS-4936 Add space support resizing
-   * VFS-4656 Added cephrados helper
-   * VFS-4463 Showing storage in GUI on storages view
-   * VFS-4560 Detect existing Let's Encrypt certificates
-   * VFS-4029 Better certificate hostname verification
-   * VFS-4504 Set min and max port for distributed erlang
+   * op-worker
+     * VFS-5826 Ensure db start at cluster init
+       * Add missing event during dir creation
+       * Add events during file creation
+       * Change max_read_dir_plus_procs value
+       * Emmit attr_changed events on chmod and acl change
+       * Change events processing - allow subscriptions per dir 
 
 * Onezone:
 
-   * VFS-4623 Add defaults to dns config envs
-   * Updating GUI, including: VFS-4702-auth-icons-config * VFS-4702 Support for customizable authorization providers icons, colors and names
-    VFS-4614 New Universal auth.config for OIDC/SAML Identity Providers
-   * VFS-4633 Tokens are not consumed upon failed operation
-   * VFS-4029 Better certificate hostname verification
-   * VFS-4029 Support http Let's Encrypt challenge in OZ and OP
-   * VFS-4560 Detect existing Let's Encrypt certificates
-   * VFS-4504 Set min and max port for distributed erlang
-
+   * oz-worker
+     * VFS-5936 Improve entitlement mapping
+       * Merge entitlements with different roles (privileges) to the highest of them
+       * Store previous privileges to discover and coalesce later changes in user roles
+     * VFS-5940 Rename GUI package verification envs to more intuitive
+     * VFS-5205 Hide share CREATE and DELETE operations from Onezone REST API (as they 
+     are reserved for Oneprovider logic), return rootFileId as ObjectID in share details
+   * onepanel
+     * VFS-5994 Make 'production' Let's Encrypt mode the default
+     * VFS-5940 Rename oz-worker's GUI package verification envs to more intuitive
 
 Known Issues
 ~~~~~~~~~~~~
@@ -67,33 +62,44 @@ Known Issues
 
 List of Artifacts
 ~~~~~~~~~~~~~~~~~
-* CentOS-7 RPMS
+* CentOS-7 RPMS - version 19.02.1
 
-  * `cluster-manager-18.02.0.rc13-1.el7.centos.x86_64.rpm <https://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/cluster-manager.html>`_
-  * `oneclient-18.02.0.rc13-1.el7.centos.x86_64.rpm <https://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/oneclient.html>`_
-  * `oneprovider-18.02.0.rc13-1.el7.centos.x86_64.rpm <https://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/oneprovider.html>`_
-  * `onezone-18.02.0.rc13-1.el7.centos.x86_64.rpm <https://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/onezone.html>`_
-  * `op-panel-18.02.0.rc13-1.el7.centos.x86_64.rpm <https://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/op-panel.html>`_
-  * `op-worker-18.02.0.rc13-1.el7.centos.x86_64.rpm <https://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/op-worker.html>`_
-  * `oz-panel-18.02.0.rc13-1.el7.centos.x86_64.rpm <https://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/oz-panel.html>`_
-  * `oz-worker-18.02.0.rc13-1.el7.centos.x86_64.rpm <https://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/oz-worker.html>`_
+  * `cluster-manager <https://repo.indigo-datacloud.eu/repository/xdc/production/2/centos7/x86_64/base/repoview/cluster-manager.html>`_
+  * `Oneclient <https://repo.indigo-datacloud.eu/repository/xdc/production/2/centos7/x86_64/base/repoview/oneclient.html>`_
+  * `oneprovider <https://repo.indigo-datacloud.eu/repository/xdc/production/2/centos7/x86_64/base/repoview/oneprovider.html>`_
+  * `onezone <https://repo.indigo-datacloud.eu/repository/xdc/production/2/centos7/x86_64/base/repoview/onezone.html>`_
+  * `op-panel <https://repo.indigo-datacloud.eu/repository/xdc/production/2/centos7/x86_64/base/repoview/op-panel.html>`_
+  * `op-worker <https://repo.indigo-datacloud.eu/repository/xdc/production/2/centos7/x86_64/base/repoview/op-worker.html>`_
+  * `oz-panel <https://repo.indigo-datacloud.eu/repository/xdc/production/2/centos7/x86_64/base/repoview/oz-panel.html>`_
+  * `oz-worker <https://repo.indigo-datacloud.eu/repository/xdc/production/2/centos7/x86_64/base/repoview/oz-worker.html>`_
 
 * Ubuntu 16.04
 
-  * `cluster-manager_18.02.0.rc13-1_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/1/ubuntu/dists/xenial/main/binary-amd64/cluster-manager_18.02.0.rc13-1_amd64.deb>`_
-  * `oneclient_18.02.0.rc13-1_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/1/ubuntu/dists/xenial/main/binary-amd64/oneclient_18.02.0.rc13-1_amd64.deb>`_
-  * `oneprovider_18.02.0.rc13-1_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/1/ubuntu/dists/xenial/main/binary-amd64/oneprovider_18.02.0.rc13-1_amd64.deb>`_
-  * `onezone_18.02.0.rc13-1_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/1/ubuntu/dists/xenial/main/binary-amd64/onezone_18.02.0.rc13-1_amd64.deb>`_
-  * `op-panel_18.02.0.rc13-1_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/1/ubuntu/dists/xenial/main/binary-amd64/op-panel_18.02.0.rc13-1_amd64.deb>`_
-  * `op-worker_18.02.0.rc13-1_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/1/ubuntu/dists/xenial/main/binary-amd64/op-worker_18.02.0.rc13-1_amd64.deb>`_
-  * `oz-panel_18.02.0.rc13-1_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/1/ubuntu/dists/xenial/main/binary-amd64/oz-panel_18.02.0.rc13-1_amd64.deb>`_
-  * `oz-worker_18.02.0.rc13-1_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/1/ubuntu/dists/xenial/main/binary-amd64/oz-worker_18.02.0.rc13-1_amd64.deb>`_
+  * `cluster-manager_19.02.1-1~xenial_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/xenial/main/binary-amd64/cluster-manager_19.02.1-1~xenial_amd64.deb>`_
+  * `oneclient_19.02.1-1~xenial_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/xenial/main/binary-amd64/oneclient_19.02.1-1~xenial_amd64.deb>`_
+  * `oneprovider_19.02.1-1~xenial_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/xenial/main/binary-amd64/oneprovider_19.02.1-1~xenial_amd64.deb>`_
+  * `onezone_onezone_19.02.1-1~xenial_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/xenial/main/binary-amd64/onezone_onezone_19.02.1-1~xenial_amd64.deb>`_
+  * `op-panel_op-panel_19.02.1-1~xenial_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/xenial/main/binary-amd64/op-panel_op-panel_19.02.1-1~xenial_amd64.deb>`_
+  * `op-worker_19.02.1-1~xenial_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/xenial/main/binary-amd64/op-worker_19.02.1-1~xenial_amd64.deb>`_
+  * `oz-panel_19.02.1-1~xenial_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/xenial/main/binary-amd64/oz-panel_19.02.1-1~xenial_amd64.deb>`_
+  * `oz-worker_19.02.1-1~xenial_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/xenial/main/binary-amd64/oz-worker_19.02.1-1~xenial_amd64.deb>`_
+
+* Ubuntu 18.04
+
+  * `cluster-manager_19.02.1-1~bionic_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/bionic/main/binary-amd64/cluster-manager_18.02.0.rc13-1_amd64.deb>`_
+  * `oneclient_19.02.1-1~bionic_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/bionic/main/binary-amd64/oneclient_19.02.1-1~bionic_amd64.deb>`_
+  * `oneprovider_19.02.1-1~bionic_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/bionic/main/binary-amd64/oneprovider_19.02.1-1~bionic_amd64.deb>`_
+  * `onezone_onezone_19.02.1-1~bionic_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/bionic/main/binary-amd64/onezone_onezone_19.02.1-1~bionic_amd64.deb>`_
+  * `op-panel_op-panel_19.02.1-1~bionic_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/bionic/main/binary-amd64/op-panel_op-panel_19.02.1-1~bionic_amd64.deb>`_
+  * `op-worker_19.02.1-1~bionic_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/bionic/main/binary-amd64/op-worker_19.02.1-1~bionic_amd64.deb>`_
+  * `oz-panel_19.02.1-1~bionic_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/bionic/main/binary-amd64/oz-panel_19.02.1-1~bionic_amd64.deb>`_
+  * `oz-worker_19.02.1-1~bionic_amd64.deb <https://repo.indigo-datacloud.eu/repository/xdc/production/2/ubuntu/dists/bionic/main/binary-amd64/oz-worker_19.02.1-1~bionic_amd64.deb>`_
 
 * Docker Container
 
-  * `indigodatacloud/onezone <https://hub.docker.com/r/indigodatacloud/onezone/tags/>`__:XDC-1 (signed)
-  * `indigodatacloud/onezone <https://hub.docker.com/r/indigodatacloud/oneezone/tags/>`__:18.02.0-rc13
-  * `indigodatacloud/oneprovider <https://hub.docker.com/r/indigodatacloud/oneprovider/tags/>`__:XDC-1 (signed)
-  * `indigodatacloud/oneprovider <https://hub.docker.com/r/indigodatacloud/oneprovider/tags/>`__:18.02.0-rc13
-  * `indigodatacloud/oneclient <https://hub.docker.com/r/indigodatacloud/oneclient/tags/>`__:XDC-1 (signed)
-  * `indigodatacloud/oneclient <https://hub.docker.com/r/indigodatacloud/oneclient/tags/>`__:18.02.0-rc13
+  * `indigodatacloud/onezone <https://hub.docker.com/r/indigodatacloud/onezone/tags/>`__:XDC-2 (signed)
+  * `indigodatacloud/onezone <https://hub.docker.com/r/indigodatacloud/oneezone/tags/>`__:19.02.1-1
+  * `indigodatacloud/oneprovider <https://hub.docker.com/r/indigodatacloud/oneprovider/tags/>`__:XDC-2 (signed)
+  * `indigodatacloud/oneprovider <https://hub.docker.com/r/indigodatacloud/oneprovider/tags/>`__:19.02.1-1
+  * `indigodatacloud/oneclient <https://hub.docker.com/r/indigodatacloud/oneclient/tags/>`__:XDC-2 (signed)
+  * `indigodatacloud/oneclient <https://hub.docker.com/r/indigodatacloud/oneclient/tags/>`__:19.02.1-1
diff --git a/source/releases/quasar/ttt.rst b/source/releases/quasar/ttt.rst
@@ -29,8 +29,8 @@ Documentation
 
 Detailed documentation can be found at:
 
-* `TOSCA types README <https://github.com/indigo-dc/tosca-types/blob/v3.0.0/README.md>`_
-* `TOSCA templates README <https://github.com/indigo-dc/tosca-templates>`_
+* `TOSCA types README <https://github.com/indigo-dc/tosca-types/blob/master/README.md>`_
+* `TOSCA templates README <https://github.com/indigo-dc/tosca-templates/blob/master/README.md>`_
 * `Brief guide to TOSCA <https://github.com/indigo-dc/tosca-templates/blob/master/doc/tosca.md>`_
 * `How to deploy a TOSCA Template <https://github.com/indigo-dc/tosca-templates/blob/master/doc/tosca-deploy.md>`_
 

diff --git a/source/releases/quasar/ttt/v4.0.1.rst b/source/releases/quasar/ttt/v4.0.1.rst
@@ -4,42 +4,35 @@ v.4.0.1
 What’s new
 ~~~~~~~~~~
 
-This version provides many new features, improvements and bug fixes
+This version provides many new features, improvements and 
+bug fixes both in TOSCA types and templates
 
 List of RfCs
 ~~~~~~~~~~~~
 
-* New features:
-
-  * Added new types for Onedata and Dynafed storage resources
-  * Updated example templates for deploying Chronos dockerized jobs that
-    use Onedata for managing input/output data
-  * Updated example template for deploying a Mesos cluster
-  * Added example template for deploying a Mesos cluster with GPU support
-    and a tensorflow container on top of it that uses GPU(s)
-  * Added GPU support for compute nodes and dockerized jobs (chronos) and
-    apps (marathon)
-  * Added preemtible_instance property to support “spot” instances
-  * Added Onedata support in DODAS template
-  * Added new types for describing a Kubernetes cluster; new Ansible
-    roles implemented.
-  * Added new type for describing a JupyterHub node; new Ansible role
-    implemented.
-
-* Bug fixes for Galaxy on cloud:
-
-  * Update support to Galaxy release_18.05 in indigo-dc.galaxycloud
-  * Fix proftpd in indigo-dc.galaxycloud
-  * New ansible role for galaxy tools installation, named
-    indigo-dc.galaxycloud-tools
-  * Update tosca.nodes.indigo.GalaxyShedTool with new ansible role
-  * Fix CERN-VM FS reference data mount on cluster worker nodes on
-    galaxy artifacts
-  * Reworked ansible role (indigo-dc.galaxycloud-fastconfig) to
-    reconfigure an image with Galaxy already installed
-  * Reworked storage encryption script on indigo-dc.galaxycloud-os
-  * Fix tasks order in Galaxy elastic cluster tosca template: now
-    galaxy user is created before slurm configuration.
+ * TOSCA types: - Tested with **Ansible 2.6.20**
+   * New features:
+     * Added type for BlockStorage and for AttachesTo relationship
+   * Improvements
+     * Improved artifacts for Kubernetes
+
+ * TOSCA templates
+   * New features and improvements:
+     * Updated templates to ensure the compliance with Simple Profile in YAML 1.0
+       * these changes are mandatory for working with **Orchestrator version >= 2.2.0**
+     * Fixing typos (e.g. priviliged --> privileged)
+     * Deleted obsolete templates
+     * Deleted templates with hard-coded values for SLAs
+
+Installation methods
+~~~~~~~~~~~~~~~~~~~~
+ * TOSCA types are used by the PaaS Orchestrator - more details are available at:
+   * `Brief guide to TOSCA <https://github.com/indigo-dc/tosca-templates/blob/master/doc/tosca.md>`_
+   * `TOSCA types README <https://github.com/indigo-dc/tosca-types/blob/master/README.md>`_
+ * TOSCA templates are used by the PaaS Orchestrator Dashboard and directly bu users through CLIs 
+ like orchent - more details are available at:
+   * `TOSCA templates README <https://github.com/indigo-dc/tosca-templates/blob/master/README.md>`_
+   * `How to deploy a TOSCA Template <https://github.com/indigo-dc/tosca-templates/blob/master/doc/tosca-deploy.md>`_
 
 Known Issues
 ~~~~~~~~~~~~
@@ -48,5 +41,5 @@ Known Issues
 List of Artifacts
 ~~~~~~~~~~~~~~~~~
 * Tarballs:
-   * `tosca-types-3.0.0.tar.gz <https://repo.indigo-datacloud.eu/repository/deep-hdc/production/1/centos7/x86_64/tgz/tosca-types-3.0.0.tar.gz>`_
-   * `tosca-templates-3.0.0.tar.gz <https://repo.indigo-datacloud.eu/repository/deep-hdc/production/1/centos7/x86_64/tgz/tosca-templates-3.0.0.tar.gz>`_
+   * `tosca-types-4.0.1.tar.gz <https://repo.indigo-datacloud.eu/repository/deep-hdc/production/1/centos7/x86_64/tgz/tosca-types-3.0.0.tar.gz>`_
+   * `tosca-templates-4.0.1.tar.gz <https://repo.indigo-datacloud.eu/repository/deep-hdc/production/1/centos7/x86_64/tgz/tosca-templates-3.0.0.tar.gz>`_