Merge pull request #7 from extreme-datacloud/preview

Preview
extreme-datacloud · Jan 22, 2019 · cacde2a · cacde2a
2 parents 56e2568 + 61c76d8
commit cacde2a
Show file tree

Hide file tree

Showing 9 changed files with 140 additions and 25 deletions.
diff --git a/source/releases/pulsar/cod.rst b/source/releases/pulsar/cod.rst
@@ -25,6 +25,5 @@ Support
 -------
 
 - GitHub issues: https://github.com/Cloud-PG/CachingOnDemand/issues
-
 - XDC project’s internal support ticketing system: http://jira.extreme-datacloud.eu/
 
diff --git a/source/releases/pulsar/dcache.rst b/source/releases/pulsar/dcache.rst
@@ -29,6 +29,5 @@ Support
 -------
 
 - GitHub issues: https://github.com/dCache/dcache/issues
-
 - XDC project’s internal support ticketing system: http://jira.extreme-datacloud.eu/
 
diff --git a/source/releases/pulsar/dynafed.rst b/source/releases/pulsar/dynafed.rst
@@ -3,7 +3,18 @@ Dynafed
 
 .. contents:: Table of Contents
 
-**Description of Dynafed**
+The **Dynamic Federations system** allows to expose via HTTP and WebDAV a very fast dynamic name
+space, built on the fly by merging and caching (in memory) metadata items taken from a number of
+(remote) endpoints.
+
+One of its fundamental features is to be redirect GET/PUT requests to the site or cluster
+hosting the requested file that is closer to the client that requested it. The focus is on
+performance, scalability and realtime fault resilience with respect to sites that can go
+offline.
+
+From the perspective of a normal user, HTTP and WebDAV clients can browse the Dynamic Federation
+as if it were a unique partially cached name space, which is able to redirect them to the right
+host when they ask for a file replica. Dynafed also supports writing. [`more <http://lcgdm.web.cern.ch/dynafed-dynamic-federation-project>`_]
 
 Release Notes
 -------------
@@ -16,11 +27,13 @@ Release Notes
 
 Documentation
 -------------
+Detailed documentation is available at:
+
+* `Dynafed - The Dynamic Federation project <http://lcgdm.web.cern.ch/dynafed-dynamic-federation-project>`_
 
 Support
 -------
 
-- GitHub issues: 
-
-- DEEP project’s internal support ticketing system: http://jira.extreme-datacloud.eu/
-
+* through `GGUS <https://ggus.eu/>`_ by using the `Dynafed Development <https://wiki.egi.eu/wiki/GGUS:Dynafed_Development_FAQ>`_ Support Unit
+* Dynafed User Forum mailing-list: dynafed-users-forum (cern.ch)
+* XDC project’s internal support ticketing system: http://jira.extreme-datacloud.eu/
diff --git a/source/releases/pulsar/dynafed/v1.3.3.rst b/source/releases/pulsar/dynafed/v1.3.3.rst
@@ -4,17 +4,27 @@ v1.3.3
 What’s new
 ~~~~~~~~~~
 
-- add
+Dynafed **1.3.3** allows configuration of multiple concurrent authentication systems via
+separate namespace prefixes. It supports OpenID Connect, both as a Relying Party (redirecting
+a browser to an IdP) and Protected Resource (consuming oauth access tokens for non-interactive
+access). This is configured through Apache's mod_auth_openidc.
+More information on the `"Authentication and Authorisation" section of documentation <https://svnweb.cern.ch/trac/lcgdm/wiki/Dynafeds>`_ 
 
 List of RfCs
 ~~~~~~~~~~~~
-* N/A
+* `XSD-31 <https://jira.extreme-datacloud.eu/browse/XSD-31>`_ - Enable oauth2.0 for accessing Dynafed
 
 Known Issues
 ~~~~~~~~~~~~
 
-* None
+* N/A
 
 List of Artifacts
 ~~~~~~~~~~~~~~~~~
-* CentOS-7 RPMS
+* CentOS-7 RPMS - in group `applications/internet <http://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/applications.internet.group.html>`_
+  * dynafed - Ultra-scalable dynamic system for federating HTTP-based storage resources
+  * dynafed-dmlite-frontend - dmlite plugin for dynafed
+  * dynafed-dmlite-plugin - dmlite plugin for dynafed
+  * dynafed-http-plugin - Http and WebDav plugin for dynafed
+  * dynafed-lfc-plugin - Logical File catalog (LFC) plugin for dynafed
+  * dynafed-private-devel - Development files for dynafed 
diff --git a/source/releases/pulsar/eos.rst b/source/releases/pulsar/eos.rst
@@ -3,7 +3,9 @@ EOS
 
 .. contents:: Table of Contents
 
-**Description of EOS**
+**EOS** is an open-source storage software solution to manage multi PB storage for the CERN
+Large Hadron Collidor LHC. Core of the implementation is the XRootD framework providing a
+feature-rich remote access protocol.
 
 Release Notes
 -------------
@@ -17,10 +19,32 @@ Release Notes
 Documentation
 -------------
 
+Detailed documentation is available at:
+
+* `EOS - OpenStorage Documentation <https://eos-docs.web.cern.ch/eos-docs/>`_
+
+  * information specific to XDC features can be found under the sections:
+
+    * "Configuration" (setting a Filesystem to use logical path)
+    * "Using EOS" (describing the adoption of storage/files process)
+    * "Client Commands" (the command to trigger the import [adoption] procedure). 
+
+Deployment automation:
+----------------------
+
+Puppt modules available for:
+
+* EOS server module: https://gitlab.cern.ch/ai/it-puppet-module-eosserver/
+* Example files for setting up the namespace node and the storage node:
+
+  * https://gitlab.cern.ch/ai/it-puppet-hostgroup-eos/blob/qa/data/hostgroup/eos/home/i00/ns.yaml
+  * https://gitlab.cern.ch/ai/it-puppet-hostgroup-eos/blob/qa/data/hostgroup/eos/home/i00/storage.yaml
+
+
 Support
 -------
 
-- GitHub issues: 
+- EOS tracking: https://its.cern.ch/jira/projects/EOS/issues/ 
 
-- DEEP project’s internal support ticketing system: http://jira.extreme-datacloud.eu/
+- XDC project’s internal support ticketing system: http://jira.extreme-datacloud.eu/
 
diff --git a/source/releases/pulsar/eos/v4.4.rst b/source/releases/pulsar/eos/v4.4.rst
@@ -1,20 +1,83 @@
-v1.3.3
+v4.4
 ------------
 
 What’s new
 ~~~~~~~~~~
 
-- add
+
+* Update of remote IO objects for S3, WebDav and XRootd.
+
+  * Used by EOS to communicate with external endpoints
+  * Allows EOS to create filesystems whose storage is residing at a remote endpoint, instead of a local disk.
+* Implementation of logical path translation.
+
+  * So far, the path of every EOS file (so called 'physical path') is generated from the File Id of that file within the namespace. This feature allows EOS to store files having their physical location the same as their logical location in the namespace. E.g.: /eos/test/myfile on filesystem 1 will be stored at /<filesystem1_basepath>/eos/test/myfile 
+  * The logical path information is stored as file extended attributes within the EOS namespace
+  * Path translation utility class, to help deciphering paths for both cases
+
+* Filesystem config options: s3credentials and logicalpath 
+
+  * Two new filesystem config options were added.
+  * s3credentals=<accesskey>:<secretkey> Sets the S3 access credentials for this filesystem
+  * logicalpath=1|0 Flag to indicate whether this filesystem uses logical path or not
+  * S3 settings can be configured FST-wide, via environment variables or on a filesystem-by-filesystem basis, via `fs config`
+
+* Implementation of file adoption
+
+  * Allows scanning an endpoint accessible by a filesystem and import all the discovered files into the EOS namespace
+  * Management of these files, upon importation, can be done fully through EOS
+  * A new command to trigger the file adoption is available, called `fs import`. It offers the `fs import start` command to trigger the import process. When triggered, an UUID is associated with the operation. The `fs import query <id>` command can be used to check the status of an on-going import operation
+
+* External storage tests
+  * External storage test script is provided to test the file adoption functionality
+  * A new Gitlab pipeline job is set up to run this script on every commit
+
+* Documentation
+  * Documentation for logical path and import functionality are provided on the eos-docs website
+
 
 List of RfCs
 ~~~~~~~~~~~~
-* N/A
+
+* `XSD-61 <https://jira.extreme-datacloud.eu/browse/XSD-61>`_ - Identity Forwarding plugin between XCache and EOS
+* `XSD-62 <https://jira.extreme-datacloud.eu/browse/XSD-62>`_ - VOMS integration for XCache testbed
+* `XSD-63 <https://jira.extreme-datacloud.eu/browse/XSD-63>`_ - VOMS security extractor for XrdHttp
+* `XSD-73 <https://jira.extreme-datacloud.eu/browse/XSD-73>`_ - File traversal over HTTP
+* `XSD-74 <https://jira.extreme-datacloud.eu/browse/XSD-74>`_ - Mechanism to import a file into the EOS namespace
+* `XSD-75 <https://jira.extreme-datacloud.eu/browse/XSD-75>`_ - Allow EOS to use logical path
+* `XSD-76 <https://jira.extreme-datacloud.eu/browse/XSD-76>`_ - System tests for adoption of external storage/files
+* `XSD-147 <https://jira.extreme-datacloud.eu/browse/XSD-147>`_ - Implement status query of import procedure
 
 Known Issues
 ~~~~~~~~~~~~
 
-* None
+* N/A
 
 List of Artifacts
 ~~~~~~~~~~~~~~~~~
-* CentOS-7 RPMS
+* CentOS-7 RPMS
+
+  * in group `applications/file <http://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/applications.file.group.html>`_
+
+    * eos-archive - The EOS archive daemon
+    * eos-cleanup - The EOS test package
+    * eos-client - The EOS shell client
+    * eos-fuse - The new EOS fuse client
+    * eos-fuse-core - The EOS fuse client
+    * eos-fuse-sysv - The EOS fuse client
+    * eos-fusex - The new EOS fuse client
+    * eos-fusex-core - The new EOS fuse client
+    * eos-fusex-selinux - The new EOS fuse client selinux configuration
+    * eos-server - The EOS server installation
+    * eos-srm - The EOS srm script package for checksumming and space
+    * eos-test - The EOS test package
+    * eos-testkeytab - The EOS testkeytab package
+
+
+  * in `applications/internet <http://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/applications.internet.group.html>`_
+
+    * eos-admin-gui - Web Interface for EOS administration 
+
+  * in `Development/Debug <http://repo.indigo-datacloud.eu/repository/xdc/production/1/centos7/x86_64/base/repoview/development.debug.group.html>`_
+
+    *  eos-debuginfo - Debug information for package eos 
diff --git a/source/releases/pulsar/fts/v3.9.0.rst b/source/releases/pulsar/fts/v3.9.0.rst
@@ -1,4 +1,4 @@
-v1.3.3
+v3.9.9
 ------------
 
 What’s new

diff --git a/source/releases/pulsar/onedata/v18.02.0-rc13.rst b/source/releases/pulsar/onedata/v18.02.0-rc13.rst
@@ -1,4 +1,4 @@
-v1.3.3
+v18.02.0-rc13
 ------------
 
 What’s new
@@ -17,4 +17,8 @@ Known Issues
 
 List of Artifacts
 ~~~~~~~~~~~~~~~~~
-* CentOS-7 RPMS
+* CentOS-7 RPMS
+  *
+* Ubuntu 16.04
+  * 
+* Docker container
diff --git a/source/releases/pulsar/paas-orchestrator.rst b/source/releases/pulsar/paas-orchestrator.rst
@@ -16,10 +16,13 @@ Release Notes
 
    paas-orchestrator/*
 
-Documentation
--------------
+Detailed documentation is available at:
+
+* `GitHub README <https://github.com/indigo-dc/orchestrator/blob/v2.1.1-FINAL/README.md>`_
+* `GitBook Guides <https://indigo-dc.gitbooks.io/indigo-paas-orchestrator/content/>`_
 
 Support
 -------
 
-
+* GitHub issues: https://github.com/indigo-dc/orchestrator/issues
+* DEEP project’s internal support ticketing system: http://jira.deep-hybrid-datacloud.eu/