From 2565329183789b5325656951b97127a82991fde3 Mon Sep 17 00:00:00 2001 From: Michal Simon Date: Mon, 30 Nov 2020 12:22:13 +0100 Subject: [PATCH] [Docs] Update Release Notes for 5.1.0. --- docs/PreReleaseNotes.txt | 40 +------- docs/ReleaseNotes.txt | 204 +++++++++++++++++++++++++++++---------- 2 files changed, 153 insertions(+), 91 deletions(-) diff --git a/docs/PreReleaseNotes.txt b/docs/PreReleaseNotes.txt index 3d2111d2ac5..0184579a1a9 100644 --- a/docs/PreReleaseNotes.txt +++ b/docs/PreReleaseNotes.txt @@ -6,47 +6,11 @@ Prerelease Notes ================ + **New Features** - **[SSI]** Allow client-side to request high resolution timestamps. - **[Server]** New ztn security plugin to provide a SciTokens sentinel. - **[Server]** Allow optional return of checksum in dirlist response. - **[Server]** Allow additional ports to be associated with a protocol. - **[Xcache]** Make TLS substitution for net cksum selectable. - **[Server]** Implement an internal nano-DNS for k8s setups (mostly for SSI). - **[Server]** Allow internal application push of plugin library. - **[Server]** Implement checkpointed file modifications (i.e. kXR_chkpoint). - **[Server]** Enhance the StatPF() method. - **[Xache]** Phase 1 of checksum integrity implementation (a.k.a pgread). - **[Monitoring]** Implement extensive g-stream enhancements. + **Major bug fixes** - **[TLS]** Provide thread-safety when required to do so. - **[POSIX]** Avoid returning null pointer upon failure to avoid SEGV. - **[POSIX]** Correctly initialize serverless cache to avoid SEGV. - **[Server]** Make sure that alignment is a power of two for posix_memalign. - **[SSI]** Prevent a buffer from being recycled twice leading to random errors. - **[SSI]** Avoid race condition between Finished() and Event Dispatch (causes SEGV) - **[Server]** Redo checksum changes to provide backward compatibility. - **[Server]** Correct version checking to prevent false negatives. - **[Client]** Use ntohll() for pgread offsets. - **[POSIX]** Initialize pointer when object reused to prevent memory corruption. - **[TPC]** Do not hold lock when deleting a proxy autorm TPC job that failed. - **[Server]** Fix memory leak of 64MB per checksum request. Fixes #1291 + ++ **Major bug fixes** + **Minor bug fixes** - **[Server]** Fix possible storage opverlay when dealing with TLS protocols. - **[Server]** Prevent inadvertent double load of fixed protocol. - **[POSIX]** Make sure to always return consistent stat() information. - **[cmsd]** Correct write lengths to not write null bytes to env file. - **[cmsd]** Correct parsing bug that results in an erroneous warning. - **[Server]** Fix esoteric truncation of long dirlist. Fixes #1340 - **[Server]** Do no terminate dirlist when a deleted directory is encountered. - **[Server]** When requested fully verify supplied checksums in pgwrite. + **Miscellaneous** - **[Server]** Make sure atleast one export exists in the export list. - **[cmsd]** Display the name of the named pipe being waited upon. - **[Server]** Echo the command line into the log. - **[SSI]** Allow server-side debug to be enabled via an envar. - **[cmsd]** Correctly parse osslib when it have options. - **[Xcache]** Allow origin location query to be refreshed. - **[CMS]** Ignore stacked plugin specifications as they are not supported. diff --git a/docs/ReleaseNotes.txt b/docs/ReleaseNotes.txt index 2ae25a6d441..e7f36c62a2c 100644 --- a/docs/ReleaseNotes.txt +++ b/docs/ReleaseNotes.txt @@ -7,85 +7,183 @@ Release Notes -------------- -Version 5.0.3 +Version 5.1.0 -------------- ++ **New Features** + * **[SSI]** Allow client-side to request high resolution timestamps. + * **[XCache]** Make TLS substitution for net cksum selectable. + * **[XCache]** Support pgRead and checksums. + * **[Server]** New ztn security plugin to provide a SciTokens sentinel. + * **[Server]** Allow optional return of checksum in dirlist response. + * **[Server]** Allow additional ports to be associated with a protocol. + * **[Server]** Implement an internal nano-DNS for k8s setups (mostly for SSI). + * **[Server]** Allow internal application push of plugin library. + * **[Server]** Implement checkpointed file modifications (i.e. kXR_chkpoint). + * **[Server]** Enhance the StatPF() method. + * **[Xache]** Phase 1 of checksum integrity implementation (a.k.a pgread). + * **[Monitoring]** Implement extensive g-stream enhancements. + * **[XrdCl]** Don't enforce host verification for localhost, closes #1318. + * **[XrdCl]** Allow for roots/xroots protocol in metalinks. + * **[XrdCl]** Add write API that transfers data from a FD. + * **[XrdCl]** Add write API that takes ownership of the buffer. + * **[XrdCl]** Implement redirect collapsing. + * **[XrdCl]** Add stream TTL callback. + * **[XrdCl]** xrdcp: allow write recovery at a redirector. + * **[XrdCl]** Allow negative flags in redirect port. + * **[XrdCl]** Implement PgRead. + * **[XrdCl]** Substitute PgRead with Read if the former is not supported. + * **[XrdCl]** Add a switch for disabling IP shuffling. + * **[XrdCl]** Declarative API: implement Repeat, Replace, Ignore and Stop + directives. + * **[XrdCl]** Allow exxternal components to register new topics in XrdCl::Log. + * **[XrdCl]** xrdfs ls: add option to get checksum per entry. + * **[Python]** Expose the Prepare::Evict flag, fixes #1322. + * **[XrdZip]** Add general ZIP utilities. + * **[XrdSys]** Add kernel buffer utility. + * **[XrdZip]** Provide headers implementing LFH, CDFH, ZIP64EOCD, ZIP64EOCDL + and EOCD records. + * **[CMake]** Add suitable RUNPATH to build-tree library. + * **[CMake]** Add 'plugins' phony target. + + **Major bug fixes** - **[Server]** Add missing return that breaks loading of the oss.statlib - **[Server]** Prevent SEGV upon poller error on TLS links doing async I/O. - **[Server]** Avoid SEGV when checksum response is invalid. - **[TLS]** Avoid bad behaviour when authentication fails on a TLS connection. + * **[Server]** Make sure that alignment is a power of two for posix_memalign. + * **[Server]** Redo checksum changes to provide backward compatibility. + * **[Server]** Correct version checking to prevent false negatives. + * **[Server]** When requested fully verify supplied checksums in pgwrite. + * **[Server]** Fix memory leak of 64MB per checksum request. Fixes #1291 + * **[TLS]** Provide thread-safety when required to do so. + * **[POSIX]** Avoid returning null pointer upon failure to avoid SEGV. + * **[POSIX]** Initialize pointer when object reused to prevent memory corruption. + * **[POSIX]** Correctly initialize serverless cache to avoid SEGV. + * **[TPC]** Do not hold lock when deleting a proxy autorm TPC job that failed. + * **[XrdHttp]** Prevent unterminated/corrupted headers from looping the server. + * **[PIP]** Convert egg-info into proper dist-info. + * **[XrdCl]** xrdcp: fix regression in recursive copy. + * **[XrdCl]** Use ntohll() for pgread offsets. + * **[XrdCl]** Correctly propagate TLS error message. + * **[SSI]** Prevent a buffer from being recycled twice leading to random errors. + * **[SSI]** Avoid race condition between Finished() and Event Dispatch (causes SEGV) + **Minor bug fixes** - **[Server]** Report correct owner/group in extended status. - **[XrdCl]** Fix group ownership print out in extended stat. - **[XrdPosix]** Fix _STAT_VER problem on Fedora rawhide. - **[HTTP]** Align TPC cadir procesing with HTTP to avoid config issues. Fixes #1323 + * **[XrdCl]** Create file descriptors with XrdSysFD utility. + * **[XrdCl]** Make sure kXR_attrVirtRdr flag is set properly. + * **[XrdCl]** Make sure error message does not include a null-character. + * **[XrdCl]** Fix 'xrdfs ls -l' output parsing. + * **[XrdHttp]** URI-quote outgoing opaque data for HTTP-TPC. + * **[XrdHttp]** In http mode fail the read if any error comes from the socket, + including timeout. + * **[CMake]** Set rpath for pip build. + * **[Python]** Strip the leading v from __version__. + * **[POSIX]** Make sure to always return consistent stat() information. + * **[cmsd]** Correct write lengths to not write null bytes to env file. + * **[cmsd]** Correct parsing bug that results in an erroneous warning. + * **[Server]** Fix possible storage opverlay when dealing with TLS protocols. + * **[Server]** Fix esoteric truncation of long dirlist. Fixes #1340 + * **[Server]** Do no terminate dirlist when a deleted directory is encountered. + * **[Server]** When requested fully verify supplied checksums in pgwrite. + * **[Server]** Prevent inadvertent double load of fixed protocol. + * **[PIP]** Fix WHEEL file (new line char). + * **[PIP]** Make sure pip list displays correct xrootd version. + * **[PIP]** Include the PKG-INFO in the root dir. + **Miscellaneous** - **[Server]** Correct TLS identification test for authentication protocol. - **[Server]** Pass the environment+secEntity to checksm manager. Fixes #1294 + * **[Server]** Make sure atleast one export exists in the export list. + * **[Server]** Echo the command line into the log. + * **[SSI]** Allow server-side debug to be enabled via an envar. + * **[Xcache]** Allow origin location query to be refreshed. + * **[cmsd]** Ignore stacked plugin specifications as they are not supported. + * **[cmsd]** Correctly parse osslib when it have options. + * **[cmsd]** Display the name of the named pipe being waited upon. + * **[XrdSciTokens]** Add XrdSciTokens submodule. + * **[XrdHttp]** Bump the max size for an Http header line to 16K. + * **[XrdHttp]** Per request, use curl's escaping function to match EOS practice. + * **[XrdHttp]** Make "tlsreuse off" the default. + * **[XrdCl]** Force socket error on header integrity check failure. + * **[RPM]** Add client-compat and server-compat packages, based on XRootD 4. + * **[XrdCns]** Retire the component. + * **[XrdCl]** Report version in the logs when the client lib is initialized. -------------- -Version 5.0.2 +Version 5.0.3 -------------- -+ **Major bug fixes** - **[Server]** Avoid POSC deletion when file creation fails because it exists. - **[HTTP]** Prevent secret key leakage if specified in the config file. - **[Python]** Prevent deadlock in Python bindings from XRootD.client.finalize. ++ * **Major bug fixes** + * **[Server]** Add missing return that breaks loading of the oss.statlib + * **[Server]** Prevent SEGV upon poller error on TLS links doing async I/O. + * **[Server]** Avoid SEGV when checksum response is invalid. + * **[TLS]** Avoid bad behaviour when authentication fails on a TLS connection. -+ **Minor bug fixes** - **[OFS]** Correct missparsing '+cksio' option to avoid config failure. - **[XRootD]** Correct flag reset code for esoteric ssq monitor option. - **[XrdCl]** Fix memory leak in copy process. ++ * **Minor bug fixes** + * **[Server]** Report correct owner/group in extended status. + * **[XrdCl]** Fix group ownership print out in extended stat. + * **[XrdPosix]** Fix _STAT_VER problem on Fedora rawhide. + * **[HTTP]** Align TPC cadir procesing with HTTP to avoid config issues. Fixes #1323 -+ **Miscellaneous** - **[Server]** Strip out explicit plugin version designation with nasty message. - **[Server]** Tighten requirements to display config file. - **[HTTP]** Honor the tlsreuse option. - **[HTTP]** Avoid issuing confusing messages for improbable configs. - **[TLS]** Really kill the session cache when asked. - **[Xcache]** Correct regression that killed dca option. - **[Utils]** Add SHA3 checksum to utils. - **[XrdCl]** Utils::GetHostAddresses: use shuffle insted of random_shuffle. - **[XrdCl]** xrdcp: short circuit file exists error. - **[Debian]** Add XrdClHttp plugin to xrootd-client-plugins package. - **[XrdVom]** Add symlink to libXrdHttpVOMS for backwards compatibility. ++ * **Miscellaneous** + * **[Server]** Correct TLS identification test for authentication protocol. + * **[Server]** Pass the environment+secEntity to checksm manager. Fixes #1294 + +-------------- +Version 5.0.2 +-------------- + ++ * **Major bug fixes** + * **[Server]** Avoid POSC deletion when file creation fails because it exists. + * **[HTTP]** Prevent secret key leakage if specified in the config file. + * **[Python]** Prevent deadlock in Python bindings from XRootD.client.finalize. + ++ * **Minor bug fixes** + * **[OFS]** Correct missparsing '+cksio' option to avoid config failure. + * **[XRootD]** Correct flag reset code for esoteric ssq monitor option. + * **[XrdCl]** Fix memory leak in copy process. + ++ * **Miscellaneous** + * **[Server]** Strip out explicit plugin version designation with nasty message. + * **[Server]** Tighten requirements to display config file. + * **[HTTP]** Honor the tlsreuse option. + * **[HTTP]** Avoid issuing confusing messages for improbable configs. + * **[TLS]** Really kill the session cache when asked. + * **[Xcache]** Correct regression that killed dca option. + * **[Utils]** Add SHA3 checksum to utils. + * **[XrdCl]** Utils::GetHostAddresses: use shuffle insted of random_shuffle. + * **[XrdCl]** xrdcp: short circuit file exists error. + * **[Debian]** Add XrdClHttp plugin to xrootd-client-plugins package. + * **[XrdVom]** Add symlink to libXrdHttpVOMS for backwards compatibility. -------------- Version 5.0.1 -------------- + **Major bug fixes** - **[CMS]** Use correct adminpath for creating Unix socket. Fixes #1255 - **[HTTP]** Correctly handle certs relative to refcount to avoid SEGV. - **[HTTP]** Escape pathnames in HTTP and XML responses. - **[Xcache]** Add missing initializer to avoid malloc() abort. - -+ **Minor bug fixes** - **[VOMS]** Correct use of undocumented API that caused hang w/ dbg. Fixes #1245 - **[GSI]** Use the storage deallocator that matches the allocator. - **[TPC]** Fix potential null pointer dereference on Push. - **[XrdOuc]** Fix XrdOucUtils::Sanitize not sanitizing the first character in + * **[CMS]** Use correct adminpath for creating Unix socket. Fixes #1255 + * **[HTTP]** Correctly handle certs relative to refcount to avoid SEGV. + * **[HTTP]** Escape pathnames in HTTP and XML responses. + * **[Xcache]** Add missing initializer to avoid malloc() abort. + ++ * **Minor bug fixes** + * **[VOMS]** Correct use of undocumented API that caused hang w/ dbg. Fixes #1245 + * **[GSI]** Use the storage deallocator that matches the allocator. + * **[TPC]** Fix potential null pointer dereference on Push. + * **[XrdOuc]** Fix XrdOucUtils::Sanitize not sanitizing the first character in the string. -+ **Miscellaneous** - **[SSI]** Forward port LSST request scaler with auto-tuning. - **[HTTP]** Enable session cache by default, provide http.tlsreuse directive. - **[cmsd]** Reimplement affinity algorithm using verified LSST mechanism. - **[CMS]** Allow redirect to local filesystem when using HTTP. - **[Mon]** Rationalize UDP packet sequence numbers. - **[Server]** Adding fbuff argument to monitoring to restrict maximum size of ++ * **Miscellaneous** + * **[SSI]** Forward port LSST request scaler with auto-tuning. + * **[HTTP]** Enable session cache by default, provide http.tlsreuse directive. + * **[cmsd]** Reimplement affinity algorithm using verified LSST mechanism. + * **[CMS]** Allow redirect to local filesystem when using HTTP. + * **[Mon]** Rationalize UDP packet sequence numbers. + * **[Server]** Adding fbuff argument to monitoring to restrict maximum size of fstream packet. - **[XrdHttp/XrdVoms]** Pass parameters specified in the http.secxtractor down the + * **[XrdHttp/XrdVoms]** Pass parameters specified in the http.secxtractor down the chain. - **[XrdCrypto/XrdHttp]** Extract DN from user (proxy, multi-proxy) certificate and + * **[XrdCrypto/XrdHttp]** Extract DN from user (proxy, multi-proxy) certificate and properly handle the gridmap-file functionality when accessing through HTTP. - **[XrdHttp]** Add "required" parameter to the http.secxtractor and http.gridmap + * **[XrdHttp]** Add "required" parameter to the http.secxtractor and http.gridmap configuration directives. - **[xrootdfs]** Set XrdSecEntity.uid/gid in xrootdfs. + * **[xrootdfs]** Set XrdSecEntity.uid/gid in xrootdfs. -------------- Version 5.0.0