Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature release 4.10.0 #977

Closed
simonmichal opened this issue May 7, 2019 · 14 comments
Closed

Feature release 4.10.0 #977

simonmichal opened this issue May 7, 2019 · 14 comments
Assignees
Milestone

Comments

@simonmichal
Copy link
Contributor

simonmichal commented May 7, 2019

Dear XRootD community,

4.10.0 is on the horizon hence I'm creating this issue so we have a place where we can discuss the upcoming release.

As this is a feature release I'll create it base on what we have in master so everything gets in. If you are curious about what's new, here's the full list of commits:

050f446 [CI] remove ubuntu artful, part 2.
83f93fb [CI] remove ubuntu artful build
cfdf448 [Server] Additional refinements for controlling server reselection.
9fd293c [Python] Expose chunked dirlist API in Python
dcf2db7 Add missing header to the public list.
24107b5 [Server] Add missing plugins to the plugin rule list.
fbf463f [CMSD] Allow redirect when limit exceeded in sched directive.
1e966a0 [Server] Correct comment.
878d983 [XrdCl] Enhancements for ZIP archive ls
ca897dc [XrdCl] Don't repeatedly release SID when handling chunked response.
1b67616 Check for errors during XrdOssFile::FSync - do not write cinfo file if it fails.
6cf7df9 Update notes on cache managetment object update.
32c8602 [POSIX] Add methods to the cache mngt objecT to get status of a cached file.
cc83c09 [XrdCl] Implement streaming dirls, closes #225
74c6a6c [Server] Yet another persing fix.
482c973 [Server] Fix parsing error.
d3e9fdd Update notes on caching improvements.
8854b4c [Server] Allow better handling for proxy caching clusters.
a22f924 Test glob on realy xrootd files
16f2278 Rewrite things so main funcion is the generator, which the list version uses, Add docstrings too
c269956 Rewrite tests so they actually check xrootd
529cabc Init rTry to -1 so default gets used when value is not set in config file.
2248d94 Improve the unit tests
ca8bd9f Add raise_error option
6471456 Test output matches normal glob for both
3afe945 Test the new glob_funcs and match their output to standard python glob
234f233 Rename glob module to glob_funcs so we can still import the module
49a89c3 Move the glob file into client
0d4ef0d [XrdCl] Fix: ClassicCopyJob segvs in absence of progress bar.
d0a7a28 [CI] Fix periodic builds.
e82e277 [XrdCl] Retry policy changes.
83d8e25 [CI] Add XrdClHttp to periodic builds and release.
c999269 [XrdCl] According to spec kXR_Overloaded should be retriable.
fd8edfd [SSI] Close loophole between internal "provision" and Finished() calls.
66b3e3b [Server] Squelch gcc tabbing compliant. Fixes #961
4546ddb [SSI] Fix atomic variable initialization.
7b26d90 [SSI] Improve debugging, remove extraneous event clearing.
217d07f Have TPC redirect based on the full URL.
185c9a3 Make full resource plus opaque info available to plugin handler.
553fdbc Redirect clients based on the full URL, not just the resource.
31a3044 Always query dual stack for HTTP TPC.
5deb156 [CI] Add XrdClHttp to CI builds.
38a36c3 [RPM] Make sure XrdClHttp is on the latest commit.
112078e [RPM] Add xrdcl-http package.
8d87336 [XrdClHttp] Add XrdClHttp submodule.
ab1fa57 [Server] Fix macosx build
2bb13e4 [XrdCl] Allow to cancel classical copy jobs.
2372090 Allow cms.dfs retries to be set to 0.
4b9fa74 [XCache] Implement write-queue number of blocks / threads config options. (#963)
28af21e [CMake] Enable by default rpaths on MacOSX.
80d5fd6 [CMake] enable rpaths on MacOSX.
3e45406 [XrdCl] Fix OSX compilation warrning.
2570a38 [Docs] Sync release notes.
0bb70d3 [XrdCl] Retry policy changes.
e69790e [XrdCl] Use DirList with Merge flag in xrdcp.
c799b82 [XrdCl] Improve CopyProcess logging on checksum error.
a3ad80d [XrdCl] Use DirList with Locate flag in xrdcp.
3c2509e [XrdCl] Enhance redirect back-trace output.
ed92986 [XrdCl] Preserve tried/triedrc cgi info on redirect for kXR_locate request, #closes #944
b1c3f22 [Python] Respect pip python version when installing xrootd, fixes #955.
138995c [Python] respect pip --user switch, fixes #952
b84d81a [Server] Use correct directory path creation flag in kXR_open (compatible).
d0eca52 [XrdCl] Make sure released SID is valid object.
578abaa [XrdCl] Fix double delete of response.
b85bccc Interact with json-c appropriately for request.
25a729f Allow admin to customize default macaroons authz.
df98297 [XrdTpc] Only use Curl's low-speed-limit with libcurl v7.38 and later
75536b0 Create macaroon with proper caveats and path.
cc88980 Do not accept more data than specified in the HTTP request.
f15ea88 Log user caveats with macaroon generation.
b305309 XrdHttp does not support chunked encoding; respond appropriately.
0421cef [POSIX] Fix string scoping issues in debug messages.
d92c656 Update notes on posc sync level control.
32d62e4 [Server] Allow configurable posc sync level.
64289d1 [XrdCl] Use correct flag to remove handler in inqueue.
aa5771b [XrdCl] Fix memory leak in AsyncSocketHandler.
23885eb secgsi: downgrade error msg from key file issues to DEBUG
7c42bfc secgsi: improve buffer content dumps for debugging purposes
48d3aed secgsi: fine tune message bucket content
7fe4dce secgsi: make sure options for proxy saving to file are honored
a473a90 secgsi: add missing entries in gsiClientStesp and gsiServerSteps
b635771 [XrdCl] Expose prepare abort and query prepare.
4380e37 [XrdCl] Log properly kXR_waitresp, closes #852
8c0cfe3 Use %lu and cast to unsigned long instead of using %zu
67799a3 Fix slc6 build.
5149d02 Fix builds.
315fc8e [Server] Correct unset variable error.
cd038d8 Add new header file to rpm spec for preplib changes.
dfc54c1 Update notes on prepare plug-in.
1725def [Server] Implement framework for a kXR_prepare plug-in.
27220fb Cleanup full file cache checking for impending read redirect.
577def4 [Server] Support direct cache access if client is capable of it (step 1).
6d5162a Fix compilation errors
de59969 [Docs] Sync release notes.
8128763 Handle clients that request multiple checksums.
a8c7110 Add standalone pyxrootd setup script
e77426f Add a first attempt at a glob file

Please let me know if there are any show stoppers?
(personally I want a fix for #976)

Cheers,
Michal

@simonmichal simonmichal added this to the 4.10.0 milestone May 7, 2019
@simonmichal simonmichal self-assigned this May 7, 2019
@bbockelm
Copy link
Contributor

bbockelm commented May 8, 2019

Nothing additional is pending from my side. Folks are just starting to test the 4.9.x series.

@osschar - how close are we to getting the per-directory monitoring done?

@osschar
Copy link
Contributor

osschar commented May 9, 2019

I will try to add proper handling of file sync errors.

@bbockelm the collection code is ready since a while and @abh just put infrastructure for the new g-stream into version 5 branch. I hope to get all the pieces together sort of soonish, ie., first version before the XRootd workshop.

@simonmichal
Copy link
Contributor Author

The XRootD 4.10.0 release candidate 1 has been tagged:
https://github.com/xrootd/xrootd/releases/tag/v4.10.0-rc1

The source RPM is available at:
http://xrootd.cern.ch/sw/releases/4.10.0-rc1/rpms/source

The RPMs are available in the XRootD testing repositories:
http://xrootd.org/binaries/xrootd-testing-slc6.repo
http://xrootd.org/binaries/xrootd-testing-slc7.repo

@bbockelm
Copy link
Contributor

Hi @simonmichal -

I think #988 is a new issue that needs to be fixed before 4.10.0 final. Should have a PR ready in about 24 hours.

Brian

@bbockelm
Copy link
Contributor

I believe #989 fixes the reported issue; works out in testing on a developer VM.

@bbockelm
Copy link
Contributor

@simonmichal - how's the release process going?

@simonmichal
Copy link
Contributor Author

@bbockelm : sorry for the delay, we just finished XRootD workshop, which was rather time-consuming. I'll have a close look tomorrow, however my intuition today is that we will have rc3 this week and release next week.

@simonmichal
Copy link
Contributor Author

The XRootD 4.10.0 release candidate 4 has been tagged:
https://github.com/xrootd/xrootd/releases/tag/v4.10.0-rc4

The source RPM is available at:
http://xrootd.cern.ch/sw/releases/4.10.0-rc4/rpms/source

The RPMs are available in the XRootD testing repositories:

http://xrootd.org/binaries/xrootd-testing-slc6.repo
http://xrootd.org/binaries/xrootd-testing-slc7.repo

@bbockelm
Copy link
Contributor

bbockelm commented Jul 1, 2019

What's the latest news on the release process?

@simonmichal
Copy link
Contributor Author

@bbockelm : we are trying to resolve one last issue for Alice and then we will have next RC (hopefully the last one).

@xrootd-dev
Copy link

xrootd-dev commented Jul 2, 2019 via email

@simonmichal
Copy link
Contributor Author

The XRootD 4.10.0 release candidate 5 has been tagged:
https://github.com/xrootd/xrootd/releases/tag/v4.10.0-rc5

The source RPM is available at:
http://xrootd.cern.ch/sw/releases/4.10.0-rc5/rpms/source

The RPMs are available in the XRootD testing repositories:
http://xrootd.org/binaries/xrootd-testing-slc6.repo
http://xrootd.org/binaries/xrootd-testing-slc7.repo

(unless a critical issue will be discovered, the plan is to cut the release in the middle of next week)

@bbockelm
Copy link
Contributor

@simonmichal @ffurano - you might want to at least make a release note of the following bug in RC5:

#1024

Basically, if a URL has opaque information and results in a redirect, the opaque info is included twice (the first time unquoted). So, the URL with path:

/foo?baz=1 1

will get redirected to:

/foo?baz=1 1?baz=1%201

@simonmichal
Copy link
Contributor Author

simonmichal commented Jul 15, 2019

Dear XRootD community,

The XRootD 4.10.0 feature release has been tagged. Please follow the link below for more details.
http://xrootd.org/2019/07/15/announcement_4_10_0.html

Please note that following PRs have been included in 4.10.0 release: #1007 #1019 #1023 #1024

Thank you all for testing and valuable input :-)

Cheers,
Michal

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants