Merge branch 'master' into throttles_v2

Conflicts:
	src/XrdSys/XrdSysAtomics.hh

docs/PreReleaseNotes.txt

@@ -4,3 +4,76 @@ XRootD
 
 Prerelease Notes
 ================
+
++ **New Features**
+   * Implement full readv-passthru for enhanced performance (B. Bockleman,
+     UNL). This breaks SFS and OSS plugin ABI compatibility. It also
+     introduces a new method to the POSIX interface.
+   * Allow NSWalk error messages to be routed to stderr for use by command
+     line tools.
+   * Add a disconnect record to the f-stream.
+   * Add --infiles option to xrdcp (and follow-ons) to accept a list of input
+     files via an external file. For the current xrdcp only 1 input file is
+     allowed (xrdcopy has no such restriction).
+   * Allow autloading of checksum plugins (this is for clients).
+   * Make it obvious that version info is mandatory (use references).
+   * Add new object to format and route error messages to multiple
+     destinations.
+   * Allow clients to easily load checksum objects via XrdCksLoader object.
+
++ **Major bug fixes**
+   * Fix various parse issues in CpConfig. Allow -T {first|only}.
+   * Do not rely in file locking to serialize inter-thread access. This
+     fixes the prolem of usage file drift.
+   * Correct calculation of polltab entries when using poll() type poll.
+     This fixes MacOS bug 99882.
+   * Fix various parse context issues in copy config with --recursive.
+   * Only use the callback dispatcher ending state to determine whether the
+     channel should be excluded from the poll set to avoid referencing
+     deleted memory should the callback delete its own channel.
+   * Recognize object deletion in the error handling path.
+   * Add missing return statement to avoid SEGV during write error recovery
+     under certain circumstances. Fixes bug 99002.
+   * Add mutex serialization so as not to use only fcntl() locking
+     as a synchronization primitive across threads. It doesn't work
+     in Linux.
+
++ **Minor bug fixes**
+   * Do not use static structs when refering to stack allocated variable.
+   * Do not create the PrepQ Netsg object in the constructor as this may
+     cause a SEGV should that fail as the PrepQ object is a static global.
+   * Avoid garbled message by using stable storage for message insert.
+   * Fix a post 3.1.1 regression that dropped "refresh" from kXR_locate.
+   * Allow extended host specification as input to TPC.
+   * Add missing instance of XrdPosixXrootd to allow local calculation
+     of checksum for a remote file and increase read size to 1MB. This
+     completes fix for problem 99711.
+   * Do not reflect an error if we actually ended a successful checksum.
+     This only applies to checksums that are externally computed and
+     partially solves problem 99711.
+   * Make sure to include unistd.h, this is a problem when this header
+     is independently used. Patch by Brian Bockelman, UNL.
+   * Fix garbled plugin message.
+   * Avoid lost memory and correct computation of env length. This also fixes
+     bug 99375.
+   * Correct midnight calculation to properly account for time shifts.
+   * Make sure error messages generated in a fork during stream execution
+     appear in the log.
+   * Return error message text to the client when a checksum fails.
+   * Reject checksums on anything that isn't a regular file.
+   * Allow for null fields in the cgi string.
+   * Remove non-atomic AtomicDTZ and AtomicISM macros.
+   * Do not use AtomicDTZ and AtomicISM so as to keep LinkCount and
+     LinkCountMax updates truly atomic. The mentioned atomic macros
+     should be removed at the next release boundary as this will
+     change a public user interface.
+   * Properly recognize a loaded checksum as a native checksum.
+
++ **Miscellaneous**
+   * Allow stdin as a source in the xrdcp front-end parser. Do not
+     compute doff for non-local sources.
+   * Final change to f-stream monitoring. Replace standard deviation
+     (sdv) calc with reporting sum of squares (ssq) counts.
+   * Remove beta warning from xrdcp after xrdcpy became xrdcp.
+   * Pretty up an error message. Required XrdOucERoute patch.
+

docs/man/xrdcpy.1 → docs/man/xrdcopy.1

@@ -1,10 +1,10 @@
-.TH xrdcp 1 "31 March 2012"
+.TH xrdcopy 1 "30 November 2012"
 .SH NAME
-xrdcp - copy files
+xrdcopy - copy files
 .SH SYNOPSIS
 .nf
 
-\fBxrdcp\fR [\fIoptions\fR] \fIsource\fR \fIdestination\fR
+\fBxrdcopy\fR [\fIoptions\fR] \fIsource\fR \fIdestination\fR
 
 \fIoptions\fR: [\fB--cksum\fR \fIargs\fR] [\fB--debug\fR \fIlvl\fR] [\fB--coerce\fR] [\fB--force\fR]
 [\fB--help\fR] [\fB--license\fR] [\fB--nopbar\fR] [\fB--posc\fR] [\fB--proxy \fIipaddr\fB:\fIport\fR]
@@ -19,7 +19,7 @@ xrdcp - copy files
 .br
 .ad l
 .SH DESCRIPTION
-The \fBxrdcp\fR utility copies one or more files from one location to
+The \fBxrdcopy\fR utility copies one or more files from one location to
 another. The data source and destination may be a local
 or remote file or directory.  Additionally, the data source may also reside
 on multiple servers.
@@ -59,7 +59,7 @@ displays license terms and conditions.
 
 .RE
 {\fB-N\fR | \fB--nopbar\fR}
-.RS5
+.RS 5
 does not display the progress bar.
 
 .RE
@@ -82,7 +82,7 @@ recursively copy all files starting at the given source directory. This option i
 
 .RE
 \fB--server\fR
-.RS5
+.RS 5
 runs as if in a server environment. Used only for server-side
 third party copy support.
 
@@ -192,56 +192,123 @@ name suffixed by /, or an xrootd URL in the form
 The \fIabsolutepath\fR can be a directory.
 
 .RE
-.SH EXAMPLES (GENERIC)
-.TP
-local file upload:
-.br
-.B $ xrdcp /tmp/myfile xroot://foo.bar.com//data/myfile
-.br
-.TP
-remote file download:
-.br
-.B $ xrdcp xroot://foo.bar.com//data/myfile /tmp/myfile
-.br
-.TP
-remote-remote copy:
-.br
-.B $ xrdcp xroot://foo.bar.com//data/myfile1 xroot://foo.bar.com//data/myfile2
-.br
-.fi
-.br
-.ad l
-.SH EXAMPLES (CASTOR)
-.TP
-local file upload to a Castor instance using a specific service class and stager:
-.br
-.B $ xrdcp /tmp/myfile root://<stagerhost>.cern.ch//castor/cern.ch/data/myfile -ODstagerHost=$STAGE_HOST&svcClass=$STAGE_SVCCLASS
-.br
-[ you need to escape the '&' in the shell ]
-.TP
-remote file download from a Castor instance using a specific stager:
-.br
-.B $ xrdcp /tmp/myfile root://<stagerhost>.cern.ch//castor/cern.ch/data/myfile -OSstagerHost=$STAGE_HOST
-.TP
-client-proxy copy to-/from- a Castor instance:
-.br
-.B $ xrdcp
-.br
-.B root://<stagerA>.cern.ch//castor/cern.ch/data/stagerA/myfile -OSstagerHost=<stagerA>
+
+.SH ENVIRONMENT
+The following environment variables are supported.
 .br
-.B root://<stagerB>.cern.ch//castor/cern.ch/data/stagerB/myfile -ODstagerHost=<stagerA>
+
+XRD_LOGLEVEL
+.RS 5
+Detemines the amout of diagnostics that should be printed. Valid values are:
+\fIDump\fR, \fIDebug\fR, \fIInfo\fR, \fIWarning\fR, and \fIError\fR.
+.RE
+
+XRD_LOGFILE
+.RS 5
+If set, the diagnostics will be printed to the specified file instead of stderr.
+.RE
+
+XRD_LOGMASK
+.RS 5
+Determines which diagnostics topics should be printed at all levels. It's a
+"|" separated list of topics. The first element may be "All" in which case
+all the topics are enabled and the subsequent elements may turn them off, or
+"None" in which case all the topics are disabled and the subsequent flags may
+turn them on. If the topic name is prefixed with "^", then it means that
+the topic should be disabled. If the topic name is not prefixed, then it means
+that the topic should be enabled.
 .br
+
+The log mask may as well be handled for each diagnostic level separately by
+setting one or more of the following variables: \fIXRD_LOGMASK_ERROR\fR,
+\fIXRD_LOGMASK_WARNING\fR, \fIXRD_LOGMASK_INFO\fR, \fIXRD_LOGMASK_DEBUG\fR,
+and \fIXRD_LOGMASK_DUMP\fR. The default for each level is "All", except
+for the \fIDump\fR level, where the default is "All|^PollerMsg". This means
+that, at the \fIDump\fR level, all the topics but "PollerMsg" are enabled.
 .br
-[ you cannot copy between stagers using the same logical filename in the castor namespace! ]
+
+Available topics: AppMsg, UtilityMsg, FileMsg, PollerMsg, PostMasterMsg,
+XRootDTransportMsg, TaskMgrMsg, XRootDMsg, FileSystemMsg, AsyncSockMsg
+.RE
+
+
+XRD_CONNECTIONWINDOW
+.RS 5
+A time window for the connection establishment. A connection failure is declared if
+the connection is not established within the time window. If a connection failure
+happens earlier then another connection attempt will only be made at the beginning
+of the next window.
+.RE
+
+XRD_CONNECTIONRETRY
+.RS 5
+Number of connection attempts that should be made (number of available connection
+windows) before declaring a permanent failure.
+.RE
+
+XRD_REQUESTTIMEOUT
+.RS 5
+Default value for the time after which an error is declared if it was impossible
+to get a response to a request.
+.RE
+
+XRD_SUBSTREAMSPERCHANNEL
+.RS 5
+Number of streams per session.
+.RE
+
+XRD_TIMEOUTRESOLUTION
+.RS 5
+Resolution for the timeout events. Ie. timeout events will be
+processed only every XRD_TIMEOUTRESOLUTION seconds.
+.RE
+
+XRD_STREAMERRORWINDOW
+.RS 5
+Time after which the permanent failure flags are cleared out and a new connection
+may be attempted if needed.
+.RE
+
+XRD_RUNFORKHANDLER
+.RS 5
+Determines whether the fork handlers should be enabled, making the API fork safe.
+.RE
+
+XRD_REDIRECTLIMIT
+.RS 5
+Maximum number of allowed redirections.
+.RE
+
+XRD_POLLERPREFERENCE
+.RS 5
+A comma separated list of poller implementations in order of preference. The
+default is: libevent,built-in.
+.RE
+
+XRD_CLIENTMONITOR
+.RS 5
+Path to the client monitor library.
+.RE
+
+XRD_CLIENTMONITORPARAM
+.RS 5
+Additional optional parameters that will be passed to the monitoring object
+on initialization.
+.RE
+
 .SH NOTES
-Documentation for all components associated with \fBxrdcp\fR can be found at
+Documentation for all components associated with \fBxrdcopy\fR can be found at
 http://xrootd.org/docs.html
+
 .SH DIAGNOSTICS
 Errors yield an error message and a non-zero exit status.
+
 .SH LICENSE
-License terms can be displayed by typing "\fBxrootd -H\fR".
+LGPL
+
 .SH SUPPORT LEVEL
-The \fBxrdcp\fR command is supported by the xrootd collaboration.
-Contact information can be found at
+The \fBxrdcopy\fR command is supported by the xrootd collaboration.
+Contact information can be found at:
+
 .ce
 http://xrootd.org/contact.html