Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Browse code

javadoc notes on value case in templated paths

  • Loading branch information...
commit bedb84b064e2494137f644abee888f84fb9bd02b 1 parent 04c4411
Chris K Wensel authored February 14, 2013
5  cascading-hadoop/src/main/java/cascading/tap/hadoop/TemplateTap.java
@@ -45,6 +45,11 @@
45 45
  * {@code openTapsThreshold} limits the number of open files to be output to. This value defaults to 300 files.
46 46
  * Each time the threshold is exceeded, 10% of the least recently used open files will be closed.
47 47
  * <p/>
  48
+ * TemplateTap will populate a given {@code pathTemplate} without regard to case of the values being used. Thus
  49
+ * the resulting paths {@code 2012/June/} and {@code 2012/june/} will likely result in two open files into the same
  50
+ * location. Forcing the case to be consistent with an upstream {@link Function} is recommended, see
  51
+ * {@link cascading.operation.expression.ExpressionFunction}.
  52
+ * <p/>
48 53
  * Though Hadoop has no mechanism to prevent simultaneous writes to a directory from multiple jobs, it doesn't mean
49 54
  * its safe to do so. Same is true with the TemplateTap. Interleaving writes to a common parent (root) directory
50 55
  * across multiple flows will very likely lead to data loss.
5  cascading-local/src/main/java/cascading/tap/local/TemplateTap.java
@@ -42,6 +42,11 @@
42 42
  * <p/>
43 43
  * {@code openTapsThreshold} limits the number of open files to be output to. This value defaults to 300 files.
44 44
  * Each time the threshold is exceeded, 10% of the least recently used open files will be closed.
  45
+ * <p/>
  46
+  * TemplateTap will populate a given {@code pathTemplate} without regard to case of the values being used. Thus
  47
+  * the resulting paths {@code 2012/June/} and {@code 2012/june/} will likely result in two open files into the same
  48
+  * location. Forcing the case to be consistent with an upstream {@link Function} is recommended, see
  49
+  * {@link cascading.operation.expression.ExpressionFunction}.
45 50
  */
46 51
 public class TemplateTap extends BaseTemplateTap<Properties, OutputStream>
47 52
   {

0 notes on commit bedb84b

Please sign in to comment.
Something went wrong with that request. Please try again.