Skip to content
This repository has been archived by the owner on May 12, 2021. It is now read-only.

APEXMALHAR-2532-TransformApplication-AlterConsoleOutputToUseFunctionO… #674

Merged
merged 1 commit into from Oct 7, 2017
Merged

APEXMALHAR-2532-TransformApplication-AlterConsoleOutputToUseFunctionO… #674

merged 1 commit into from Oct 7, 2017

Conversation

ananthc
Copy link

@ananthc ananthc commented Oct 1, 2017

@tweise - Could you please review ?

@ShunxinLu - Please note that this is being worked reworked per your original PR. Could you please provide any comments if any ?

tweise
tweise suggested changes Oct 1, 2017
View reviewed changes
...s/transform/src/main/java/org/apache/apex/examples/transform/SimpleTransformApplication.java Outdated
dag.addStream("TransformToOutput", transform.output, output.input);

dag.setInputPortAttribute(transform.input, Context.PortContext.TUPLE_CLASS, CustomerEvent.class);
dag.setOutputPortAttribute(transform.output, Context.PortContext.TUPLE_CLASS, CustomerInfo.class);
dag.setAttribute(transform, Context.OperatorContext.PARTITIONER, new StatelessPartitioner<TransformOperator>(2));
}

public POJOGenerator getPojoDataGenerator()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps make pojoGenerator @VisibleForTesting instead? Idea is to keep application code concise, yet allow for testing.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done.

examples/transform/src/main/java/org/apache/apex/examples/transform/CustomerInfo.java Outdated
", name='" + name + '\'' +
", age=" + age +
", address='" + address + '\'' +
return "{" +
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this is just for test validation, why not verify the pojo instances instead of doing the toString conversion?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

revert the toString change?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done. Misunderstood the transform operator logic ( assumed it was serialising as a string ) Hence the original change. Reverted it back. Transform Operator should have been ideally a templatised instance.

.../transform/src/main/java/org/apache/apex/examples/transform/DynamicTransformApplication.java Outdated
@@ -44,6 +48,22 @@
private static String MAX_THROUGHPUT = "dt.maxThroughput";
private static String MIN_THROUGHPUT = "dt.minThroughput";

@SuppressWarnings("serial")
public static final Function.MapFunction<Object, Void> CONSOLE_OUTPUT_FN = new Function.MapFunction<Object, Void>()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since it repeats in multiple places, make it resusable.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Refactored to extend from the Simple version of this class.

...ansform/src/test/java/org/apache/apex/examples/transform/SimpleTransformApplicationTest.java Outdated
ObjectMapper mapper = new ObjectMapper();
POJOGenerator pojoGenerator = simpleTransformApplication.getPojoDataGenerator();
int maxLengthOfCustomerName = 1 + ( 2 * pojoGenerator.getMaxNameLength()); //first name + last name + space
for (Object stringJsonObject : results) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

stringJsonObject is already CustomerInfo, right? So need need for toString and then parse again.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed.

@ananthc ananthc force-pushed the APEXMALHAR-2532-TransformApplication-AlterConsoleOutputToUseFunctionOperator branch from 7718650 to ec8c1b4 Compare October 1, 2017 22:53
tweise
tweise reviewed Oct 1, 2017
View reviewed changes
examples/transform/src/main/java/org/apache/apex/examples/transform/POJOGenerator.java Outdated
// Limit number of emitted tuples per window
@Min(1)
private long maxTuplesPerWindow = 100;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maxTuplesPerWindow serves a different purpose, it controls a throughput rate without capping the total number of tuples. I think you need a separate setting.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I initially went about using a separate variable but realised that the max tuples per window is essentially dead code. It is not serving any purpose downstream and hence thought it can be removed. I can revert it back if you reckon there is some value add in this.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To run the application standalone (not as test) and get a continuous stream of data, I would set the tuples per streaming window to establish a rate. That's different from controlling the total number of tuples emitted.

examples/transform/src/main/java/org/apache/apex/examples/transform/CustomerInfo.java Outdated
", name='" + name + '\'' +
", age=" + age +
", address='" + address + '\'' +
return "{" +
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

revert the toString change?

.../transform/src/main/java/org/apache/apex/examples/transform/DynamicTransformApplication.java Outdated
{
private static String COOL_DOWN_MILLIS = "dt.cooldown";
private static String MAX_THROUGHPUT = "dt.maxThroughput";
private static String MIN_THROUGHPUT = "dt.minThroughput";

@Override
public void populateDAG(DAG dag, Configuration conf)
void setPartitionerForTest(DAG dag,Configuration conf,TransformOperator transform)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shouldn't this be setPartitioner - since it isn't for test purposes.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

corrected.

...s/transform/src/main/java/org/apache/apex/examples/transform/SimpleTransformApplication.java Outdated
{
@SuppressWarnings("serial")
public static final Function.MapFunction<Object, Void> CONSOLE_OUTPUT_FN = new Function.MapFunction<Object, Void>()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I actually thought this can be moved to common package where all examples can use it from.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Introduced a class FunctionOperatorUtil into which the above code is moved. This new class is in the same package as the FunctionOperator class.

@ananthc ananthc force-pushed the APEXMALHAR-2532-TransformApplication-AlterConsoleOutputToUseFunctionOperator branch from ec8c1b4 to 8af9291 Compare October 2, 2017 17:37
tweise
tweise reviewed Oct 2, 2017
View reviewed changes
library/src/main/java/org/apache/apex/malhar/lib/function/FunctionOperatorUtil.java
* A Map Function implementation that can be used to write to the Console as a sink.
*/
@SuppressWarnings("serial")
public static final Function.MapFunction<Object, Void> CONSOLE_SINK_FN = new Function.MapFunction<Object, Void>()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change enricher example to also use this

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Enricher Application also has been modified as part of this PR ( in the second iteration )

@ananthc ananthc force-pushed the APEXMALHAR-2532-TransformApplication-AlterConsoleOutputToUseFunctionOperator branch from 8af9291 to 282a80f Compare October 3, 2017 09:15
@tweise
Copy link
Contributor

tweise commented Oct 6, 2017

@ananthc please rebase + resolve conflict

@ananthc
Copy link
Author

ananthc commented Oct 6, 2017

@tweise - Rebased and resolved the conflict.

@tweise
Copy link
Contributor

tweise commented Oct 6, 2017

i still see there merge conflict, please squash

@ananthc ananthc force-pushed the APEXMALHAR-2532-TransformApplication-AlterConsoleOutputToUseFunctionOperator branch from ae6f5d9 to db930fd Compare October 6, 2017 18:31
tweise
tweise reviewed Oct 6, 2017
View reviewed changes
library/src/main/java/org/apache/apex/malhar/lib/function/FunctionOperatorUtil.java Outdated
/***
* A utility class that can be used in conjunction with the FunctionOperator class
*/
public class FunctionOperatorUtil
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please add @Evolving

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added the annotation.

@ananthc ananthc force-pushed the APEXMALHAR-2532-TransformApplication-AlterConsoleOutputToUseFunctionOperator branch from db930fd to 30bfac5 Compare October 6, 2017 19:05
@tweise
Copy link
Contributor

tweise commented Oct 6, 2017

jenkins test this please

@ananthc
Copy link
Author

ananthc commented Oct 6, 2017 •
edited

I have observed this on Jenkins lately ( not necessarily related to this PR but the other PR )

The actual build seems to be successful but fails in/after the archiving phase.

[INFO] --- maven-checkstyle-plugin:2.17:check (checkstyle) @ malhar-flume ---
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Apex Malhar ................................ SUCCESS [9.685s]
[INFO] Apache Apex Malhar Library ........................ SUCCESS [10:43.833s]
[INFO] Apache Apex Malhar Contrib Library ................ SUCCESS [33.047s]
[INFO] Apache Apex Malhar Kafka Support .................. SUCCESS [6.959s]
[INFO] Apache Apex Malhar Common Utilities for Kafka Support  SUCCESS [12.668s]
[INFO] Apache Apex Malhar Kafka Support using 0.9 Consumer API  SUCCESS [4:36.083s]
[INFO] Apache Apex Malhar Kafka Support using 0.10 Consumer API  SUCCESS [12.877s]
[INFO] Apache Apex Malhar Kudu Support ................... SUCCESS [15.704s]
[INFO] Apache Apex Malhar Examples ....................... SUCCESS [4.091s]
[INFO] Apache Apex Malhar MachineData Example ............ SUCCESS [10.174s]
[INFO] Apache Apex Malhar Pi Example ..................... SUCCESS [41.908s]
[INFO] Apache Apex Malhar Twitter Example ................ SUCCESS [9.307s]
[INFO] Apache Apex Malhar Yahoo! Finance Example ......... SUCCESS [7.957s]
[INFO] Apache Apex Malhar Fraud Detect Example ........... SUCCESS [8.035s]
[INFO] Apache Apex Malhar Mobile Example ................. SUCCESS [7.602s]
[INFO] Apache Apex Malhar Wordcount Example .............. SUCCESS [8.357s]
[INFO] Apache Apex Malhar MR Monitoring Example .......... SUCCESS [8.843s]
[INFO] Apache Apex Malhar MR Operator Example ............ SUCCESS [7.788s]
[INFO] Apache Apex Malhar Unique Count Example ........... SUCCESS [17.538s]
[INFO] Apache Apex Malhar R Example ...................... SUCCESS [8.072s]
[INFO] Apache Apex Malhar EchoServer Example ............. SUCCESS [20.248s]
[INFO] Apache Apex Malhar Iteration Example .............. SUCCESS [17.243s]
[INFO] Apache Apex Malhar CSV Formatter Example .......... SUCCESS [15.948s]
[INFO] Apache Apex Malhar Dedup Example .................. SUCCESS [20.087s]
[INFO] Apache Apex Malhar Dynamic Partitioning Example ... SUCCESS [20.248s]
[INFO] Apache Apex Malhar Enricher Example ............... SUCCESS [16.556s]
[INFO] Apache Apex Malhar Filter Example ................. SUCCESS [10.594s]
[INFO] Apache Apex Malhar Partitions Example ............. SUCCESS [15.155s]
[INFO] Apache Apex Malhar File Record Reader Example ..... SUCCESS [18.031s]
[INFO] Apache Apex Malhar Throttle Example ............... SUCCESS [20.067s]
[INFO] Apache Apex Malhar Transform Example .............. SUCCESS [12.254s]
[INFO] Apache Apex Malhar Kafka examples ................. SUCCESS [1:09.646s]
[INFO] Apache Apex Malhar FTP Example .................... SUCCESS [6.516s]
[INFO] malhar-examples-s3 ................................ SUCCESS [6.732s]
[INFO] Apache Apex Malhar JDBC Examples .................. SUCCESS [1:18.326s]
[INFO] Apache Apex Malhar Exactly-Once Examples .......... SUCCESS [59.100s]
[INFO] Apache Apex Malhar Distributed Distinct Example ... SUCCESS [7.596s]
[INFO] Apache Apex Malhar Stream API ..................... SUCCESS [32.847s]
[INFO] Apache Apex Malhar High-Level API Example ......... SUCCESS [44.135s]
[INFO] Apache Apex Malhar SQL Support .................... SUCCESS [55.076s]
[INFO] Apache Apex Malhar SQL API Example ................ SUCCESS [56.768s]
[INFO] Apache Apex Malhar Hive Support ................... SUCCESS [31.578s]
[INFO] Apache Apex Malhar Benchmark ...................... SUCCESS [13.118s]
[INFO] Apache Apex Malhar Apps ........................... SUCCESS [3.980s]
[INFO] Apache Apex Malhar Logstream Application .......... SUCCESS [11.682s]
[INFO] Apache Apex Malhar File copy Application .......... SUCCESS [5.710s]
[INFO] Apache Apex Malhar Samples ........................ SUCCESS [10.179s]
[INFO] Apache Apex Malhar Flume Support .................. SUCCESS [18.029s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 32:11.338s
[INFO] Finished at: Fri Oct 06 19:38:40 UTC 2017
[INFO] Final Memory: 808M/1572M
[INFO] ------------------------------------------------------------------------
Waiting for Jenkins to finish collecting data
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/library/pom.xml to org.apache.apex/malhar-library/3.8.0-SNAPSHOT/malhar-library-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/library/target/malhar-library-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-library/3.8.0-SNAPSHOT/malhar-library-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/library/target/malhar-library-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-library/3.8.0-SNAPSHOT/malhar-library-3.8.0-SNAPSHOT-tests.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/pom.xml to org.apache.apex/malhar/3.8.0-SNAPSHOT/malhar-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/mrmonitor/pom.xml to org.apache.apex/malhar-examples-mrmonitor/3.8.0-SNAPSHOT/malhar-examples-mrmonitor-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/mrmonitor/target/malhar-examples-mrmonitor-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-mrmonitor/3.8.0-SNAPSHOT/malhar-examples-mrmonitor-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 3.45 MB of artifacts by 47.1% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/kafka/pom.xml to org.apache.apex/malhar-examples-kafka/3.8.0-SNAPSHOT/malhar-examples-kafka-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/kafka/target/malhar-examples-kafka-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-kafka/3.8.0-SNAPSHOT/malhar-examples-kafka-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 10.14 MB of artifacts by 69.0% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/recordReader/pom.xml to org.apache.apex/malhar-examples-recordReader/3.8.0-SNAPSHOT/malhar-examples-recordReader-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/recordReader/target/malhar-examples-recordReader-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-recordReader/3.8.0-SNAPSHOT/malhar-examples-recordReader-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/flume/pom.xml to org.apache.apex/malhar-flume/3.8.0-SNAPSHOT/malhar-flume-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/flume/target/malhar-flume-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-flume/3.8.0-SNAPSHOT/malhar-flume-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/uniquecount/pom.xml to org.apache.apex/malhar-examples-uniquecount/3.8.0-SNAPSHOT/malhar-examples-uniquecount-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/uniquecount/target/malhar-examples-uniquecount-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-uniquecount/3.8.0-SNAPSHOT/malhar-examples-uniquecount-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/filter/pom.xml to org.apache.apex/malhar-examples-filter/3.8.0-SNAPSHOT/malhar-examples-filter-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/filter/target/malhar-examples-filter-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-filter/3.8.0-SNAPSHOT/malhar-examples-filter-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 3.28 MB of artifacts by 23.8% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/sql/pom.xml to org.apache.apex/malhar-examples-sql/3.8.0-SNAPSHOT/malhar-examples-sql-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/sql/target/malhar-examples-sql-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-sql/3.8.0-SNAPSHOT/malhar-examples-sql-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 25.15 MB of artifacts by 85.2% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/twitter/pom.xml to org.apache.apex/malhar-examples-twitter/3.8.0-SNAPSHOT/malhar-examples-twitter-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/twitter/target/malhar-examples-twitter-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-twitter/3.8.0-SNAPSHOT/malhar-examples-twitter-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 29.35 MB of artifacts by 90.0% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/sql/pom.xml to org.apache.apex/malhar-sql/3.8.0-SNAPSHOT/malhar-sql-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/sql/target/malhar-sql-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-sql/3.8.0-SNAPSHOT/malhar-sql-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/sql/target/malhar-sql-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-sql/3.8.0-SNAPSHOT/malhar-sql-3.8.0-SNAPSHOT-tests.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/mroperator/pom.xml to org.apache.apex/malhar-examples-mroperator/3.8.0-SNAPSHOT/malhar-examples-mroperator-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/mroperator/target/malhar-examples-mroperator-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-mroperator/3.8.0-SNAPSHOT/malhar-examples-mroperator-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/benchmark/pom.xml to org.apache.apex/malhar-benchmark/3.8.0-SNAPSHOT/malhar-benchmark-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/contrib/pom.xml to org.apache.apex/malhar-contrib/3.8.0-SNAPSHOT/malhar-contrib-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/contrib/target/malhar-contrib-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-contrib/3.8.0-SNAPSHOT/malhar-contrib-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/contrib/target/malhar-contrib-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-contrib/3.8.0-SNAPSHOT/malhar-contrib-3.8.0-SNAPSHOT-tests.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/pom.xml to org.apache.apex/malhar-kafka-connectors/3.8.0-SNAPSHOT/malhar-kafka-connectors-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/target/malhar-kafka-connectors-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-kafka-connectors/3.8.0-SNAPSHOT/malhar-kafka-connectors-3.8.0-SNAPSHOT-tests.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/throttle/pom.xml to org.apache.apex/malhar-examples-throttle/3.8.0-SNAPSHOT/malhar-examples-throttle-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/throttle/target/malhar-examples-throttle-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-throttle/3.8.0-SNAPSHOT/malhar-examples-throttle-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/apps/filecopy/pom.xml to org.apache.apex/filecopy/3.8.0-SNAPSHOT/filecopy-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/apps/filecopy/target/filecopy-3.8.0-SNAPSHOT.apa to org.apache.apex/filecopy/3.8.0-SNAPSHOT/filecopy-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/highlevelapi/pom.xml to org.apache.apex/malhar-examples-highlevelapi/3.8.0-SNAPSHOT/malhar-examples-highlevelapi-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/highlevelapi/target/malhar-examples-highlevelapi-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-highlevelapi/3.8.0-SNAPSHOT/malhar-examples-highlevelapi-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 5.09 MB of artifacts by 46.1% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/mobile/pom.xml to org.apache.apex/malhar-examples-mobile/3.8.0-SNAPSHOT/malhar-examples-mobile-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/mobile/target/malhar-examples-mobile-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-mobile/3.8.0-SNAPSHOT/malhar-examples-mobile-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 2.06 MB of artifacts by 19.7% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/pom.xml to org.apache.apex/malhar-examples/3.8.0-SNAPSHOT/malhar-examples-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/wordcount/pom.xml to org.apache.apex/malhar-examples-wordcount/3.8.0-SNAPSHOT/malhar-examples-wordcount-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/wordcount/target/malhar-examples-wordcount-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-wordcount/3.8.0-SNAPSHOT/malhar-examples-wordcount-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 18.11 MB of artifacts by 91.1% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/echoserver/pom.xml to org.apache.apex/malhar-examples-echoserver/3.8.0-SNAPSHOT/malhar-examples-echoserver-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/echoserver/target/malhar-examples-echoserver-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-echoserver/3.8.0-SNAPSHOT/malhar-examples-echoserver-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/r/pom.xml to org.apache.apex/malhar-examples-r/3.8.0-SNAPSHOT/malhar-examples-r-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/r/target/malhar-examples-r-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-r/3.8.0-SNAPSHOT/malhar-examples-r-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/distributedistinct/pom.xml to org.apache.apex/malhar-examples-distributedistinct/3.8.0-SNAPSHOT/malhar-examples-distributedistinct-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/distributedistinct/target/malhar-examples-distributedistinct-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-distributedistinct/3.8.0-SNAPSHOT/malhar-examples-distributedistinct-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/s3/pom.xml to org.apache.apex/malhar-examples-s3/3.8.0-SNAPSHOT/malhar-examples-s3-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/s3/target/malhar-examples-s3-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-s3/3.8.0-SNAPSHOT/malhar-examples-s3-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 7.00 MB of artifacts by 71.0% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/iteration/pom.xml to org.apache.apex/malhar-examples-iteration/3.8.0-SNAPSHOT/malhar-examples-iteration-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/iteration/target/malhar-examples-iteration-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-iteration/3.8.0-SNAPSHOT/malhar-examples-iteration-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka09/pom.xml to org.apache.apex/malhar-kafka/3.8.0-SNAPSHOT/malhar-kafka-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka09/target/malhar-kafka-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-kafka/3.8.0-SNAPSHOT/malhar-kafka-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka09/target/malhar-kafka-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-kafka/3.8.0-SNAPSHOT/malhar-kafka-3.8.0-SNAPSHOT-tests.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/enricher/pom.xml to org.apache.apex/malhar-examples-enricher/3.8.0-SNAPSHOT/malhar-examples-enricher-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/enricher/target/malhar-examples-enricher-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-enricher/3.8.0-SNAPSHOT/malhar-examples-enricher-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 53.63 MB of artifacts by 91.5% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/ftp/pom.xml to org.apache.apex/malhar-examples-ftp/3.8.0-SNAPSHOT/malhar-examples-ftp-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/ftp/target/malhar-examples-ftp-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-ftp/3.8.0-SNAPSHOT/malhar-examples-ftp-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/machinedata/pom.xml to org.apache.apex/malhar-examples-machinedata/3.8.0-SNAPSHOT/malhar-examples-machinedata-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/machinedata/target/malhar-examples-machinedata-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-machinedata/3.8.0-SNAPSHOT/malhar-examples-machinedata-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 3.77 MB of artifacts by 31.5% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/yahoofinance/pom.xml to org.apache.apex/malhar-examples-yahoo-finance/3.8.0-SNAPSHOT/malhar-examples-yahoo-finance-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/yahoofinance/target/malhar-examples-yahoo-finance-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-yahoo-finance/3.8.0-SNAPSHOT/malhar-examples-yahoo-finance-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 5.15 MB of artifacts by 52.7% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/csvformatter/pom.xml to org.apache.apex/malhar-examples-csvformatter/3.8.0-SNAPSHOT/malhar-examples-csvformatter-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/csvformatter/target/malhar-examples-csvformatter-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-csvformatter/3.8.0-SNAPSHOT/malhar-examples-csvformatter-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 8.44 MB of artifacts by 66.3% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/frauddetect/pom.xml to org.apache.apex/malhar-examples-frauddetect/3.8.0-SNAPSHOT/malhar-examples-frauddetect-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/frauddetect/target/malhar-examples-frauddetect-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-frauddetect/3.8.0-SNAPSHOT/malhar-examples-frauddetect-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 2.18 MB of artifacts by 23.0% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kudu/pom.xml to org.apache.apex/malhar-kudu/3.8.0-SNAPSHOT/malhar-kudu-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kudu/target/malhar-kudu-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-kudu/3.8.0-SNAPSHOT/malhar-kudu-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/exactly-once/pom.xml to org.apache.apex/malhar-examples-exactly-once/3.8.0-SNAPSHOT/malhar-examples-exactly-once-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/exactly-once/target/malhar-examples-exactly-once-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-exactly-once/3.8.0-SNAPSHOT/malhar-examples-exactly-once-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 34.60 MB of artifacts by 91.4% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/samples/pom.xml to org.apache.apex/malhar-samples/3.8.0-SNAPSHOT/malhar-samples-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/samples/target/malhar-samples-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-samples/3.8.0-SNAPSHOT/malhar-samples-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/transform/pom.xml to org.apache.apex/malhar-examples-transform/3.8.0-SNAPSHOT/malhar-examples-transform-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/transform/target/malhar-examples-transform-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-transform/3.8.0-SNAPSHOT/malhar-examples-transform-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 2.67 MB of artifacts by 35.2% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/jdbc/pom.xml to org.apache.apex/malhar-examples-jdbc/3.8.0-SNAPSHOT/malhar-examples-jdbc-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/jdbc/target/malhar-examples-jdbc-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-jdbc/3.8.0-SNAPSHOT/malhar-examples-jdbc-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 4.77 MB of artifacts by 47.2% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/pi/pom.xml to org.apache.apex/malhar-examples-pi/3.8.0-SNAPSHOT/malhar-examples-pi-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/pi/target/malhar-examples-pi-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-pi/3.8.0-SNAPSHOT/malhar-examples-pi-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 18.10 MB of artifacts by 90.8% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/partition/pom.xml to org.apache.apex/malhar-examples-partition/3.8.0-SNAPSHOT/malhar-examples-partition-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/partition/target/malhar-examples-partition-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-partition/3.8.0-SNAPSHOT/malhar-examples-partition-3.8.0-SNAPSHOT.apa
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/dynamic-partition/pom.xml to org.apache.apex/malhar-examples-dynamic-partition/3.8.0-SNAPSHOT/malhar-examples-dynamic-partition-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/dynamic-partition/target/malhar-examples-dynamic-partition-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-dynamic-partition/3.8.0-SNAPSHOT/malhar-examples-dynamic-partition-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 2.12 MB of artifacts by 20.7% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/apps/logstream/pom.xml to org.apache.apex/logstream/3.8.0-SNAPSHOT/logstream-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/apps/logstream/target/logstream-3.8.0-SNAPSHOT.apa to org.apache.apex/logstream/3.8.0-SNAPSHOT/logstream-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 50.58 MB of artifacts by 89.5% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka-common/pom.xml to org.apache.apex/malhar-kafka-common/3.8.0-SNAPSHOT/malhar-kafka-common-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka-common/target/malhar-kafka-common-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-kafka-common/3.8.0-SNAPSHOT/malhar-kafka-common-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka-common/target/malhar-kafka-common-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-kafka-common/3.8.0-SNAPSHOT/malhar-kafka-common-3.8.0-SNAPSHOT-tests.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/dedup/pom.xml to org.apache.apex/malhar-examples-dedup/3.8.0-SNAPSHOT/malhar-examples-dedup-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/examples/dedup/target/malhar-examples-dedup-3.8.0-SNAPSHOT.apa to org.apache.apex/malhar-examples-dedup/3.8.0-SNAPSHOT/malhar-examples-dedup-3.8.0-SNAPSHOT.apa
[Fast Archiver] Compressed 2.96 MB of artifacts by 42.3% relative to #1711
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/stream/pom.xml to org.apache.apex/malhar-stream/3.8.0-SNAPSHOT/malhar-stream-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/stream/target/malhar-stream-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-stream/3.8.0-SNAPSHOT/malhar-stream-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/stream/target/malhar-stream-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-stream/3.8.0-SNAPSHOT/malhar-stream-3.8.0-SNAPSHOT-tests.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/apps/pom.xml to org.apache.apex/malhar-apps/3.8.0-SNAPSHOT/malhar-apps-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka010/pom.xml to org.apache.apex/malhar-kafka010/3.8.0-SNAPSHOT/malhar-kafka010-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka010/target/malhar-kafka010-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-kafka010/3.8.0-SNAPSHOT/malhar-kafka010-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/kafka/kafka010/target/malhar-kafka010-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-kafka010/3.8.0-SNAPSHOT/malhar-kafka010-3.8.0-SNAPSHOT-tests.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/hive/pom.xml to org.apache.apex/malhar-hive/3.8.0-SNAPSHOT/malhar-hive-3.8.0-SNAPSHOT.pom
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/hive/target/malhar-hive-3.8.0-SNAPSHOT.jar to org.apache.apex/malhar-hive/3.8.0-SNAPSHOT/malhar-hive-3.8.0-SNAPSHOT.jar
[JENKINS] Archiving /home/jenkins/jenkins-slave/workspace/Apex_Malhar_PR@2/hive/target/malhar-hive-3.8.0-SNAPSHOT-tests.jar to org.apache.apex/malhar-hive/3.8.0-SNAPSHOT/malhar-hive-3.8.0-SNAPSHOT-tests.jar
channel stopped
Setting status of 30bfac5a83b54b5909640db41c1e1db9844672ac to FAILURE with url https://builds.apache.org/job/Apex_Malhar_PR/1712/ and message: 'FAILURE
 '
Using context: Jenkins: maven verify
Finished: UNSTABLE

@tweise
Copy link
Contributor

tweise commented Oct 7, 2017

Maybe an error archiving the build artifacts. Earlier Jenkins failure and most others I see are due to flaky tests.

@tweise tweise merged commit b247df3 into apache:master Oct 7, 2017
@tweise tweise mentioned this pull request Oct 7, 2017
Closed
@ananthc ananthc deleted the APEXMALHAR-2532-TransformApplication-AlterConsoleOutputToUseFunctionOperator branch October 27, 2017 21:18
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@tweise tweise tweise approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
2 participants
@ananthc @tweise