Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Webui/watermarks #3333

Closed
wants to merge 50 commits into from
Closed

Webui/watermarks #3333

wants to merge 50 commits into from

Conversation

pnelligan
Copy link
Contributor

@pnelligan pnelligan commented Feb 16, 2017

implement watermarks tab and display low watermarks on graph nodes.

Nico Kruber and others added 30 commits February 16, 2017 10:52
…tory

If "<flink-dir>/build-target" already existed, running 'mvn package' for
flink-dist would create a symbolic link inside "<flink-dir>/build-target"
instead of replacing that symlink. This commit fixes this behaviour of 'ln -sf'
by adding the --no-dereference parameter.

This closes apache#3331
… AskSupport

Akka's AskSupport trait requires that failures are wrapped in a akka.actor.Status.Failure
to be recognized. Internally the trait will unwrap the failure and wrap it in a
scala.util.Failure instance. However, it does not recognize the scala Failure when given
to the AskSupport trait. As a consequence it would wrap scala.util.Failure in a
scala.util.Success instance.

This closes apache#3321.
Add fail call after method which is supposed to fail. Remove stack trace printing
to stdout.

This closes apache#3326.
…ingReportsToLeader

Prevent the race condition between shutting down the leader election service and the
contender becoming the leader by waiting on a LeaderRetrievalListener. The problem
was that if the service has been shut down before the contender has become the leader,
then the contender would not be notified about the shut down via the handleError method.

At correct waiting behaviour using Mockito's verify statement

This closes apache#3327.
A absolute URL to an image prevents this image in case of
running with a YARN proxy. This makes the URL relative.

This closes apache#3337.
… directories

Flip the logic (check existence and create directory) to resolve currency problem

This closes apache#3342
…bs from distrinbuted file system if possible

This closes apache#3084
… to a separate class

This fixes the problem that the Storm LocalCluster can't run with powermock

This closes apache#3138
…h generation

This makes sure the TemporaryFolder rule is already evaluated by the time
the temp files are generated.

This also injects a random parent directory to ensure that even for fix directory/file
names, the absolute path is randomized.
…ress (127.0.0.1) with local environments.

Using loopback rather than the "local address" allows tests to run in
situations where the local machine's hostname may not be resolvable in DNS
(because DNS is unreacable or the hostname is not found) or the hostname does
resolve, but not to an IP address that is reachable.

This closes apache#3223
… of failures

This verifies that the given network buffer is recycled as expected and that
no notifiers are called upon failures to add a buffer.

This closes apache#3309
Nico Kruber and others added 20 commits February 20, 2017 01:01
With this change, any project using flink-test-utils which also requires
SecureTestEnvironment must add a dependency to hadoop-minikdc itself, e.g. in
pom.xml:

   ...
   <dependencies>
     <dependency>
       <groupId>org.apache.hadoop</groupId>
       <artifactId>hadoop-minikdc</artifactId>
       <version>${minikdc.version}</version>
       <scope>compile</scope>
     </dependency>
   ...
   </dependencies>
   ...

   <build>
     <plugins>
       <!--
         https://issues.apache.org/jira/browse/DIRSHARED-134
         Required to pull the Mini-KDC transitive dependency
       -->
       <plugin>
       <groupId>org.apache.felix</groupId>
       <artifactId>maven-bundle-plugin</artifactId>
       <version>3.0.1</version>
       <inherited>true</inherited>
       <extensions>true</extensions>
     </plugin>
   ...

This closes apache#3322
  - This makes the FileSystem use the 'WriteMode' (otherwise it was an unused enumeration)
  - Extends comments
  - Deprecate the method that controls the replication factor and block size
Move the FileSystem safety net to a separate class.
…ots and deploys tasks in bulk

That way, strictly topological deployment can be guaranteed.

Also, many quick deploy/not-enough-resources/fail/recover cycles can be
avoided in the cases where resources need some time to appear.

This closes apache#3295
…for tests

This unsets the HADOOP_HOME and HADOOP_CONF_DIR envirobment variables for tests, to avoid
that the tests pick those variable up from build servers and produce unexpected test
results.

This closes apache#3288
…nto webui/watermarks

Conflicts:
	flink-runtime-web/web-dashboard/web/js/index.js
@pnelligan pnelligan closed this Feb 20, 2017
@pnelligan pnelligan deleted the webui/watermarks branch February 20, 2017 17:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet