Permalink
Commits on Jan 23, 2017
  1. [FLINK-5298] TM checks that log file exists

    This closes #2974.
    zentol committed Dec 8, 2016
  2. [FLINK-5613][query] querying a non-existing key is inconsistent among…

    … state backends
    
    Querying for a non-existing key for a state that has a default value set
    currently results in an UnknownKeyOrNamespace exception when the
    MemoryStateBackend or FsStateBackend is used but results in the default value
    if RocksDBStateBackend is set.
    
    This removes the special handling from the RocksDBStateBackend and makes it
    consistent with the other two back-ends, i.e. returning null which results
    in the mentioned UnknownKeyOrNamespace exception.
    
    This closes #3193
    NicoK committed with rmetzger Jan 17, 2017
  3. [FLINK-5229] [state] Cleanup of operator snapshots if subsequent oper…

    …ator snapshots fail
    
    This PR adds operator state cleanup to the StreamTask class. If a stream task contains multiple
    stream operators, then every operator is checkpointed. In case that a snapshot operation fails
    all state handles and OperatorSnapshotResults belonging to previous operators have to be freed.
    
    Add test cases for failing checkpoint operations in StreamTask
    
    Address PR comments
    
    This closes #3179.
    tillrohrmann committed Jan 20, 2017
  4. [FLINK-5214] Clean up checkpoint data in case of a failing checkpoint…

    … operation
    
    Adds exception handling to the stream operators for the snapshotState method. A failing
    snapshot operation will trigger the clean up of all so far generated state resources.
    This will avoid that in case of a failing snapshot operation resources (e.g. files) are
    left behind.
    
    Add test case for OperatorSnapshotResult
    
    Add StateSnapshotContextSynchronousImplTest
    
    Add AbstractStreamOperator failing snapshot tests
    
    This closes #3178.
    tillrohrmann committed Dec 1, 2016
  5. [FLINK-5365] Mesos AppMaster/TaskManager should obey sigterm

    - use ‘exec’ in bash script to ensure that signals flow to the java
    process.
    
    This closes #3025.
    EronWright committed with tillrohrmann Dec 19, 2016
  6. [hotfix] [ml] Use the FlinkTestBase ExecutionEnvironment in Stochasti…

    …cOutlierSelectionITSuite
    
    The FlinkTestBase instantiates a Flink cluster with the right setup (logging, parallelism).
    This cluster should be used by calling ExecutionEnvironment.getExecutionEnvironment from
    within the test method. Calling this method in the constructor won't create the right
    ExecutionEnvironment, because the before method of FlinkTestBase has not been executed.
    tillrohrmann committed Jan 23, 2017
  7. [FLINK-5450] Fix restore from legacy log message

    This closes #3134
    kl0u committed with rmetzger Jan 16, 2017
  8. [FLINK-5118] [metrics] Fix inconsistent numBytesIn/Out metrics for ne…

    …twork channels
    
    This closes #3106
    zentol committed with StephanEwen Jan 12, 2017
  9. [FLINK-5562] [gelly] Driver fixes: Improve parametrization and output…

    … formatting.
    
    This closes #3187
    This closes #3188
    greghogan committed with StephanEwen Oct 26, 2016
  10. [hotfix] [build] Include flink-gelly-examples in opt/

    Adds the flink-gelly-examples jar to the opt/ directory of the binary
    release artifacts. The examples jar is referenced in the online documentation.
    
    Corrects the file paths in the Gelly quickstart documentation.
    greghogan committed with StephanEwen Jan 20, 2017
  11. [hotfix] [gelly] Fix TriangleListing EdgeOrder

    The edge bitmask was swapped in ed09dba.
    greghogan committed with StephanEwen Jan 20, 2017
  12. [FLINK-5532] [streaming api] Improve JavaDocs for assigners for Fast …

    …Aligned Windows to clarify role
    StephanEwen committed Jan 23, 2017
  13. [FLINK-5532] [streaming api] Make marker window assigners for aligned…

    … window ops non-extendable
    
    Makes the TumblingAlignedProcessingTimeWindows and the
    SlidingAlignedProcessingTimeWindows final so that users cannot
    extend them.
    
    This closes #3180
    kl0u committed with StephanEwen Jan 20, 2017
  14. [FLINK-5503] [log] Print error message in case MesosApplicationMaster…

    …Runner fails
    
    This PR adds an error message to the mesos-appmaster.sh script which is printed in case
    that the MesosApplicationMasterRunner fails.
    
    This closes #3162.
    tillrohrmann committed Jan 18, 2017
  15. [FLINK-5492] [log] Log unresolved address when starting an ActorSystem

    With the Flakka changes we no longer resolve the given hostname into an IP. Thus,
    we should henceforth log the unresolved hostname as the address to which the
    ActorSystem binds to.
    
    This closes #3161.
    tillrohrmann committed Jan 18, 2017
  16. [FLINK-5504] Create mesos-appmaster log file in log directory

    This PR prepends the FLINK_LOG_DIR env variable pointing to Flink's logging
    directory to the logging file name.
    
    This closes #3159.
    tillrohrmann committed Jan 18, 2017
  17. [FLINK-5508] [mesos] Introduce ZooKeeperUtilityFactory to create ZooK…

    …eeper utility classes
    
    This commit adds utility classes to abstract the CuratorFramework dependency from ZooKeeper
    utility classes away. That way it is possible for modules outside of flink-runtime to use
    these utility classes without facing the problem of a relocated curator dependency.
    
    Address PR comments
    
    This closes #3157.
    tillrohrmann committed Jan 18, 2017
  18. [FLINK-5496] [mesos] Relocate Mesos Protobuf dependency to avoid vers…

    …ion conflicts
    
    Only relocate Mesos Protobuf dependency in flink-mesos. This avoids problems with Mesos
    because Flink pulls in Protobuf 2.5.0 via Flakka.
    
    This closes #3156.
    tillrohrmann committed Jan 16, 2017
  19. [FLINK-5495] [mesos] Provide executor to ZooKeeperMesosWorkerStore

    The ZooKeeperMesosWorkerStore instantiates a ZooKeeperStateHandleStore which requires an
    Executor instance. This executor is now given to the ZooKeeperMesosWorkerStore.
    
    This closes #3155.
    tillrohrmann committed Jan 16, 2017
Commits on Jan 22, 2017
  1. [FLINK-5582] [streaming] Add 'AggregateFunction' and 'AggregatingState'.

    The AggregateFunction implements a very flexible interface for distributive aggregations.
    StephanEwen committed Jan 10, 2017
  2. [hotfix] [runtime] Various code cleanups and reductions of warnings i…

    …n heap state restoring code
    StephanEwen committed Jan 20, 2017
  3. [FLINK-5590] [runtime] Add proper internal state hierarchy

    This introduces an internal state hierarchy that mirrors the external state hierarchy,
    but gives the runtime access to methods that should not be part of the user facing API,
    such as:
      - setting namespaces
      - accessing raw values
      - merging namespaces
    StephanEwen committed Jan 13, 2017
  4. [hotfix] [streaming api] Non-merging triggers throw UnsupportedOperat…

    …ionException instead of RuntimeException
    StephanEwen committed Jan 19, 2017