Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[FLINK-2462] [streaming] Major cleanup of streaming task structure #1017

Closed
wants to merge 2 commits into from
Closed

[FLINK-2462] [streaming] Major cleanup of streaming task structure #1017

wants to merge 2 commits into from

Commits on Aug 16, 2015

  1. [FLINK-2462] [streaming] Major cleanup of operator structure for exce… 

    …ption handling and code simplication

  - The exceptions are no longer logged by the operators themselves.
    Operators perform only cleanup in reaction to exceptions.
    Exceptions are reported only the the root Task object, which knows whether this is the first
    failure-causing exception (root cause), or is a subsequent exception, or whether the task was
    actually canceled already. In the later case, exceptions are ignored, because many
    cancellations lead to meaningless exceptions.

  - more exception in signatures, less wrapping where not needed

  - Core resource acquisition/release logic is in one streaming task, reducing code duplication

  - Guaranteed cleanup of output buffer and input buffer resources (formerly missed when other exceptions where encountered)

  - Fix mixup in instantiation of source contexts in the stream source task

  - Auto watermark generators correctly shut down their interval scheduler

  - Improve use of generics, got rid of many raw types

This closes apache#1017
    @StephanEwen
    StephanEwen committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    beed1d4 View commit details
    Browse the repository at this point in the history

  2. [tests] Reinforce StateCheckpoinedITCase to make sure actual checkpoi… 

    …nting has happened before a failure.
    @StephanEwen
    StephanEwen committed Aug 16, 2015
    Configuration menu
    Copy the full SHA
    1023b60 View commit details
    Browse the repository at this point in the history