Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-8372] Do not show applications that haven't recorded their app ID yet. #7097

Closed
wants to merge 4 commits into from
Closed

[SPARK-8372] Do not show applications that haven't recorded their app ID yet. #7097

wants to merge 4 commits into from

Commits on Jun 29, 2015

  1. [SPARK-8372] History server shows incorrect information for applicati… 

    …on not started

The history server may show an incorrect App ID for an incomplete application like <App ID>.inprogress. This app info will never disappear even after the app is completed.
![incorrectappinfo](https://cloud.githubusercontent.com/assets/9278199/8156147/2a10fdbe-137d-11e5-9620-c5b61d93e3c1.png)

The cause of the issue is that a log path name is used as the app id when app id cannot be got during replay.

Author: Carson Wang <carson.wang@intel.com>

Closes apache#6827 from carsonwang/SPARK-8372 and squashes the following commits:

cdbb089 [Carson Wang] Fix code style
3e46b35 [Carson Wang] Update code style
90f5dde [Carson Wang] Add a unit test
d8c9cd0 [Carson Wang] Replaying events only return information when app is started
    @carsonwang
    carsonwang authored and Marcelo Vanzin committed Jun 29, 2015
    Configuration menu
    Copy the full SHA
    1eca3fe View commit details
    Browse the repository at this point in the history

  2. Handle logs generated by 1.0 and 1.1. 

    These logs don't have app IDs, so they should not be filtered.
    Marcelo Vanzin committed Jun 29, 2015
    Configuration menu
    Copy the full SHA
    7b91b74 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2015

  1. Merge branch 'master' into SPARK-8372

    Marcelo Vanzin committed Jun 30, 2015
    Configuration menu
    Copy the full SHA
    112ae8f View commit details
    Browse the repository at this point in the history

  2. Feedback.

    Marcelo Vanzin committed Jun 30, 2015
    Configuration menu
    Copy the full SHA
    a24eab2 View commit details
    Browse the repository at this point in the history