Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-2080] Yarn: report HS URL in client mode, correct user in cluster mode. #1002

Closed
wants to merge 2 commits into from

Commits on Jun 6, 2014

  1. Yarn: report HS URL in client mode, correct user in cluster mode.

    Yarn client mode was not setting the app's tracking URL to the
    History Server's URL when configured by the user. Now client mode
    behaves the same as cluster mode.
    
    In SparkContext.scala, the "user.name" system property had precedence
    over the SPARK_USER environment variable. This means that SPARK_USER
    was never used, since "user.name" is always set by the JVM. In Yarn
    cluster mode, this means the application always reported itself as
    being run by user "yarn" (or whatever user was running the Yarn NM).
    One could argue that the correct fix would be to use UGI.getCurrentUser()
    here, but at least for Yarn that will match what SPARK_USER is set
    to.
    Marcelo Vanzin committed Jun 6, 2014
    Configuration menu
    Copy the full SHA
    4c692d9 View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2014

  1. Set HS link in yarn-alpha also.

    Marcelo Vanzin committed Jun 10, 2014
    Configuration menu
    Copy the full SHA
    4046e04 View commit details
    Browse the repository at this point in the history