Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to get mapreduce job id from a hive query? #28

Closed
keeyonghan opened this issue Sep 23, 2015 · 3 comments
Closed

How to get mapreduce job id from a hive query? #28

keeyonghan opened this issue Sep 23, 2015 · 3 comments

Comments

@keeyonghan
Copy link

I am wondering if it is possible to get back mapreduce job id from a hive query in PyHive?

Thanks!

@jingw
Copy link
Contributor

jingw commented Sep 24, 2015

Sorry, I don't believe Hive thrift exposes the MR job id. As far as I know, the only solution is to search the JobTracker UI.

@jingw jingw closed this as completed Sep 24, 2015
@ptallada
Copy link
Contributor

ptallada commented Oct 6, 2015

If you need the job ID to track the progress of the query, thrift exposes a method to retrieve query logs and you can see the progress there. Beeline client uses this API too to report progress

Is this method implemented in pyhive? I am very much interested in this :)

Thanks!

@jingw
Copy link
Contributor

jingw commented Oct 6, 2015

Sorry, this has not been implemented.

On Tue, Oct 6, 2015 at 3:30 AM, ptallada notifications@github.com wrote:

If you need the job ID to track the progress of the query, thrift exposes
a method to retrieve query logs and you can see the progress there. Beeline
client uses this API too to report progress

Is this method implemented in pyhive? I am very much interested in this :)

Thanks!


Reply to this email directly or view it on GitHub
#28 (comment).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants