Skip to content
This repository was archived by the owner on May 12, 2021. It is now read-only.

TAJO-1289: History reader fails to get the query information after a successful query execution#356

Closed
jinossy wants to merge 6 commits into
apache:masterfrom
jinossy:TAJO-1289
Closed

TAJO-1289: History reader fails to get the query information after a successful query execution#356
jinossy wants to merge 6 commits into
apache:masterfrom
jinossy:TAJO-1289

Conversation

@jinossy
Copy link
Copy Markdown
Member

@jinossy jinossy commented Jan 22, 2015

Main problem is some corrupted history files in hdfs. TajoClient are to get a query status in finished list when a query is finished. but the finished list is a stored files
So I’ve add LRU map for a finished query caching, and fix hidden race condition bug.

@blrunner
Copy link
Copy Markdown
Contributor

+1

Thank you for your contribution.
It looks good to me and I found that history server ran as expected on my testing server. :)

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In some cases, it may result in lots of histories. In that case, It will cause long latency. Later, we need to improve the paging feature in new jira.

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree with you, we should make to pagination

@hyunsik
Copy link
Copy Markdown
Member

hyunsik commented Jan 22, 2015

The patch looks nice to me. I leave some trivial comments.

@jinossy
Copy link
Copy Markdown
Member Author

jinossy commented Jan 23, 2015

Thanks guys for the review. I’ll commit it shortly.
If you have more review, please let me know

@jinossy
Copy link
Copy Markdown
Member Author

jinossy commented Jan 23, 2015

I've add two configuration following:

tajo.history.query.replication
tajo.history.task.replication

Please review again
Thanks

@asfgit asfgit closed this in a15b5fa Jan 23, 2015
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants