TAJO-1026: Implement Query history persistency manager.

[babokim]

Query history has the three types of files.

• Query list file: saving the list of query(default store is hdfs), hourly rolling, stored by TajoMaster.

<tajo.query-history.path>/<yyyyMMdd>/query-list/query-list-<sequence>.hist

• Query detail file: saving the query plan and execution block summary(default store is hdfs), single file per query or execution block, stored by QueryMaster.

<tajo.query-history.path>/<yyyyMMdd>/query-detail/<QUERY_ID>/query.hist

<tajo.query-history.path>/<yyyyMMdd>/query-detail/<QUERY_ID>/<EB_ID>.hist

• Task detail file: saving the task history(default is local), stored by Worker.

  <tajo.task-history.path>/<yyyyMMdd>/tasks/<WORKER_HOST>_<WORKER_PORT>/<WORKER_HOST>_<WORKER_PORT>_<HH>_<seq>.hist

And I added page navigation in query.jsp and querytasks.jsp

[hyunsik]

I'm sorry for late review. Could you rebase it against the latest revision?

Actually, I'm already reviewing it after trivial rebase. But it is better for you to push the rebased version because github pull request (PR) does not allow some user to push to another user's PR.

[babokim]

I'm sorry for late rebase. I just rebase.

[hyunsik]

I'd like to suggest using tajo.history prefix for query and task histories. It seems to be more consistency. Also, we already use -expiry-time-[unit] suffix for expiry time. So, I'd like to suggest the followings:

• tajo.history.query.dir
• tajo.history.task.dir
• tajo.history.expiry-time-day

[babokim]

It looks better. I will modify it as your comment.

[hyunsik]

Hi @babokim,

It's really great work. This work will reduce our memory consumption for keeping history in memory, and this work is able to keep history longer than now.

I leave some comments and some questions. After your feedback, I'll finish the review.

[hyunsik]

+1

The patch looks nice to me. I checked the history list and task details in web UI. They work well.

[babokim]

@hyunsik Thanks. I had just committed.