Skip to content
This repository has been archived by the owner on Jan 15, 2022. It is now read-only.

make hRaven hadoop 2.0 compatible #5

Closed
vrushalic opened this issue Jul 9, 2013 · 2 comments
Closed

make hRaven hadoop 2.0 compatible #5

vrushalic opened this issue Jul 9, 2013 · 2 comments
Assignees
@vrushalic
Labels
enhancement
Milestone
0.9.4

Comments

@vrushalic
Copy link
Collaborator

hRaven needs to be enhanced to process the job history files generated by hadoop 2.0.

The job history file format has changed from 1.0. It is now a avro-json format.

There is a job history parser api which can be used to process the jobhistory files.
vrushalic pushed a commit to vrushalic/hraven that referenced this issue Jul 29, 2013
[Issue twitter#5] make hRaven hadoop 2.0 compatible
7e521af
@vrushalic
Copy link
Collaborator Author

One known limitation in JobHistoryParser is being tracked in https://issues.apache.org/jira/browse/MAPREDUCE-5432

@ghost ghost assigned vrushalic Jul 29, 2013
vrushalic pushed a commit to vrushalic/hraven that referenced this issue Aug 7, 2013
[Issue twitter#5] Adding a mapping for hadoop 2.0 keys to hadoop 1.0 …
2e379f5 
…to be compatible, also formatting changes
vrushalic pushed a commit to vrushalic/hraven that referenced this issue Aug 8, 2013
[Issue twitter#5] updating regex for job history file names in 2.0
37261f0
vrushalic pushed a commit to vrushalic/hraven that referenced this issue Aug 13, 2013
[Issue twitter#5] Creating enum class for Hadoop 2.0 record types and…
4192cc4 
… other review changes
vrushalic pushed a commit to vrushalic/hraven that referenced this issue Aug 13, 2013
[Issue twitter#5] adding some more comments and correcting formatting
7327ff7
vrushalic pushed a commit to vrushalic/hraven that referenced this issue Aug 14, 2013
[Issue twitter#5] modifying as per review suggestions for null checks…
0cd6334 
… and year in copy right, also adding in some more keys I saw in 2.0.5 history files
vrushalic pushed a commit to vrushalic/hraven that referenced this issue Aug 20, 2013
[Issue twitter#5] Updating to work as a hadoop 1.0 compiled jar on a …
2d7af69 
…hadoop 2.0 cluster to process 2.0 job history files
vrushalic pushed a commit to vrushalic/hraven that referenced this issue Aug 26, 2013
[Issue twitter#5] updating as per review suggestions
8dbe3d8
@vrushalic
Copy link
Collaborator Author

pull request merged to master

#18

angadsingh referenced this issue in angadsingh/hraven Sep 21, 2015
@sandeepSamudrala
Merge pull request InMobi#5 from avi-ram/nominalTime
b14e9e1 
USER-3381: support for nominalTime
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@vrushalic vrushalic

Labels
enhancement
Projects
None yet
Milestone
0.9.4
Development

No branches or pull requests
1 participant
@vrushalic