Join GitHub today
GitHub is home to over 20 million developers working together to host and review code, manage projects, and build software together.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
|Failed to load latest commit information.|
# Copyright 2012 Raj Vishwanathan (email@example.com) # # Licensed under the Apache License, Version 2.0 (the "License"); # you may not use this file except in compliance with the License. # You may obtain a copy of the License at # # http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. # INSTALLATION Copy summary.py and tasks.py to a directory of choice. OVERVIEw Provides the summary of a hadoop job based on the default hadoop log. USAGE: summary [-v| --verbose] -j | --job log-file DESCRIPTION summary provides a succinct or verbose analyis of a hadoop job based on the log file. The output is a CSV file that can be used by other programs for deeper analysis. summary is not clever at all. If the log file suits it, it delivers reasonable results. If the log file is not suitable it could either survive or die a horrible death. More work is needed to make summary a more robust character. The log file is assumed to be the default hadoop log. It has not been tested with other formats. OPTIONS -j, --job Job log file. Mandatory. -v, --verbose Provide analysis of both job and task logs. -h, --help Provide a succinct and unhelpful message. PYTHON It has been tested with Python 2.7.2+