Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Browse files

massive update to CHANGES.txt (fixes #246)

  • Loading branch information...
commit 877e30722709c953f7d19a88eadc142b8a47806c 1 parent ccc17d6
David Marin authored
Showing with 56 additions and 10 deletions.
  1. +56 −10 CHANGES.txt
View
66 CHANGES.txt
@@ -1,13 +1,59 @@
-v0.3.0, ??? -- ???!
- * Changes that (slightly) break compatibility with 0.2.x:
- * ec2_instance_type option now only sets instance type for slave nodes when
- there are multiple EC2 instances (Issue #66)
- * job_name_prefix option is gone (was deprecated)
- * default Hadoop version on EMR is 0.20 (was 0.18)
- * hadoop_bin, python_bin, and ssh_bin can now all take switches (Issue #96)
- * Old ways of specifying protocols are deprecated in favor of new instance-
- based behavior
- * Removed debian packaging (should be handled separately)
+v0.3.0, 2011-11-?? -- Worth the wait
+ * Configuration:
+ * Saner mrjob.conf locations (Issue #97):
+ * ~/.mrjob is deprecated in favor of ~/.mrjob.conf
+ * searching in PYTHONPATH is deprecated
+ * MRJOB_CONF environment variable for custom
+ * Defining Jobs (MRJob):
+ * Combiner support (Issue #74)
+ * *_init() and *_final() methods for mappers, combiners, and reducers
+ (Issue #124)
+ * Protocols:
+ * Protocols can be anything with read() and write() methods, and are
+ instances by default (Issue #229)
+ * Set protocols with the *_PROTOCOL attributes or by re-defining the
+ *_protocol() methods
+ * Built-in protocol classes cache the encoded and decoded value of the
+ last key for faster decoding during reducing (Issue #230)
+ * --*protocol switches and aliases are deprecated (Issue #106)
+ * Set Hadoop formats with HADOOP_*_FORMAT attributes or the hadoop_*_format()
+ methods (Issue #241)
+ * --hadoop-*-format switches are deprecated
+ * Hadoop formats can no longer be set from mrjob.conf
+ * Set jobconf with JOBCONF attribute or the jobconf() method (in addition
+ to --jobconf)
+ * Set Hadoop partitioner class with --partitioner, PARTITIONER, or
+ partitioner() (Issue #6)
+ * Custom option parsing (Issue #172)
+ * Use mrjob.compat.get_jobconf_value() to get jobconf values from environment
+ * Running jobs:
+ * All modes:
+ * All runners are Hadoop-version aware and use the correct jobconf and
+ combiner invocation styles (Issue #111)
+ * All types of URIs can be passed through to Hadoop (Issue #53)
+ * Speed up steps with no mapper by using cat (Issue #5)
+ * Stream compressed files with cat() method (Issue #17)
+ * hadoop_bin, python_bin, and ssh_bin can now all take switches (Issue #96)
+ * job_name_prefix option is gone (was deprecated)
+ * Better cleanup (Issue #10):
+ * Separate cleanup_on_failure option
+ * More granular cleanup options
+ * Cleaner handling of passthrough options (Issue #32)
+ * emr mode:
+ * job flow pooling (Issue #26)
+ * vastly improved log fetching via SSH (Issue #2)
+ * New tool: mrjob.tools.emr.fetch_logs
+ * default Hadoop version on EMR is 0.20 (was 0.18)
+ * ec2_instance_type option now only sets instance type for slave nodes
+ when there are multiple EC2 instances (Issue #66)
+ * inline mode:
+ * Supports cmdenv (Issue #136)
+ * local mode:
+ * Runs 2 mappers and 2 reducers in parallel by default (Issue #228)
+ * Preliminary Hadoop simulation for some jobconf variables (Issue #86)
+ * Misc:
+ * boto 2.0+ is now required (Issue #92)
+ * Removed debian packaging (should be handled separately)
v0.2.8, 2011-09-07 -- Bugfixes and betas
* Fix log parsing crash dealing with timeout errors
Please sign in to comment.
Something went wrong with that request. Please try again.