Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Scalding 0.17.2 release #1707

Merged
merged 2 commits into from
Jul 14, 2017
Merged

Scalding 0.17.2 release #1707

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
c218e3d
Bump version and add changes to CHANGES.md
Jul 14, 2017
93ecbf3
Update scalding version in more places
Jul 14, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
57 changes: 57 additions & 0 deletions CHANGES.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,5 +1,62 @@
# Scalding #

### Version 0.17.2 ###
This version is basically the same as 0.17.1 but backward compatible with 0.17.0.
* Revert memory estimator changes on 0.17.x branch: #1704
* Turn on mima checks on 0.17.x branch: #1706

### Version 0.17.1 ###
This version breaks backward compatibility with 0.17.0, don't use it, use 0.17.2 instead.
* Request for Scalding release 0.17.0: #1641
* make ordered serialization stable across compilations: #1664
* Remove unnecessary semicolon: #1668
* Add tailrec annotation: #1671
* Be more paranoid about Kryo registration order: #1673
* Update sbt version to 0.13.15: #1677
* Register all Boxed classes in Kryo: #1678
* Fix serialization of KryoHadoop: #1685
* Merge pull request #1686 from ttim/cherry_pick_0.17.x_changes
* Fix stack overflow in typedPipeMonoid.zero: #1688
* A couple of fixes into the 0.17.x branch: #1695
* Memory estimator changes to 0.17.x branch: #1700

### Version 0.17.0 ###
This is the first Scalding release that publishes artifacts for Scala 2.12!
* 2.12 releated updates: #1663, #1646
* Use reflection over Jobs to find serialized classes: #1654, #1662
* Simplify match statement and use collection.breakOut: #1661
* Add explicit types to implicit methods and values: #1660
* Reducer estimation size fixes: #1652, #1650, #1645, #1644
* Use Combined*SequenceFile for VKVS, WritableSequenceFileScheme, SequenceFileScheme: #1647
* Improve Vertica support in scalding-db: #1655
* Add andThen to Mappable: #1656
* Expand libjars globs in ScaldingShell to match the behavior of Tool: #1651
* Use Batched in Sketch production: #1648
* Pick up Algebird 0.13.0: #1640
* Added API for Execution/Config to work with DistributedCache: #1635
* Bump chill version to 0.8.3: #1634
* Fixes a bug in how we use this stack: #1632
* Upgrade build to sbt 0.13.13: #1629
* Generate Scalding microsite via sbt-microsites: #1623
* FileSource support for empty directories: #1622, #1618, #1613, #1611, #1591
* Clean up temporary files created by forceToDiskExecution: #1621
* Moving the repl in wonderland to a dedicated md file: #1614
* Update Scala and sbt version: #1610
* REFACTOR: Fixed some compilation warnings: #1604
* REFACTOR: Rename parameter to reflect expectation: #1601
* Add partitioned sources for Parquet thrift / scrooge: #1590
* Add a test for sortBy: #1594
* Create COMMITTERS.md: #1589
* Use ExecutionContext in Execution.from/fromTry: #1587
* Support custom parquet field name strategies: #1580
* Deprecate reflection-based JobTest apply method: #1578
* Use Caching for FlowDefExecution: #1581
* [parquet tuple macros] listType was deprecated in favor of listOfElements: #1579
* Use Batched to speed up CMS summing on mappers: #1575
* Remove a TypedPipeFactory wrapper which seems unneeded: #1576
* Make Writeable sources Mappable to get toIterator: #1573
* case class implicit children: #1569

### Version 0.16.0 ###

* Add tests around hashcode collisions : #1299
Expand Down
2 changes: 1 addition & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -97,7 +97,7 @@ We use [Coveralls](https://coveralls.io/r/twitter/scalding) for code coverage re

Scalding modules are available from maven central.

The current groupid and version for all modules is, respectively, `"com.twitter"` and `0.17.0`.
The current groupid and version for all modules is, respectively, `"com.twitter"` and `0.17.2`.

Current published artifacts are

Expand Down
2 changes: 1 addition & 1 deletion scalding-core/src/main/scala/com/twitter/package.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ package object scalding {
/**
* Make sure this is in sync with version.sbt
*/
val scaldingVersion: String = "0.17.0"
val scaldingVersion: String = "0.17.2"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should automate this: we could have the build create a file and we could import that file to get the version (I have seen people do something similar for the git-sha which would also be nice.


object RichPathFilter {
implicit def toRichPathFilter(f: PathFilter) = new RichPathFilter(f)
Expand Down
2 changes: 1 addition & 1 deletion tutorial/execution-tutorial/ExecutionTutorial.scala
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ To test it, first build the assembly jar from root directory:
./sbt execution-tutorial/assembly

Run:
scala -classpath tutorial/execution-tutorial/target/execution-tutorial-assembly-0.17.0.jar \
scala -classpath tutorial/execution-tutorial/target/execution-tutorial-assembly-0.17.2.jar \
com.twitter.scalding.tutorial.MyExecJob --local \
--input tutorial/data/hello.txt \
--output tutorial/data/execution_output.txt
Expand Down
2 changes: 1 addition & 1 deletion version.sbt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1 +1 @@
version in ThisBuild := "0.17.1-SNAPSHOT"
version in ThisBuild := "0.17.2"