Skip to content
This repository has been archived by the owner on Jan 20, 2022. It is now read-only.

Summingbird changes for Algebird 0.13.0 #715

Closed

Conversation

piyushnarang
Copy link
Collaborator

@piyushnarang piyushnarang commented Feb 16, 2017

Noticed that the Algebird bump broke SB in a couple of places. We might need to also bump Scalding as part of this (which I can do when we have a release out).

@piyushnarang piyushnarang changed the title Summingbird changes for Algebird 0.13.0 WIP: Summingbird changes for Algebird 0.13.0 Feb 16, 2017
@codecov-io
Copy link

codecov-io commented Feb 16, 2017

Codecov Report

Merging #715 into develop will increase coverage by 0.11%.
The diff coverage is 100%.

@@             Coverage Diff             @@
##           develop     #715      +/-   ##
===========================================
+ Coverage    70.84%   70.96%   +0.11%     
===========================================
  Files          141      141              
  Lines         3471     3468       -3     
  Branches       195      195              
===========================================
+ Hits          2459     2461       +2     
+ Misses        1012     1007       -5
Impacted Files Coverage Δ
.../twitter/summingbird/scalding/VersionedState.scala 0% <ø> (ø)
...cala/com/twitter/summingbird/batch/TimeStamp.scala 62.85% <ø> (+6.1%)
.../scala/com/twitter/summingbird/batch/BatchID.scala 81.08% <100%> (ø)
...la/com/twitter/summingbird/scalding/TestUtil.scala 49.12% <ø> (+1.75%)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 476d58e...e0eb39b. Read the comment docs.

@piyushnarang piyushnarang changed the title WIP: Summingbird changes for Algebird 0.13.0 Summingbird changes for Algebird 0.13.0 Feb 16, 2017
@piyushnarang
Copy link
Collaborator Author

@pankajroark / @johnynek / @ttim - please take a look when you can, thanks.

@@ -81,7 +79,7 @@ class HDFSStateLaws extends WordSpec {
}
}

def leftClosedRightOpenInterval(low: Timestamp, high: Timestamp) = Interval.leftClosedRightOpen[Timestamp](low, high).right.get
def leftClosedRightOpenInterval(low: Timestamp, high: Timestamp) = Interval.leftClosedRightOpen[Timestamp](low, high)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we put a type on the result here? Interval[Timestamp]

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sure

@johnynek
Copy link
Collaborator

👍


import com.twitter.algebird.{ Intersection, Interval }
import com.twitter.scalding.{ DateParser, RichDate }
import java.util.{TimeZone, UUID}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: I think it should be with spaces (I think it's where your IDEA style settings going against our scalafmt setup).

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah seems like the Twitter defaults are set to not include the space :-).

ttim pushed a commit to ttim/summingbird that referenced this pull request May 10, 2017
@ttim ttim mentioned this pull request May 11, 2017
ttim pushed a commit to ttim/summingbird that referenced this pull request May 11, 2017
@ttim ttim mentioned this pull request May 11, 2017
ttim pushed a commit to ttim/summingbird that referenced this pull request May 26, 2017
ttim pushed a commit to ttim/summingbird that referenced this pull request May 31, 2017
ttim pushed a commit to ttim/summingbird that referenced this pull request Jun 2, 2017
@ttim ttim mentioned this pull request Jun 2, 2017
ttim added a commit that referenced this pull request Jul 25, 2017
* Remove scala 2.10 and add scala 2.12

* Bump versions of deps

* Fix algebird related issues based on #715

* Fix finagle related compilation error

* Fix ClientStoreLaws

* Bump scalding version

* Rename TimeStamp.scala to Timestamp.scala and fix serialization of timestampSuccessible

* Remove usage of JavaConversions

* Trying to fix travis scalacheck fail

* Introduce ArbitraryWorkaround object

* Bump scalding version
@johnynek
Copy link
Collaborator

looks like develop already has this. closing.

@johnynek johnynek closed this Feb 15, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants