Update Dataflow SDK to 1.7.0

[ravwojdyla]

New Dataflow SDK release.

[ravwojdyla]

Plain bump PR -> #253

[ravwojdyla]

There seems to be some change in the way BQIO handles Integers/Long. For tests using BQIO, expected values are encoded via TableRowJsonCoder - which codes TableRow as Json (Long becomes Integer). This was fine in 1.6.1 as actual (coming from pipelines) values in TableRows were Integer (at least during the matching) as well, after bumping to 1.7.0 this is no longer the case. TableRows coming from pipeline results use Long while TableRows in expected values use Integer (even if input values are Long - the conversion Long -> Integer happens after TableRowJsonCoder encode/decode cycle) thus mismatch. I'm working on fixing this.

[ravwojdyla]

Pushed the change that is fixing tests - by forcing the use of Int on the actual, still not sure where the difference is coming from.

[nevillelyh]

We were using Ints in expected before. Maybe should change them to Long instead?

I suspect they changed equality behavior of table row fields?

[nevillelyh]

You're right TableRowJsonCoder did something funky with expected. I'll leave this alone.

[ravwojdyla]

More on the issue:

• http://stackoverflow.com/questions/33622227/dataflow-mixing-integer-long-types
• http://stackoverflow.com/questions/7316689/forcing-jackson-to-deserialize-to-specific-primitive-type

Serialization ... 💀

[ravwojdyla]

If I understand things correctly - I don't like how DataflowAssert does encode/decode cycle on expected values (code) but NOT on actual - thus in case of TableRow we end up with this inconsistency (apart from TableRow/Jackson Int/Long "optimization").

I think we should (and will submit PR shortly) enforce encode/decode on actual too to keep it consistent and that would also solve the problem of how TableRow/Jackson handles Int/Long.

Interestingly there is DeserializationFeature.USE_LONG_FOR_INTS maybe TableRow Coder should enforce it - given that in BQ there is no "Integer", only "Long". But that is probably up to DF/BQ.

[ravwojdyla]

Updated PR -> #253 with serde cycle.