Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Explore protocol buffers vs Avro #1031
GA4GH says they are moving to protocol buffers as opposed to Avro due to the streaming rpc support in PB - which is lacking in Avro. Is this use case, and compatibility with GA4GH, sufficient reason to consider a branch/option of ADAM and bdg that uses PB instead of Avro?
Since we just rely on Avro for serialization and model definition, we wouldn't benefit from the streaming RPC support. For compatibility, I like the "view" approach that we take, where we translate data from underlying storage format
Since our long term roadmap is to move to Datasets (where the serialization framework is somewhat moot other than for defining schemas), I'm -0.5 on exploring protobuf.