This repository has been archived by the owner on Jul 21, 2023. It is now read-only.
[schema] aggregation-share/sum-part has incorrect cardinality of sum and batch_uuid #3
Labels
p1
Must be fixed for the corresponding milestone to be reached.
schema-protocol
issues with encoding formats or protocol between servers requiring coordination outside ISRG
Milestone
In the original protobuf schema defined in the IDL document,
PrioSumPart
contained a singlebytes value_sum
field, and a repeatedbatch_uuid
list. Thebatch_uuid
list represents the uuids of all of the batches (tracing back to the ingestor) that participated in this aggregation.At some point in the conversion to Avro, this got flipped and the current schema now has only a single
batch_uuid
, but an array ofsums
.Not only does this not let us properly represent the
batch_uuid
s when we do the final multi-batch reduction sum, thesums
array will also always contain only one value (because all aggregations we'll do always produce a single output sum per file, both the per-batch sum, and the overall sum for a given time range), so this seems like an oversight and should be fixed to match the intent of the original schema.The text was updated successfully, but these errors were encountered: