v0.5.7-rc1

This is primarily a bugfix release to improve Duchy fault tolerance and to make the Honest Majority Share Shuffle (HMSS) protocol available for use.

Issues Addressed

• #1637
• #1644
• #1663
• #1529

Highlights

• More performance improvements for Report creation. See #1641
• The Honest Majority Share Shuffle (HMSS) protocol is now available.
  • TODO(@renjiezh): Describe flags to enable
• The HMSS EDP client library is published as a Maven artifact
  • TODO(@SanjayVas): Link guide

Potentially Requiring Action

• Kubernetes object configuration changes for HMSS. These are required even if HMSS is not enabled.
  • TODO(@renjiezh): Describe the changes
  • See #1632 and #1679

What's Changed

• Fix batch get metrics limit in reports service by @tristanvuong2021 in #1529
• Optimize privacy budget charge for reach and frequency measurement. by @ple13 in #1650
• Use index in existing Measurements check when creating Measurements by @tristanvuong2021 in #1641
• Add executable binary classes and docker images for HMSS. by @renjiezh in #1632
• Create panel match internal versions of protobuf messages by @robinsons in #1661
• Add metrics for HMSS mill. by @renjiezh in #1633
• Update common-jvm to 0.85.0 by @renjiezh in #1664
• Make duchy storage writing error transient. by @renjiezh in #1656
• Add etag support to system ComputationParticipant. by @SanjayVas in #1654
• Add ComputationParticipants.GetComputationParticipant to system API. by @SanjayVas in #1657
• Add FulfillRequisitionRequestBuilder by @kungfucraig in #1638
• Add support for reach only HMSS. by @ple13 in #1655
• chore: update rules_proto dep to 6.0.2 by @SanjayVas in #1667
• Fix api-linter error in system GetComputationParticipant. by @SanjayVas in #1666
• Fix requisition_params being set when set method wasn't called. by @SanjayVas in #1669
• chore: update common-cpp dep to 0.13.0 by @SanjayVas in #1672
• Allow Herald to skip stage to catch up with Measurement state. by @renjiezh in #1671
• Retry updating ComputationParticipant to avoid Measurement failure. by @SanjayVas in #1665
• Create Population Requisition Fulfiller by @jojijac0b in #1527
• Update panel match client to use internal proto definitions. by @robinsons in #1670
• Add Amazon EDP root certificate by @YuhongWang-Amazon in #1676
• Create ExchangeCheckpoint protobuf message for Kingdom-less panel match by @robinsons in #1675
• Add target for exporting shareshuffle library as a Maven artifact. by @SanjayVas in #1674
• Publish Maven artifacts on release. by @SanjayVas in #1680
• Implement CertificateManager for Kingdom-less panel match protocol. by @robinsons in #1681
• fix: use version for common-jvm dep by @SanjayVas in #1687
• Add library to compute the variances for HMSS protocol. by @ple13 in #1677
• Add prioritizedStages for duchy claimTask by @renjiezh in #1673
• HMSS reach-only integration test by @renjiezh in #1679
• Add protocol config to the request header by @kungfucraig in #1690
• Set participant_child_reference_id for claimWork log entries. by @SanjayVas in #1683
• Implement ApiClient for Kingdom-less panel match protocol. by @robinsons in #1685

Full Changelog: v0.5.6...v0.5.7-rc1

v0.5.6

This is primarily a bugfix release to address the following issues:

• Cannot specify separate privacy parameters for single- vs. multi-EDP Measurements in Reporting v2. See #1610
• #1626
• #1636
• #1612
• #1648

Potentially Requiring Action

• MetricSpecConfig for Reporting v2 needs to be updated due to changes in #1610
• Exported OpenTelemetry metrics have been changed slightly. On GKE, these now are exported directly to Google Cloud Monitoring rather than Managed Prometheus. See #1623

What's Changed

• Fix bugs in HMSS implementation. by @renjiezh in #1611
• Adjust Git tag format for nightly builds. by @SanjayVas in #1617
• Escape invalid characters in container image tag. by @SanjayVas in #1620
• Log state transition to SUCCEEDED for MPC Measurements. by @SanjayVas in #1621
• Add missing ignoringRepeatedFieldOrder in ReportsServiceTest V1Alpha by @tristanvuong2021 in #1622
• Fix the bug that enqueues Computations in ending stage. by @renjiezh in #1625
• Add smaller synthetic data set for in-process tests. by @renjiezh in #1618
• Fix the mismatch of dataset k8s config. by @renjiezh in #1628
• Add reach only shuffle and aggregation phase. by @ple13 in #1600
• Add Support for different Privacy Params for Single and Multiple Data Providers by @tristanvuong2021 in #1610
• Stop reading google_container_cluster after creation. by @SanjayVas in #1630
• Add utilities for reading/writing a VidIndexMap from/to a file. by @kungfucraig in #1631
• Add missing population_count_params field to testing MetricSpecConfig by @tristanvuong2021 in #1642
• Follow semantic conventions for OpenTelemetry instruments. by @SanjayVas in #1623
• Disables AWS Postgres password rotation by @YuhongWang-Amazon in #1646
• Split reach and frequency privacy budget for HMSS protocol. by @ple13 in #1635
• Free SWIG string input arg by @kungfucraig in #1639
• Update SyntheticGeneratorCorrectnessTest to use large dataset. by @renjiezh in #1647
• Upgrade to any-sketch-java 0.7.0 by @kungfucraig in #1649
• Make queries use indexes when getting a Report by @tristanvuong2021 in #1643
• Add root CA certs for Meta EDP. by @SanjayVas in #1652
• Improve performance of StreamActiveComputations query. by @SanjayVas in #1651

Full Changelog: v0.5.5...v0.5.6

v0.5.5

This is primarily a bug fix release to address #1616

What's Changed

• Add corresponding seed encryption key in HMSS requisitions. by @renjiezh in #1585
• Fix swapped names for AWS Duchy IP addresses. by @SanjayVas in #1605
• Implement FrequencyVectorBuilder by @kungfucraig in #1604
• Add default service config by @jcorilla in #1603
• Add requisition fulfillment for hmss. by @ple13 in #1567
• Move SecretSeed from database to RequisitionDetails proto. by @renjiezh in #1592
• Support head environment in workflows. by @SanjayVas in #1608
• Enable nightly deployments to head environment. by @SanjayVas in #1609
• Fix setting of Metric state to SUCCEEDED by @tristanvuong2021 in #1593
• Move shareshuffle files to v2alpha subdirectory by @kungfucraig in #1614
• Factor InMemoryVidIndexMap out of VidIndexMap by @kungfucraig in #1615

Full Changelog: v0.5.4...v0.5.5

v0.5.4

This is primarily a bug fix release to address #1596

Potentially Requiring Action

• The dev configuration for EKS now manages external IP addresses with Terraform. See #1586
  • Use terraform import to import your existing Elastic IP address resources to avoid unintentional external IP address changes.

What's Changed

• Skip pushing images in Update CMMS workflow if there's an existing image tag. by @SanjayVas in #1582
• Manage external IP addresses for EKS in Terraform. by @SanjayVas in #1586
• Add back dispatch for image push. by @renjiezh in #1598
• Add INITIALIZED stage for aggregator in HMSS. by @renjiezh in #1587
• Fail correctness/integration test if Measurement is cancelled. by @SanjayVas in #1599
• Populate MeasurementSpec.serialized_measurement_public_key field. by @SanjayVas in #1597

Full Changelog: v0.5.3...v0.5.4

v0.5.3

This is primarily a bug fix release to address #1588

Known Issues

• Requisitions created by the Measurement CLI or Reporting system are not backwards compatible with v0.4.x DataProviders. See #1596

Potentially Requiring Action

• The dev configuration for GKE now manages external IP addresses with Terraform. See #1583
  • Clusters using the dev configuration must be running GKE 1.29+
  • Service resources may need to be manually deleted as migration of existing Services to L4-RBS is not supported.
  • Use terraform import and specify existing IP addresses in your Terraform config to avoid unintentional external IP address changes. See #1590

What's Changed

• Manage external IP addresses for GKE in Terraform. by @SanjayVas in #1583
• Add variables for specifying existing IP addresses in gcloud Terraform modules. by @SanjayVas in #1590
• Populate Requisition.encrypted_requisition_spec_ciphertext field. by @SanjayVas in #1589

Full Changelog: v0.5.2...v0.5.3

v0.5.3-rc1

This is primarily a bug fix release to address #1588

Potentially Requiring Action

• The dev configuration for GKE now manages external IP addresses with Terraform. See #1583
  • Clusters using the dev configuration must be running GKE 1.29+
  • Use terraform import and specify existing IP addresses in your Terraform config to avoid unintentional external IP address changes. See #1590

What's Changed

• Manage external IP addresses for GKE in Terraform. by @SanjayVas in #1583
• Add variables for specifying existing IP addresses in gcloud Terraform modules. by @SanjayVas in #1590
• Populate Requisition.encrypted_requisition_spec_ciphertext field. by @SanjayVas in #1589

Full Changelog: v0.5.2...v0.5.3-rc1

v0.5.2

Starting with these release, scanning alerts for container image vulnerabilities should appear in GitHub Security.

Highlights

• Closed #1544
• Closed #1553
• Various performance improvements for Reporting API operations.
• Updated Java base images.
• More detailed errors from many Kingdom public API services (ongoing).

Potentially Requiring Action

• CMMS instances may define a set of known EventGroup metadata types that are shared between components and integrators. These are the only EventGroup metadata types that can be used by multiple DataProviders. See #1512
  • The Kingdom internal API server and the Reporting v1 and v2 public API servers have a new --known-event-group-metadata-type option for specifying a FileDescriptorSet for these known metadata types.
    • The dev configuration expects this to come from a known_event_group_metadata_type_set.pb file in the config-files ConfigMap. By default, this contains the types defined in simulator_synthetic_data_spec.proto and test_metadata_message.proto
• There is a new required --requisition-fulfillment-service-duchy-id option to the EDP simulator. This is in preparation for supporting the HMSS protocol. See #1574.
  • This option, along with the --requisition-fulfillment-service-target and --requisition-fulfillment-service-cert-host option, form an argument group that can be repeated to allow fulfillment at multiple Duchies.

What's Changed

• Update cross-media-measurement-api dep for CustomMaximumFrequencyPerUser in DeterministicCount methodology by @iverson52000 in #1462
• Increase Mill and EDP simulator memory sizes for dev configuration. by @SanjayVas in #1514
• Remove unnecessary hard-coded delay from K8s panel match test. by @SanjayVas in #1515
• Move reporting sets call out of build internal create metric request method by @tristanvuong2021 in #1499
• Fix race conditions in empty cluster K8s tests. by @SanjayVas in #1517
• Duchy Herald supports HMSS protocol by @renjiezh in #1513
• Introduce the concept of known EventGroup metadata types. by @SanjayVas in #1512
• Implement the aggregation phase of the HMSS protocol. by @ple13 in #1494
• Replace one insert call per row with one insert call for multiple rows by @tristanvuong2021 in #1502
• Replace one update call per row with one update call for multiple rows by @tristanvuong2021 in #1518
• Fix order of batch get measurements response by @tristanvuong2021 in #1519
• Change all Internal Reporting Measurements Service Methods responses to empty responses by @tristanvuong2021 in #1521
• Add internal BatchGetDataProviders. by @SanjayVas in #1523
• Update cross-media-measurement-api dep for DataProvider capabilities. by @SanjayVas in #1472
• Update simulator guides to reflect BigQuery event source changes. by @SanjayVas in #1522
• Update common-jvm dep for base Java image update. by @SanjayVas in #1525
• Add data-providers update-capabilities subcommand to MeasurementSystem CLI. by @SanjayVas in #1528
• Use remote cache when building protobufs for API linter. by @SanjayVas in #1531
• Use values when logging external IDs by @jcorilla in #1532
• Updates Terraform and K8s to support deploy to AWS QA env by @YuhongWang-Amazon in #1534
• Fix bazel container script by @YuhongWang-Amazon in #1536
• Add detailed conversion of internal to external errors by @jcorilla in #1520
• Add detailed logging for public api keys service by @jcorilla in #1541
• Add detailed logging to public accounts service by @jcorilla in #1540
• Add detailed logging for public certificate service by @jcorilla in #1542
• Update local deployment instruction. by @renjiezh in #1543
• Update any-sketch to 0.8 by @kungfucraig in #1554
• Fix dev Duchy kustomization_dir targets not being marked as testonly. by @SanjayVas in #1547
• Update common-jvm dep for grpc-java and netty-codec-http2. by @SanjayVas in #1555
• Add detailed logging to population service by @jcorilla in #1548
• Add detailed logging for public keys service by @jcorilla in #1549
• Update workflows for QA environment. by @SanjayVas in #1546
• Add Open Telemetry Auto Instrumented Traces to Cloud Trace by @tristanvuong2021 in #1537
• Implement HonestMajorityShareShuffle mill by @renjiezh in #1506
• Add stubs for a set of utilities for building a FrequencyVector. by @kungfucraig in #1552
• Add the function to generate hmss sketch. by @ple13 in #1509
• Add State to Internal Metric by @tristanvuong2021 in #1557
• Update common-jvm dep for changes to java_image. by @SanjayVas in #1561
• Improve performance of batch create measurements by @tristanvuong2021 in #1533
• Add CreateUiReport to the CLI by @bdomen-ggl in #1535
• Add detailed logging to requisitions service by @jcorilla in #1550
• Add detailed logging for exchanges service by @jcorilla in #1556
• Add index for update metric calculation spec reporting metrics in create metrics by @tristanvuong2021 in #1538
• Add getUserVirtualIdUniverse() to EventQuery by @renjiezh in #1562
• Add detailed logging to ExchangeSteps and Attempts services by @jcorilla in #1565
• Scan container images with Trivy on release. by @SanjayVas in #1558
• Update Building doc with more recent information. by @SanjayVas in #1572
• Refactor Metric Reuse to handle Metric State by @tristanvuong2021 in #1564
• Add population attribute annotations by @kungfucraig in #1571
• Add detailed logging to data providers service by @jcorilla in #1568
• Add detailed logging to measurement c...

v0.5.2-rc3

Starting with these release, scanning alerts for container image vulnerabilities should appear in GitHub Security.

Highlights

• Closed #1544
• Closed #1553
• Various performance improvements for Reporting API operations.
• Updated Java base images.
• More detailed errors from many Kingdom public API services (ongoing).

Potentially Requiring Action

• CMMS instances may define a set of known EventGroup metadata types that are shared between components and integrators. These are the only EventGroup metadata types that can be used by multiple DataProviders. See #1512
  • The Kingdom internal API server and the Reporting v1 and v2 public API servers have a new --known-event-group-metadata-type option for specifying a FileDescriptorSet for these known metadata types.
    • The dev configuration expects this to come from a known_event_group_metadata_type_set.pb file in the config-files ConfigMap. By default, this contains the types defined in simulator_synthetic_data_spec.proto and test_metadata_message.proto
• There is a new required --requisition-fulfillment-service-duchy-id option to the EDP simulator. This is in preparation for supporting the HMSS protocol. See #1574.
  • This option, along with the --requisition-fulfillment-service-target and --requisition-fulfillment-service-cert-host option, form an argument group that can be repeated to allow fulfillment at multiple Duchies.

What's Changed

• Update cross-media-measurement-api dep for CustomMaximumFrequencyPerUser in DeterministicCount methodology by @iverson52000 in #1462
• Increase Mill and EDP simulator memory sizes for dev configuration. by @SanjayVas in #1514
• Remove unnecessary hard-coded delay from K8s panel match test. by @SanjayVas in #1515
• Move reporting sets call out of build internal create metric request method by @tristanvuong2021 in #1499
• Fix race conditions in empty cluster K8s tests. by @SanjayVas in #1517
• Duchy Herald supports HMSS protocol by @renjiezh in #1513
• Introduce the concept of known EventGroup metadata types. by @SanjayVas in #1512
• Implement the aggregation phase of the HMSS protocol. by @ple13 in #1494
• Replace one insert call per row with one insert call for multiple rows by @tristanvuong2021 in #1502
• Replace one update call per row with one update call for multiple rows by @tristanvuong2021 in #1518
• Fix order of batch get measurements response by @tristanvuong2021 in #1519
• Change all Internal Reporting Measurements Service Methods responses to empty responses by @tristanvuong2021 in #1521
• Add internal BatchGetDataProviders. by @SanjayVas in #1523
• Update cross-media-measurement-api dep for DataProvider capabilities. by @SanjayVas in #1472
• Update simulator guides to reflect BigQuery event source changes. by @SanjayVas in #1522
• Update common-jvm dep for base Java image update. by @SanjayVas in #1525
• Add data-providers update-capabilities subcommand to MeasurementSystem CLI. by @SanjayVas in #1528
• Use remote cache when building protobufs for API linter. by @SanjayVas in #1531
• Use values when logging external IDs by @jcorilla in #1532
• Updates Terraform and K8s to support deploy to AWS QA env by @YuhongWang-Amazon in #1534
• Fix bazel container script by @YuhongWang-Amazon in #1536
• Add detailed conversion of internal to external errors by @jcorilla in #1520
• Add detailed logging for public api keys service by @jcorilla in #1541
• Add detailed logging to public accounts service by @jcorilla in #1540
• Add detailed logging for public certificate service by @jcorilla in #1542
• Update local deployment instruction. by @renjiezh in #1543
• Update any-sketch to 0.8 by @kungfucraig in #1554
• Fix dev Duchy kustomization_dir targets not being marked as testonly. by @SanjayVas in #1547
• Update common-jvm dep for grpc-java and netty-codec-http2. by @SanjayVas in #1555
• Add detailed logging to population service by @jcorilla in #1548
• Add detailed logging for public keys service by @jcorilla in #1549
• Update workflows for QA environment. by @SanjayVas in #1546
• Add Open Telemetry Auto Instrumented Traces to Cloud Trace by @tristanvuong2021 in #1537
• Implement HonestMajorityShareShuffle mill by @renjiezh in #1506
• Add stubs for a set of utilities for building a FrequencyVector. by @kungfucraig in #1552
• Add the function to generate hmss sketch. by @ple13 in #1509
• Add State to Internal Metric by @tristanvuong2021 in #1557
• Update common-jvm dep for changes to java_image. by @SanjayVas in #1561
• Improve performance of batch create measurements by @tristanvuong2021 in #1533
• Add CreateUiReport to the CLI by @bdomen-ggl in #1535
• Add detailed logging to requisitions service by @jcorilla in #1550
• Add detailed logging for exchanges service by @jcorilla in #1556
• Add index for update metric calculation spec reporting metrics in create metrics by @tristanvuong2021 in #1538
• Add getUserVirtualIdUniverse() to EventQuery by @renjiezh in #1562
• Add detailed logging to ExchangeSteps and Attempts services by @jcorilla in #1565
• Scan container images with Trivy on release. by @SanjayVas in #1558
• Update Building doc with more recent information. by @SanjayVas in #1572
• Refactor Metric Reuse to handle Metric State by @tristanvuong2021 in #1564
• Add population attribute annotations by @kungfucraig in #1571
• Add detailed logging to data providers service by @jcorilla in #1568
• Add detailed logging to measureme...

v0.5.2-rc2

Starting with these release, scanning alerts for container image vulnerabilities should appear in GitHub Security.

Highlights

• Closed #1544
• Closed #1553
• Various performance improvements for Reporting API operations.
• Updated Java base images.
• More detailed errors from many Kingdom public API services (ongoing).

Potentially Requiring Action

• CMMS instances may define a set of known EventGroup metadata types that are shared between components and integrators. These are the only EventGroup metadata types that can be used by multiple DataProviders. See #1512
  • The Kingdom internal API server and the Reporting v1 and v2 public API servers have a new --known-event-group-metadata-type option for specifying a FileDescriptorSet for these known metadata types.
    • The dev configuration expects this to come from a known_event_group_metadata_type_set.pb file in the config-files ConfigMap. By default, this contains the types defined in simulator_synthetic_data_spec.proto and test_metadata_message.proto

What's Changed

• Update cross-media-measurement-api dep for CustomMaximumFrequencyPerUser in DeterministicCount methodology by @iverson52000 in #1462
• Increase Mill and EDP simulator memory sizes for dev configuration. by @SanjayVas in #1514
• Remove unnecessary hard-coded delay from K8s panel match test. by @SanjayVas in #1515
• Move reporting sets call out of build internal create metric request method by @tristanvuong2021 in #1499
• Fix race conditions in empty cluster K8s tests. by @SanjayVas in #1517
• Duchy Herald supports HMSS protocol by @renjiezh in #1513
• Introduce the concept of known EventGroup metadata types. by @SanjayVas in #1512
• Implement the aggregation phase of the HMSS protocol. by @ple13 in #1494
• Replace one insert call per row with one insert call for multiple rows by @tristanvuong2021 in #1502
• Replace one update call per row with one update call for multiple rows by @tristanvuong2021 in #1518
• Fix order of batch get measurements response by @tristanvuong2021 in #1519
• Change all Internal Reporting Measurements Service Methods responses to empty responses by @tristanvuong2021 in #1521
• Add internal BatchGetDataProviders. by @SanjayVas in #1523
• Update cross-media-measurement-api dep for DataProvider capabilities. by @SanjayVas in #1472
• Update simulator guides to reflect BigQuery event source changes. by @SanjayVas in #1522
• Update common-jvm dep for base Java image update. by @SanjayVas in #1525
• Add data-providers update-capabilities subcommand to MeasurementSystem CLI. by @SanjayVas in #1528
• Use remote cache when building protobufs for API linter. by @SanjayVas in #1531
• Use values when logging external IDs by @jcorilla in #1532
• Updates Terraform and K8s to support deploy to AWS QA env by @YuhongWang-Amazon in #1534
• Fix bazel container script by @YuhongWang-Amazon in #1536
• Add detailed conversion of internal to external errors by @jcorilla in #1520
• Add detailed logging for public api keys service by @jcorilla in #1541
• Add detailed logging to public accounts service by @jcorilla in #1540
• Add detailed logging for public certificate service by @jcorilla in #1542
• Update local deployment instruction. by @renjiezh in #1543
• Update any-sketch to 0.8 by @kungfucraig in #1554
• Fix dev Duchy kustomization_dir targets not being marked as testonly. by @SanjayVas in #1547
• Update common-jvm dep for grpc-java and netty-codec-http2. by @SanjayVas in #1555
• Add detailed logging to population service by @jcorilla in #1548
• Add detailed logging for public keys service by @jcorilla in #1549
• Update workflows for QA environment. by @SanjayVas in #1546
• Add Open Telemetry Auto Instrumented Traces to Cloud Trace by @tristanvuong2021 in #1537
• Implement HonestMajorityShareShuffle mill by @renjiezh in #1506
• Add stubs for a set of utilities for building a FrequencyVector. by @kungfucraig in #1552
• Add the function to generate hmss sketch. by @ple13 in #1509
• Add State to Internal Metric by @tristanvuong2021 in #1557
• Update common-jvm dep for changes to java_image. by @SanjayVas in #1561
• Improve performance of batch create measurements by @tristanvuong2021 in #1533
• Add CreateUiReport to the CLI by @bdomen-ggl in #1535
• Add detailed logging to requisitions service by @jcorilla in #1550
• Add detailed logging for exchanges service by @jcorilla in #1556
• Add index for update metric calculation spec reporting metrics in create metrics by @tristanvuong2021 in #1538
• Add getUserVirtualIdUniverse() to EventQuery by @renjiezh in #1562
• Add detailed logging to ExchangeSteps and Attempts services by @jcorilla in #1565
• Scan container images with Trivy on release. by @SanjayVas in #1558
• Update Building doc with more recent information. by @SanjayVas in #1572
• Refactor Metric Reuse to handle Metric State by @tristanvuong2021 in #1564
• Add population attribute annotations by @kungfucraig in #1571
• Add detailed logging to data providers service by @jcorilla in #1568
• Add detailed logging to measurement consumers service by @jcorilla in #1569
• Update common-jvm dep for base images. by @SanjayVas in #1575
• Add detailed logging to event groups and metadata descriptors services by @jcorilla in https://github.com/world-federation...

v0.5.2-rc1

Starting with these release, scanning alerts for container image vulnerabilities should appear in GitHub Security.

Highlights

• Closed #1544
• Closed #1553
• Various performance improvements for Reporting API operations.
• Updated Java base images.
• More detailed errors from many Kingdom public API services (ongoing).

Potentially Requiring Action

• CMMS instances may define a set of known EventGroup metadata types that are shared between components and integrators. These are the only EventGroup metadata types that can be used by multiple DataProviders. See #1512
  • The Kingdom internal API server and the Reporting v1 and v2 public API servers have a new --known-event-group-metadata-type option for specifying a FileDescriptorSet for these known metadata types.
    • The dev configuration expects this to come from a known_event_group_metadata_type_set.pb file in the config-files ConfigMap. By default, this contains the types defined in simulator_synthetic_data_spec.proto and test_metadata_message.proto

What's Changed

• Update cross-media-measurement-api dep for CustomMaximumFrequencyPerUser in DeterministicCount methodology by @iverson52000 in #1462
• Increase Mill and EDP simulator memory sizes for dev configuration. by @SanjayVas in #1514
• Remove unnecessary hard-coded delay from K8s panel match test. by @SanjayVas in #1515
• Move reporting sets call out of build internal create metric request method by @tristanvuong2021 in #1499
• Fix race conditions in empty cluster K8s tests. by @SanjayVas in #1517
• Duchy Herald supports HMSS protocol by @renjiezh in #1513
• Introduce the concept of known EventGroup metadata types. by @SanjayVas in #1512
• Implement the aggregation phase of the HMSS protocol. by @ple13 in #1494
• Replace one insert call per row with one insert call for multiple rows by @tristanvuong2021 in #1502
• Replace one update call per row with one update call for multiple rows by @tristanvuong2021 in #1518
• Fix order of batch get measurements response by @tristanvuong2021 in #1519
• Change all Internal Reporting Measurements Service Methods responses to empty responses by @tristanvuong2021 in #1521
• Add internal BatchGetDataProviders. by @SanjayVas in #1523
• Update cross-media-measurement-api dep for DataProvider capabilities. by @SanjayVas in #1472
• Update simulator guides to reflect BigQuery event source changes. by @SanjayVas in #1522
• Update common-jvm dep for base Java image update. by @SanjayVas in #1525
• Add data-providers update-capabilities subcommand to MeasurementSystem CLI. by @SanjayVas in #1528
• Use remote cache when building protobufs for API linter. by @SanjayVas in #1531
• Use values when logging external IDs by @jcorilla in #1532
• Updates Terraform and K8s to support deploy to AWS QA env by @YuhongWang-Amazon in #1534
• Fix bazel container script by @YuhongWang-Amazon in #1536
• Add detailed conversion of internal to external errors by @jcorilla in #1520
• Add detailed logging for public api keys service by @jcorilla in #1541
• Add detailed logging to public accounts service by @jcorilla in #1540
• Add detailed logging for public certificate service by @jcorilla in #1542
• Update local deployment instruction. by @renjiezh in #1543
• Update any-sketch to 0.8 by @kungfucraig in #1554
• Fix dev Duchy kustomization_dir targets not being marked as testonly. by @SanjayVas in #1547
• Update common-jvm dep for grpc-java and netty-codec-http2. by @SanjayVas in #1555
• Add detailed logging to population service by @jcorilla in #1548
• Add detailed logging for public keys service by @jcorilla in #1549
• Update workflows for QA environment. by @SanjayVas in #1546
• Add Open Telemetry Auto Instrumented Traces to Cloud Trace by @tristanvuong2021 in #1537
• Implement HonestMajorityShareShuffle mill by @renjiezh in #1506
• Add stubs for a set of utilities for building a FrequencyVector. by @kungfucraig in #1552
• Add the function to generate hmss sketch. by @ple13 in #1509
• Add State to Internal Metric by @tristanvuong2021 in #1557
• Update common-jvm dep for changes to java_image. by @SanjayVas in #1561
• Improve performance of batch create measurements by @tristanvuong2021 in #1533
• Add CreateUiReport to the CLI by @bdomen-ggl in #1535
• Add detailed logging to requisitions service by @jcorilla in #1550
• Add detailed logging for exchanges service by @jcorilla in #1556
• Add index for update metric calculation spec reporting metrics in create metrics by @tristanvuong2021 in #1538
• Add getUserVirtualIdUniverse() to EventQuery by @renjiezh in #1562
• Add detailed logging to ExchangeSteps and Attempts services by @jcorilla in #1565
• Scan container images with Trivy on release. by @SanjayVas in #1558
• Update Building doc with more recent information. by @SanjayVas in #1572
• Refactor Metric Reuse to handle Metric State by @tristanvuong2021 in #1564
• Add population attribute annotations by @kungfucraig in #1571
• Add detailed logging to data providers service by @jcorilla in #1568
• Add detailed logging to measurement consumers service by @jcorilla in #1569
• Update common-jvm dep for base images. by @SanjayVas in #1575
• Add detailed logging to event groups and metadata descriptors services by @jcorilla in https://github.com/world-federation...