chore: Containers reduced to ~100MB total. ~30s installation.

[charlielye]

TLDR: Want to test?

for img in aztec-sandbox cli noir; do docker pull aztecprotocol/${img}:cl_sandbox_cli_layer_share; done

More wonderful improvements:

• We build a common prod image (yarn-project-prod) shared between sandbox and cli, so we only pull the data once for both images. The actual cli/sandbox images now just specify how to actually run. This gets the compressed image size down to about ~110mb. Took about 50s to pull/extract sandbox, cli and nargo on crappy office connection (30s on home connection).
• We introduce buildx for the creation of multiarch images, allowing us to ditch the doubling of jobs and manifest creation phases of multiarch images.
  • This makes most sense for small containers. It doesn't replace the traditional flow for large project builds such as noir as it uses virtualisation.
  • Multiarch is configured by a new multiarch property added to the build manifest. If set to buildx it uses buildx virtualisation, if set to host it's expected that two host machines with different arches do the build (as traditionally).
  • This also goes back to a pattern of there being no arch postfix by default on image tags, instead we only apply the postfix to images specifically where multiarch: host is enabled. The ecr manifest job is then expected to immediately create the postfixless version.
• We separate some calculate_content_hash stuff into calculate_rebuild_files to aid debugging rebuild pattern stuff.
• deploy_dockerhub is extensively simplified and sped up by using skopeo to perform direct registry to registry multiarch image copies and retags.
• The concept of commit messages with [ci force-release] is introduced, and at present if enabled, images will pushed to dockerhub with the normalised branch name as a tag. Npm stuff does nothing still.
• We separate the concept of deploy and release, where a release is a publishing of artefacts, and a deploy involves deployment of services etc in AWS.
• noir has stricter rebuild patterns specified to prevent aggressive rebuilding.
• Change some sync fs calls to async.

[AztecBot]

Benchmark results

No metrics with a significant change found.

Detailed results

All benchmarks are run on txs on the Benchmarking contract on the repository. Each tx consists of a batch call to create_note and increment_balance, which guarantees that each tx has a private call, a nested private call, a public call, and a nested public call, as well as an emitted private note, an unencrypted log, and public storage read and write.

This benchmark source data is available in JSON format on S3 here.

Values are compared against data from master at commit ebdeea3f and shown if the difference exceeds 1%.

L2 block published to L1

Each column represents the number of txs on an L2 block published to L1.

Metric	8 txs	32 txs	128 txs
l1_rollup_calldata_size_in_bytes	45,444	179,588	716,132
l1_rollup_calldata_gas	222,996	868,340	3,449,564
l1_rollup_execution_gas	842,083	3,595,448	22,204,933
l2_block_processing_time_in_ms	2,193	8,424 (-2%)	34,954 (-2%)
note_successful_decrypting_time_in_ms	310 (-2%)	920 (-1%)	3,318 (-1%)
note_trial_decrypting_time_in_ms	19.5 (-20%)	47.6 (-13%)	197 (-1%)
l2_block_building_time_in_ms	20,428 (-1%)	80,914	324,942
l2_block_rollup_simulation_time_in_ms	16,891 (-1%)	66,989	268,981
l2_block_public_tx_process_time_in_ms	3,490	13,778	55,407

L2 chain processing

Each column represents the number of blocks on the L2 chain where each block has 16 txs.

Metric	5 blocks	10 blocks
node_history_sync_time_in_ms	24,658 (+1%)	47,526
note_history_successful_decrypting_time_in_ms	2,142	4,202 (+1%)
note_history_trial_decrypting_time_in_ms	163	232 (+2%)
node_database_size_in_bytes	2,794,477	5,023,970
pxe_database_size_in_bytes	29,748	59,307

Circuits stats

Stats on running time and I/O sizes collected for every circuit run across all benchmarks.

Circuit	circuit_simulation_time_in_ms	circuit_input_size_in_bytes	circuit_output_size_in_bytes
private-kernel-init	199 (-3%)	43,109	20,441
private-kernel-ordering	114 (-5%)	25,833	9,689
base-rollup	2,954 (-3%)	664,108	873
root-rollup	86.1 (-3%)	4,072	1,097
private-kernel-inner	259 (-2%)	64,516	20,441
public-kernel-private-input	171 (-1%)	25,203	20,441
public-kernel-non-first-iteration	168 (-2%)	25,245	20,441
merge-rollup	10.8 (-1%)	2,592	873

Miscellaneous

Transaction sizes based on how many contracts are deployed in the tx.

Metric	0 deployed contracts	1 deployed contracts
tx_size_in_bytes	10,323	25,938