Merge remote-tracking branch 'origin/main' into canton-3.4 (#1942) * List amulet allocations (#1508) --------- Signed-off-by: Oriol Muñoz * [static] Add ability to configure topology change delay per cluster (#1521) Signed-off-by: Nicu Reut * Aggregate sequencer client delay metrics (#1523) Without this we get two entries for the same SV if the pod got restarted and it just looks confusing. [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * [static] Add ability to configure the number of sql backups to retina (#1524) Signed-off-by: Nicu Reut * Add new Helm-chart "splice-info" (#332) This helm charts runs a simple web-server to provide static deployment and dynamic runtime information as JSON files. - Static deployment configuration is published as JSON under / - Runtime part supports fetching DSO information from Scan and publishes it under /runtime/dso.json Signed-off-by: Stanislav German-Evtushenko * [static] Reduce resource requests for sv-app/sv validator (#1527) Signed-off-by: Nicu Reut * docs, fix: Move splice-info notes to unreleased (#1529) This is a follow up fix for https://github.com/hyperledger-labs/splice/pull/332 Signed-off-by: Stanislav German-Evtushenko * Include round numbers in triggers logs (#1525) [ci] Got somewhat annoyed only seeing cids in some logs Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Backend to Allow withdrawing an AmuletAllocation (#1528) --------- Signed-off-by: Oriol Muñoz * 0.4.6 release notes (#1535) Signed-off-by: Itai Segall * Improvements to docker image scanning (#1537) Signed-off-by: Itai Segall * post cutting 0.4.6 (#1538) Signed-off-by: Itai Segall * Adjust contention alert (#1519) Signed-off-by: Julien Tinguely * Support limited parallelism in ExecuteConfirmedActionTrigger (#1539) part of https://github.com/DACH-NY/canton-network-internal/issues/932 This should help working through large sets of stale tasks without increasing contention. [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Set default `delegatelessContention` monitoring threshold (#1545) Came up here: https://github.com/hyperledger-labs/splice/pull/1519/files#r2213557976 Otherwise we have to set it per-cluster... [static] Signed-off-by: Martin Florian * [ci] Update canton_log ignore. (#1526) Signed-off-by: Raymond Roestenburg * Pulumi: support loading an additional common config override (#1554) Fixes #1490 [static] Signed-off-by: Martin Florian * Disable multi-synchronizer triggers in SV and validator app (#1542) CI doesn't complain so clearly they're not needed. [ci] fixes #1534 Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Extend skipSynchronizerInitialization to mediator (#1551) [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * updates to main after 0.4.7 (#1562) Signed-off-by: Itai Segall * wait for docker daemon before running in gha (#1563) Signed-off-by: Itai Segall * Fix SV onboarding if DSO party is already hosted (#1569) [ci] fixes #1568 Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Allow withdrawing an AmuletAllocation (FE) (#1555) --------- Signed-off-by: Oriol Muñoz * Add dashboard for acs commitment performance (#1574) * Add dashboard for acs commitment performance [static] Signed-off-by: Moritz Kiefer * pretend canton is not always canton-network [static] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Move acknowledgements to a separate dashboard (#1576) [static] The acknowledgement metrics are really slow due to the large number of members (I think). Moving it to a separate dashboard seems sensible since it's really tracking something different than the rest of the dashboard which tracks our own nodes whereas acks track different nodes. Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * splice-info, fix: Do not prepend an extra prefix "md5:" and add the relevant validation to the Helm chart (#1566) - pulumi, info, fix: Do not prepend an extra prefix "md5:". It is prepended by the helm chart so we don't need to do this again. - cluster, helm, splice-info: Validate digests. --------- Signed-off-by: Stanislav German-Evtushenko * [static] Adjust resources for validator/sv participants (#1547) Signed-off-by: Nicu Reut * [static] Adjust multi validator resources based on observed usage (#1546) Signed-off-by: Nicu Reut * Fix race condition in checkTxHistory (test) (#1578) --------- Signed-off-by: Oriol Muñoz Co-authored-by: moritzkiefer-da <45630097+moritzkiefer-da@users.noreply.github.com> * [ci] Retry dump participant identities. (#1581) Signed-off-by: Raymond Roestenburg * periodically run all CI with canton OSS (#1515) Signed-off-by: Itai Segall * Document `help wanted` and `good first issue` labels (#1540) [static] Signed-off-by: Martin Florian * Fix `Failed clue` log checker failure... (#1585) TIL that if you put a `clue` in an `eventually` the log checker might get unhappy. Fixes https://github.com/DACH-NY/cn-test-failures/issues/5060 [ci] Signed-off-by: Martin Florian * Remove GCP log alert queries from this repo (#1583) Moved them to our internal repo in https://github.com/DACH-NY/canton-network-internal/pull/943 [static] Signed-off-by: Martin Florian * [ci] Check that gh API returns JSON before passing to jq. (#1584) * [ci] Check that gh API returns JSON before passing to jq. Signed-off-by: Raymond Roestenburg * Update .github/workflows/pr_cluster_test.yml Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Signed-off-by: Raymond Roestenburg <98821776+ray-roestenburg-da@users.noreply.github.com> --------- Signed-off-by: Raymond Roestenburg Signed-off-by: Raymond Roestenburg <98821776+ray-roestenburg-da@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * fix untrapped signals in gha run.sh (#1589) Signed-off-by: Itai Segall * Backend to allow rejecting an AllocationRequest (#1586) --------- Signed-off-by: Oriol Muñoz * [static] Add dependency on scan to the info chart (#1591) Prevents crash loops until scan is deployed Signed-off-by: Nicu Reut * [static] Include istio rate limit for scan acs endpoints (#1590) Signed-off-by: Nicu Reut * Fix deploying clusters with no logAlerts set (#1596) Got broken with #1583 Signed-off-by: Martin Florian * Frontend to allow rejecting an AllocationRequest (#1597) --------- Signed-off-by: Oriol Muñoz * Reduce acknowledgement interval to 10m (#1598) fixes #1570 Tested on a scratch, seems to do what we want. Not documenting the min observation duration explicitly. That one has even less impact. Making it configurable doesn't seem worth here, you always have ADDITIONAL_CONFIG overwrites if you really need it. [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * pin all base images by digest (#1567) Signed-off-by: Itai Segall * Add `expected.json` for `gcp-project` (#1593) I'm changing things in `gcp-project` for https://github.com/DACH-NY/canton-network-internal/issues/798; having an expected files seems prudent for seeing (unintended) changes. (Deliberately not pushing any of my changes and refactorings in this PR so we have a ground truth.) Signed-off-by: Martin Florian * Fix sv runbook topology change delay setting (#1602) * [static] Improve logging around establishing topology changes Include enough info to be useful at info level Signed-off-by: Nicu Reut * [static] Improve sequencer dashboard by show all the values in the tooltip Signed-off-by: Nicu Reut * [static] Fix sv runbook config to respect log levels and topology change delay Signed-off-by: Nicu Reut --------- Signed-off-by: Nicu Reut * [static] Adjust multi validator resources (#1605) Signed-off-by: Nicu Reut * [static] fix multi validator config - set default postgres pvc size (#1606) Signed-off-by: Nicu Reut * Fix in-flight commands in participant dashboard (#1613) The old metric is completely useless, it measures commands before they are submitted. The submissions dashboard is more useful but still measures the wrong thing as we care about Daml transactions not sequencer submissions usually. [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * [ci] Upgrade canton to consume perf improv around signature verification (#1607) Signed-off-by: Nicu Reut * fix macos nix env (#1611) Signed-off-by: sgatewood-da * git-ignore `.debug` files (#1612) Signed-off-by: sgatewood-da * [ci] Allow concurrent inserts initializing active parties (#1599) on conflict do nothing, fixes https://github.com/DACH-NY/cn-test-failures/issues/5071 --------- Signed-off-by: Raymond Roestenburg * bump npm packages (#1617) Signed-off-by: Itai Segall * revert #1611 daml-sdk path change on use_enterprise=true branch (#1620) #1611 broke on my Mac with enterprise enabled as follows direnv: using flake_subdir direnv: ([/opt/homebrew/bin/direnv export bash]) is taking a while to execute. Use CTRL-C to give up. error: … while calling the 'derivationStrict' builtin at /builtin/derivation.nix:9:12: (source not available) … while evaluating derivation 'nix-shell' whose name attribute is located at /nix/store/sxxcxacn2y3xvgshjm06488n2cxlj4mi-source/pkgs/stdenv/generic/make-derivation.nix:375:7 … while evaluating attribute 'nativeBuildInputs' of derivation 'nix-shell' at /nix/store/sxxcxacn2y3xvgshjm06488n2cxlj4mi-source/pkgs/stdenv/generic/make-derivation.nix:419:7: 418| depsBuildBuild = elemAt (elemAt dependencies 0) 0; 419| nativeBuildInputs = elemAt (elemAt dependencies 0) 1; | ^ 420| depsBuildTarget = elemAt (elemAt dependencies 0) 2; (stack trace truncated; use '--show-trace' to show the full trace) error: unable to download 'https://digitalasset.jfrog.io/artifactory/assembly/daml/3.3.0-snapshot.20250415.13756.0.vafc5c867/daml-sdk-3.3.0-snapshot.20250415.13756.0.vafc5c867-macos-x86_64.tar.gz': HTTP error 404 response body: { "errors" : [ { "status" : 404, "message" : "File not found.; Path: 'assembly:daml/3.3.0-snapshot.20250415.13756.0.vafc5c867/daml-sdk-3.3.0-snapshot.20250415.13756.0.vafc5c867-macos-x86_64.tar.gz'" } ] } Signed-off-by: Stephen Compall * Fix multi-validator ack configuration (#1622) [static] At some point we really need to factor out the shared config but I guess not today … Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Bump mediator acknowledgement alert threshold (#1623) With acknowledgements only every 10min alerting on 5min lag makes not all that much sense. [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Deprecate choices from old voting flow (#1522) Signed-off-by: Julien Tinguely * [static] Make istio access logging configurable (#1625) Signed-off-by: Nicu Reut * Support listing TransferInstruction in CLI (#1615) --------- Signed-off-by: Oriol Muñoz * Refactor `gcp-project` config and add option to authorize a SA for CI (#1614) Part of DACH-NY/canton-network-internal#798 Signed-off-by: Martin Florian * Document that party hints must be preserved when restoring from key (#1628) And that you don't need a new onboarding secret. Seen this come up a few times now. [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Implement components for Action, Expiry and Effectivity in new SV UI [ci] (#1626) Fixes #1530 Signed-off-by: fayi-da * [static] Make pulumi parallelism bounded (#1631) Signed-off-by: Nicu Reut * separate scan images with and without the base image (#1616) Signed-off-by: Itai Segall * more npm dependencies bumps (#1618) Signed-off-by: Itai Segall * Fix a filter condition in SvOffboardingIntegrationTest (#1630) Fixes https://github.com/DACH-NY/cn-test-failures/issues/5083 [ci] Signed-off-by: Martin Florian * Extend `cluster_enable_workload_identity` to also prep the node pool (#1639) Follow-up to #1362 that was needed to get DACH-NY/canton-network-internal#1017 moving. S.a.: https://cloud.google.com/kubernetes-engine/docs/how-to/workload-identity#option_2_node_pool_modification Context DACH-NY/canton-network-internal#798 Signed-off-by: Martin Florian * bump scala deps (#1640) Signed-off-by: Itai Segall * include in all amulet holders also latest amulet created (#1641) Signed-off-by: Itai Segall * remove double counting due to imports (#1643) Signed-off-by: Itai Segall * bigquery: query for all validators (#1642) Signed-off-by: Itai Segall * fix nix cache for non-oss (#1644) Signed-off-by: Itai Segall * Upgrade Canton to 3.3.0-snapshot.20250722.16020.0.v29173ccf (#1635) fixes https://github.com/DACH-NY/canton-network-internal/issues/1001 [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Fix Canton oss hash (#1648) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Pulumi: fix granting of KMS participant-related IAM roles (#1649) Weird Pulumi stuff but this shouldn't cause problems anymore Signed-off-by: Martin Florian * Add TransferInstruction_Accept to CLI (#1638) --------- Signed-off-by: Oriol Muñoz * [ci] Change topology change delay to 250ms by default (#1653) Signed-off-by: Nicu Reut * Add FAQ entry for how to determine traffic spend (#1651) Fixes #1645 [static] Signed-off-by: Simon Meier * nix: add dockerfile-parse (#1656) Signed-off-by: Itai Segall * embed email lookup in the auth0 retry loop for create user (#1619) - fixes DACH-NY/cn-test-failures#3469 Signed-off-by: Stephen Compall * Add back missing image from readme (#1657) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Fix runner index variable name (#1659) maybe fixes https://github.com/DACH-NY/cn-test-failures/issues/5128#issuecomment-3108865364 How does that pass lint? [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * CIP-0058 (UI) Add CreateUnallocatedUnclaimedActivityRecord vote (#1462) * cip-0058-ui: add CreateUnallocatedUnclaimedActivityRecord vote + integration test Signed-off-by: Jose Velasco - IEU * cip-0058-ui: improve label Signed-off-by: Jose Velasco - IEU * cip-0058-ui: remove useless test Signed-off-by: Jose Velasco - IEU * cip-0058-ui: improve label - 2 Signed-off-by: Jose Velasco - IEU * cip-0058-ui: use decimal library instead of parseFloat Signed-off-by: Jose Velasco - IEU * cip-0058-ui: add proper integration test Signed-off-by: Jose Velasco - IEU * cip-0058-ui: fix import unused Signed-off-by: Jose Velasco - IEU * cip-0058-ui: add vitest for create-unallocated-unclaimed-activity-record Signed-off-by: Jose Velasco - IEU * cip-0058-ui: add TODO about checking that amount <= amount of unclaimed rewards available Signed-off-by: Jose Velasco - IEU * cip-0058-ui: add vitest for covering utc conversion Signed-off-by: Jose Velasco - IEU * Update apps/sv/frontend/src/components/votes/actions/CreateUnallocatedUnclaimedActivityRecord.tsx Co-authored-by: moritzkiefer-da <45630097+moritzkiefer-da@users.noreply.github.com> Signed-off-by: Jose Velasco - IEU * cip-0058-ui: fix vitest for create-unallocated-unclaimed-activity-record - it should work for any local time Signed-off-by: Jose Velasco - IEU * cip-0058-ui: replace label with 'mint' Signed-off-by: Jose Velasco - IEU * Revert "cip-0058-ui: fix vitest for create-unallocated-unclaimed-activity-record - it should work for any local time" This reverts commit a63b141cb9a94fa47086b758a2683ece6f3e39dd. Signed-off-by: Jose Velasco - IEU * cip-0058-ui: modify vitest by using dayjs to fix the issue with utc time Signed-off-by: Jose Velasco - IEU * cip-0058-ui: add amount validation to submissionConditions to disable submit button when there's an error Signed-off-by: Jose Velasco - IEU * cip-0058-ui: Remove assertions on fields that are unmounted after submission, making post-submit checks unreliable Signed-off-by: Jose Velasco - IEU * cip-0058-ui: fix compilation error Signed-off-by: Jose Velasco - IEU * cip-0058-ui: Clean up dropdown overlays before next test starts Signed-off-by: Jose Velasco - IEU * cip-0058-ui: Undo: Clean up dropdown overlays before next test starts Signed-off-by: Jose Velasco - IEU * cip-0058-ui: Replace test with a new one that doesn't depend on testCreateAndVoteDsoRulesAction Signed-off-by: Jose Velasco - IEU * cip-0058-ui: fix compilation error Signed-off-by: Jose Velasco - IEU --------- Signed-off-by: Jose Velasco - IEU Co-authored-by: moritzkiefer-da <45630097+moritzkiefer-da@users.noreply.github.com> * Return record_time and update_id in TS CLI transfer (#1654) --------- Signed-off-by: Oriol Muñoz Co-authored-by: moritzkiefer-da <45630097+moritzkiefer-da@users.noreply.github.com> * Implement url, summary and weight components [ci] (#1637) Fixes #1531 Signed-off-by: fayi-da * add ManualStartIntegrationTest to resource-intensive set (#1665) Attempt to fix a couple CI timeouts involving it. Signed-off-by: Stephen Compall * factor migration ID/record time check; fix () nesting (#1669) Signed-off-by: Stephen Compall * cluster, images, fix: Make empty value for SPLICE_MALLOC_ARENA_MAX work (#1670) Use the default only if SPLICE_MALLOC_ARENA_MAX is not set. Previously, setting SPLICE_MALLOC_ARENA_MAX to an empty value would still result in the default (which is 2) being used. Note: this change is no-op unless your configuration have environment variable SPLICE_MALLOC_ARENA_MAX set to '' Signed-off-by: Stanislav German-Evtushenko * Fix typo in docs (#1671) [static] Signed-off-by: Simon Meier * gcp-project: role fixes for new CCI SA to be able to run cluster tests (#1667) Changes that were needed for `deploy-basic` and `deploy-hdm-operator` to pass on https://github.com/DACH-NY/canton-network-internal/pull/1017 (I applied these on the scratchnet project already, for testing...) [static] Signed-off-by: Martin Florian * Reset network with non-zero initial round (#1658) Signed-off-by: Julien Tinguely * Add confirmation log when writing node identities in SV app (#1650) Fixes #926 Signed-off-by: Divam * Add configuration around validator & participant init containers (#1565) Signed-off-by: sgatewood-da * Fix SvFrontendIntegrationTest flake (#1672) Signed-off-by: Julien Tinguely * Fix canton oss hash (#1673) Signed-off-by: Oriol Muñoz * Fix race condition in AnsSubscriptionInitialPaymentTrigger (#1663) Fixes DACH-NY/cn-test-failures#5064 Signed-off-by: Martin Florian * [static] Add release notes for 0.4.8 (#1676) Signed-off-by: Nicu Reut * Switch load-tester to token-standard transfers (#1677) There are two main differences: 1. There is no status endpoint. This makes retries a bit harder. We could in theory make some of this work directly through the JSON API. But it seems like if we need this something is already a bit sketchy and treating that as a failed transaction doesn't seem too bad. 2. There is no complete stage. If accept goes through it's done, if it fails it fails. This likely needs some adjustment on the target rate to keep the same number of confirmation requests as before. My plan is to merge this and the reduction in SV status reports and then callibrate CILR to have the same as before. [ci] fixes #1449 Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Reduce status report frequency (#1678) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * cluster, helm, splice-info: Configuration tuning (#1629) - Hardening: Do not expose Nginx version - Enable gzipping of responses - Allow "localdev" and "scratch" as possible values for "network" Signed-off-by: Stanislav German-Evtushenko * CIP-0058 (Script - 2) Add weight as input + test for invalid weight (#1587) * cip-0058-script: add weight as input + test for invalid weight Signed-off-by: Jose Velasco - IEU * cip-0058-script: add already-minted-weight as input + test Signed-off-by: Jose Velasco - IEU * cip-0058-script: assert active_rewards is empty at the end Signed-off-by: Jose Velasco - IEU * cip-0058-script: log a warning for cases when weight is invalid instead of failing + adjust test Signed-off-by: Jose Velasco - IEU * cip-0058-script: consider available_weight for amount calculation in cases when weight is invalid Signed-off-by: Jose Velasco - IEU * cip-0058-script: cover available weight < 0 + test Signed-off-by: Jose Velasco - IEU * cip-0058-script: add exclusive/inclusive to script-help messages Signed-off-by: Jose Velasco - IEU --------- Signed-off-by: Jose Velasco - IEU * Revert "Reset network with non-zero initial round (#1658)" (#1680) [ci] This reverts commit c9e77b939216d4d7e4ce437bf02d839e70c3022f. Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Upgrade Canton to 3.3.0-snapshot.20250724.16021.0.vd3595b84 (#1682) fixes #1647 [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Add retry in allocateRandomSvParty (#1683) Signed-off-by: Julien Tinguely * [force] Bump latest versions (#1688) Signed-off-by: Nicu Reut * Improve DR docs (#1686) * Improve DR docs TBH I'm not sure if step 1 is particularly practical for anyone to do. But checking that they are on one of the two nodes can also be done by an SV (e.g. us) or anyone else. And so far I have always seen all parties migrated or none migrated so you don't need the manual migrate step. Step 2 on the other hand is fairly practical and I've recommended that in various forms in the past with success. [static] Signed-off-by: Moritz Kiefer * Update docs/src/validator_operator/validator_disaster_recovery.rst Co-authored-by: Martin Florian Signed-off-by: moritzkiefer-da <45630097+moritzkiefer-da@users.noreply.github.com> * trust me it's fine [static] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Signed-off-by: moritzkiefer-da <45630097+moritzkiefer-da@users.noreply.github.com> Co-authored-by: Moritz Kiefer Co-authored-by: Martin Florian * Improve ACS snapshot query performance (#1687) --------- Signed-off-by: Oriol Muñoz * [static] Lower multi validator parallelism to 10 (#1690) should help not overload k8s Signed-off-by: Nicu Reut * [static] Improve db executor metrics (#1689) Signed-off-by: Nicu Reut * fix docker-scan script (#1693) Signed-off-by: Itai Segall * Bump timeout for getAcsSnapshot endpoint (#1666) --------- Signed-off-by: Oriol Muñoz * Save Nix EE cache on Canton enterprise job (#1660) [ci] That one finishes faster so this should give slightly faster CI times. Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Add components for Config Values [ci] (#1696) Fixes #1533 Had to include some of the work in #1695 for sanity Signed-off-by: fayi-da * [main] Support custom additionalEnvVars for sv-app (#1702) forward port from #1697 [static] --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Adjust docs for splice-api-token-burn-mint-v1 (#1709) to match the fact that it is not a token standard API. [static] Signed-off-by: Simon Meier * Add ToC entry for Scan APIs (#1705) solved as a proxy page as that's easiest to do with our Sphinx setup. [static] --------- Signed-off-by: Simon Meier Co-authored-by: Wayne Collier * Bump nix binary on gha (#1701) [ci] Signed-off-by: Oriol Muñoz * Pulumi: Support creating arbitrary CRs via infra stack (#1715) Part of DACH-NY/canton-network-internal#1078 Signed-off-by: Martin Florian * cip-0058-script-improvements: add app state caching support (#1704) Signed-off-by: Jose Velasco - IEU * [ci] Check proposals state when proposing topology transactions (#1711) Avoids producing duplicate signatures if the signatures are not consistent Signed-off-by: Nicu Reut * CIP-0058 UI improvements: Remove redundant 'Reason' + expiry default (#1703) * cip-0058-improvements: remove 'Reason' from UI and use 'Summary' as reason in action creation Signed-off-by: Jose Velasco - IEU * cip-0058-improvements: modify expiry default (vote-effective + 2 days instead of + 1 day) Signed-off-by: Jose Velasco - IEU * cip-0058-improvements: rename variable to avoid confusion Signed-off-by: Jose Velasco - IEU --------- Signed-off-by: Jose Velasco - IEU * [static] Fix multi validator resource requests (#1723) Signed-off-by: Nicu Reut * Reduce scan cache ttl in DecentralizedSynchronizerMigrationIntegrationTest (#1718) * [ci] Add http server metrics to sv and validator apps (#1719) Signed-off-by: Nicu Reut * Upgrade Canton to 3.3.0-snapshot.20250729.16028.0.v37375862 (#1724) [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Fix nix maybe, probably not but dunno (#1727) [ci] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * [static] specify gcp zone if available when reading the cluster (#1467) (#1470) (#1738) Signed-off-by: Nicu Reut * Bump release notes to 0.4.9 (#1736) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Fix wallet frontend test (#1737) Signed-off-by: Julien Tinguely * Add app rate limiting - included in scan http apis (#1652) Signed-off-by: Nicu Reut * [ci] Flake - SvReconcileSynchronizerConfig - do not read sync id by listing the connected syncs (#1744) Signed-off-by: Nicu Reut * [ci] Flake - ScanIntegrationTest - adjust rate limit test (#1745) * Bump version to 0.4.10 (#1746) [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * [ci] Do not use the dso party for the acs preflight (#1743) Signed-off-by: Nicu Reut * Don't retry allocateRandomSvParty if already exists (#1748) Signed-off-by: Oriol Muñoz * [ci] Flake - ScanIntegrationTest - do not use dso party as timing gets werid (#1749) Signed-off-by: Nicu Reut * integration test against bespoke ledger & temporary BigQuery dataset (#1479) - loading and setup - exporting from PG, importing into BQ - needs ledger operations * tests depend on google-cloud-bigquery 2.53.0 Java lib * split BigQuery so it doesn't get run by an existing runner * use stream API - has better support for JSON columns * text-array convert to JSON special case * detailed report of serialization errors * Any is a great type; fixes JSON as JSON * account for zero mints - nonsensical in practice, but possible in this test * tests pass * skip ACL setting * split minted out to #1713 * split daily run out to #1730 * add separate path check for total supply - suggested by @isegall-da; thanks --------- Signed-off-by: Stephen Compall * [ci] start test with paused MergeValidatorLicenseContractsTrigger (#1756) Fixes https://github.com/DACH-NY/cn-test-failures/issues/4938 Signed-off-by: Raymond Roestenburg * [ci] Some debug for protoc issue and set java.io.tmpdir (#1760) * [static] Added debug for protoc issue and set java.io.tmpdir Signed-off-by: Raymond Roestenburg * [static] Setting java.io.tmpdir for protocbridge Signed-off-by: Raymond Roestenburg --------- Signed-off-by: Raymond Roestenburg * [ci] Fix topology reset by ensuring sync is connected (#1761) Signed-off-by: Nicu Reut * [main] Make load tester chart version configurable (#1762) forward port from #1759 [static] Signed-off-by: Moritz Kiefer * Refactor initial package version support (#1765) * Refactor initial package version support part of #1661 [ci] Together with the docs (will add in the next PR) this hopefully sets us up for a reasonable state when it comes to bumping the minimum version and removing any code that becomes redundant by that. Signed-off-by: Moritz Kiefer * drop unused code [ci] Signed-off-by: Moritz Kiefer * format [ci] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * [static] Add ignore for multiple close to gauges (#1770) Signed-off-by: Nicu Reut * stop leaking absolute paths in pulumi preview for commands (#1754) * use relative path from cwd for pulumi Commands * newlines between all args of bigquery-cloudsql.sh for easier diff reading * fix prometheus-crd-update too, use a utils function for all 3 --------- Signed-off-by: Stephen Compall * Separate synchronization time from accept time in load test metrics (#1763) * Separate synchronization time from accept time in load test metrics fixes #1758 [static] Tested by building the load tester image locally and replacing it on CILR (yes I know a bit hacky but much faster than deploying a new cluster :)) Signed-off-by: Moritz Kiefer * shut up ci [static] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Reset network from non-zero initial round (#1742) Signed-off-by: Julien Tinguely * Document deprecation and removal of Daml code (#1772) fixes #1661 [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Remove stale parts of pulumi grafana dashboard (#1773) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Add new sv reward weight form (#1733) * Add new sv reward weight form [ci] and some stuff for #1695 Signed-off-by: fayi-da * Extra test :wink: [ci] Signed-off-by: fayi-da --------- Signed-off-by: fayi-da * Fix flakey UI test (#1780) --------- Signed-off-by: fayi-da * Handle HttpCommandException in BftScanConnection (#1764) --------- Signed-off-by: Oriol Muñoz * Implement offboard sv form (#1782) Signed-off-by: fayi-da * Bump max heap size for localnet canton (#1787) Fixes https://github.com/DACH-NY/cn-test-failures/issues/5313 The amount of the increase is inspired by what we did in https://github.com/hyperledger-labs/splice/pull/1075 Also bumping the memory constraint on the container by the same amount for good measure; may I be forgiven the awkward final number there. [ci] Signed-off-by: Martin Florian * Document high level roles and functions of the nodes making up the cn #731 (#1692) Fixes #731 Added top-level overview section and landing page Overview of CN, Global Sync, SV, V, Tokenomics Signed-off-by: Simon Letort * [ci] Flake - integration tests against mainnet Daml version failing (#1784) Signed-off-by: Julien Tinguely * reimplement istio gateway and loopback in pulumi (#1755) Signed-off-by: Itai Segall * Fix package id selection for ValidatorRight (#1788) fixes #1037 fixes https://github.com/DACH-NY/cn-test-failures/issues/5312 [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * fix multi-validator loopback (#1792) Signed-off-by: Itai Segall * realistically mint for BigQuery total-supply test (#1775) * don't abort comparisons too early * suppress breaking token-standard sanity check * mint more by amulet price tweaking * adjust minted, locked for smaller rewarded amounts * use aliceValidatorParty more * split minted and alice-validator-minted * adjust burned and unminted; all tests pass * remove unused aliceParty --------- Signed-off-by: Stephen Compall * separate LoadBalancer for TCP traffic (#1712) Signed-off-by: Itai Segall * fix off-by-one in sv node indices (#1804) Signed-off-by: Itai Segall * fix the fix to cometbft ports (#1808) Signed-off-by: Itai Segall * Ignore sv participant ids in traffic waste alerts (#1794) --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * [static] Fix cometbft ingress port (#1812) Signed-off-by: Nicu Reut * [static] Add basic sequencer dashboard (#1813) Signed-off-by: Nicu Reut * cluster, helm, info: Add option imagePullPolicy (#1809) Makes splice-info more consistent with other Helm charts. Signed-off-by: Stanislav German-Evtushenko * Implement forms for granting and revoking featured app rights (#1797) --------- Signed-off-by: fayi-da * Fix location of mock svNames (#1821) They clearly should not be in the default cluster config but in the mock one. [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * save nix cache to gcp (#1802) Signed-off-by: Itai Segall * remove dummy helm chart (#1803) Signed-off-by: Itai Segall * Add section on disabling BFT sequencer connections for SV participants (#1828) Based on earlier release notes + https://github.com/DACH-NY/canton-network-internal/pull/859 [static] Signed-off-by: Martin Florian * Set all dashboards to UTC (#1827) Because I am too stupid for timezones. [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Retire delegate election (#1633) Signed-off-by: Julien Tinguely * remove excessive cometbft port being exposed (#1831) Signed-off-by: Itai Segall * add support for increasing max event batches in the participant (#1832) * [static] Add support for additional env vars for sv participants in pulumi Signed-off-by: Nicu Reut * [static] add sequencer client batches to the participant dashboard (#1833) Signed-off-by: Nicu Reut * Make it easy to disable SV participant BFT sequencer connections via `config.yaml` (#1829) Part of https://github.com/DACH-NY/canton-network-internal/issues/1169 Signed-off-by: Martin Florian * Add circuit breaker for ledger API command submissions (#1834) * Add circuit breaker for ledger API command submissions [ci] We may want to consider: 1. Removing the logic to disabling automation on synchronization time delays. 2. Add logic that disables it when the circuit breaker is enabled to avoid too much spam. But both of that doesn't seem strictly required for now. fixes #1815 Signed-off-by: Moritz Kiefer * static tests [ci] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Enable auto refresh for pulumi dashboard (#1837) [static] Somehow this is one of the few dashboards we don't autorefresh and I keep getting confused by it. Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * [ci] Set unknown contract synchronizer as contention error for metrics (#1840) Signed-off-by: Nicu Reut * Revert accidental scratch config push (#1842) Signed-off-by: Martin Florian * Publish generated token standard openapi documentation (#1843) [static] Signed-off-by: Oriol Muñoz * Add metrics for latest issuing mining round (#1844) part of https://github.com/DACH-NY/canton-network-internal/issues/927 Will add dashboard and alerts in the next PR. [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Doc pointers on how to check BFT connection status for SVs (#1847) Follow-up to #1828, by popular demand. [static] Signed-off-by: Martin Florian * [ci] Upgrade canton to latest 3.3 (#1850) Signed-off-by: Nicu Reut * handle more special cases in minted query (#1783) * factor TransferSummary handling * include other non-Transfer mint sources in minted * un-factor json_query calls because of constant whatever restrictions * error unrecognized result_burn * bump to last tested date * comment the origin of the list of choices in minted --------- Signed-off-by: Stephen Compall Co-authored-by: Itai Segall * add missing auth credentials for uploading nix cache (#1854) Signed-off-by: Itai Segall * Ignore scan connection logs in upgrade integration test [static] (#1846) Signed-off-by: fayi-da * [static] Make sv participant resources configurable (#1855) Signed-off-by: Nicu Reut * Cut release notes for 0.4.10 (#1858) [static] Signed-off-by: Martin Florian * Document Canton Coin preapprovals (#1857) * Document Canton Coin preapprovals [static] fixes #1856 Not quite sure about putting it under background but none of the other sections seemed right either so for now just focusing on getting the content in. Moving it around is easy later. Compare to https://docs.google.com/document/d/1gAqCnEnQdszbtWQBYuGao7XCKil8AQYjCNkr6FyJwms/edit?tab=t.0. I think it anwers everything from there. Signed-off-by: Moritz Kiefer * add header [static] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * [static] Set default batch size for all the participants (#1859) Signed-off-by: Nicu Reut * Release notes tweaks for 0.4.10 (#1861) Not changing the cut-off point, will backport (without PR) to the release-line-0.4.10 branch before `[release`]. Signed-off-by: Martin Florian * Disable warning if Xmx is more than 50% of available memory (#1750) [ci] Signed-off-by: Oriol Muñoz * [static] Flake - remove hardcoded zero rounds in preflights (#1865) Signed-off-by: Julien Tinguely * Remove incorrect update_id description (#1866) [static] Signed-off-by: Oriol Muñoz * Bump versions after 0.4.10 release cut (#1864) Signed-off-by: Martin Florian * move some jobs to gh-hosted runners (#1849) Signed-off-by: Itai Segall * [ci] Do not group expired reward coupons by party (#1852) [ci] Change trigger logic to account for bigger batches Signed-off-by: Nicu Reut * Add host aliases for localnet tests (#1867) To make the tests in https://github.com/hyperledger-labs/splice/pull/1830 work [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Upgrade Canton to consume fixes for stuck sequencers (#1868) fixes #1814 fixes #1491 [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * fix(localnet): add missing nginx locations for token registry API (#1830) * fix(localnet): add missing nginx locations for token registry API Signed-off-by: Julien Nicoulaud * Remove extra registry entries and add tests [ci] Signed-off-by: Moritz Kiefer * try to check at the end [ci] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Julien Nicoulaud Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Copy localnet host aliases to docker runners (#1870) [static] Will it work? I have no idea but worth a try maybe. Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Disable dsoDelegateInactiveTimeout in request creation (#1860) Signed-off-by: Julien Tinguely * Fix participant reference in DR docs (#1871) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Partly turn off selenium implicit waits (#1811) Signed-off-by: Julien Tinguely * Fix todo checker (#1499) --------- Signed-off-by: fayi-da * Add documentation around limitations on number of parties (#1876) * Add documentation around limitations on number of parties This keeps coming up so this adds some docs around the limits and options to work around it in the current state. fixes #1869 [static] Signed-off-by: Moritz Kiefer * shuffle around disclaimer on lifting the limitation [static] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Fix hardcoded GHA runner scale set version (#1879) [static] Signed-off-by: Martin Florian * move openapi npm codegen to lfdt namespace (#1851) Signed-off-by: Itai Segall * expand log ignore on daml.executor calling close() (#1874) Signed-off-by: Itai Segall * Harden AnsSubscriptionInitialPaymentTrigger against "confirmation already archived" case (#1881) Fixes https://github.com/DACH-NY/cn-test-failures/issues/5151 [ci] Signed-off-by: Martin Florian * Fix #links to docs.digitalasset.com (#1882) They need a .html prefix. [static] Signed-off-by: Simon Meier * [static] Revert "Partly turn off selenium implicit waits (#1811)" (#1883) This reverts commit 472f947300fc19f8e0f5e4c9d098650b0ac0b8af. Signed-off-by: Julien Tinguely * bump localnet memory (#1888) Signed-off-by: Itai Segall * images, canton: Fix libjemalloc availability (#1721) Signed-off-by: Stanislav German-Evtushenko Co-authored-by: Itai Segall * Fully remove implicit waits in selenium frontend testing (#1877) Signed-off-by: Julien Tinguely * [ci] fix race in vote reject test (#1889) Signed-off-by: Itai Segall * [ci] wait longer after intentional canton disconnect in integration test (#1887) Signed-off-by: Itai Segall * Move SV UI general info checks to vite (#1769) Signed-off-by: Julien Tinguely * Add alerts for issuing mining rounds (#1891) [static] fixes https://github.com/DACH-NY/canton-network-internal/issues/927 Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Remove useless isHealthy checks (#1884) Signed-off-by: Robert Autenrieth * Fix triggers possibly being unhealthy inbetween tasks (#1886) --------- Signed-off-by: Oriol Muñoz * Randomize submission of vetting transactions to avoid load spikes (#1880) * Randomize submission of vetting transactions to avoid load spikes [ci] fixes #1863 --------- Signed-off-by: Moritz Kiefer Signed-off-by: moritzkiefer-da <45630097+moritzkiefer-da@users.noreply.github.com> Co-authored-by: Moritz Kiefer Co-authored-by: Martin Florian * Reduce frontend test parallelism (#1894) Signed-off-by: Julien Tinguely * Retry accept/reject transfer offer in wallet UI (#1895) --------- Signed-off-by: Oriol Muñoz * Bump canton for sequencer fix (#1896) Plausibly fixes https://github.com/DACH-NY/canton-network-internal/issues/1248 [ci] Signed-off-by: Martin Florian * Deprecate splice-wallet-payments and transfer offers in docs (#1898) and note so in release notes. They are deprecated in favor of the corresponding token standard workflows. No changes to the Daml models to avoid bumping their package-ids. [static] Signed-off-by: Simon Meier * Add more disclaimers to DR docs for external parties (#1900) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Upgrade to pulumi operator 2.2 (#1899) This primarily includes the retry/backoff fixes from Nicu which we want and the rest seems harmless/irrelevant. [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * clarify useTransferPreapproval flag in sweep config (#1902) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Make alert threshold for mediator acknowledgement lag configurable (#1903) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Fix txlog backfilling alert false positive (#1908) Signed-off-by: Robert Autenrieth * Clean up public ingress things and allow making SV info endpoint public (#1909) Fixes https://github.com/DACH-NY/canton-network-internal/issues/933 Fixes https://github.com/DACH-NY/canton-network-internal/issues/360 The removed code paths were not used in a while and at least some of them look broken to me. The approach of defining an extra gateway for public things is also quite complex; it seems like everything we might need can be achieved with istio by the same way we allow the info endpoint here: by adding `AuthorizationPolicy` CRs. Signed-off-by: Martin Florian * Make it harder to lose your CometBFT PVC (#1911) 1. Helm chart: Add `resource-policy: keep` to CometBFT PVC 2. Pulumi: Make it easy to have pulumi `protect: true` the cometbft release, so if we accidentally try to remove it Pulumi won't let us. Fixes https://github.com/hyperledger-labs/splice/issues/470 Signed-off-by: Martin Florian * cluster: Build cross-platform Docker images natively (#1890) * cluster: Build cross-platform Docker images natively This change removes hacks for building cross-platform images to run native builds instead. This is cleaner and more reliable. Signed-off-by: Stanislav German-Evtushenko * cluster, images, canton: Update comment and lablel Replace TODO by an actual comment and update label with a reference to the actual base image Signed-off-by: Stanislav German-Evtushenko * scripts/check-base-images.sh: Parse Dockerfiles to get base image This allows to set BASE_IMAGE as an argument and then use in FROM and LABEL instead of duplicating it. Signed-off-by: Stanislav German-Evtushenko * scripts/check-base-images.sh: Make shellcheck happy False-positive Signed-off-by: Stanislav German-Evtushenko --------- Signed-off-by: Stanislav German-Evtushenko * Bump an eventually in AnsIntegrationTest (#1917) Fixes https://github.com/DACH-NY/cn-test-failures/issues/5374 Signed-off-by: Martin Florian * Bump release notes to 0.4.11 (#1914) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Support a custom fluent bit instance to reduce logging overhead (#1916) * Support a custom fluent bit instance to reduce logging overhead part of https://github.com/DACH-NY/canton-network-internal/issues/1257 --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Remove ReportValidatorLicenseMetricsExportTrigger from busy automation alert (#1919) [static] Signed-off-by: Oriol Muñoz * Trigger 'K6 Throughput Below Threshold' after an extended period (#1920) --------- Signed-off-by: Oriol Muñoz * Bump version and latest release after 0.4.11 release (#1922) [ci] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Fix some grafana log warnings (#1921) The sustained traffic one never got merged to main but it got added to some clusters for testing and now keeps logging warnings. I'm not actually completely sure about the null check in the automation alert because I'm struggling to reproduce it but it seems like it at least doesn't make things worse. [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Enable self hosted fluentbit on all scratchnets (#1924) [static] Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Remove version and levelValue field from logs (#1925) [static] version is just a constant 1 which is not very useful. levelValue is just a duplicate of level. Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Add Vagrantfile (#1927) Easy and quick way to get a clean development environment for Splice inside a virtual machine Signed-off-by: Stanislav German-Evtushenko * Upgrade Canton to 3.3.0-snapshot.20250814.16047.0.v6b685b94 (#1923) * Upgrade Canton to 3.3.0-snapshot.20250814.16047.0.v6b685b94 [ci] fixes #1125 Signed-off-by: Moritz Kiefer * log ignore [ci] Signed-off-by: Moritz Kiefer --------- Signed-off-by: Moritz Kiefer Co-authored-by: Moritz Kiefer * Implement DSO Rules Form (#1930) --------- Signed-off-by: fayi-da * Fix flakey UI test [ci] (#1933) Give the dom time to remove the error node Signed-off-by: fayi-da --------- Signed-off-by: Oriol Muñoz Signed-off-by: Nicu Reut Signed-off-by: Moritz Kiefer Signed-off-by: Stanislav German-Evtushenko Signed-off-by: Itai Segall Signed-off-by: Julien Tinguely Signed-off-by: Martin Florian Signed-off-by: Raymond Roestenburg Signed-off-by: Raymond Roestenburg <98821776+ray-roestenburg-da@users.noreply.github.com> Signed-off-by: sgatewood-da Signed-off-by: Stephen Compall Signed-off-by: fayi-da Signed-off-by: Simon Meier Signed-off-by: Jose Velasco - IEU Signed-off-by: Divam Signed-off-by: moritzkiefer-da <45630097+moritzkiefer-da@users.noreply.github.com> Signed-off-by: Simon Letort Signed-off-by: Julien Nicoulaud Signed-off-by: Robert Autenrieth Co-authored-by: Oriol Muñoz Co-authored-by: Nicu Reut Co-authored-by: Moritz Kiefer Co-authored-by: Stanislav German-Evtushenko Co-authored-by: Itai Segall Co-authored-by: Julien Tinguely <128390688+julientinguely-da@users.noreply.github.com> Co-authored-by: Martin Florian

run BigQuery integration test daily #1730

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions