Logbook

This page records a log of the team’s work, thinking, discussions, pains, joys, events, and experiences that happen on a daily basis. It’s supposed to be a kind of Stream of consciousness that can later be searched, analyzed, reviewed in more formal retrospectives.

Rules:

• Log days in reverse chronological order, recent first

• When the stream is getting too big, such that github refuses to render do the following:

  • extract biggest logical section (half-year or quarter) out of this into a correspondingly named Logbook-Year-Hn.md or Logbook-Year-Qn.md page
  • update links on top of this page to make it easier to navigate try to fix all links in the wiki at least
  • notify the team

• Move (and link) recurring sections to relevant dedicated pages.

History

• May 2024
• April 2024
• March 2024
• February 2024
• January 2024

2023-H2

• December 2023
• November 2023
• October 2023
• September 2023
• August 2023
• July 2023

2023-H1

• June 2023
• May 2023
• April 2023
• March 2023
• February 2023
• January 2023

2022-H2

• December 2022
• November 2022
• October 2022
• September 2022
• August 2022
• July 2022

2022-H1

• June 2022
• May 2022
• April 2022
• March 2022

2021

• 2021

May 2024

2024-05-15

• Today, the team has worked on these issues:
  • Aggregator stress test crashes during signer registration #1676: we have kept pairing on the issue. The PR Fix aggregator stress test #1679 has been created and will be merged shortly
  • Some timing tests fail on ARM #1466]: the PR Stabilize test removing most of the time dependency #1673 has been merged. The issue is closed
  • ChainObserver supports retrieving the Chain Point of the tip of the chain #1589: the PR feat: add get_current_chain_point function to fetch chain point information #1674 has been reviewed and will be merged when a new version of the pallas crate is published
  • Refactor Cardano transactions database layer in persistence for signer and aggregator #1677: the PR Common Cardano transactions & Block range roots repository #1678 has merged which closes the issue
  • Prune Cardano transactions stored on signer #1645: we have started working on the issue and a PR will be created shortly
  • Retrieves Cardano blocks with chainsync in pallas PoC #1590: we have paired on the issue and we have created the draft PR Implement chainsync ChainReader with pallas #1680. We'll keep working on it shortly
  • Finally, we have kept assessing the performances of the transactions signature and proving

2024-05-14

• Today, we have worked on these topics:
  • Aggregator stress test crashes during signer registration #1676: we have kept investigating on the problem. The draft PR Fix aggregator stress test #1679 has been created
  • Some timing tests fail on ARM #1466]: the PR Stabilize test removing most of the time dependency #1673 fixes the problem and has been reviewed. It will be merged shortly
  • Add section for manual setup of squid in SPO guide #1610: we have fixed the problem that prevented the squid service to start. The PR Build and setup Squid in SPO guide #1612 has been merged and the issue is closed
  • ChainObserver supports retrieving the Chain Point of the tip of the chain #1589: the PR feat: add get_current_chain_point function to fetch chain point information #1674 has been reviewed and will be merged when a new version of the pallas crate is published
  • Refactor Cardano transactions database layer in persistence for signer and aggregator #1677: the issue has been created and the PR Common Cardano transactions & Block range roots repository #1678 has been created. It is pending review and will be merged shortly
  • Prune Cardano transactions stored on signer #1645: we have started working on the issue and a PR will be created shortly
  • Additionally, we have also kept assessing the performances of the transactions signature and proving
  • Finally, we have held our weekly Office Hours meeting on Discord

2024-05-13

• Today, we have worked on these topics:
  • Release 2418 distribution #1614: The distribution 2418.1 has been released and deployed to the release-mainnet and release-preprod networks 🎉
  • Deploy Cardano transactions to testing-mainnet #1647: the signature of Cardano transactions has been working consistently on the network for a week. The issue is closed
  • Consistent sorting of transactions from GetCardanoTransactionProvider in signer and aggregator #1657: the PR Consistent transactions sort #1672 has been reviewed and merged. This closes the issue
  • Merkle roots don't have fixed size in the block_range_root table #1668: the source of the size difference has been identified and is actually not a concern. We have closed the issue as all the possible fixes would lead to performance degradation
  • Aggregator stress test crashes during signer registration #1676: the issue has been created and we have started investigating on the problem. It seems to be related with the way the discrepancies of recording of protocol parameters are done at startup of the aggregator. We'll work on a fix PR shortly
  • Some timing tests fail on ARM #1466]: the PR Stabilize test removing most of the time dependency #1673 fixes the problem and has been reviewed. It will be merged shortly
  • Add section for manual setup of squid in SPO guide #1610: we have resumed our tests to understand what prevents the service from starting correctly. The PR is being updated and we should have a ready for review version shortly
  • ChainObserver supports retrieving the Chain Point of the tip of the chain #1589: the PR feat: add get_current_chain_point function to fetch chain point information #1674 has been reviewed and will be merged when a new version of the pallas crate is published
  • missing field network at line 1 column 18453. #1651: following the release of the distribution 2418.1 the problem has been fixed which closes the issue
  • Prune history of gh-pages branch #1670: the PR has been merged

2024-05-03

• The team has worked on these topics:
  • Release 2418 distribution #1614: We don't have enough SPOs running the 2418.1-pre pre-release distribution yet. We will postpone the release until the beginning of week 20
  • Use SQLite transactions when inserting Cardano Transactions and Block Range Roots #1656: the PR Add benchmark tests for storing Cardano transactions #1666 has been reviewed and it will be merged shortly
  • Add Mithril networks configurations in networks.json #1638: the PR Adding Mithril networks configuration to networks.json #1664 has been merged and the issue is closed
  • Implement Ord on SignedEntityTypeDiscriminants #1648: the PR Ord on signed entity type discriminants #1669 has been created and reviewed. It will be merged shortly
  • Deploy Cardano transactions to testing-mainnet #1647: we have kept deploying the signature of the Cardano transactions on the test network
  • Add new mithril logo and give credit #1665: the PR has been created and reviewed. It will be merged shortly
  • Prune history of gh-pages branch #1670: the PR has been created and it will be merged shortly
  • Create a test Cardano transactions builder #1667: the issue has been created and groomed
  • Merkle roots don't have fixed size in the block_range_root table #1668: the issue has been created and groomed
  • We have also rotated the KES keys of the SPOs we operate on the release-preprod network

2024-05-02

• Today, we worked on these issues:
  • Release 2418 distribution #1614: We haven't had enough SPOs running the 2418.1-pre pre-release distribution yet. We will probably postpone the release to week 20
  • Use Block Range Merkle roots to sign Cardano transactions #1634: the PR Sign Cardano Transactions with Block Range Merkle Roots #1660 has been merged and the issue is closed
  • Use Block Range Merkle roots to prove Cardano transactions #1635: the PR Prove Cardano Transactions with Block Range Merkle Roots #1663 has been created, reviewed and merged. This closes the issue
  • Use SQLite transactions when inserting Cardano Transactions and Block Range Roots #1656: we have kept pairing on the issue and created the draft PR Add benchmark tests for storing Cardano transactions #1666
  • Add Mithril networks configurations in networks.json #1638: the PR Adding Mithril networks configuration to networks.json #1664 has been created and is pending review. It will be merged shortly
  • Implement Ord on SignedEntityTypeDiscriminants #1648: we have started working on the issue. A PR will be created shortly
  • Deploy Cardano transactions to testing-mainnet #1647: we have started deploying the signature of the Cardano transactions on the testing-mainnet network. We will monitor the behavior of the network in the following days
  • Add new mithril logo and give credit #1665: the PR has been created and reviewed. It will be merged shortly
  • We have also prepared the sprint planning for the next iteration

April 2024

2024-04-30

• Today, we have worked on these topics:
  • Release 2418 distribution #1614: The 2418.1-pre pre-release distribution has been created and deployed on the pre-release-preview network as some node versions had not been correctly bumped in the previous one. We expect to release the distribution 2418 by the end of the week.
  • Use Block Range Merkle roots to sign Cardano transactions #1634: the PR Sign Cardano Transactions with Block Range Merkle Roots #1660 has been reviewed and fixed after review. It will be merged shortly
  • Use Block Range Merkle roots to prove Cardano transactions #1635: we have kept working on the issue, a PR will be created shortly
  • Use SQLite transactions when inserting Cardano Transactions and Block Range Roots #1656: we have paired and pushed developments on the branch ensemble/1656/use-sqlite-transactions-insert-ctx. The benchmarks don't show the expected performance gain
  • Add Mithril networks configurations in networks.json #1638: we have started working on the issue and a PR will be created shortly
  • We have also held our Office Hours meeting on Discord where we worked with the community
  • Finally, we have worked on preparing the demo for the monthly review meeting

2024-04-29

• Today, the team has worked on these topics:
  • Release 2418 distribution #1614: The new 2418.0-pre pre-release distribution has been created and deployed on the pre-release-preview network. We expect to release the distribution 2418 by the end of the week.
  • Use Block Range Merkle roots to sign Cardano transactions #1634: the PR Sign Cardano Transactions with Block Range Merkle Roots #1660 has been created and is pending review. It will be merged shortly
  • Use Block Range Merkle roots to prove Cardano transactions #1635: we have worked on the issue, a PR will be created shortly
  • Use SQLite transactions when inserting Cardano Transactions and Block Range Roots #1656: the issue has been created and groomed. We have paired and pushed developments on the branch ensemble/1656/use-sqlite-transactions-insert-ctx
  • Consistent sorting of transactions from GetCardanoTransactionProvider in signer and aggregator #1657: the issue has been created and groomed

2024-04-26

• Today, the team has worked on the following issues:
  • Store Block Range Merkle roots in signer and aggregator databases #1633: we have merged the PR Store block range roots in db #1650. The issue is closed
  • Memory leak in Cardano transactions signature/proof #1629: the PR Use new memory allocator 'jemallocator' #1649 has been merged and we have reactivated the Cardano transactions signature on the testing-preview network. We have also created, reviewed and merged the optimization PR Optimize block range roots computation #1655. The issue is closed
  • Stream import of Cardano transactions #1646: The PR Stream blocks during import #1652 has been reviewed and merged. This closes the issue
  • Use Block Range Merkle roots to sign Cardano transactions #1634: we have started working on the issue and we will create a draft PR shortly
  • feat: add github workflow for the aggregator stress test #1643: the PR has been reviewed and merged
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still investigating the problem when we start the service with an unpermissioned user
  • Finally, we have verified if some test SPOs we are operating needed to have their KES keys rotated, which was not the case

2024-04-25

• We have worked on the following issues:
  • Store Block Range Merkle roots in signer and aggregator databases #1633: we have created the PR Store block range roots in db #1650. It has been reviewed and is being updated. We will merge it shortly
  • Memory leak in Cardano transactions signature/proof #1629: we have implemented a new memory allocator on the signer and the aggregator with the PR Use new memory allocator 'jemallocator' #1649 which has been reviewed and merged
  • Handle unparsed blocks in Cardano transactions parser #1567: the PR Handle unparsed blocks in Cardano transactions parser #1641 has been merged, which closes the issue
  • Stream import of Cardano transactions #1646: The draft PR Stream blocks during import #1652 has been created and is pending review
  • Replace "BFT nodes" with "Full nodes" in devnet #1642: the PR has been merged
  • feat: add github workflow for the aggregator stress test #1643: the draft PR is being updated following review comments
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still investigating the problem when we start the service with an unpermissioned user

2024-04-19

• Today the team has worked on:
  • Store Block Range Merkle roots in signer and aggregator databases #1633: we have kept pairing on the issue and pushed developments on the branch ensemble/1633/store-block-ranges-in-db. A PR will be created shortly
  • Memory leak in Cardano transactions signature/proof #1629: we have kept investigating the issue.
  • Handle unparsed blocks in Cardano transactions parser #1567: the PR Handle unparsed blocks in Cardano transactions parser #1641 has been reviewed and will be merged shortly
  • Replace "BFT nodes" with "Full nodes" in devnet #1642: the PR has been created and reviewed. It will be merged shortly
  • feat: add github workflow for the aggregator stress test #1643: the draft PR has been created and will be ready to be reviewed shortly
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still investigating the problem when we start the service with an unpermissioned user
  • We have also checked if some test SPOs that we operate needed to have their KES keys rotated which was not the case

2024-04-18

• Today the team has worked on:
  • Store Block Range Merkle roots in signer and aggregator databases #1633: we have kept pairing on the issue and pushed developments on the branch ensemble/1633/store-block-ranges-in-db. A PR will be created shortly
  • Memory leak in Cardano transactions signature/proof #1629: we have kept investigating the issue. We have made progress and discovered that the storage of the underlyinng Merkle tree library that we use could be the origin of the problem. We will keep investigating the problem
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: the PR Mithril relay broadcasts signer registrations in P2P #1588 has been merged. This closes the issue
  • Handle unparsed blocks in Cardano transactions parser #1567: we created the draft PR Handle unparsed blocks in Cardano transactions parser #1641
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still investigating the problem when we start the service with an unpermissioned user
  • We have also worked on preparing the sprint planning for next iteration

2024-04-17

• Today the team has worked on:
  • Store Block Range Merkle roots in signer and aggregator databases #1633: we have kept pairing on the issue and pushed developments on the branch ensemble/1633/store-block-ranges-in-db. A PR will be created shortly
  • Memory leak in Cardano transactions signature/proof #1629: we have kept investigating the issue. It appears that the problem could be linked to the memory of HashMap not being completely freed under certain conditions
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: the PR Mithril relay broadcasts signer registrations in P2P #1588 is being updated following review and will be merged shortly
  • Handle unparsed blocks in Cardano transactions parser #1567: we have started working on the issue. A PR will be created shortly
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still investigating the problem when we start the service with an unpermissioned user. It will be merged shortly

2024-04-16

• We have worked on these issues:
  • Store Block Range Merkle roots in signer and aggregator databases #1633: we have worked on the issue and pushed developments on the branch ensemble/1633/store-block-ranges-in-db. A PR will be created shortly
  • Memory leak in Cardano transactions signature/proof #1629: we have kept investigating the issue
  • Remove unused network configuration parameter in mithril-client cli #1640: the PR has been reviewed and merged
  • Fix open_message.is_expired in aggregator runner #1622: the PR has been reviewed and merged
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: the PR Mithril relay broadcasts signer registrations in P2P #1588 is pending review
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly
  • We have also held our Office Hours meeting on Discord where we worked with the community on:
    • ChainObserver supports retrieving the Chain Point of the tip of the chain #1589
    • Retrieves Cardano blocks with chainsync in pallas PoC #1590
    • Mithril Signer Local Error Policy : Error 182 - MuxError #1632

2024-04-15

• Today, the team has worked on these topics:
  • Memory leak in Cardano transactions signature/proof #1629: we have kept investigating the issue
  • Create file with Cardano minimum versions in repository #1615: the PR Minimum supported Cardano node versions for Mithril signers #1624 has been reviewed and merged. The issue is closed
  • Deploy testing-mainnet network #1617: the PR Deploy testing-mainnet network #1625 has been merged. The issue is closed
  • Prepare testing-sanchonet for respin with Cardano 8.10 #1618: the PR Support Cardano 8.10.0 in testing-sanchonet #1628 has been merged. The testing-sanchonet network has been re-spun. It needs re-genesis and will be signing back in 2 days. The issue is closed
  • Store Block Range Merkle roots in signer and aggregator databases #1633: we have started working on the issue. A PR will be created shortly
  • Proof generation memory optimisation #1637: the PR has been created, reviewed and merged
  • Remove unused network configuration parameter in mithril-client cli #1640: the PR has been created and is pending review
  • Fix open_message.is_expired in aggregator runner #1622: the PR is being fixed with an integration test which is modified. It will be merged shortly
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have kept working on the draft PR Mithril relay broadcasts signer registrations in P2P #1588 with the wip implementation of a new integration test
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly

2024-04-12

• Today, we have worked on these issues:
  • Memory leak in Cardano transactions signature/proof #1629: we have paired in order to investigate the issue. We'll keep investigating next week
  • Create file with Cardano minimum versions in repository #1615: following some suggestions from the community, we have decided to re-challenge the scope of the issue: the PR Minimum supported Cardano node versions for Mithril signers #1624 is being updated accordingly
  • Fix open_message.is_expired in aggregator runner #1622: the PR is being reviewed and it will be merged shortly
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have kept working on the draft PR Mithril relay broadcasts signer registrations in P2P #1588 with the wip implementation of a new integration test
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly
  • We have also checked if some SPOs we operate on the test networks needed to have their KES keys rotated, which was not the case

2024-04-11

• Today, the team has worked on these topics:
  • Memory leak in Cardano transactions signature/proof #1629: we have started investigating the issue
  • Refactor database module in aggregator #1583: the PR Refactor Aggregator & Signer database structure #1626 has been merged and the issue closed
  • Create file with Cardano minimum versions in repository #1615: the PR Minimum supported Cardano node versions for Mithril signers #1624 is being updated. It will be merged shortly
  • Fix open_message.is_expired in aggregator runner #1622: the PR has been created and is being reviewed. It will be merged shortly
  • Activate portable feature in mithril-stm by default #1613: the PR Use BLST portable feature to enable runtime ADX instruction set check #1630 has been reviewed and merged. This closes the issue
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have kept working on the draft PR Mithril relay broadcasts signer registrations in P2P #1588 with the wip implementation of a new integration test
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly
  • Client deprecation notice should be written in JSON when --json option is used #1616: the PR fix: Output deprecation warning in JSON format when option --json is set #1631 has been created, reviewed and merged. The issue is closed
  • Store Block Range Merkle roots in signer and aggregator databases #1633: the issue has been created
  • Use Block Range Merkle roots to sign Cardano transactions #1634: the issue has been created
  • Use Block Range Merkle roots to prove Cardano transactions #1635: the issue has been created

2024-04-10

• Today, the team has worked on these topics:
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: the activation of the feature on the testing-preview network has led to the VM down. We have restarted the VM and upgraded its RAM
  • Memory leak in Cardano transactions signature/proof #1629: the bug issue has been created. It seems to be the reason why the testing-preview went down. We'll investigate shortly
  • Refactor database module in aggregator #1583: the PR Refactor Aggregator & Signer database structure #1626 has been created and is being reviewed. It will be merged shortly
  • Create file with Cardano minimum versions in repository #1615: the PR Minimum supported Cardano node versions for Mithril signers #1624 has been reviewed and is pending some modifications. It will be merged shortly
  • ChainObserver supports retrieving the Chain Point of the tip of the chain #1589: the PR Chain observer retrieves the current Chain Point #1623 has been merged. TxPipe will work on a second PR for the implementation in the PallasChainObserver
  • Deploy testing-mainnet network #1617: the draft PR Deploy testing-mainnet network #1625 has been created and will be ready for review shortly. In the mean time, the testing-mainnet network has been activated and its genesis certificate created. We expect it to start signing at next epoch.
  • Fix open_message.is_expired in aggregator runner #1622: the draft PR has been created and is being reviewed. It will be merged shortly
  • Activate portable feature in mithril-stm by default #1613: the PR Use BLST portable feature to enable runtime ADX instruction set check #1630 has been created and is pending review. It will be merged shortly
  • Prepare testing-sanchonet for respin with Cardano 8.10 #1618: the draft PR Support Cardano 8.10.0 in testing-sanchonet #1628 has been created. It will be ready for review by the end of the week
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have updated the draft PR Mithril relay broadcasts signer registrations in P2P #1588 with the wip implementation of a new integration test
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly
  • We have also started grooming the storage and usage of the Block range roots for Cardano transactions signature and proofs

2024-04-09

• Today, we have worked on these topics:
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: the PR Incremental storage of Cardano transactions #1619 has been merged. This closes the issue
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have updated the draft PR Mithril relay broadcasts signer registrations in P2P #1588 with the wip implementation of a new integration test
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly
  • Refactor database module in aggregator #1583: we have started working on the issue and the developments have been pushed to the branch djo/1583/refactor_aggregator_db. A draft PR will be created shortly
  • Create file with Cardano minimum versions in repository #1615: the PR Minimum supported Cardano node versions for Mithril signers #1624 has been created and is pending review
  • ChainObserver supports retrieving the Chain Point of the tip of the chain #1589: the PR Chain observer retrieves the current Chain Point #1623 has been created and is pending review. It will be merged soon. TxPipe will work on a second PR for the implementation of the PallasChainObserver
  • Deploy testing-mainnet network #1617: the draft PR Deploy testing-mainnet network #1625 has been created and will be ready for review shortly
  • Fix open_message.is_expired in aggregator runner #1622: the draft PR has been created and is pending review
  • Signer metrics server displays confusing log message #1620: the issue has been created. The PR Fix signer metrics server caught signal log #1621 has been created, reviewed and merged. The issue is closed
  • We have also held our weekly Open Hours meeting on Discord

2024-04-08

• We have worked on these issues:
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: the PR Incremental storage of Cardano transactions #1619 has been created and reviewed. It will be merged shortly
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have updated the draft PR Mithril relay broadcasts signer registrations in P2P #1588 with some fix on the repeater and a wip implementation of a new integration test
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly
  • Prepare testing-sanchonet for respin with Cardano 8.10 #1618: the issue has been created and groomed
  • Client deprecation notice should be written in JSON when --json option is used #1616: the issue has been created and groomed
  • Deploy testing-mainnet network #1617: the issue has been created and groomed
  • Create file with Cardano minimum versions in repository #1615: the issue has been created and groomed

2024-04-05

• We have worked on these issues:
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have implemented a message repeater mechanism on the P2P network for the signer registrations, and the draft PR Mithril relay broadcasts signer registrations in P2P #1588 has been updated
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: the developments have been pushed to the ensemble/1591/incremental-storage-of-cardano-tx branch and a draft PR will be created shortly
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are still testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly
  • Prepare testing-sanchonet for respin with Cardano 8.10 #1618: the issue has been created and groomed
  • Additionally, we have computed and announced on Discord the list of SPOs not registered anymore on the release-mainnet network at the beginning of epoch 477
  • Finally, we have rotated the KES keys of all the SPOs that we operate in the testing-preview and pre-release-preview networks

2024-04-04

• The team has worked on these issues:
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: we have kept pairing on this issue. The developments have been pushed to the ensemble/1591/incremental-storage-of-cardano-tx branch and a draft PR will be created shortly
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we are working on stabilizing the prototyped feature and the draft PR Mithril relay broadcasts signer registrations in P2P #1588 has been updated
  • Add section for manual setup of squid in SPO guide #1610: we have updated the draft PR Build and setup Squid in SPO guide #1612 and we are testing the procedure and trying to fix a user right problem when launching the squid service. It will be merged shortly
  • Activate portable feature in mithril-stm by default #1613: the issue has been created
  • Release 2416 distribution #1614: the issue has been created
  • We have also prepared the sprint planning for the next iteration

2024-04-03

• Today, we have worked on these topics:
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: we have kept pairing on this issue. The developments have been pushed to the ensemble/1591/incremental-storage-of-cardano-tx branch and a draft PR will be created shortly
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: We have kept working on the issue. The draft PR Mithril relay broadcasts signer registrations in P2P #1588 has been updated
  • Some transactions are not signed in testing-sanchonet #1577: the PR Fix Conway transactions parsing #1608 has been merged which fixes the bug on testing-sanchonet and closes the issue
  • Add indexes on foreign keys of SQLite stores #1603: the PR New migration to add indexes on foreign keys #1609 has been created, reviewed and merged. The issue is closed
  • Add section for manual setup of squid in SPO guide #1610: the issue has been created along with the draft PR Build and setup Squid in SPO guide #1612. It will be merged shortly
  • Fix CHANGELOG.md #1611: the PR has been created, reviewed and merged

2024-04-02

• We have worked on the following issues:
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have found and fixed the lock that was responsible for the slow integration tests. The draft PR Mithril relay broadcasts signer registrations in P2P #1588 has been updated
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: we have kept pairing on this issue and a first PR Add and persist slot_number and block_hash to CardanoTransaction #1607 has been created, reviewed and merged. The remaining developments have been pushed to the ensemble/1591/incremental-storage-of-cardano-tx branch
  • End to end tests are flaky in CI #1558: we have understood the sources of the second type of flakiness: one due to Cardano node unable to produce the same immutable files for all the nodes on the devnet (probably due to the parameters that we use for fast execution of the e2e tests), second due to lost messages on the experimental P2P network
  • Some transactions are not signed in testing-sanchonet #1577: the bug has been fixed by TxPipe and a new version of pallas has been released on crates.io. We have created the PR Fix Conway transactions parsing #1608 which is being reviewed and will be merged shortly
  • Add indexes on foreign keys of SQLite stores #1603: we have started working on this issue and the developments have been pushed to the damien/1603/add-indexes-on-foreign-keys branch

March 2024

2024-03-29

• The team has worked on the following topics:
  • Support multiple beacon types in signer/aggregator #1562: the PR Handle multiple beacon types in Certificate #1601 has been merged and the re-computation of the certificate hashes has been done on testing-preview and testing-sanchonet networks. The issue is closed
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have kept investigating the source of slow integration tests. We will update the PR Mithril relay broadcasts signer registrations in P2P #1588 shortly
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: we have paired on this issue and pushed the developments on the ensemble/1591/incremental-storage-for-cardano-tx branch
  • End to end tests are flaky in CI #1558: we are still investigating the second source of flakiness
  • Some transactions are not signed in testing-sanchonet #1577: the PR created in the TxPipe Pallas repository should be reviewed shortly and a patch version of pallas will be deployed on crates.io
  • We have also checked if some SPOs needed to have their KES keys rotated which was not the case
  • Finally, we have pruned the docker images registry on the VM of the testing-preview and testing-sanchonet networks

2024-03-28

• Today, we have worked on the following topics:
  • Support multiple beacon types in signer/aggregator #1562: the PR Handle multiple beacon types in Certificate #1601 has been reviewed and is being updated. It will be merged shortly
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have updated the PR Mithril relay broadcasts signer registrations in P2P #1588 and tried to fix slow integration tests which seem to be due to some blocking on the peer swarm tick
  • End to end tests are flaky in CI #1558: we are still investigating the second source of flakiness
  • Some transactions are not signed in testing-sanchonet #1577: the PR created in the TxPipe Pallas repository should be reviewed shortly and a patch version of pallas will be deployed on crates.io
  • ChainObserver supports retrieving the Chain Point of the tip of the chain #1589: the issue has been re-groomed
  • Implement incremental storage of Cardano transactions in signer/aggregator #1591: the issue has been re-groomed

2024-03-27

• Today, the team worked on theses issues:
  • Provide fake aggregator data in an aggregated form #1594: the PR Aggregate fake aggregator reference json files #1600 has been merged and this closes the issue
  • Support multiple beacon types in signer/aggregator #1562: the preparatory the PR Rename Beacon common entity to CardanoDbBeacon #1593 has been merged and the PR Handle multiple beacon types in Certificate #1601 has been created and is pending review
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have updated the PR Mithril relay broadcasts signer registrations in P2P #1588 and tried to fix the dead lock which is occurring in the integration tests of the CI
  • End to end tests are flaky in CI #1558: we are still investigating the second source of flakiness
  • Some transactions are not signed in testing-sanchonet #1577: the PR created in the TxPipe Pallas repository should be reviewed shortly and a patch version of pallas will be deployed on crates.io
  • Upgrade bech32 crate #1592: the PR has been merged
  • Rotate documentation for 2412 distribution #1585: the PR has been merged
  • We have also worked on the demo path for the monthly review

2024-03-26

• We have worked on theses topics:
  • The release distribution 2412.0 has been created and deployed on the release-mainnet and release-preprod networks 🎉
  • Support multiple beacon types in signer/aggregator #1562: we have kept pairing on the issue, and we have pushed latest developments to the ensemble/1562/multiple_beacon_types branch. In the mean time, a first preparatory PR Rename Beacon common entity to CardanoDbBeacon #1593 has been created and reviewed. It will be merged tomorrow
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: we have updated the PR Mithril relay broadcasts signer registrations in P2P #1588 and tried to fix the dead lock which is occurring in the integration tests of the CI
  • End to end tests are flaky in CI #1558: we are still investigating the second source of flakiness
  • Some transactions are not signed in testing-sanchonet #1577: the PR created in the TxPipe Pallas repository should be reviewed shortly and a patch version of pallas will be deployed on crates.io
  • Upgrade bech32 crate #1592: the PR has been created in order to upgrade the bech32 crate which had breaking changes in its latest version. It should be merged tomorrow
  • Rotate documentation for 2412 distribution #1585: the PR has been updated with new dev blog posts and merged. The blog posts are available at https://mithril.network/doc/dev-blog/2024/03/26/mithril-signer-prometheus-endpoint and https://mithril.network/doc/dev-blog/2024/03/26/client-cli-deprecated-command
  • ChainObserver supports retrieving the Chain Point of the tip of the chain #1589: the issue has been created and groomed
  • Retrieves Cardano blocks with chainsync in pallas PoC #1590: the issue has been created and groomed
  • We have also held the weekly Mithril office hours meeting in Discord

2024-03-22

• Today, the team has been working on theses issues:
  • The pre-release distribution 2412.0-pre has been created and deployed on the pre-release-preview network. We expect to release it at the beginning of next week
  • Support multiple beacon types in signer/aggregator #1562: we have kept pairing on the issue, and we have pushed latest developments to the ensemble/1562/multiple_beacon_types branch
  • Mithril relay broadcasts signer registrations with P2P PubSub #1587: the issue has been created and a draft PR Mithril relay broadcasts signer registrations in P2P #1588 has been created
  • End to end tests are flaky in CI #1558: we have kept investigating the second source of flakiness
  • Some transactions are not signed in testing-sanchonet #1577: a PR has been created in the TxPipe Pallas repository. We'll apply the fix as soon as it is published with a new version of pallas crate
  • We have also checked if some test SPOs that we operate needed to get their KES keys rotated, but this was not the case
  • Finally, we have created a diagram detailing the road-map of the implementation of the Cardano transactions certification for the mainnet:

2024-03-21

• Today, we have worked on these topics:
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the PR Implement Block range Merkle tree for Cardano transactions #1560 has been reviewed and merged. This closes the issue
  • Support multiple beacon types in signer/aggregator #1562: we have kept pairing on the issue, and we have pushed new developments to the branch ensemble/1562/multiple_beacon_types
  • End to end tests are flaky in CI #1558: we have kept investigating the second source of flakiness
  • Some transactions are not signed in testing-sanchonet #1577: a PR has been created in the TxPipe Pallas repository. We'll apply the fix as soon as it is published with a new version of pallas crate
  • We have also prepared the sprint planning for the next iteration

2024-03-20

• Today, the team worked on these issues:
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the PR Implement Block range Merkle tree for Cardano transactions #1560 has been updated following review comments and will be ready to be merged tomorrow
  • Support multiple beacon types in signer/aggregator #1562: we have kept pairing on the issue, and we have made good progress. The developments have been pushed to the branch ensemble/1562/multiple_beacon_types
  • End to end tests are flaky in CI #1558: we have kept investigating the second source of flakiness
  • Some transactions are not signed in testing-sanchonet #1577: a PR has been created in the TxPipe Pallas repository. We'll apply the fix as soon as it is published with a new version of pallas crate
  • Do not require the mithril client to create the DB directory #1572: the PR Accept existing but empty db dir for client-cli cardano-db download #1581 has been created, reviewed and merged. The issue is closed

2024-03-19

• Today, we have worked on these topics:
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the PR Implement Block range Merkle tree for Cardano transactions #1560 has been reviewed and the PR is being updated accordingly. It will be merged shortly
  • Provide latest immutable file number with certified Cardano transactions #1536: the PR Provide latest immutable file number with certified ctx #1571 has been merged. The issue is closed
  • Support multiple beacon types in signer/aggregator #1562: we have kept pairing on the issue, and we have made good progress. The developments have been pushed to the branch ensemble/1562/multiple_beacon_types
  • End to end tests are flaky in CI #1558: we have kept investigating the second source of flakiness
  • Some transactions are not signed in testing-sanchonet #1577: the bug issue has been opened and we have created a bug issue in the TxPipe Pallas repository
  • feat: refactor get_kes_period to create isolated new queries #1576: the PR has been reviewed and merged
  • We have also had our first Office Hours meeting with the community on Discord 🚀

2024-03-18

• Today, we have been working on these issues:
  • Explorer improvements Cardano transactions #1554: the PR Explorer: Improve Cardano Transaction Certification & Certificate Chain Validation UI #1569 has been merged and this closes the issue
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the draft PR Implement Block range Merkle tree for Cardano transactions #1560 has been updated with enhanced implementation of the merkle map. It will be ready for review shortly
  • Provide latest immutable file number with certified Cardano transactions #1536: the PR Provide latest immutable file number with certified ctx #1571 has been reviewed and will be merged shortly
  • Support multiple beacon types in signer/aggregator #1562: we have kept pairing on the issue, and we have made good progress. The developments have been pushed to the branch ensemble/1562/multiple_beacon_types
  • Upgrade Cardano node to 8.9.0 #1570: the PR Support Cardano node 8.9.0 #1509 has been merged and the new Cardano node has been successfully deployed to testing-preview and testing-sanchonet. The issue is closed
  • End to end tests are flaky in CI #1558: we have kept investigating the second source of flakiness

2024-03-15

• Today, the team worked on the following topics:
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the draft PR Implement Block range Merkle tree for Cardano transactions #1560 has been updated with enhanced benchmarks
  • Explorer improvements Cardano transactions #1554: the PR Explorer: Improve Cardano Transaction Certification & Certificate Chain Validation UI #1569 has been validated and will be merged shortly.
  • Provide latest immutable file number with certified Cardano transactions #1536: the PR Provide latest immutable file number with certified ctx #1571 has been created and will be ready for review shortly
  • Support multiple beacon types in signer/aggregator #1562: we have started to work on the issue.
  • Upgrade Cardano node to 8.9.0 #1570: the issue has been created and the PR Support Cardano node 8.9.0 #1509 has been created and is pending review. It will be merged next week
  • End to end tests are flaky in CI #1558: we have kept investigating the second source of flakiness
  • We have checked if some test SPOs needed to have their KES keys rotated, which was not the case

2024-03-14

• Today, we have worked on the following issues:
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the draft PR Implement Block range Merkle tree for Cardano transactions #1560 has been updated with the new developments
  • Refactor the Cardano transactions parser with pallas-hardano #1557: the fix PR Handle pallas-hardano parsing errors #1566 has been merged and the signature has resumed on testing-sanchonet
  • Explorer improvements Cardano transactions #1554: the PR Explorer: Improve Cardano Transaction Certification & Certificate Chain Validation UI #1569 has been created and is pending review.
  • Provide latest immutable file number with certified Cardano transactions #1536: the developments updates have been pushed to the branch ensemble/1536/provide-latest-immutable-file-number-with-certified-ctx. A PR will be created shortly
  • End to end tests are flaky in CI #1558: we have created the PR Fix E2E flakiness when transferring funds #156 which fixes the first source of flakiness. It has been reviewed and merged

2024-03-13

• The team has worked on the following topics:
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the draft PR Implement Block range Merkle tree for Cardano transactions #1560 has been updated with benchmarks
  • Refactor the Cardano transactions parser with pallas-hardano #1557: we have kept pairing on the issue and the PR Use pallas hardano transactions parser #1564 has been merged. Unfortunately, the multiple blocks formats used for Conway triggered errors on the testing-sanchonet network. We have created the fix PR Handle pallas-hardano parsing errors #1566 in order to mitigate the problem. It will be merged shortly
  • Explorer improvements Cardano transactions #1554: we have worked on the issue and pushed the developments to the branch djo/1554/explorer/improve-ctx-ui. A draft PR will be created shortly
  • Provide latest immutable file number with certified Cardano transactions #1536: we have kept pairing on this issue and the developments have been pushed to the branch ensemble/1536/provide-latest-immutable-file-number-with-certified-ctx. A PR will be created shortly
  • End to end tests are flaky in CI #1558: we have kept investigating the source of flakiness in the E2E of the CI

2024-03-12

• Today, we have worked on the following issues:
  • Enhance www demonstration in mithril-client-wasm #1552: the PR Enhance Cardano transaction part in mithril-client-wasm/www #1555 has been merged, which closes the issue
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the draft PR Implement Block range Merkle tree for Cardano transactions #1560 has been updated
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 has been merged. The issue is closed
  • Refactor the Cardano transactions parser with pallas-hardano #1557: we have kept pairing on the issue and the PR Use pallas hardano transactions parser #1564 has been reviewed and is almost validated. It will be merged shortly
  • Explorer improvements Cardano transactions #1554: we have worked on the issue and pushed the developments to the branch djo/1554/explorer/improve-ctx-ui. A draft PR will be created shortly
  • Provide latest immutable file number with certified Cardano transactions #1536: we have started pairing on this issue and the developments have been pushed to the branch ensemble/1536/provide-latest-immutable-file-number-with-certified-ctx
  • End to end tests are flaky in CI #1558: we have started investigating the source of flakiness in the E2E of the CI
  • We have created a new "Mithril office hours" weekly meeting that will take place in Discord starting next Tuesday

2024-03-11

• The team worked on the following topics:
  • Enhance www demonstration in mithril-client-wasm #1552: the PR Enhance Cardano transaction part in mithril-client-wasm/www #1555 is being reviewed and will be merged tomorrow
  • Cardano transactions are not all signed in testing-sanchonet #1537: the bug fix has been created in the PR Fix parsing Cardano Conway transactions from immutable files #1563 which has been reviewed and merged. The certification of Cardano transactions on testing-sanchonet has resumed 🎉
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the draft PR Implement Block range Merkle tree for Cardano transactions #1560 has been updated
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 has been updated with the latest released version of pallas. It will be merged tomorrow
  • Refactor the Cardano transactions parser with pallas-hardano #1557: we have kept pairing on the issue and the PR Use pallas hardano transactions parser #1564 has been created. It will be reviewed and merged shortly
  • Explorer improvements Cardano transactions #1554: we have worked on the issue and pushed the developments to the branch djo/1554/explorer/improve-ctx-ui. A draft PR will be created shortly
  • Support multiple beacon types in signer/aggregator #1562: the issue has been created and groomed
  • Sign block number with Cardano transactions hashes #1561: the issue has been created

2024-03-08

• The team worked on the following topics:
  • Implement Cardano Transactions in explorer #1497: the PR Cardano Transactions Snapshots/Certification in explorer #1553 has been validated and merged. The issue is closed
  • Output CLIs logs to stderr #1515: the PR Send aggregator logs in the right output (stdout / stderr) #1550 has been validated and merged, which closes the issue
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: A draft PR Implement Block range Merkle tree for Cardano transactions #1560 has been created
  • Enhance www demonstration in mithril-client-wasm #1552: we have paired on the draft PR Enhance Cardano transaction part in mithril-client-wasm/www #1555. It will be ready to be reviewed shortly
  • Cardano transactions are not all signed in testing-sanchonet #1537: we are waiting for a bug fix in pallas crate which should be available in the next days
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 will be merged with the new version of the pallas crate which should be available in the next days
  • Support download binaries for macOS in E2E test #1551: the PR has been created and merged
  • Refactor the Cardano transactions parser with pallas-hardano #1557: the issue has been created and we have paired on it. A draft PR will be created shortly
  • Explorer improvements Cardano transactions #1554: the issue has been created
  • MacOS Rust tests are flaky in CI #1556: the issue has been created
  • End to end tests are flaky in CI #1558: the issue has been created
  • Release 2412 distribution #1559: the issue has been created
  • We have checked if some SPOs that we operate needed to have their KES keys rotated, but this was not the case

2024-03-07

• Today, we worked on the following topics:
  • Implement Cardano Transactions in explorer #1497: the PR Cardano Transactions Snapshots/Certification in explorer #1553 has been created and is pending review. It will be merged shortly
  • Output CLIs logs to stderr #1515: we have paired on this issue. The PR Send aggregator logs in the right output (stdout / stderr) #1550 has been reviewed and validated: it will be merged shortly
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: we have started working on this issue. The developments have been pushed on the jpraynaud/1533-block-range-merkle-tree-cardano-tx branch. A PR will be created shortly
  • Enhance www demonstration in mithril-client-wasm #1552: the issue has been create, and a draft PR has been created Enhance Cardano transaction part in mithril-client-wasm/www #1555. It will be reviewed shortly
  • Cardano transactions are not all signed in testing-sanchonet #1537: we are waiting for a bug fix in pallas crate which should be available in the next days
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 will be merged with the new version of the pallas crate which should be available in the next days
  • Support download binaries for macOS in E2E test #1551: the PR has been created, reviewed and validated. It will be merged tomorrow
  • We also prepared the sprint planning for the next iteration

2024-03-06

• We have worked on the following issues:
  • Implement Cardano Transactions in explorer #1497: the developments have been pushed to the djo/1497/ctx-in-explorer branch and a PR will be created shortly
  • npm publish fails on latest when next exists #1531: the PR Add new npm package step dedicated to release process (latest tag) #1545 has been reviewed and merged. It closes the issue
  • Cardano transactions are not all signed in testing-sanchonet #1537: we are waiting for a bug fix in pallas crate which should be available in the next days
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 will be merged with the new version of the pallas crate which should be available in the next days
  • Output CLIs logs to stderr #1515: we have paired on this issue. The draft PR Send aggregator logs in the right output (stdout / stderr) #1550 has been created and will be ready for review shortly
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: we have started working on this issue. A draft PR will be available shortly
  • Replace deprecated serde_cbor crate #1546: the PR Replacement of serde_cbor dependency by ciborium dependency #1549 hass been created, reviewed and merged, which closes the issue

2024-03-05

• Today, the team worked on the following issues:
  • Expose Prometheus metrics for Mithril signer #1096: the PR Activate metrics endpoint on signer #1544 has been merged and a first version of a Grafana dashboard has been created. This closes the issue
  • Implement Cardano Transactions in explorer #1497: the developments have been pushed to the djo/1497/ctx-in-explorer branch and a PR will be created shortly
  • npm publish fails on latest when next exists #1531: the PR Add new npm package step dedicated to release process (latest tag) #1545 has been updated following the review and is pending review. We should merge it tomorrow
  • Make HTTP server tests more robust #1524: the PR Improve aggregator HTTP server tests #1543 has been closed, which closes the issue
  • Cardano transactions are not all signed in testing-sanchonet #1537: we are waiting for a bug fix in pallas crate which should be available in the next days
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 will be merged with the new version of the pallas crate which should be available in the next days
  • Upgrade dependencies #1547: the PR has been created, reviewed and merged
  • Output CLIs logs to stderr #1515: we have started pairing on this issue. A draft PR will be available shortly
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: we have started working on this issue. A draft PR will be available shortly
  • Replace deprecated serde_cbor crate #1546: the issue has been created and groomed

2024-03-04

• We have worked on the following topics:
  • Expose Prometheus metrics for Mithril signer #1096: the draft PR Activate metrics endpoint on signer #1544 has been reviewed and validated, and will be merged shortly
  • Implement Cardano Transactions in explorer #1497: the developments have been pushed to the djo/1497/ctx-in-explorer branch and a PR will be created shortly
  • npm publish fails on latest when next exists #1531: the PR Add new npm package step dedicated to release process (latest tag) #1545 has been created and is under review. It will be merged shortly
  • Make HTTP server tests more robust #1524: we have kept pairing on this issue and a the draft PR Improve aggregator HTTP server tests #1543 has been created. It will be ready to be reviewed shortly
  • Cardano transactions are not all signed in testing-sanchonet #1537: we are waiting for a bug fix in pallas crate
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 has been merged, which closes the issue

2024-03-01

• Today, the team has worked on the issues:
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 is now validated and is pending final release version of pallas crate before it can be merged
  • Make HTTP server tests more robust #1524: we have kept pairing on this issue and a the draft PR Improve aggregator HTTP server tests #1543 has been created. It will be ready to be reviewed shortly
  • Cardano transactions are not all signed in testing-sanchonet #1537: we are waiting for a bug fix in pallas crate
  • Expose Prometheus metrics for Mithril signer #1096: the draft PR Activate metrics endpoint on signer #1544 has been created, and will be ready for review shortly
  • Implement Cardano Transactions in explorer #1497: the developments have been pushed to the djo/1497/ctx-in-explorer branch and a PR will be created shortly
• We have also checked if some KES keys of the test SPOs that we run needed to be rotated: the KES rotation has been done for the release-preprod network

February 2024

2024-02-29

• We have worked on the following topics:
  • Enhance Mithril/Cardano node communication #1315: the PR feat: implement and calculate the current key period using pallas #1541 is being reviewed and some updates are being made. It will be merged shortly
  • Make HTTP server tests more robust #1524: we have kept pairing on this issue and a the draft PR Improve aggregator HTTP server tests #1543 has been updated. It will be ready for review shortly
  • Cardano transactions are not all signed in testing-sanchonet #1537: we are waiting for a bug fix in pallas crate
  • Stabilize namings in Cardano Transactions API #1535: the PR Stabilize namings cardano transactions #1542 has been validated and merged. It closes the issue
  • Expose Prometheus metrics for Mithril signer #1096: we have pushed the developments to the branch jpraynaud/1096-signer-prometheus-endpoint and a PR will be created shortly
  • Implement Cardano Transactions in explorer #1497: we have started working on this issue and a PR will be created shortly

2024-02-28

• Today, the team has worked on the following issues:

  • Document Mithril signer footprint #1519: the PR Document Mithril signer footprint in SPO Setup guide #1538 has been merged, which closes the issue
  • Reorganize crates in the repository #1528: the PR Reorganize crates #1540 has been merged. The issue is closed
  • Enhance Mithril/Cardano node communication #1315: the draft PR feat: implement and calculate the current key period using pallas #1541 is now pending for review and will be merged shortly
  • Make HTTP server tests more robust #1524: we have kept pairing on this issue and a new PR will be created shortly
  • Cardano transactions are not all signed in testing-sanchonet #1537: we are waiting for a bug fix in pallas crate
  • Stabilize namings in Cardano Transactions API #1535: the PR Stabilize namings cardano transactions #1542 has been created and is pending review. It will be merged shortly
  • Expose Prometheus metrics for Mithril signer #1096: we have started working on the issue and a PR will be created shortly
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the issue has been groomed
  • Output CLIs logs to stderr #1515: the issue has been groomed

• We have also defined the new signature mechanism for the Cardano transactions to support its availability on the mainnet in epic Light Wallet implementation MVP #1457. Here is a summary of the design:

  • Signature diagram for aggregator
  • Signature diagram for signer
  • Proof diagram for aggregator

2024-02-27

• Today, we have worked on these topics:
  • Unify test folder generation #1508: the PR Unified temp dir builder #1529 has been merge, which closes the issue
  • Make HTTP server tests more robust #1524: we have paired on this issue and a new PR will be created shortly
  • Add a runbook for running Client multi-platform tests #1530: the PR Add runbook for 'Mithril client multi-platform test' #1534 has been created, reviewed and merged. The issue is closed
  • Document Mithril signer footprint #1519: the PR Document Mithril signer footprint in SPO Setup guide #1538 has been created and is pending review. It will be merged shortly
  • Reorganize crates in the repository #1528: the PR Reorganize crates #1540 has been created and is pending review. It will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: the draft PR feat: implement and calculate the current key period using pallas #1522 is still under development
  • Cardano transactions are not all signed in testing-sanchonet #1537: the bug issue has been created, and is being investigated
  • Stabilize namings in Cardano Transactions API #1535: the issue has been created and groomed
  • Provide block number with certified Cardano transactions #1536: the issue has been created and groomed

2024-02-26

• Today, the team worked on the following issues:
  • Release 2408 distribution #1500: we have released the new 2408.0 distribution which has been deployed on the release-mainnet and release-preprod networks. This closes the issue
  • Unify test folder generation #1508: the PR Unified temp dir builder #1529 has been reviewed and it will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: the draft PR feat: implement and calculate the current key period using pallas #1522 has been created and will be ready for review shortly
  • Make HTTP server tests more robust #1524: we have paired on this issue and a new PR will be created shortly
  • npm publish fails on latest when next exists #1531: the bug issue has been created as we have been compelled to publish maunally the npm package for the WASM client of the 2408.0 distribution
  • Implement a Block Range Merkle Tree for Cardano Transactions #1533: the issue has been created
  • Add a runbook for running Client multi-platform tests #1530: the issue has been created
  • We have also been working on the demos for the Cardano Scaling - Monthly Review meeting

2024-02-23

• Today, we have worked on the following issues:

  • Release 2408 distribution #1500: we have created the new 2408.0-pre pre-release which has been deployed on the pre-release-preview network. We will resume the release process early next week
  • Some end to end tests are flaky in the CI #1147: the PR Fix end to end test flakiness in CI #1486 has been reviewed and merged 🎉. This closes the issue
  • Adapt Mithril Client multi-platform test for Cardano Transactions #1510: the PR Adapt multi platform test for Cardano transactions #1518 has been reviewed and merged. The issue is closed
  • Update workflow github actions to node-20 #1520: the PR CI: Upgrade actions #1521 has been reviewed and merged. It closes the issue
  • Unify test folder generation #1508: we have paired on the issue and the PR Unified temp dir builder #1529 has been created and is pending review. It will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: the PR add pallas stake snapshots integration #1513 has been merged. A new draft PR feat: implement and calculate the current key period using pallas #1522 has been created and will be ready for review shortly
  • Document Mithril signer footprint #1519: the issue has been created
  • Store aggregator snapshot archives on IPFS #1523: the issue has been created
  • Make HTTP server tests more robust #1524: the issue has been created
  • Reorganize crates in the repository #1528: the issue has been created

• We have also verified if some KES keys needed to be rotated on SPOs of the test networks, but it was not the case

2024-02-22

• We have worked on the following issues:

  • Some end to end tests are flaky in the CI #1147: the PR Fix end to end test flakiness in CI #1486 has been reviewed and updated and will be merged tomorrow
  • Implement Cardano Transactions commands in the client binary #1469: the PR Enhance client-cli standard output #1516 has been merged. The PR Mithril client CLI: fix remove archive directory #1517 has also been merged. This closes the issue
  • Unify test folder generation #1508: we have started working on the issue, and a PR swill be published shortly
  • Enhance Mithril/Cardano node communication #1315: the PR add pallas stake snapshots integration #1513 has been reviewed. We have encountered difficulties to make it compile on MacOS after some dependencies were updated. We are investigating the problem, and the PR will be merged as soon as the build is working

• We have also prepared the sprint planning for the next iteration

2024-02-21

• Today, the team worked on theses topics:
  • Some end to end tests are flaky in the CI #1147: we have identified and fixed new sources of flakiness occurring at when rollbacks occur on the devnet. The draft PR Fix end to end test flakiness in CI #1486 has been updated and is ready to be reviewed
  • Implement Cardano Transactions verification in the WASM client #1470: the PR [Implement Cardano transactions verification in mithril-client-wasm #1512] has been merged. This closes the issue
  • Implement Cardano Transactions commands in the client binary #1469: the PR Enhance client-cli standard output #1516 has been created and is being reviewed. It will be merged shortly. The PR Mithril client CLI: fix remove archive directory #1517 has also been created, and is being reviewed
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 has been merged, which closes the issue
  • Unify test folder generation #1508: we have started working on the issue, and a PR swill be published shortly
  • Enhance Mithril/Cardano node communication #1315: the PR add pallas stake snapshots integration #1513 has been reviewed. It will be merged shortly
  • Output CLIs logs to stderr #1515: the issue has been created

2024-02-20

• Today, we have worked on theses issues:
  • Some end to end tests are flaky in the CI #1147: we have identified and fixed most of the source of flakiness occurring on the P2P mode, and we are enhancing the fix for the genesis bootstrap errors. The draft PR Fix end to end test flakiness in CI #1486 has been updated and will be ready for review shortly
  • Implement Cardano Transactions verification in the WASM client #1470: the PR [Implement Cardano transactions verification in mithril-client-wasm #1512] has been reviewed and will be merged shortly after few modifications
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 has been validated and is ready to be merged
  • Unify test folder generation #1508: we have started working on the issue, and a PR swill be published shortly
  • Add an example crate for the CardanoTransactions type #1495: the PR Add example crate for Cardano transactions #1511 has been validated and merged. This closes the issue
  • Enhance Mithril/Cardano node communication #1315: the PR add pallas stake snapshots integration #1513 has been created and reviewed. It will be merged shortly

2024-02-19

• The team worked on the following topics:
  • Some end to end tests are flaky in the CI #1147: we are investigating still some flakiness occurring on the P2P mode, and we are enhancing the fix for the genesis bootstrap errors. The draft PR Fix end to end test flakiness in CI #1486 will be ready for review shortly
  • Implement Cardano Transactions verification in the WASM client #1470: we have paired on this issue and a draft PR [Implement Cardano transactions verification in mithril-client-wasm #1512] has been created
  • Re-spin Sanchonet network #1503: the testing-sanchonet network is now working smoothly and is consistently producing new certificates. It is also signing the new Cardano transactions entity type
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 has been reviewed and minor modifications are being done. It will be merged shortly
  • Unify test folder generation #1508: we have started working on the issue, and a PR swill be published shortly
  • Add an example crate for the CardanoTransactions type #1495: the PR Add example crate for Cardano transactions #1511 has been created and reviewed. After some minor modifications, it will be merged
  • Adapt Mithril Client multi-platform test for Cardano Transactions #1510: the issue has been created

2024-02-16

• Today, the team has worked on the following issues:

  • Some end to end tests are flaky in the CI #1147: we have made good progress and we have fixed all the flakiness on the standard mode. There is still some flakiness occurring on the P2P mode, which we are currently investigating. The draft PR Fix end to end test flakiness in CI #1486 is almost complete, and it should be ready to be reviewed early next week
  • Implement commands in the client binary #1469: we have paired on the issue and a new PR will be created shortly
  • Implement Cardano Transactions verification in the WASM client #1470: we have paired on this issue and the developments have been pushed to the ensemble/1470/implement-cardano-transactions-verification-wasm branch. A PR will be created shortly
  • Re-spin Sanchonet network #1503: the testing-sanchonet network needed to be re-genesis once again due to some cryptographic material from previous version of Sanchonet still in the key registration. The network should resume producing certificates tomorrow
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 has been updated and is pending final review. It will be merged shortly
  • Unify test folder generation #1508: we have started working on the issue, and a PR swill be published shortly
  • Add an example crate for the CardanoTransactions type #1495: the developments have been pushed to the damien/1495/add-example-crate-for-cardano-transactions branch and a PR will be created shortly

• We have also verified that no KES key needed to be rotated in the test SPOs of the Mithril networks

2024-02-15

• We have worked on the following issues:
  • Some end to end tests are flaky in the CI #1147: we are still investigating flakiness that seems to originate form the Cardano devnet
  • Implement commands in the client binary #1469: we have paired on the issue and a new PR will be created shortly
  • Implement Cardano Transactions verification in the WASM client #1470: we have paired on this issue and the developments have been pushed to the ensemble/1470/implement-cardano-transactions-verification-wasm branch. A PR will be created shortly
  • Re-spin Sanchonet network #1503: the testing-sanchonet has been re-spun with n, era markers have been re-written on chain, and a new SPO has been setup. the signer nodes of the SPOs which could not start previously have since then successfully registered their signers, and the network chain has been re-genesis. The network should resume producing certificates tomorrow. The issue is closed
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 has been updated and is pending final review. It will be merged shortly
  • Unify test folder generation #1508: we have started working on the issue, and a PR swill be published shortly
  • Add an example crate for the CardanoTransactions type #1495: we have started working on the issue, and a PR will be published shortly. In the mean time developments have been pushed to the damien/1495/add-example-crate-for-cardano-transactions branch
  • Support Cardano node 8.8.0-pre in e2e test #1509: the draft PR has been created to add testing of the Cardano node 8.8.0-pre which introduces some breaking changes

2024-02-14

• Today, we have worked on the following topics:
  • Some end to end tests are flaky in the CI #1147: we are still investigating flakiness that seems to originate form the Cardano devnet
  • Implement commands in the client binary #1469: we have paired on the issue and a new PR will be created shortly
  • Update Mithril network architecture documentation #1488: the PR Update Mithril architecture documentation #1499 has been merged, which closes the issue
  • Re-spin Sanchonet network #1503: the issue has been created and the PR Upgrade Cardano configurations in infra #1505 has been created, reviewed and merged. The testing-sanchonet is currently being restarted and should be back online tomorrow
  • Add signing capabilities to the root route of the aggregator #1496: we have paired on the issue, and the PR Add signing capabilities to aggregator root route #1506 has been created, reviewed and merged. This closes the issue
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 has been updated and is pending review
  • Unify test folder generation #1508: the issue has been created as we have noticed that on some platform socket file names were too long and made some tests fail
  • Fix clippy warning in common when using only fs flag #1504: the PR has been created, reviewed and merged. It fixes some warnings when building nodes

2024-02-13

• Today, we have worked on the following topics:
  • Some end to end tests are flaky in the CI #1147: we are still investigating flakiness that seems to originate form the Cardano devnet
  • Implement commands in the client binary #1469: we have paired on the issue and the PR Cardano transaction sets & proof in client cli #1501 has been created, reviewed and merged. We now have a complete end to end signature and verification for the PoC of the Cardano transactions signature
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 has been merged 🎉
  • Update Mithril network architecture documentation #1488: the PR Update Mithril architecture documentation #1499 has been created and reviewed. It will be merged tomorrow
  • Extract database feature from common crate #1492: the PR Extract persistence related code to a new shared crate #1494 has been reviewed and merged, which closes the issue
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 has been updated and is pending review
  • The Cardano transactions signature has also been activated on the testing-sanchonet network

2024-02-12

• We have been working on the following issues:
  • Some end to end tests are flaky in the CI #1147: we are still investigating flakiness that seems to originate form the Cardano devnet
  • Create a test network on SanchoNet #1173: the network is consistently producing certificates. The PR Add dev blog post announcing testing-sanchonet network #1491 has been merged and the availability of the network has been announced on discord. This closes the issue
  • Implement commands in the client binary #1469: we have paired on the issue and the development have been pushed on the ensemble/1469/cardano-tx-in-client-cli branch. A PR will be created shortly
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 has been updated with the latest version of pallas crate. It will be merged tomorrow
  • Handle cancellation of certificate verification in WASM client #1480: the implementation seems a bit more complicated than what we expected. As it is not a priority of the sprint, we have decided to postpone it until later in the sprint
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 has been updated to add examples in generated descriptions with macros. Also we have noticed that the actual configuration mechanism in the aggregator and signer does not allow to associate parameters to commands. This needs to be updated until we can complete the feature
  • Add an example crate for the CardanoTransactions type #1495: the issue has been created and groomed
  • Add signing capabilities to the root route of the aggregator #1496: the issue has been created and groomed
  • Implement Cardano Transactions in explorer #1497: the issue has been created and groomed
  • Handle cache for certificate verification in WASM client #1484: the issue has been groomed
  • Expose Prometheus metrics for Mithril signer #1096: the issue has been groomed
  • Release 2407 distribution #1500: the issue has been created

2024-02-09

• Today, we have worked on the following topics:
  • Handle cancellation of certificate verification in WASM client #1480: Due to wasm multithreading limitations we failed to fully delegate the cancellation to an AbortController. We will need to implementing a cancel mechanism on the mithril-client api directly.
  • Extract database feature from common crate #1492: The PR Extract persistence related code to a new shared crate #1494 has been created and is pending review. It will be merged shortly
  • Improve signed entity test #1460: the PR has been merged

2024-02-08

• Today, we have worked on the following topics:

  • Some end to end tests are flaky in the CI #1147: we are still investigating flakiness that seems to originate form the Cardano devnet
  • Implement transactions verification in client library #1468: the PR Add Cardano transactions proofs support to mithril-client #1489 been reviewed and merged. This closes the issue
  • Create a test network on SanchoNet #1173: the PR Support Sanchonet Cardano network #1384 has been reviewed and merged, and the genesis certificate of the network has been bootstrapped. The network should start producing certificates tomorrow. The PR Add dev blog post announcing testing-sanchonet network #1491 has been created and will be merged early next week to announce the availability of the network
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 will be merged when the new crate version of pallas is released
  • Handle cancellation of certificate verification in WASM client #1480: We have paired on this issue and it seems that we can probably delegate the full responsibility of cancellation to the browser itself with the use of an AbortController. We will attempt to do this implementation shortly
  • Upgrade http dependency #1474: the PR Remove http from dependencies #1490 has been created, reviewed and merged, which closed the issue
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 is being updated to add examples in generated descriptions
  • Improve signed entity test #1460: the PR is validated and will be merged shortly

• We have also worked on the sprint planning for the next iteration

2024-02-07

• Today, we have been working on the following issues and PRs:
  • Some end to end tests are flaky in the CI #1147: We have kept investigating the cause of the flakiness observed with the end to end test Cardano network. We have reproduced the same flakiness on an ephemeral self hosted GitHub Actions runner. We have also detected that there was probably an error when generating the topology files for the Cardano full nodes. We are working on a fix to verify if this is the root cause of the flakiness
  • Implement transactions verification in client library #1468: the PR Add Cardano transactions proofs support to mithril-client #1489 has been created and is pending review. It will be merged shortly
  • Create a test network on SanchoNet #1173: the PR Support Sanchonet Cardano network #1384 has been updated and is pending review. It will be merged shortly. The new testing-sanchonet has been fully configured to handle on chain era markers. We should be able to genesis the certificate chain tomorrow and see the first certificate produced the day after tomorrow.
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 will be merged when the new crate version of pallas is released
  • Handle cancellation of certificate verification in WASM client #1480: A PR is under development
  • Upgrade http dependency #1474: a PR is under development
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 is being updated to add examples in generated descriptions
  • Improve signed entity test #1460: the PR is validated and will be merged shortly

2024-02-06

• We have been working on the following topics:
  • Some end to end tests are flaky in the CI #1147: We have kept investigating the cause of the flakiness observed with the end to end test Cardano network. We have created a temporary self hosted runner and we are making tests to see if we witness the same failure ratio as with shared runners. We'll keep investigating tomorrow
  • Implement transactions verification in client library #1468: we have kept pairing on this issue and the developments have been pushed to the branch ensemble/1468/cardano-tx-in-client-lib. A PR will be created and merged shortly
  • Create a test network on SanchoNet #1173: the PR Support Sanchonet Cardano network #1384 has been updated and the new testing-sanchonet has been bootstrapped. We have created a SPO on sanchonet network and need to wait for a couple of epochs before the network is able to sign its first certificate
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 will be merged when the new crate version of pallas is released
  • Handle cancellation of certificate verification in WASM client #1480: A PR is under development
  • Upgrade http dependency #1474: a PR is under development and should be ready soon
  • Update Mithril network architecture documentation #1488: the issue has been created and we will start to work on it shortly
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 is being updated to add examples in generated descriptions
  • Improve signed entity test #1460: the PR is being reviewed and will be merged shortly

2024-02-05

• Today, we have worked on the following issues:
  • Some end to end tests are flaky in the CI #1147: we have kept investigating the flakiness of the CI. It appears that since the new version of the devnet has been released, most of the flakiness occurs on the Cardano network which gets stuck after few epochs in flaky way. We have implemented some CPU throttling on the end to end test and we have been able to reproduce the error messages which occur most of the time. We are trying to understand if the source of flakiness could be attributed to the underlying GitHub Actions runners
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 will be merged when the new crate version of pallas is released
  • Implement transactions verification in client library #1468: we have paired on this issue and the developments have been pushed to the branch ensemble/1468/cardano-tx-in-client-lib. A PR will be created shortly
  • Handle cancellation of certificate verification in WASM client #1480: A PR is being prepared
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 is being updated to add examples in generated descriptions
  • Improve signed entity test #1460: the PR is being reviewed and will be merged shortly

2024-02-01

• Today, we have worked on these issues:
  • Light Wallet: Implement artifact routes in the aggregator #1478: the PR Implement CardanoTransactions artifact routes in aggregator #1479 has been reviewed and merged. It closes the issue
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 will be merged when the new crate version of pallas is released
  • Some end to end tests are flaky in the CI #1147: we have witnessed high rate of failure on the end to end test in the CI lately, and we have started investigating the problem
  • Handle cancellation of certificate verification in WASM client #1480: the issue has been created, and we have groomed it. A PR is being prepared
  • Handle cache for certificate verification in WASM client #1484: the issue has been created and needs to be groomed
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 is being updated to add examples in generated descriptions
  • Improve signed entity test #1460: the PR is being reviewed and will be merged shortly

January 2024

2024-01-31

• We have worked on the following issues:
  • Light Wallet: Implement proof generation route in the aggregator #1467:the PR Implement CardanoTransactions proof generation route in aggregator #1473 has been merged. This closes the issue
  • Light Wallet: Implement artifact routes in the aggregator #1478: the issue has been created and the PR Implement CardanoTransactions artifact routes in aggregator #1479 has been created and is pending review. It will be merged shortly
  • Add WASM client step in Mithril Client multi-platform test #1408: the PR Add mithril-client-wasm tests in multi platform test #1462 has been merged which closes the issue
  • Upgrade http dependency #1474: the issue has been created and the PR Update dependencies #1476 has been created, reviewed and merged. We'll keep working on this issue shortly
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 will be merged when the new crate version of pallas is released
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 is being updated to use missing configuration parameters
  • Improve signed entity test #1460: the PR is being updated to improve missing tests
  • Fails to download a snapshot on preview #1475: the issue has been created, troubleshooted and closed
  • Enhance WASM client #1480: the issue has been created
  • Epic: Conway support for Mithril nodes #1482: the epic has been created
  • Epic: Light Wallet implementation MVP #1457: the epic has been created
  • Epic: P2P Signer Registration PoC #1456: the epic has been created
  • Epic: Expose Prometheus metrics for Mithril nodes #1481: the epic has been created

2024-01-30

• Today, we have been working on these topics:
  • Light Wallet: Implement proof generation route in the aggregator #1467: we have kept pairing on it. The PR Implement CardanoTransactions proof generation route in aggregator #1473 has been created and is pending review. It will be merged shortly
  • Enhance ImmutableFile list computation resilience #1450: the PR List immutables resilience #1465 has been reviewed and merged. This closes the issue
  • Add WASM client step in Mithril Client multi-platform test #1408: the PR Add mithril-client-wasm tests in multi platform test #1462 has been reviewed and will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 will be merged when the new crate version of pallas is released
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 is being updated to use missing configuration parameters
  • Improve signed entity test #1460: the PR is being updated to improve missing tests

2024-01-29

• Today, we have worked on the following issues:
  • Enhance ImmutableFile list computation resilience #1450: the PR List immutables resilience #1465 has been created, and is being reviewed. It will be merged shortly
  • Add WASM client step in Mithril Client multi-platform test #1408: the draft PR has been created Add mithril-client-wasm tests in multi platform test #1462 will be ready for review shortly
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 has been updated and it fixes the problem of compatibility 🎉. As soon as a new crate version of pallas is released, we will merge the PR
  • Generate automatic documentation for CLIs #1471: the PR Generate documentation on module command lines #1424 is being updated to use missing configuration parameters
  • Improve signed entity test #1460: the PR is being updated to improve missing tests
  • Light Wallet: Implement proof generation route in the aggregator #1467: the issue was created and we have paired on it. The development have been pushed to the branch ensemble/1467-transactions-proof-route-aggregator. We will keep pairing on it shortly
  • Light Wallet: Implement transactions verification in client library #1468: the issue has been created and groomed
  • Light Wallet: Implement commands in the client binary #1469: the issue has been created and groomed
  • Light Wallet: Implement transactions verification in the WASM client #1470: the issue has been created and groomed
  • Some timing tests fail on ARM #1466: the issue has been created by a user from the community. We have started investigating it

2024-01-26

• We have worked on the following topics:

  • Enhance end to end test for Cardano hard forks #1464: the PR Enhance end to end test for Cardano hard forks #1459 has been merged. This closes the issue
  • Enhance ImmutableFile list computation resilience #1450: the PR Fix building mithril-common with some features and targets combinatory #1463 has been created, reviewed and merged. A new PR is in progress
  • Add WASM client step in Mithril Client multi-platform test #1408: the draft PR has been created Add mithril-client-wasm tests in multi platform test #1462 will be ready for review shortly
  • Enhance Mithril/Cardano node communication #1315: the PR get datums using pallas observer #1403 has been updated to handle forward compatibility, but there are still some backward compatibility problems that are being investigated. It will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Improve signed entity test #1460: the PR is being updated to improve missing tests
  • Fix missing test data in nix flake build #1461: the PR has been reviewed and merged

• We have also rotated the KES keys of all the SPOs running in the testing-preview and pre-release-preview networks

2024-01-25

• Today, we have worked on the following issues:

  • Light Wallet: Compute message to sign for CardanoTransactions #1436: we have kept paired on this issue, and the PR Compute message to sign for Cardano transactions #1455 has been reviewed and merged. It closes the issue
  • Enhance end to end test for Cardano hard forks #1459: the PR Enhance end to end test for Cardano hard forks #1459 has been created and is pending review
  • Enhance Mithril/Cardano node communication #1315: the problem of UTxO retrieval is apparently due to the version of the Cardano node: pallas is not fully compatible with 8.7.3. The PR get datums using pallas observer #1403 is being updated to handle forward compatibility. It will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Improve signed entity test #1460: the PR is being updated to improve missing tests
  • Fix missing test data in nix flake build #1461: the PR has been created and is pending review. It will be merged shortly

• We have also prepared the sprint planning for the next iteration

2024-01-24

• Today, we have worked on the following issues:
  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: the PR Gather and store Cardano transactions from immutable files #1451 has been merged. It closes the issue
  • Light Wallet: Compute message to sign for CardanoTransactions #1436: we have paired on this issue, and the draft PR Compute message to sign for Cardano transactions #1455 has been created. It will be merged shortly
  • Enhance end to end test for Cardano hard forks #1459: the drat PR has been created and will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: the problem of UTxO retrieval is apparently due to the version of the Cardano node: pallas is not fully compatible with 8.7.3. The PR get datums using pallas observer #1403 is being updated to handle forward compatibility. It will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • improve signed entity test #1460: the draft PR has been created and is pending review

2024-01-23

• The 2304.1 distribution has been released today, and the new Mithril client wasm npm package has also been officially released 🥳

• We have also worked on the following issues:

  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: we have kept pairing on the issue and the PR Gather and store Cardano transactions from immutable files #1451 is now pending reviews. It will be merged tomorrow
  • Enhance Mithril/Cardano node communication #1315: we are still investigating a problem of UTxO retrieval. The PR get datums using pallas observer #1403 will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Rotate current documentation #1446: the PR has been merged
  • Fix mithril-client wasm basic JS code example #1449: the PR has been merged
  • Specify explicitly permissions for prerelease creation #1452: the PR has been created, reviewed and merged
  • Increment mithril-client-wasm version for npm publish #1453: the PR has been created, reviewed and merged
  • Add dev blog post to announce Mithril client npm package #1454: the PR has been created, reviewed and merged

2024-01-22

• Today, we have monitored the 2304.1-pre pre-release distribution which is working as expected. It will be released tomorrow

• We have also worked on the following issues:

  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: we have kept pairing on the issue and the draft PR Gather and store Cardano transactions from immutable files #1451. It will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: we are still investigating a problem of UTxO retrieval. The PR get datums using pallas observer #1403 will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Rotate current documentation #1446: the draft PR has been created and will be merged tomorrow
  • Fix mithril-client wasm basic JS code example #1449: the PR has been created and reviewed. It will be merged tomorrow

2024-01-19

• We have created the new 2304.1-pre pre-release distribution that has been deployed to the pre-release-preview network. We expect to release the distribution early next week 🎉

• We have also worked on the following topics:

  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: we have kept pairing on the issue and we have made good progress. The developments have been published to the branch ensemble/1435-gather-store-cardano-transactionshttps://github.com/input-output-hk/mithril/tree/ensemble/1435-gather-store-cardano-transactions. We'll keep working on it shortly
  • Light Wallet: Implement browser tests with fake aggregator#1407: the PR Implement fake aggregator in wasm tests #1441 has been merged, which closes the issue
  • Enhance Mithril/Cardano node communication #1315: we are still investigating a problem of UTxO retrieval. The PR get datums using pallas observer #1403 will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Upgrade dependencies #1445: the PR has been reviewed and merged
  • Fix 2803 pre-release distribution #1447: the PR has been created, reviewed and merged
  • Fix npm authentication to registry in CI #1448: the PR has been created, reviewed and merged
  • Rotate current documentation #1446: the draft PR has been created and will be merged next week

2024-01-18

• We have worked on the following topics:
  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: we have paired on the issue and we have made good progress. The developments have been published to the branch ensemble/1435-gather-store-cardano-transactionshttps://github.com/input-output-hk/mithril/tree/ensemble/1435-gather-store-cardano-transactions. We'll keep working on it shortly
  • Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 has been merged. It closes the issue
  • Enhance Mithril/Cardano node communication #1315: we are still investigating a problem of UTxO retrieval. The PR get datums using pallas observer #1403 will be merged as soon as the problem is fixed
  • Light Wallet: Implement browser tests with fake aggregator#1407: the PR Implement fake aggregator in wasm tests #1441 has is pending final review. It will be merged shortly
  • Add warn missing docs in mithril client cli #1439: the PR Warn missing docs directive missing in Mithril Client Cli #1444 has been reviewed and merged. It closes the issue
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Upgrade dependencies #1445: the PR has been created and is pending review. It will be merged tomorrow
  • We have also started preparing the rollout of the pre-release for the new 2403 distribution. It should be ready tomorrow

2024-01-17

• Today, we have been working on the following issues:
  • Transition Era Reader adapter to CardanoChain in devnet #1428: the PR Use CardanoChain era reader in end to end test #1431 has been merged
  • Light Wallet: Create new signed entity type for CardanoTransactions #1434: the PR Support CardanoTransactions signed entity type #1437 has been reviewed and merged
  • Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 is pending final modifications. It will be merged tomorrow
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged. We have noticed that the end to end tests are not working with the new devnet, there is likely a problem of UTxO retrieval that is being investigated. The PR will be merged as soon as the problem is fixed
  • Upgrade Cardano node to 8.7.3 #1410: the PRs Fix Docker registry for Cardano node #1440 and Fix Cardano configuration in infrastructure #1442 have been created, reviewed and merged. We have successfully upgraded the Cardano nodes of the testing-preview network
  • Light Wallet: Implement browser tests with fake aggregator#1407: the PR Implement fake aggregator in wasm tests #1441 has been created and is pending review. It will be merged shortly
  • Add warn missing docs in mithril client cli #1439: the issue has been created and the PR Warn missing docs directive missing in Mithril Client Cli #1444 is pending review
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Fix path on command #1438: the PR has been created, reviewed and merged
  • Remove contact form in the documentation website #1443: the PR has been created, reviewed and merged

2024-01-16

• Today, we have been working on the following issues:
  • Transition Era Reader adapter to CardanoChain in devnet #1428: the PR Use CardanoChain era reader in end to end test #1431 has been enhanced following review and will be merged tomorrow
  • Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 is pending final modifications. It will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged. We will be to test the UTxO retrieval in the end to end test once the PR Use CardanoChain era reader in end to end test #1431 has bee merged
  • Generate documentation on module command lines #1424: the PR is pending review
  • Upgrade Cardano node to 8.7.3 #1410: We are working on the modification of the Docker image we use for the Cardano node to limit dependency to their Docker registry
  • Light Wallet: Create new signed entity type for CardanoTransactions #1434: the issue has been created and groomed. We have paired on the issue and the PR Support CardanoTransactions signed entity type #1437 has been created and is pending review. It should be merged tomorrow
  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: the issue has been created and groomed
  • Light Wallet: Compute message to sign for CardanoTransactions #1436: the issue has been created and groomed

2024-01-15

• We have been working on the following issues:

  • Transition Era Reader adapter to CardanoChain in devnet #1428: the PR Use CardanoChain era reader in end to end test #1431 is pending review and will be merged shortly
  • Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 has been updated and is pending final review. It will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged. We will be to test the UTxO retrieval in the end to end test once the PR Use CardanoChain era reader in end to end test #1431 has bee merged
  • Generate documentation on module command lines #1424: the PR is pending review
  • Upgrade Cardano node to 8.7.3 #1410: the PR Upgrade Cardano node to 8.7.3 #1430 has been merged. However, we have not been able to deploy the 8.7.3 Docker image of the Cardano node which is not published on any registry. We will have to circumvent the problem by modifying the Cardano node Docker image that we use in the infrastructure
  • Upgrade testing-preview VM in infra #1429: the PR has been merged
  • Update ci.yml after the deletion of doc.yml #1432: the PR has been created, reviewed and merged
  • Fix devnet to run consistently on mac OS #1433: the PR has been created, reviewed and merged

• During our team session, we have discussed about the following topics:

  • Decentralized key registration:
    • We will soon work on a 'naive' decentralization through the P2P network layer that we have implemented. In that case, we acknowledge that there is absolutely no guarantee that this will be stable enough to go to production as is
    • We could possibly make all the signer node aggregate signatures (but not handle the heavy duty task on creating/hosting the artifacts) which could mitigate the adversaries behaviors in P2P signer registration
    • This will give us knowledge and feedback that we will use to hopefully find solutions to this problem
    • Also it is a door opener for working on a fully decentralized Mithril network
    • We have also imagined an on chain signer registration that would be automated provided some script send few ADAs at regular intervals to an address whose private key is on the signer node (avoiding the burden of manual transactions done every epoch, but there is still an associated cost)
  • We talked about the new version of the Mithril client available in the browser and that will soon provide transaction verification capability
  • We have also talked about the new version of the devnet and of the end to end test that allows us to thoroughly test the new Pallas chain observer (UTxO retrieval and hard forks compatibility)

2024-01-12

• Today, we have worked on the following issues:

  • Activate babbage/conway eras on devnet #1425: the PR Activate babbage/conway eras in devnet #1427 has been reviewed and merged
  • Transition Era Reader adapter to CardanoChain in devnet #1428: the draft PR Use CardanoChain era reader in end to end test #1431 has been created and will be ready to be reviewed shortly
  • Implement a fake standalone aggregator #1397: we have kept working on the finalization of the implementation. The PR has been updated and is pending final review. It will be merged next week
  • Implement the mithril client WASM package in the explorer #1409: the PR Implement mithril client wasm in explorer #1426 has been merged. We know have the Mithril client available directly in the explorer and verifying the certificates in the browser 🎉
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged
  • Generate documentation on module command lines #1424: the PR is pending review
  • Upgrade Cardano node to 8.7.3 #1410: the PR Upgrade Cardano node to 8.7.3 #1430 has been created and is pending review. It will be merged shortly
  • Upgrade testing-preview VM in infra #1429: the PR has been created in order to upgrade the VM which is missing some CPU power. It will be merged shortly

• The testing-preview network has resumed producing certificates without interruption since yesterday. We will keep monitoring it

2024-01-11

• Today, we have worked on the following issues:

  • Activate babbage/conway eras on devnet #1425: the PR Activate babbage/conway eras in devnet #1427 is pending review and will be merged tomorrow
  • Transition Era Reader adapter to CardanoChain in devnet #1428: the issue has been created and we have started implementing it. A draft PR will be created shortly
  • Implement a fake standalone aggregator #1397: we have kept working on the implementation of tests for the Open API specifications conformity. The PR will be updated shortly
  • Implement the mithril client WASM package in the explorer #1409: we have paired on the PR Implement mithril client wasm in explorer #1426 in order to fix the problems in the CI. The PR has also been reviewed and will be merged tomorrow
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged
  • Generate documentation on module command lines #1424: the PR is pending review

• Following the re-genesis, the testing-preview network has resumed producing certificates today. It appears that the communication problems are probably due to the Mithril relays. We'll keep investigating in the following days

• Finally, we have worked on the sprint planning for the next iteration

2024-01-10

• Today, we have worked on the following issues:

  • Activate babbage/conway eras on devnet #1425: the PR Activate babbage/conway eras in devnet #1427 has been updated and is ready to be reviewed. The new version of the devnet is now working with stake delegation, and it has a new hard fork option that defines the epoch at which the latest era is to be activated. The execution time has also been significantly reduced (<1min, -50% drop). Finally, we will implement the transition to the Cardano chain observer for the eras reader which will give us more control for testing the Pallas chain observer
  • Implement a fake standalone aggregator #1397: we have kept working on the implementation of tests for the Open API specifications conformity. The PR will be updated shortly
  • Implement the mithril client WASM package in the explorer #1409: the PR Implement mithril client wasm in explorer #1426 has been created and is pending review. We still need to fix the explorer build in the documentation workflow as it needs to use the WASM package that is produced in the CI
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged
  • Generate documentation on module command lines #1424: the PR is pending review

• Following the epoch gap, the testing-preview network has been re-genesis and it should resume producing certificates tomorrow

2024-01-09

• Today, we have worked on the following issues:

  • Implement ChainObserver adapter configuration in aggregator #1396: the PR has been merged. This closes the issue
  • Activate babbage/conway eras on devnet #1425: the draft PR Activate babbage/conway eras in devnet #1427 has been created. We have migrated the legacy devnet to the new development and made the end to end test successful (except for the stake delegation part) which is more complicated. We have also prepared a mechanism for switching to the latest hard fork at a specified epoch number. We will keep working on it tomorrow
  • Implement a fake standalone aggregator #1397: we have kept working on the implementation of tests for the Open API specifications conformity. The PR will be updated shortly
  • Implement the mithril client WASM package in the explorer #1409: the draft PR Implement mithril client wasm in explorer #1426 has been created and will be ready soon
  • Enhance Mithril/Cardano node communication #1315: we have reviewed the PR get datums using pallas observer #1403 which is almost ready to be merged
  • Generate documentation on module command lines #1424: the PR is pending review

• We have noticed that the testing-preview network was not producing certificates any more for a few days. It happened that there was a communication problem between the signers and the aggregator on the VM (which was fixed by restarting the aggregator container). This implies a re-genesis of the chain which will take place tomorrow and the network should resume signing the day after

2024-01-08

We have worked on the following issues:

• Implement ChainObserver adapter configuration in aggregator #1396: the PR is still pending reviews. It will be merged tomorrow
• Activate babbage era on devnet #1425: the issue has been created. We have succeeded in adapting the current devnet with the new Babbage era. The developments have been pushed to the branch jpraynaud/1425-activate-babbage-devnet. We have also checked that the developments are compatible with Conway era. We will keep working on it shortly
• Implement a fake standalone aggregator #1397: we have paired on the implementation of tests for the Open API specifications conformity. The PR will be updated shortly
• Enhance Mithril/Cardano node communication #1315: we have reviewed the PR get datums using pallas observer #1403 which should be ready to be merged shortly
• Generate documentation on module command lines #1424: the PR has been created and will be reviewed soon

2024-01-03

Today, we have been working on the following issues:

• Light Wallet: Implement browser tests with fake aggregator #1407: we have started using the not yet merged fake aggregator and checked that we could run successful tests with the WASM client. We will keep working on it shortly
• Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 has been reviewed and is pending modifications
• Implement the mithril client WASM package in the explorer #1409: we have successfully implemented a draft version of the certificate verification in the explorer. It has some consequences on the way we package npm module, and we will attempt to stabilize it next week
• Implement ChainObserver adapter configuration in aggregator #1396: the PR Implement configurable Chain Observer in aggregator #1423 has been created and is under review. It will be merged shortly
• Upgrade Cardano node to 8.7.2 #1410: we are making some attempts to make the devnet work on the last era, but the Cardano nodes get stuck and do not keep on creating new slots/blocks. We are trying to understand the source of the problem and we will keep investigating on this issue

2024-01-03

Today, we have worked on the following issues:

• Fix signer node service setup #1404: the PR Fix signer service recommended configuration #1419 has been reviewed and merged. This closes the issue
• Make all infra Cardano nodes use P2P topology #1405: the PR Activate Cardano node P2P mode in infrastructure #1417 has been merged, which closes the issue
• Light Wallet: Implement browser tests with fake aggregator #1407: the PR Implement tests for WASM library #1418 has been merged. It will be completed once the issue Implement a fake standalone aggregator #1397 is done
• Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 has been created and is pending review
• Implement the mithril client WASM package in the explorer #1409: we have paired on this issue in order to fix some problems with using WASM modules with nextjs framework. We will keep working on it shortly
• Upgrade Cardano node to 8.7.2 #1410: we are attempting to upgrade the devnet with the new version of the Cardano node
• Rust version 1.75.0: fix cargo clippy warning & update dependencies #1420: the PR has been reviewed and merged