Logbook

This page records a log of the team’s work, thinking, discussions, pains, joys, events, and experiences that happen on a daily basis. It’s supposed to be a kind of Stream of consciousness that can later be searched, analyzed, reviewed in more formal retrospectives.

Rules:

• Log days in reverse chronological order, recent first

• When the stream is getting too big, such that github refuses to render do the following:

  • extract biggest logical section (half-year or quarter) out of this into a correspondingly named Logbook-Year-Hn.md or Logbook-Year-Qn.md page
  • update links on top of this page to make it easier to navigate try to fix all links in the wiki at least
  • notify the team

• Move (and link) recurring sections to relevant dedicated pages.

History

• January 2024

2023-H2

• December 2023
• November 2023
• October 2023
• September 2023
• August 2023
• July 2023

2023-H1

• June 2023
• May 2023
• April 2023
• March 2023
• February 2023
• January 2023

2022-H2

• December 2022
• November 2022
• October 2022
• September 2022
• August 2022
• July 2022

2022-H1

• June 2022
• May 2022
• April 2022
• March 2022

2021

• 2021

January 2024

2024-01-23

• The 2304.1 distribution has been released today 🥳, and the new Mithril client wasm npm package has also been officially released

• We have also worked on the following issues:

  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: we have kept pairing on the issue and the PR Gather and store Cardano transactions from immutable files #1451 is now pending reviews. It will be merged tomorrow
  • Enhance Mithril/Cardano node communication #1315: we are still investigating a problem of UTxO retrieval. The PR get datums using pallas observer #1403 will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Rotate current documentation #1446: the PR has been merged
  • Fix mithril-client wasm basic JS code example #1449: the PR has been merged
  • Specify explicitly permissions for prerelease creation #1452: the PR has been created, reviewed and merged
  • Increment mithril-client-wasm version for npm publish #1453: the PR has been created, reviewed and merged
  • Add dev blog post to announce Mithril client npm package #1454: the PR has been created, reviewed and merged

2024-01-22

• Today, we have monitored the 2304.1-pre pre-release distribution which is working as expected. It will be released tomorrow

• We have also worked on the following issues:

  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: we have kept pairing on the issue and the draft PR Gather and store Cardano transactions from immutable files #1451. It will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: we are still investigating a problem of UTxO retrieval. The PR get datums using pallas observer #1403 will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Rotate current documentation #1446: the draft PR has been created and will be merged tomorrow
  • Fix mithril-client wasm basic JS code example #1449: the PR has been created and reviewed. It will be merged tomorrow

2024-01-19

• We have created the new 2304.1-pre pre-release distribution that has been deployed to the pre-release-preview network. We expect to release the distribution early next week 🎉

• We have also worked on the following topics:

  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: we have kept pairing on the issue and we have made good progress. The developments have been published to the branch ensemble/1435-gather-store-cardano-transactionshttps://github.com/input-output-hk/mithril/tree/ensemble/1435-gather-store-cardano-transactions. We'll keep working on it shortly
  • Light Wallet: Implement browser tests with fake aggregator#1407: the PR Implement fake aggregator in wasm tests #1441 has been merged, which closes the issue
  • Enhance Mithril/Cardano node communication #1315: we are still investigating a problem of UTxO retrieval. The PR get datums using pallas observer #1403 will be merged as soon as the problem is fixed
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Upgrade dependencies #1445: the PR has been reviewed and merged
  • Fix 2803 pre-release distribution #1447: the PR has been created, reviewed and merged
  • Fix npm authentication to registry in CI #1448: the PR has been created, reviewed and merged
  • Rotate current documentation #1446: the draft PR has been created and will be merged next week

2024-01-18

• We have worked on the following topics:
  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: we have paired on the issue and we have made good progress. The developments have been published to the branch ensemble/1435-gather-store-cardano-transactionshttps://github.com/input-output-hk/mithril/tree/ensemble/1435-gather-store-cardano-transactions. We'll keep working on it shortly
  • Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 has been merged. It closes the issue
  • Enhance Mithril/Cardano node communication #1315: we are still investigating a problem of UTxO retrieval. The PR get datums using pallas observer #1403 will be merged as soon as the problem is fixed
  • Light Wallet: Implement browser tests with fake aggregator#1407: the PR Implement fake aggregator in wasm tests #1441 has is pending final review. It will be merged shortly
  • Add warn missing docs in mithril client cli #1439: the PR Warn missing docs directive missing in Mithril Client Cli #1444 has been reviewed and merged. It closes the issue
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Upgrade dependencies #1445: the PR has been created and is pending review. It will be merged tomorrow
  • We have also started preparing the rollout of the pre-release for the new 2403 distribution. It should be ready tomorrow

2024-01-17

• Today, we have been working on the following issues:
  • Transition Era Reader adapter to CardanoChain in devnet #1428: the PR Use CardanoChain era reader in end to end test #1431 has been merged
  • Light Wallet: Create new signed entity type for CardanoTransactions #1434: the PR Support CardanoTransactions signed entity type #1437 has been reviewed and merged
  • Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 is pending final modifications. It will be merged tomorrow
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged. We have noticed that the end to end tests are not working with the new devnet, there is likely a problem of UTxO retrieval that is being investigated. The PR will be merged as soon as the problem is fixed
  • Upgrade Cardano node to 8.7.3 #1410: the PRs Fix Docker registry for Cardano node #1440 and Fix Cardano configuration in infrastructure #1442 have been created, reviewed and merged. We have successfully upgraded the Cardano nodes of the testing-preview network
  • Light Wallet: Implement browser tests with fake aggregator#1407: the PR Implement fake aggregator in wasm tests #1441 has been created and is pending review. It will be merged shortly
  • Add warn missing docs in mithril client cli #1439: the issue has been created and the PR Warn missing docs directive missing in Mithril Client Cli #1444 is pending review
  • Generate documentation on module command lines #1424: the PR is being updated to use missing configuration parameters
  • Fix path on command #1438: the PR has been created, reviewed and merged
  • Remove contact form in the documentation website #1443: the PR has been created, reviewed and merged

2024-01-16

• Today, we have been working on the following issues:
  • Transition Era Reader adapter to CardanoChain in devnet #1428: the PR Use CardanoChain era reader in end to end test #1431 has been enhanced following review and will be merged tomorrow
  • Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 is pending final modifications. It will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged. We will be to test the UTxO retrieval in the end to end test once the PR Use CardanoChain era reader in end to end test #1431 has bee merged
  • Generate documentation on module command lines #1424: the PR is pending review
  • Upgrade Cardano node to 8.7.3 #1410: We are working on the modification of the Docker image we use for the Cardano node to limit dependency to their Docker registry
  • Light Wallet: Create new signed entity type for CardanoTransactions #1434: the issue has been created and groomed. We have paired on the issue and the PR Support CardanoTransactions signed entity type #1437 has been created and is pending review. It should be merged tomorrow
  • Light Wallet: Gather transactions from immutable files and store them in the database #1435: the issue has been created and groomed
  • Light Wallet: Compute message to sign for CardanoTransactions #1436: the issue has been created and groomed

2024-01-15

• We have been working on the following issues:

  • Transition Era Reader adapter to CardanoChain in devnet #1428: the PR Use CardanoChain era reader in end to end test #1431 is pending review and will be merged shortly
  • Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 has been updated and is pending final review. It will be merged shortly
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged. We will be to test the UTxO retrieval in the end to end test once the PR Use CardanoChain era reader in end to end test #1431 has bee merged
  • Generate documentation on module command lines #1424: the PR is pending review
  • Upgrade Cardano node to 8.7.3 #1410: the PR Upgrade Cardano node to 8.7.3 #1430 has been merged. However, we have not been able to deploy the 8.7.3 Docker image of the Cardano node which is not published on any registry. We will have to circumvent the problem by modifying the Cardano node Docker image that we use in the infrastructure
  • Upgrade testing-preview VM in infra #1429: the PR has been merged
  • Update ci.yml after the deletion of doc.yml #1432: the PR has been created, reviewed and merged
  • Fix devnet to run consistently on mac OS #1433: the PR has been created, reviewed and merged

• During our team session, we have discussed about the following topics:

  • Decentralized key registration:
    • We will soon work on a 'naive' decentralization through the P2P network layer that we have implemented. In that case, we acknowledge that there is absolutely no guarantee that this will be stable enough to go to production as is
    • We could possibly make all the signer node aggregate signatures (but not handle the heavy duty task on creating/hosting the artifacts) which could mitigate the adversaries behaviors in P2P signer registration
    • This will give us knowledge and feedback that we will use to hopefully find solutions to this problem
    • Also it is a door opener for working on a fully decentralized Mithril network
    • We have also imagined an on chain signer registration that would be automated provided some script send few ADAs at regular intervals to an address whose private key is on the signer node (avoiding the burden of manual transactions done every epoch, but there is still an associated cost)
  • We talked about the new version of the Mithril client available in the browser and that will soon provide transaction verification capability
  • We have also talked about the new version of the devnet and of the end to end test that allows us to thoroughly test the new Pallas chain observer (UTxO retrieval and hard forks compatibility)

2024-01-12

• Today, we have worked on the following issues:

  • Activate babbage/conway eras on devnet #1425: the PR Activate babbage/conway eras in devnet #1427 has been reviewed and merged
  • Transition Era Reader adapter to CardanoChain in devnet #1428: the draft PR Use CardanoChain era reader in end to end test #1431 has been created and will be ready to be reviewed shortly
  • Implement a fake standalone aggregator #1397: we have kept working on the finalization of the implementation. The PR has been updated and is pending final review. It will be merged next week
  • Implement the mithril client WASM package in the explorer #1409: the PR Implement mithril client wasm in explorer #1426 has been merged. We know have the Mithril client available directly in the explorer and verifying the certificates in the browser 🎉
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged
  • Generate documentation on module command lines #1424: the PR is pending review
  • Upgrade Cardano node to 8.7.3 #1410: the PR Upgrade Cardano node to 8.7.3 #1430 has been created and is pending review. It will be merged shortly
  • Upgrade testing-preview VM in infra #1429: the PR has been created in order to upgrade the VM which is missing some CPU power. It will be merged shortly

• The testing-preview network has resumed producing certificates without interruption since yesterday. We will keep monitoring it

2024-01-11

• Today, we have worked on the following issues:

  • Activate babbage/conway eras on devnet #1425: the PR Activate babbage/conway eras in devnet #1427 is pending review and will be merged tomorrow
  • Transition Era Reader adapter to CardanoChain in devnet #1428: the issue has been created and we have started implementing it. A draft PR will be created shortly
  • Implement a fake standalone aggregator #1397: we have kept working on the implementation of tests for the Open API specifications conformity. The PR will be updated shortly
  • Implement the mithril client WASM package in the explorer #1409: we have paired on the PR Implement mithril client wasm in explorer #1426 in order to fix the problems in the CI. The PR has also been reviewed and will be merged tomorrow
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged
  • Generate documentation on module command lines #1424: the PR is pending review

• Following the re-genesis, the testing-preview network has resumed producing certificates today. It appears that the communication problems are probably due to the Mithril relays. We'll keep investigating in the following days

• Finally, we have worked on the sprint planning for the next iteration

2024-01-10

• Today, we have worked on the following issues:

  • Activate babbage/conway eras on devnet #1425: the PR Activate babbage/conway eras in devnet #1427 has been updated and is ready to be reviewed. The new version of the devnet is now working with stake delegation, and it has a new hard fork option that defines the epoch at which the latest era is to be activated. The execution time has also been significantly reduced (<1min, -50% drop). Finally, we will implement the transition to the Cardano chain observer for the eras reader which will give us more control for testing the Pallas chain observer
  • Implement a fake standalone aggregator #1397: we have kept working on the implementation of tests for the Open API specifications conformity. The PR will be updated shortly
  • Implement the mithril client WASM package in the explorer #1409: the PR Implement mithril client wasm in explorer #1426 has been created and is pending review. We still need to fix the explorer build in the documentation workflow as it needs to use the WASM package that is produced in the CI
  • Enhance Mithril/Cardano node communication #1315: we have kept reviewing the PR get datums using pallas observer #1403 which is almost ready to be merged
  • Generate documentation on module command lines #1424: the PR is pending review

• Following the epoch gap, the testing-preview network has been re-genesis and it should resume producing certificates tomorrow

2024-01-09

• Today, we have worked on the following issues:

  • Implement ChainObserver adapter configuration in aggregator #1396: the PR has been merged. This closes the issue
  • Activate babbage/conway eras on devnet #1425: the draft PR Activate babbage/conway eras in devnet #1427 has been created. We have migrated the legacy devnet to the new development and made the end to end test successful (except for the stake delegation part) which is more complicated. We have also prepared a mechanism for switching to the latest hard fork at a specified epoch number. We will keep working on it tomorrow
  • Implement a fake standalone aggregator #1397: we have kept working on the implementation of tests for the Open API specifications conformity. The PR will be updated shortly
  • Implement the mithril client WASM package in the explorer #1409: the draft PR Implement mithril client wasm in explorer #1426 has been created and will be ready soon
  • Enhance Mithril/Cardano node communication #1315: we have reviewed the PR get datums using pallas observer #1403 which is almost ready to be merged
  • Generate documentation on module command lines #1424: the PR is pending review

• We have noticed that the testing-preview network was not producing certificates any more for a few days. It happened that there was a communication problem between the signers and the aggregator on the VM (which was fixed by restarting the aggregator container). This implies a re-genesis of the chain which will take place tomorrow and the network should resume signing the day after

2024-01-08

We have worked on the following issues:

• Implement ChainObserver adapter configuration in aggregator #1396: the PR is still pending reviews. It will be merged tomorrow
• Activate babbage era on devnet #1425: the issue has been created. We have succeeded in adapting the current devnet with the new Babbage era. The developments have been pushed to the branch jpraynaud/1425-activate-babbage-devnet. We have also checked that the developments are compatible with Conway era. We will keep working on it shortly
• Implement a fake standalone aggregator #1397: we have paired on the implementation of tests for the Open API specifications conformity. The PR will be updated shortly
• Enhance Mithril/Cardano node communication #1315: we have reviewed the PR get datums using pallas observer #1403 which should be ready to be merged shortly
• Generate documentation on module command lines #1424: the PR has been created and will be reviewed soon

2024-01-03

Today, we have been working on the following issues:

• Light Wallet: Implement browser tests with fake aggregator #1407: we have started using the not yet merged fake aggregator and checked that we could run successful tests with the WASM client. We will keep working on it shortly
• Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 has been reviewed and is pending modifications
• Implement the mithril client WASM package in the explorer #1409: we have successfully implemented a draft version of the certificate verification in the explorer. It has some consequences on the way we package npm module, and we will attempt to stabilize it next week
• Implement ChainObserver adapter configuration in aggregator #1396: the PR Implement configurable Chain Observer in aggregator #1423 has been created and is under review. It will be merged shortly
• Upgrade Cardano node to 8.7.2 #1410: we are making some attempts to make the devnet work on the last era, but the Cardano nodes get stuck and do not keep on creating new slots/blocks. We are trying to understand the source of the problem and we will keep investigating on this issue

2024-01-03

Today, we have worked on the following issues:

• Fix signer node service setup #1404: the PR Fix signer service recommended configuration #1419 has been reviewed and merged. This closes the issue
• Make all infra Cardano nodes use P2P topology #1405: the PR Activate Cardano node P2P mode in infrastructure #1417 has been merged, which closes the issue
• Light Wallet: Implement browser tests with fake aggregator #1407: the PR Implement tests for WASM library #1418 has been merged. It will be completed once the issue Implement a fake standalone aggregator #1397 is done
• Implement a fake standalone aggregator #1397: the PR fake aggregator #1422 has been created and is pending review
• Implement the mithril client WASM package in the explorer #1409: we have paired on this issue in order to fix some problems with using WASM modules with nextjs framework. We will keep working on it shortly
• Upgrade Cardano node to 8.7.2 #1410: we are attempting to upgrade the devnet with the new version of the Cardano node
• Rust version 1.75.0: fix cargo clippy warning & update dependencies #1420: the PR has been reviewed and merged