Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Caliper 2023 Q2 project update #131

Merged
merged 1 commit into from
Jul 13, 2023

Conversation

aklenik
Copy link
Contributor

@aklenik aklenik commented Jun 26, 2023

No description provided.

Copy link
Member

@petermetz petermetz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@aklenik I think this might be based on the old report template, you can see the new one here: https://github.com/hyperledger/toc/blob/gh-pages/project-reports/0000-template.md

Signed-off-by: Attila Klenik <a.klenik@gmail.com>
@aklenik
Copy link
Contributor Author

aklenik commented Jun 28, 2023

@petermetz Apologies, I've updated the report accordingly.

@ryjones ryjones added the quarterly-report Quarterly Project Updates label Jun 29, 2023
* Docker monitoring bug fix
* Evaluating Caliper capabilities/limitations for upcoming mentorship project

The activity has been minimal in the last quarter due to the maintainers being otherwise engaged.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you have a roadmap for Caliper and goals for what you want to accomplish in the next year?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The Fabric integration and core features are stable enough to conduct large scale experiments in terms of workload generation. There hasn't been much interest in other integrations recently that would warrant the improvement and maintenance of other platform connectors. So currently we mainly provide support for the community regarding the usage of Caliper (configuration, best practices), rarely about missing features.

There are ongoing mentorships that will utilize Caliper in some way, so serving their needs will be the main concern for the next months (probably bringing some improvements to Caliper too). After that, some technical debts should be resolved (tests, documentation, tutorials, workshop material), and hopefully that'll push Caliper into a stable/major release state.

There are ongoing discussions about a performance task force (or some other form), so we'll see what role Caliper will play in that. That are some tooling around blockchain performance that could be consolidated too, but that'll be a bit more complicated work/discussion I think :)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the project maintainers are willing to, there can be ambitious goals that benefits both the Hyperledger Foundation, user base of the bigger Hyperledger projects and the Caliper project itself. Following are the ways I would think Caliper can be a value add

  1. Either the Caliper team or the task force can come up with a list of variable parameters, and their influence in the throughput of blockchain commits.
  2. Caliper team can define a means of certifying a blockchain deployment platform through benchmarking capabilities. This can be done through a combination of pre-defined test cases and required deployment structure. I would visualize this as a means of compliance suite for the blockchain deployment platforms so that they are aware of complex and otherwise overlooked scenarios that are possible.

* Docker monitoring bug fix
* Evaluating Caliper capabilities/limitations for upcoming mentorship project

The activity has been minimal in the last quarter due to the maintainers being otherwise engaged.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the project maintainers are willing to, there can be ambitious goals that benefits both the Hyperledger Foundation, user base of the bigger Hyperledger projects and the Caliper project itself. Following are the ways I would think Caliper can be a value add

  1. Either the Caliper team or the task force can come up with a list of variable parameters, and their influence in the throughput of blockchain commits.
  2. Caliper team can define a means of certifying a blockchain deployment platform through benchmarking capabilities. This can be done through a combination of pre-defined test cases and required deployment structure. I would visualize this as a means of compliance suite for the blockchain deployment platforms so that they are aware of complex and otherwise overlooked scenarios that are possible.

@petermetz
Copy link
Member

@petermetz Apologies, I've updated the report accordingly.

@aklenik No worries, thank you for the fix!

Copy link
Member

@petermetz petermetz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tkuhrt tkuhrt merged commit 23f1bf3 into hyperledger:gh-pages Jul 13, 2023
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
quarterly-report Quarterly Project Updates
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet