Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and
privacy statement. We’ll occasionally send you account related emails.
Already on GitHub?
to your account
Since 2014 @clarus has maintained https://coq-bench.github.io/ ; indeed, this tooling seems to be not properly publicized, and as discussed in coq/opam-coq-archive#798 now an alternative was developed (http://check.ocamllabs.io/).
I've opened this issue to track integration of coq-bench within Coq's infrastructure. A few issues are:
The text was updated successfully, but these errors were encountered:
@ejgallego Thanks for your message. I am currently looking at if I can achieve connection with Gitter.
Sorry, something went wrong.
Great @clarus ! I wonder which channel should it go, maybe we should create an OPAM channel?
I think you should be able to do it but just in case ping us on gitter if that doesn't work.
OK thanks, good for the idea of creating an opam channel.
Bench reports should now be available on this Gitter canal: https://gitter.im/coq/opam-bench-reports ! I will see over time if the implementation is stable.
There was some discussion in the Coq Call today about 2nd stage CI systems, this bug is relevant.
OK, thanks for the information! What should be done for example? What would be the use cases?
What I should do on the short term:
@clarus maybe we could start a discussion about this bug in Zulip? Your list sounds good but I'm sure other devs will have more suggestions.
Coq weekly visio calls are also an option if we feel like live discussion would be good.
OK, I can start to work on the Zulip bug then. I can join the Coq call next week.
Cool, I've opened a Zulip thread https://coq.zulipchat.com/#narrow/stream/237656-Coq-devs.20.26.20plugin.20devs/topic/coq.2Eio.20bench
One thing that would be great to do is to have coq-bench to automatically open an issue in coq-opam-repos everytime a failure happens.
cc: @Zimmi48 / coqbot ppl
Another thing that would be useful is to provide a link / status display for coq bench from the main platform / coq opam repos website.
Successfully merging a pull request may close this issue.