New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Performance harness for MirageOS 3 #685

Open
avsm opened this Issue Nov 16, 2016 · 6 comments

Comments

Projects
None yet
5 participants
@avsm
Member

avsm commented Nov 16, 2016

  • We need one to evaluate all the MirageOS 3 backends and determine if changesets are causing regressions or improvements.

  • Many parameters to vary: individual library versions, OCaml compiler revisions, compiler flags, options like tracing, and the actual backends that we target (Xen, KVM, Unix)

  • Initially going to look at on-host network tests, and then move to off-host ones when we get physical machines.

  • Possibly use Owl to do some multivariate data analysis on the script results.

  • Push the results to a single performance summary page

  • @avsm to sort out physical machine infrastructure (initially hosted at CUCL)

  • @avsm to build a DataKit module to run perf tests via OPAM

  • Takayuki Imada to start on Mirage unikernels for individual network performance (e.g. iperf, ping)

  • @mor1 to resurrect https://github.com/mirage/mirage-perf which we used for MirageOS2 (but never ran on an ongoing basis)

  • someone to determine what format we log in for post processing

Useful notes:

@mort

This comment has been minimized.

mort commented Nov 16, 2016

Hi there. Seems you got me mistaken for one of your devs :)

@avsm

This comment has been minimized.

Member

avsm commented Nov 16, 2016

@mort sorry! It was meant to be @mor1, although you are of course more than welcome to contribute to the MirageOS performance harness ;-)

@avsm avsm referenced this issue Nov 16, 2016

Closed

Tracking issue towards MirageOS 3.0 #592

29 of 29 tasks complete
@mort

This comment has been minimized.

mort commented Nov 16, 2016

If only my skills were up to the task! :) Best of lucks.

@amirmc

This comment has been minimized.

Member

amirmc commented Nov 16, 2016

Manuel, you may need to manually unsubscribe yourself from this thread. Otherwise you'll keep getting notifications. :)

@yomimono

This comment has been minimized.

Member

yomimono commented Nov 17, 2017

@TImada IIRC you were awaiting permission to publish the performance harness work you've done - is that still in process somewhere?

@TImada

This comment has been minimized.

TImada commented Nov 18, 2017

@yomimono sorry, I'm still awaiting the permission. It was supposed to be done by this week. I hope I can publish it soon. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment