You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Consider the normalised major collections result here
We see that the baseline for this graph is turing_5.2.0+trunk+sequential_20230423_063894d and the plotted result is for the variant is turing_5.2.0+trunk+fix-idle-gc+sequential_20230423_7440f24.
Problem
Observe that the right-most benchmark is labelled LU_decomposition.1024 (577.00)
The intention is that "577" is the number associated for the baseline i.e, trunk. That is trunk does 577 major GCs and relative that fix-dle-gc variant does 100x more major GCs.
However, it turns out that the labels are incorrect, if you look at the data, then trunk does only 6 major collections where as fix-idle-gc does 577 collections.
Intended behaviour
The label should be LU_decomposition.1024 (6). In the course of it, can we also not display this label as a floating point number as we are counting the number of GCs and this can never not be a natural number?
Please can we also verify that other metrics don't also have this issue?
The text was updated successfully, but these errors were encountered:
Other metrics also had this issues, since a utility function that generated the name with the baseline value was buggy. Apologies for the inconvenience.
Consider the normalised major collections result here
We see that the baseline for this graph is
turing_5.2.0+trunk+sequential_20230423_063894dand the plotted result is for the variant isturing_5.2.0+trunk+fix-idle-gc+sequential_20230423_7440f24.Problem
Observe that the right-most benchmark is labelled
LU_decomposition.1024 (577.00)The intention is that "577" is the number associated for the baseline i.e, trunk. That is
trunkdoes 577 major GCs and relative thatfix-dle-gcvariant does 100x more major GCs.However, it turns out that the labels are incorrect, if you look at the data, then
trunkdoes only 6 major collections where asfix-idle-gcdoes 577 collections.Intended behaviour
The label should be
LU_decomposition.1024 (6). In the course of it, can we also not display this label as a floating point number as we are counting the number of GCs and this can never not be a natural number?Please can we also verify that other metrics don't also have this issue?
The text was updated successfully, but these errors were encountered: