Skip to content

Commit d059997

Browse files
authored
fix(specs): abtests metadata mean (#5121)
1 parent 484cb73 commit d059997

File tree

1 file changed

+13
-7
lines changed

1 file changed

+13
-7
lines changed

specs/abtesting-v3/common/schemas/Variant.yml

Lines changed: 13 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -57,17 +57,17 @@ metricResult:
5757
type: number
5858
format: double
5959
description: |
60-
The upper bound of the 95% confidence interval for the metric value. The confidence interval is calculated using
60+
The upper bound of the 95% confidence interval for the metric value. The confidence interval is calculated using
6161
either the relative ratio or relative difference between the metric values for the control and the variant.
62-
Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),
62+
Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),
6363
while relative difference is used for continuous metrics (e.g., revenue).
6464
valueCILow:
6565
type: number
6666
format: double
6767
description: |
68-
The lower bound of the 95% confidence interval for the metric value. The confidence interval is calculated using
68+
The lower bound of the 95% confidence interval for the metric value. The confidence interval is calculated using
6969
either the relative ratio or relative difference between the metric values for the control and the variant.
70-
Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),
70+
Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),
7171
while relative difference is used for continuous metrics (e.g., revenue).
7272
pValue:
7373
type: number
@@ -83,7 +83,7 @@ metricResult:
8383
format: double
8484
description: |
8585
The value that was computed during error correction. It is used to determine significance of the metric pValue.
86-
The critical value is calculated using Bonferroni or Benjamini-Hochberg corrections, based on the given
86+
The critical value is calculated using Bonferroni or Benjamini-Hochberg corrections, based on the given
8787
configuration during the A/B test creation.
8888
significant:
8989
type: boolean
@@ -131,9 +131,15 @@ metricMetadata:
131131
type: number
132132
format: double
133133
description: |
134-
Only present in case the metric is 'revenue'.
134+
Only present in case the metric is 'revenue'.
135135
It is the amount exceeding the 95th percentile of global revenue transactions involved in the AB Test. This amount is not considered when calculating statistical significance.
136-
It is tied to a per revenue-currency pair contrary to other
136+
It is tied to a per revenue-currency pair contrary to other
137137
global filter effects (such as outliers and empty search count).
138+
mean:
139+
type: number
140+
format: double
141+
description: Mean value for this metric.
142+
example: 53.7
138143
example:
139144
winsorizedValue: 888.80
145+
mean: 53.7

0 commit comments

Comments
 (0)