You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: specs/abtesting-v3/common/schemas/Variant.yml
+13-7Lines changed: 13 additions & 7 deletions
Original file line number
Diff line number
Diff line change
@@ -57,17 +57,17 @@ metricResult:
57
57
type: number
58
58
format: double
59
59
description: |
60
-
The upper bound of the 95% confidence interval for the metric value. The confidence interval is calculated using
60
+
The upper bound of the 95% confidence interval for the metric value. The confidence interval is calculated using
61
61
either the relative ratio or relative difference between the metric values for the control and the variant.
62
-
Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),
62
+
Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),
63
63
while relative difference is used for continuous metrics (e.g., revenue).
64
64
valueCILow:
65
65
type: number
66
66
format: double
67
67
description: |
68
-
The lower bound of the 95% confidence interval for the metric value. The confidence interval is calculated using
68
+
The lower bound of the 95% confidence interval for the metric value. The confidence interval is calculated using
69
69
either the relative ratio or relative difference between the metric values for the control and the variant.
70
-
Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),
70
+
Relative ratio is used for metrics that are ratios (e.g., click-through rate, conversion rate),
71
71
while relative difference is used for continuous metrics (e.g., revenue).
72
72
pValue:
73
73
type: number
@@ -83,7 +83,7 @@ metricResult:
83
83
format: double
84
84
description: |
85
85
The value that was computed during error correction. It is used to determine significance of the metric pValue.
86
-
The critical value is calculated using Bonferroni or Benjamini-Hochberg corrections, based on the given
86
+
The critical value is calculated using Bonferroni or Benjamini-Hochberg corrections, based on the given
87
87
configuration during the A/B test creation.
88
88
significant:
89
89
type: boolean
@@ -131,9 +131,15 @@ metricMetadata:
131
131
type: number
132
132
format: double
133
133
description: |
134
-
Only present in case the metric is 'revenue'.
134
+
Only present in case the metric is 'revenue'.
135
135
It is the amount exceeding the 95th percentile of global revenue transactions involved in the AB Test. This amount is not considered when calculating statistical significance.
136
-
It is tied to a per revenue-currency pair contrary to other
136
+
It is tied to a per revenue-currency pair contrary to other
137
137
global filter effects (such as outliers and empty search count).
0 commit comments