I want to change how we show Reward Metric in the stepper and the details page. Showing it as a query is a little confusing. It should be shown as the key + allowed values, "SUCCESS" and "FAILURE" with a brief explanation.
Metrics
-----------------------------------------------------------------------------------
(Potentially show a grayed out and un-trashable query that will be created here)
Metric Key: Statistics: Display:
MY_MOOC_EXPERIMENT_REWARD
+ Add Metric
Reward Metric
--------------------------------------------------------------------------------------
Key: "MY_MOOC_EXPERIMENT_REWARD"
Allowed Values: ["SUCCESS", "FAILURE"]
* Adaptive experiments require "reward" feedback to be logged from enrolled users, which will tilt the probability of experimental assignments towards conditions that receive more successful feedback. Use this key when logging metrics as a simple metric value.
UpGrade automatically creates this metric for your experiment when created, and a metric query for success rate will also be automatically applied. For more info, see [insert link to wonderful documentation]
Something like that ^. On Experiment design page.
I want to change how we show Reward Metric in the stepper and the details page. Showing it as a query is a little confusing. It should be shown as the key + allowed values, "SUCCESS" and "FAILURE" with a brief explanation.
Something like that ^. On Experiment design page.