-
Notifications
You must be signed in to change notification settings - Fork 2.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add eligible segment filter for bandits #13395
Comments
Labelling as |
Verified using the test plan in brave/brave-core#7533 with additional contextual details, from @moritzhaller and @tmancey (and thx to @btlechowski for pro-tips, too!)
Case 1: Default models enabled (Text Classification and Purchase Intent) Used
Nothing shows up under Exploring... or Exploiting...
Case 2: Variant models enabled (Epsilon Greedy Bandit and Purchase Intent: Used
Case 3: Restart after one round of training and make sure state wasn't deleted in user Preferences JSON key epsilon_greedy_bandit_arms In addition to the details below, I verified that the Used Here, I'm covering those ads from segments pulled from the catalog (and shown), which I either So, with 2 Before training, each segment's (ad) key for the below: segment category, ad name, clicked or dismissed (
References: a) before and after training comparison, in Verification passed on
Verified using the test plan in brave/brave-core#7533 Default models enabled (Text Classification and Purchase Intent)
Nothing shows up under Exploring... or Exploiting...
Variant models enabled (Epsilon Greedy Bandit and Purchase Intent: Used
Restart after one round of training and make sure state wasn't deleted in user Preferences JSON key epsilon_greedy_bandit_arms In addition to the details below, I verified that the First
After ad is clicked the value is increased to 1
Second ad was dismissed
After ad is dismissed the value is decreased to 0.5
|
Verification passed on
Case 1: Default models enabled
Case 2: Variant models enabled
Case 3: Restart after one round of training and make sure state wasn't deleted in user Preferences JSON key epsilon_greedy_bandit_arms
Case 3.1: Verified default pulls values is ` 0` and value is `1.0` in the Preference file for all the segments
Case 3.2: Clicked on AD and verified `pulls` values becomes `1` and `value` remained `1.0` in the Preference file - military segmentClicked on AD:
Case 3.3: Clicked on AD and verified `pulls` value becomes `1` and `value` remained `1.0` in the Preference file - hobbies and interests segmentClicked on AD:
Case 3.4: Dismissed an AD and verified that `pulls` value becomes `1` and `value` changed to `0.0` in the Preference file - personal finance segmentDismissed an AD:
Case 3.5: Viewed two Ads of same segment/category, click the 1st Ad and dismiss the 2nd ADViewed 1st Ad from Technology & Computing segment
Dismiss 2nd Ad from the same segment
Case 3.6: View an AD don't take any action on the notification wait until AD gets time outView an AD don't take any action on the Ads notification:
|
No description provided.
The text was updated successfully, but these errors were encountered: