Skip to content
This repository has been archived by the owner on Feb 20, 2023. It is now read-only.

Add telemetry for Allow users to customize their home screen #21239

Closed
7 tasks
Amejia481 opened this issue Sep 10, 2021 · 3 comments
Closed
7 tasks

Add telemetry for Allow users to customize their home screen #21239

Amejia481 opened this issue Sep 10, 2021 · 3 comments

Comments

@Amejia481
Copy link
Contributor

Amejia481 commented Sep 10, 2021

Description & Product Manager / Data Scientist User Story

We know how often users disables a section.

What questions will you answer with this data?

We would like to know for users disables a section (“Jump back in”, “Recently Saved”, “Recently visited” and “Pocket”).

Acceptance Criteria

  • ENG files a DS JIRA request outlining their methodology.
  • DS sign off on instrumentation methodology addressing product questions.
  • Event pings can be queried via re:dash
  • Event pings can be queried via amplitude
  • We are sending telemetry events for the actions listed in the requirements
  • We have documented the telemetry
  • We have asked a data steward to review the telemetry

┆Issue is synchronized with this Jira Task

@Amejia481
Copy link
Contributor Author

Related ticket #21095

@github-actions github-actions bot added the needs:triage Issue needs triage label Sep 10, 2021
Amejia481 added a commit to Amejia481/fenix that referenced this issue Sep 16, 2021
Amejia481 added a commit to Amejia481/fenix that referenced this issue Sep 17, 2021
Amejia481 added a commit to Amejia481/fenix that referenced this issue Sep 17, 2021
Amejia481 added a commit to Amejia481/fenix that referenced this issue Sep 17, 2021
Amejia481 added a commit to Amejia481/fenix that referenced this issue Sep 20, 2021
Amejia481 added a commit to Amejia481/fenix that referenced this issue Sep 21, 2021
@Amejia481 Amejia481 added eng:qa:needed QA Needed and removed needs:triage Issue needs triage labels Sep 21, 2021
@Amejia481 Amejia481 removed the eng:qa:needed QA Needed label Sep 21, 2021
Amejia481 added a commit to Amejia481/fenix that referenced this issue Sep 22, 2021
mergify bot pushed a commit that referenced this issue Sep 22, 2021
@Amejia481
Copy link
Contributor Author

Amejia481 commented Sep 22, 2021

👋🏽
QA team, we would help us to verify that we are sending the correct telemetry for the below user's interaction? :)

When the app starts we want to send metrics for:

  • Category customize_home.most_visited_sites
  • Category customize_home.jump_back_in
  • Category customize_home.recently_saved
  • Category customize_home.recently_visited
  • Category customize_home.pocket

When users go to Settings -> Customize -> Home and toggle

  • "Show most visited top sites" -> Event preference_toggled with the extra keys most_visited_sites true or false
  • "Jump back in" -> Event preference_toggled with the extra keys jump_back_in true or false
  • "Recently bookmarked" -> Event preference_toggled with the extra keys recently_saved true or false

When clicking at the end of the home screen the "Customize home" button, we should send the event Category home_screen.customize_home_clicked, this only shows when one of these features are active Show most visited top sites, Jump back in or Recently bookmarked.

When clicking the menu item on the three dotted menu item, we should send the event "Category home_screen.customize_home_clicked.

pkirakosyan pushed a commit to gexsi/user-agent-android that referenced this issue Sep 24, 2021
pkirakosyan pushed a commit to gexsi/user-agent-android that referenced this issue Sep 24, 2021
@AndiAJ
Copy link
Collaborator

AndiAJ commented Oct 6, 2021

👋🏽 @Amejia481

Verified as fixed on Firefox 94.0.0 beta 1 using a Google Pixel 3a (Android 11)

✅ Tap "Customize home" from the home screen ⋮ menu - Event type ping d8949806-6853-4936-830a-386c80e6ec03

 {
          "timestamp": 12753,
          "category": "home_screen",
          "name": "customize_home_clicked"
        }

✅ Tap "Customize homepage" from the end of the home screen - Event type ping ad92861a-a0f4-4ea9-98d6-48d69b4edc87

{
          "timestamp": 10020,
          "category": "home_screen",
          "name": "customize_home_clicked"
        }

✅ Disable the 4 options from "Customize" settings - Event type ping d4cd8501-69f1-49c3-8215-a64f06d4c7fd

{
          "timestamp": 3684,
          "category": "customize_home",
          "name": "preference_toggled",
          "extra": {
            "enabled": "false",
            "preference_key": "jump_back_in"
          }
        },
        {
          "timestamp": 4219,
          "category": "customize_home",
          "name": "preference_toggled",
          "extra": {
            "enabled": "false",
            "preference_key": "recently_saved"
          }
        },
        {
          "timestamp": 4720,
          "category": "customize_home",
          "name": "preference_toggled",
          "extra": {
            "enabled": "false",
            "preference_key": "recently_visited"
          }
        },
        {
          "timestamp": 5974,
          "category": "customize_home",
          "name": "preference_toggled",
          "extra": {
            "preference_key": "pocket",
            "enabled": "false"
          }

✅ Enable the 4 options from "Customize" settings - Event type ping 9abfaa97-1b20-4512-a41d-76a8d3f3b77c

{
          "timestamp": 3515,
          "category": "customize_home",
          "name": "preference_toggled",
          "extra": {
            "enabled": "true",
            "preference_key": "jump_back_in"
          }
        },
        {
          "timestamp": 3966,
          "category": "customize_home",
          "name": "preference_toggled",
          "extra": {
            "preference_key": "recently_saved",
            "enabled": "true"
          }
        },
        {
          "timestamp": 4518,
          "category": "customize_home",
          "name": "preference_toggled",
          "extra": {
            "enabled": "true",
            "preference_key": "recently_visited"
          }
        },
        {
          "timestamp": 5103,
          "category": "customize_home",
          "name": "preference_toggled",
          "extra": {
            "enabled": "true",
            "preference_key": "pocket"
          }

✅ Enabled values of the 4 options sent in the metrics ping - Metrics type ping 31101ec7-cf7a-4dda-bc14-15010450952e

 "boolean": {
          "customize_home.pocket": true,
          "customize_home.recently_visited": true,
          "customize_home.recently_saved": true,
          "customize_home.jump_back_in": true,    
          }

✅ Disabled values of the 4 options sent in the metrics ping - Metrics type ping 42cdb899-d31b-4ce2-8f25-f08f6d9b077c

 "boolean": {
          "customize_home.pocket": false,
          "customize_home.recently_visited": false,
          "customize_home.jump_back_in": false,
          "customize_home.recently_saved": false, 
          }

Logcat
Glean dashboard

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants