Replace Matomo by PostHog

[pixlwave]

• Integrate PostHog SDK
  • API token storage
  • Test at least one basic event works
• Redact anything PII that's leaking - room names, usernames, etc
• Use an API to get a track id (see James)
  • Check im.vector.web.analytics_id if present, otherwise generate a new one (web PR)
• Ask consent again for new analytics schema (web PR)
  • Remove old enableCrashReport setting and use enableAnalytics everywhere.
  • Confirm whether crash logs should be same opt in
• Define the right screens to track initially (event PR)
• Finalize Podspec in events repo
• Remove analytics reporting from debug builds switch to production server
• Review App Store privacy disclosure

[daniellekirkwood]

There's documentation here

TL;DR

Approvers
Denise, James, and Amsha should be additional approvers to the PR.

Designs
Figma file

• There are 2 variations; one for users who previously said no & one for users who previously said yes
• There are screens for each platform (iOS & Android)

When to ask:
For existing users:

• Who previously said no: Once, on app open after upgrade to newest version
• Who previously said yes: Once, on app open after upgrade to newest version

For new users:

• Utilise the “previously said no” screen for now
• Short-term: First time the user hits home screen
• Long-term: Is a part of the FTU flow (not a part of this issue)

[pixlwave]

Thanks sounds good. One note related to the web PR:

For existing users:

• Who previously said no: Once, on app open after upgrade to newest version

The original idea was to not prompt users a second time if they had previously opted out from Matomo. Should we be doing the same on iOS?

[daniellekirkwood]

Yes. Routinely we won't ask people twice, once they've said no, they've said no. As this is a new system (not Matomo) and the circumstances for how and what we track are different, we'll ask all users once more.

WDYT?

[pixlwave]

Well I thought the original reasoning of "if someone has opted out already, they aren't likely to opt into a system that adds an id to it, so lets not annoy them with a second prompt" made sense. But equally given the new prompt that gives more clarity, maybe some will choose to opt in now, so I can see the rationale in asking again.

Will update to show to everyone.