Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Option to write experiments and results back to a SQL data source #70

Open
jdorn opened this issue Aug 31, 2021 · 2 comments
Open

Option to write experiments and results back to a SQL data source #70

jdorn opened this issue Aug 31, 2021 · 2 comments
Labels
ds-tracked On the GrowthBook Data Science teams tracker enhancement New feature or request roadmap
Projects

Comments

@jdorn
Copy link
Member

jdorn commented Aug 31, 2021

Add an option to persist experiments and results back to a SQL data source automatically.

New data source settings

  • sync_results (boolean, default false)
  • table_prefix (can include a dot to write to another schema in postgres/redshift e.g. growthbook.)

New cronjob:

  • Gather all the data from MongoDB
  • Connect to data source
  • Run DELETE TABLE IF EXISTS... queries
  • Run CREATE TABLE ... queries
  • Run INSERT INTO ... queries

Proposed schema:

  • metrics
    • metric_id
    • name
    • type
  • metrics_tags
    • metric_id
    • tag
  • experiments
    • experiment_id
    • name
    • tracking_key
    • project
    • owner
    • hypothesis
    • num_variations
    • status (draft, running, stopped)
    • archived (boolean)
    • result (win, lose, dnf, inconclusive)
    • winner
    • created_at
    • started_at
    • ended_at
    • synced_at
    • latest_phase_id
  • experiments_tags
    • experiment_id
    • tag
  • experiments_metrics
    • experiment_id
    • metric_id
    • type (goal or guardrail)
  • phases
    • phase_id
    • experiment_id
    • type (ramp, main, or holdout)
    • coverage
    • traffic_split (e.g. 50/50 or 40/40/20)
    • status (finished, running)
    • started_at
    • ended_at
  • results
    • phase_id
    • metric_id
    • variation
    • users
    • count
    • mean
    • stddev
    • conversion_rate
    • percent_improvement
    • risk_of_choosing
    • chance_to_beat_control
@jdorn jdorn added this to Sep 2021 in Roadmap Aug 31, 2021
@jdorn jdorn added the enhancement New feature or request label Sep 3, 2021
@jdorn jdorn moved this from Sep 2021 to Oct 2021 in Roadmap Sep 14, 2021
@jdorn jdorn moved this from Oct 2021 to Nov 2021 in Roadmap Oct 13, 2021
@jdorn jdorn moved this from Nov 2021 to Dec 2021 in Roadmap Nov 22, 2021
@jdorn jdorn moved this from Dec 2021 to Jan 2022 in Roadmap Dec 2, 2021
@itsgrimetime
Copy link
Contributor

I know this has been around for a while now, but just wanted to toss a +1 here, my team would love to have this

@lukesonnet lukesonnet added the ds-tracked On the GrowthBook Data Science teams tracker label Jun 8, 2023
@jdorn jdorn added the roadmap label Oct 17, 2023
@jdorn
Copy link
Member Author

jdorn commented Oct 17, 2023

Now that we have Data Pipeline mode, we plan to focus on this soon

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ds-tracked On the GrowthBook Data Science teams tracker enhancement New feature or request roadmap
Projects
No open projects
Roadmap
Jan 2022
Development

No branches or pull requests

3 participants