Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding Unequal Variance to Signature Analysis T-Test #186

Merged
merged 14 commits into from Sep 21, 2019

Conversation

gwaybio
Copy link
Collaborator

@gwaybio gwaybio commented Sep 19, 2019

ef98d58 is the major change of this pull request.

I tracked this error down after failing to align t-test results in subpanels b, d, and f to the results shown in a, c, and e (respectively).

A t-test with equal variance assumption will fail to identify cases found in b.

Another minor change is plotting panels b and d with the test-set features only. Previously, panels a and b were calculated using the test set and panels b and d were generated using the training set. Now, b and d use the test set.

I reran the pipeline after these changes and all files here are updated.

Updated Figure

full_separation_plot

@gwaybio gwaybio changed the title Adding Unequal Variance to Signature Analysis T-Test [WIP] Adding Unequal Variance to Signature Analysis T-Test Sep 19, 2019
@@ -54,7 +54,7 @@
" b_activation = feature_series[feature_series.index.isin(group_b_ids)]\n",
" \n",
" # Perform t-test on two groups\n",
" t_stat, t_p = ttest_ind(a_activation, b_activation)\n",
" t_stat, t_p = ttest_ind(a_activation, b_activation, equal_var=False)\n",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@@ -100,7 +100,7 @@
"metadata": {},
"outputs": [],
"source": [
"url = \"https://www.nature.com/articles/sdata201733/tables/3\"\n",
"url = \"https://www.nature.com/articles/sdata201733/tables/4\"\n",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🙀

Copy link
Member

@cgreene cgreene left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@gwaybio gwaybio changed the title [WIP] Adding Unequal Variance to Signature Analysis T-Test Adding Unequal Variance to Signature Analysis T-Test Sep 21, 2019
@gwaybio gwaybio merged commit 843923e into greenelab:master Sep 21, 2019
@gwaybio gwaybio deleted the signature-analysis-unequal-var branch September 21, 2019 23:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants