Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failing PLE #8

Closed
konstjar opened this issue Aug 30, 2019 · 9 comments
Closed

Failing PLE #8

konstjar opened this issue Aug 30, 2019 · 9 comments

Comments

@konstjar
Copy link

Getting error with folder location in combination with cohortMethods lib in R

Generating outcomes
Warning: the condition has length > 1 and only the first element will be used
Generating outcomes for exposure NA and outcome NA
Warning: cannot open compressed file 'NA/betas.rds', probable reason 'No such file or directory'
Error in gzfile(file, "rb") : cannot open the connection
Calls: tryCatch ... <Anonymous> -> <Anonymous> -> lapply -> FUN -> readRDS -> gzfile

Attached Study in JSON format
Graham replication.json.zip

@wivern
Copy link
Contributor

wivern commented Aug 30, 2019

@schuemie Could you please check this issue on the Truven dataset?

@schuemie
Copy link
Member

Someone within JnJ has reported the same problem (on a different study). I'm trying to work with her to reproduce this problem, but so far no luck (it runs fine in my environment). I'll keep trying.

@schuemie
Copy link
Member

Note that it's the positive control synthesis that is causing the problem, so if you're pressed for time you could try disabling that.

@schuemie
Copy link
Member

schuemie commented Sep 2, 2019

I think I found the cause: there appear to not be enough negative controls with sufficient outcome count to fit the outcome models for the positive control synthesis. I've modified MethodEvaluation to give a meaningful error message in this case. Please try installing the latest version (from the develop branch). You'll also need to have the latest version of SqlRender:

install.packages("SqlRender")
devtools::install_github("ohdsi/MethodEvaluation", ref="develop")

@konstjar
Copy link
Author

konstjar commented Sep 2, 2019

image

It looks it works now. I'm getting this message

@schuemie
Copy link
Member

schuemie commented Sep 2, 2019

So no negative control has enough outcomes during the time-at-risk to fit a model.

The only thing you can do is turn off positive control synthesis alltogether. Likely your entire study will prove to be underpowered though.

@pbr6cornell
Copy link

@schuemie , would this be a situation where we'd recommend doing CI calibration using on the negative controls? And if so, where can we find the documentation to explain how to do CI calibration without positive control synthesis?

@schuemie
Copy link
Member

schuemie commented Sep 3, 2019

Good point @pbr6cornell ! As Patrick mentioned, you can still perform CI calibration even without positive controls if you're willing to make the assumption systematic error does not change as a function of true effect size. The biggest challenge to that assumption would be bias towards the null, which arguably is less of a threat in a comparative cohort analysis.

The instructions for doing this are here.

@anthonysena
Copy link
Collaborator

Closing since this question appears to be answered by the information provided by @schuemie.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants