Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CausalForestDML to get ate and ate confidence interval on training data #838

Closed
DailiZhang2010 opened this issue Jan 9, 2024 · 2 comments

Comments

@DailiZhang2010
Copy link

There are two ways to do it:

  1. use the est.ate_ and est.ate_stderr_. Under the hood, it uses Doubly Robust ATE on training data
  2. use est.ate(X=X, T0=T0, T1=T1) and est.ate_interval(X=X, T0=T0, T1=T1)

My target is to get the ate and confidence interval on the training data set.

The question is: which one is more reliable?

Thanks for the great package and awesome documentation.

@fverac
Copy link
Collaborator

fverac commented Jan 9, 2024

I would recommend ate_ for your use case, since you should get tighter confidence intervals.

See more info here #753 (comment)

This is expected; as you note the ate_ attribute applies a double-robustness correction to the computation of the ATE itself (on the training data); the ate() method allows you to compute the ATE for any population by averaging the computed CATE values for each individual, so will not provide exactly the same result; however, if your use case is to compute the ATE for a data set that was not used in training then only the ate() method can be used for that.

@DailiZhang2010
Copy link
Author

Thanks, @fverac

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants