Skip to content

ChaisemartinDHaultfoeuille (DCDH) methodology-review-tracker promotion: In Progress -> Complete#481

Merged
igerber merged 2 commits into
mainfrom
feature/dcdh-tracker-promotion-pr-b
May 21, 2026
Merged

ChaisemartinDHaultfoeuille (DCDH) methodology-review-tracker promotion: In Progress -> Complete#481
igerber merged 2 commits into
mainfrom
feature/dcdh-tracker-promotion-pr-b

Conversation

@igerber
Copy link
Copy Markdown
Owner

@igerber igerber commented May 21, 2026

Summary

Methodology references (required if estimator / math changes)

  • Method name(s): ChaisemartinDHaultfoeuille (DCDH) — DID_M, DID_+, DID_-, DID_M^pl, DID_l, DID_{g,l}, DID^{pl}_l, DID^n_l, delta cost-benefit, DID^X, DID^{fd}, state-set-specific trends, heterogeneity testing, Design-2, by_path, HonestDiD integration.
  • Paper / source link(s):
    • de Chaisemartin, C. & D'Haultfœuille, X. (2020). Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects. American Economic Review, 110(9), 2964-2996. https://doi.org/10.1257/aer.20181169
    • de Chaisemartin, C. & D'Haultfœuille, X. (2022, revised July 2023). Difference-in-Differences Estimators of Intertemporal Treatment Effects. NBER Working Paper 29873. https://www.nber.org/papers/w29873
    • de Chaisemartin, C., Ciccia, D., D'Haultfœuille, X. & Knau, F. (2026). Difference-in-Differences Estimators When No Unit Remains Untreated. arXiv:2405.04465v6 (companion review for the universal-rollout extension; primary source for the HeterogeneousAdoptionDiD estimator).
  • Any intentional deviations from the source (and why): No new deviations introduced. The new ### Deviations block consolidates the 7 already-existing scattered REGISTRY Notes into a single labeled surface for AI-review compatibility; the original inline **Note (deviation from R...):** entries remain in place at the point of maximum mechanical context.

Validation

  • Tests added/updated: No test changes. Consolidation only against the existing 12 methodology tests (tests/test_methodology_chaisemartin_dhaultfoeuille.py), 26 R-parity tests (tests/test_chaisemartin_dhaultfoeuille_parity.py), 352 unit tests (tests/test_chaisemartin_dhaultfoeuille.py, 37 test classes), survey suites (tests/test_survey_dcdh.py, tests/test_survey_dcdh_replicate_psu.py, plus three dCDH cell-period coverage suites), and three primary-source paper reviews on disk (2020 AER + 2022/2023 NBER WP 29873 from PR PR-A: DCDH paper reviews (2020 AER + 2022 NBER WP) #478, 2026 Knau et al. universal-rollout companion).
  • Backtest / simulation / notebook evidence (if applicable): N/A — documentation-only PR.

Security / privacy

  • Confirm no secrets/PII in this PR: Yes

Flip the ChaisemartinDHaultfoeuille (DCDH) row from In Progress to
Complete. Adds the Verified Components / Test Coverage / Corrections
Made / Deviations / Outstanding Concerns detail section mirroring the
ContinuousDiD (PR #476) and HAD (PR #473) precedents. Consolidates 7
DCDH deviations from the paper, from R DIDmultiplegtDYN, and library
extensions into a labeled REGISTRY surface per the AI-review
"Documenting Deviations" convention. CHANGELOG [Unreleased] gains a
new Added entry. L27 In Progress example re-pointed to WooldridgeDiD;
L1289 priority-order queue item #6 removed and items #7-#11
renumbered to #6-#10.

No source code changes, no new tests, no new docstrings —
documentation consolidation only.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@github-actions
Copy link
Copy Markdown

Overall Assessment

✅ Looks good

No P0/P1 issues found. This PR is documentation-only, and the new DCDH deviation block/test inventory mostly matches the current repo state. The highest unmitigated finding is P2.

Executive Summary

  • No estimator code, weighting, variance, or inference paths changed in this PR.
  • The new DCDH REGISTRY deviations block is consistent with the existing documented DCDH notes.
  • I verified the promoted inventory claims: tests/test_methodology_chaisemartin_dhaultfoeuille.py has 12 tests, tests/test_chaisemartin_dhaultfoeuille_parity.py has 26, and tests/test_chaisemartin_dhaultfoeuille.py has 352.
  • One P2 documentation-scope issue remains: the promoted DCDH row treats the 2026 universal-rollout paper as a DCDH primary reference even though the DCDH REGISTRY entry and the 2026 review itself say that paper is HAD-specific / out of scope for DCDH.
  • Residual risk is explicitly disclosed: the NBER review-of-record is the July 2023 revision.

Methodology

  • P2 Impact: METHODOLOGY_REVIEW.md now lists the 2026 Knau et al. universal-rollout paper as a DCDH primary reference and counts its review toward DCDH primary-source coverage, but the DCDH REGISTRY primary sources are only the 2020 AER and 2022/2023 NBER papers, and the 2026 review itself says it covers the case ChaisemartinDHaultfoeuille does not handle and is the primary source for HAD. That makes the DCDH promotion narrative internally inconsistent and slightly overstates the methodological scope of the Complete label. Concrete fix: remove the 2026 paper from the DCDH Primary References and from the “Three primary-source paper reviews on file” checklist, or relabel it as companion / adjacent context rather than DCDH primary-source coverage. References: METHODOLOGY_REVIEW.md:L694-L716, METHODOLOGY_REVIEW.md:L744-L745, docs/methodology/REGISTRY.md:L486-L488, docs/methodology/papers/dechaisemartin-2026-review.md:L226-L228, CHANGELOG.md:L11-L11.

Code Quality

  • No findings in the changed files.

Performance

  • No findings in the changed files.

Maintainability

  • No findings beyond the methodology-scope issue above.

Tech Debt

  • No findings in the changed files.

Security

  • No findings.

Documentation/Tests

  • No findings. The promoted test-count and paper-review-file claims match the current repo state.

Aligns METHODOLOGY_REVIEW.md DCDH Primary References cell and "paper
reviews on file" claims with the REGISTRY ## ChaisemartinDHaultfoeuille
"Primary sources" header (2020 AER + 2022/2023 NBER WP only). The
Knau et al. 2026 universal-rollout paper is HAD's primary source and
is referenced from DCDH as adjacent context, not as DCDH primary-source
coverage.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
@github-actions
Copy link
Copy Markdown

🔁 AI review rerun (requested by @igerber)

Head SHA: 426e36c61e17464dc328782b1f20f5da3f3321a9


Overall Assessment

✅ Looks good

No unmitigated P0/P1 findings. This re-review resolves the prior documentation-scope issue: DCDH is now promoted against the 2020 AER and the July 2023 revision of WP 29873 only, while the 2026 universal-rollout paper is consistently treated as HAD-only adjacent context. The diff is documentation-only; no estimator, weighting, variance, inference, or default-behavior code changed. METHODOLOGY_REVIEW.md CHANGELOG.md REGISTRY.md dechaisemartin-2026-review.md

Executive Summary

Methodology

  • P3-informational Impact: The new ### Deviations from the paper / from R / library extensions block is a documentation-surface change only. Each of its seven items maps back to pre-existing DCDH notes on weighting, control-set definition, ragged panels, SE normalization, singleton-cohort NaN behavior, far-horizon warnings, and DID^X weighting, so there is no new undocumented methodology deviation introduced by this PR. Concrete fix: None. REGISTRY.md REGISTRY.md REGISTRY.md REGISTRY.md REGISTRY.md REGISTRY.md

Code Quality

  • No findings.

Performance

  • No findings.

Maintainability

  • No findings.

Tech Debt

  • P3-informational Impact: The only remaining follow-up explicitly surfaced by the promoted entry is a possible paper-review pass against a later 2024 revision of WP 29873. It is disclosed as an outstanding concern rather than silently omitted, so it is not a blocker for this docs-only promotion. Concrete fix: Optional only; queue a follow-up review if that later revision materially changes the estimator. METHODOLOGY_REVIEW.md dechaisemartin-dhaultfoeuille-2022-review.md

Security

  • No findings.

Documentation/Tests

@igerber igerber added the ready-for-ci Triggers CI test workflows label May 21, 2026
@igerber igerber merged commit 24de906 into main May 21, 2026
11 of 12 checks passed
@igerber igerber deleted the feature/dcdh-tracker-promotion-pr-b branch May 21, 2026 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready-for-ci Triggers CI test workflows

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant