Context
Before releasing the joint g-computation method in production, we need a rigorous comparison to the current marginal approach to:
- Quantify the bias in current marginal-method netstats.
- Validate that joint g-comp reproduces marginal-method behavior when the target distribution matches ARTnet (internal consistency check).
- Identify which ERGM terms are most affected by the correction.
- Generate the comparison figures/tables that will anchor the methods paper.
Scope
Run both methods on ARTnet 2017-18 data with:
- Scenario 1 — ARTnet-self target (sanity): target population = ARTnet 2017-18 respondents themselves. Joint and marginal should give similar results (any difference is pure marginal-bias artifact).
- Scenario 2 — Current ARTnet default target (NCHS age + national race): what
build_netstats() currently does. Joint method may differ if interactions matter.
- Scenario 3 — Shifted target (e.g., older population or different race mix): explicitly stress-test the correction. This is where joint-vs-marginal should diverge most.
For each scenario, report:
- All netstats values side-by-side (marginal vs joint).
- % difference per target stat.
- Which interactions drive the differences (via ablation).
Tasks
Acceptance criteria
- Reproducible validation script.
- Comparison table for all ERGM target stats.
- Clear interpretation of which stats shift how much under which scenarios.
Related
Stretch
Extend validation to a second dataset if available (e.g., a city-specific subset). Internal consistency check: the bias magnitude should correlate with how much the target distribution differs from ARTnet.
Context
Before releasing the joint g-computation method in production, we need a rigorous comparison to the current marginal approach to:
Scope
Run both methods on ARTnet 2017-18 data with:
build_netstats()currently does. Joint method may differ if interactions matter.For each scenario, report:
Tasks
tests/testthat/orinst/validation/directory.Acceptance criteria
Related
Stretch
Extend validation to a second dataset if available (e.g., a city-specific subset). Internal consistency check: the bias magnitude should correlate with how much the target distribution differs from ARTnet.