Hard Problem of RCT
A conceptual challenge: the fundamental difficulty of proving causality in open, real‑world systems even with perfect randomization. The Hard Problem of RCT points out that randomization only balances known and unknown confounders at baseline, but it does not control for post‑randomization events, differential attrition, or the fact that the act of randomization itself may affect behavior (e.g., resentment, treatment contamination). Moreover, an RCT can only estimate average treatment effects, which may hide enormous heterogeneity; and generalizing from the trial sample to other populations remains a matter of judgment, not proof. The Hard Problem reminds us that RCTs are not magic; they are tools with limits embedded in the nature of causality itself.
Example: “Even the most rigorous RCT could not tell her whether the intervention would work in a different school district—the Hard Problem of RCT, where statistical inference stops and practical wisdom must take over.”
Hard Problem of RCT by Abzugal Nammugal Enkigal April 21, 2026
Get the Hard Problem of RCT mug.