Loading...
In 2019, a team at BioNova Labs led by Mira spent 14 months and $2.3 million studying why a high-protein supplement failed to improve muscle recovery in clinical trials. They had excellent blood-work data — inflammatory markers, amino acid levels, creatine kinase — so they kept running increasingly sophisticated analyses on those biomarkers. Three papers were published. None found the answer. A new postdoc named Kai joined and asked a strange question during his first lab meeting: 'Instead of asking why the supplement doesn't work, what if we ask what would have to be true for it to work?' The room went quiet. Mira frowned. They'd never inverted the problem. Kai sketched it on the whiteboard. For the supplement to work, it had to survive stomach acid, get absorbed in the small intestine...
Popular framing: The supplement failed because the science was complex and the biological mechanisms were hard to pin down — it took years of careful research to understand why it didn't work.
Structural analysis: The supplement failed at the first step of a three-step causal chain, and this was detectable with a $50 bench test before the trial began. The 14-month investigation never looked at that step because measurement convenience, not causal logic, determined what got studied. The streetlight effect operated at the level of research design, not just data analysis. The 'streetlight effect' is a good start but misses the 'Circle of Competence' trap—it's not just that they were under the light, but that they felt 'safe' there.
The popular framing mistakes methodological sophistication for causal completeness — it assumes that rigorous analysis of available data is equivalent to testing the right hypothesis. The structural analysis reveals that the choice of what to measure is itself a theory-laden decision, and when that choice is driven by convenience rather than causal mapping, expensive, high-quality research can be systematically wrong about what it's measuring.
