Clinical Failure Rates over the Decades: Yikes(science.org) |
Clinical Failure Rates over the Decades: Yikes(science.org) |
He starts off on the wrong note, there is nothing at all wrong with a high rate of clinical failures. If anything, the reasonable argument standard might be that this rate is too low. It implies researchers are trying things that they expect to have a 10% chance of working out. That means we're missing out on all the cures and techniques that have a 1% chance of working out but but nonetheless do work.
Failed attempts cost society nearly nothing and successes will have compounding benifits for, y'know, lets optimistically say the human race survives for centuries. 1% or 0.1% success rates sound completely reasonable with that sort of lopsided risk profile. There isn't much of a reason not to try anything and everything that has the faintest chance of helping and see what happens.
Lower numbers don’t mean we’re doing better, it means we’re trying less.
But let’s think about that 91% failure rate for a moment. When I bring this up in presentations, I invite the audience to consider what the auto industry would look like of 91% of new car designs proved unable to roll out of the factory, or if 91% of new airliner models were unable to leave the ground
Is an utterly irrelevant comparison. For physical thing we have engineering, and the practical application of the trades and craft, trial and error.
For modern medicine, we're only just starting to come out of the wild west era. Or perhaps slightly further along than that.
Drug design seems a lot more binary. You can find a new pathway, but drugs themselves are fairly simply molecules, and you can't iteratively 'fix bugs' the way you can in an engine or a piece of software.
The engine is a given, it's almost astronomically complicated, you know a lot less about how it works than you'd like to, and you're trying to change how it works while it's running without breaking anything, using tiny rigid parts that have to snap into place correctly and can't be bent to fit.
High failure rates aren't surprising.
Why do you say that? What's the evidence? We continue to have virtually no clue how to make drugs, per TFA.
Drug development is a hard problem because the solution space is poorly constrained: biochemistry is complex and messy, expecting one chemical substance to have narrow positive effects is probably hopeless.
If they could do that today, they would. Trial criteria are already incredibly narrow specifically to try to encode as much of this knowledge as the company has prior to starting the trial. But it empirically turns out they don't have nearly enough to matter.
It's really not a problem that pre-filtering to that responders group produces too small a market. There are plenty of drug programs going after way-too-small markets because of all these wacky perverse incentives created by insurers and regulators to incentivize the creation of billion-dollar++ drugs for diseases virtually no one has.
There are breakthroughs that I could have never imagined such as mRNA vaccines.