I applaud the approach taken by Reed et al. in their investigation of the cost-effectiveness of larger vs. smaller safety databases. This type of evaluation is, in my opinion, far preferable to an emotionally based
opinion by committee. However, there are several issues that lead me to question the results of the specific cost-effectivness ratios.
First, the cost of increased sample size in the paper appears to represent only the per patient costs of clinical trials. There are other substantial costs that should ideally be included. Larger trials and larger NDA submissions are almost inevitably slower than small ones, and therefore the benefits to patients for novel drugs are delayed; this factor should be included in the costs, and as it affects every program (not just the ones with safety issues), the disease costs to patients could be substantial.
Second, raising the cost of a drug program has an effect on the economics of drug development, leading to fewer medicines, most obviously for smaller medical populations where some drugs may never be put into development if the trial size requirements are too high. This is difficult to model, maybe, but nonetheless another substantial cost that is not included or mentioned.
Finally, there is a limitation in deducing rates of societal tolerance of safety issues from prior decisions that have not included cost-effectiveness evaluations. Both Vioxx and rotavirus vaccines were mentioned as helping to determine societal acceptance of safety issues -- but certainly for rotavirus, and possibly also for Vioxx, had a cost-effectivness appoach been used, it would have been highly positive in favor of the therapy. It seems a bit of a paradox to use numbers from opinion-based decisions to determine the limits for cost-effectiveness
based ones. If drug regulation moves towards a more quantitative approach like the one advocated in this paper, then perhaps people will tolerate different rates of adverse events because they can have the confidence
that a competent calculation has been done and that -- on average -- the benefits outweigh the risks.