Chicago Board of Trade

Cost Benefit Analysis: Costs are always higher, benefits are always lower

Just clicking around some articles on net present value (NPV) and cost benefit analysis and found this gem of a paragraph on WikiP:

The accuracy of the outcome of a cost-benefit analysis is dependent on how accurately costs and benefits have been estimated. A peer-reviewed study [13] of the accuracy of cost estimates in transportation infrastructure planning found that for rail projects actual costs turned out to be on average 44.7 percent higher than estimated costs, and for roads 20.4 percent higher (Flyvbjerg, Holm, and Buhl, 2002). For benefits, another peer-reviewed study [14] found that actual rail ridership was on average 51.4 percent lower than estimated ridership; for roads it was found that for half of all projects estimated traffic was wrong by more than 20 percent (Flyvbjerg, Holm, and Buhl, 2005). Comparative studies indicate that similar inaccuracies apply to fields other than transportation. These studies indicate that the outcomes of cost-benefit analyses should be treated with caution, because they may be highly inaccurate. In fact, inaccurate cost-benefit analyses may be argued to be a substantial risk in planning, because inaccuracies of the size documented are likely to lead to inefficient decisions, as defined by Pareto and Kaldor-Hicks efficiency ([15] Flyvbjerg, Bruzelius, and Rothengatter, 2003).

Article here.

Very interesting and consistent with my experience.  The question, though, is this: how do we inject more reality into things without dampening the very useful energy that this unrealistic optimism brings?