Here we present the framework of a new approach to assessing the capacity of research programs to achieve social goals. Research evaluation has made great strides in addressing questions of scientific and economic impacts. It has largely avoided, however, a more important challenge: assessing (prospectively or retrospectively) the impacts of a given research endeavor on the non-scientific, non-economic goals—what we here term public values —that often are the core public rationale for the endeavor. Research programs are typically justified in terms (...) of their capacity to achieve public values, and that articulation of public values is pervasive in science policy-making. We outline the elements of a case-based approach to public value mapping of science policy, with a particular focus on developing useful criteria and methods for assessing public value failure, with an intent to provide an alternative to market failure thinking that has been so powerful in science policy-making. So long as research evaluation avoids the problem of public values, science policy decision makers will have little help from social science in making choices among competing paths to desired social outcomes. (shrink)

Unreasonable expectations about the nature and character of scientific knowledge support the widespread political assumption that predictive scientific assessments are a necessary precursor to environmental decision making. All too often, the practical outcome of this assumption is that scientific uncertainty becomes a ready-made dodge for what is in reality just a difficult political decision. Interdisciplinary assessments necessary to address complex environmental policy issues invariably result in findings that are inherently contestable, especially when applied in the unrestrained realm of partisan politics. (...) In this article, the authors argue that predictive scientific assessments are inherently limited in the extent to which they can guide policy development and that rigorous scientific assessments can be much more valuable in the role of ex post policy evaluation than they can in the context of ex ante policy formulation. (shrink)

One goal of the scientific research enterprise is to improve the lives of individuals and the overall health of societies. This goal is achieved through a combination of factors, including the composition of research portfolios. In turn, this composition is determined by a variety of scientific and societal needs. The recent history of polio research highlights the complex relations between research policy, scientific progress and societal benefits. Here, we briefly review the circumstances leading to the possibility of eradication of poliovirus, (...) evaluate the research environment that emerged following the introduction of a vaccine, and compare and contrast the current research framework with that for other infectious diseases. From this analysis, policy lessons with general applicability to scientific research are identified. (shrink)

We can't know everything; in fact, compared to the vast expanses of our ignorance, we can't really know very much. So the problem of "limiting knowledge" is not just one of the conflict between efforts to make knowledge available and efforts to keep knowledge locked up. There is also the often-invisible problem of how we decide what it is we are going to try to know, and what, as a consequence, we decide, even if by benign neglect, we are not (...) going to know. This problem is particularly present in efforts to expand formal knowledge about the world through scientific research. In this essay I will briefly explore how this effort to expand knowledge brings with it, unavoidably and simultaneously, powerfully enforced limits on knowledge that are often unexamined. (shrink)