U.S. federal research funding is generally justified by promises of public benefits, but the specific natures and distribution of such benefits often remain vague and ambiguous. Furthermore, the metrics by which outcomes are reported often do not necessarily or strongly imply the achievement of public benefits. These ambiguities and discontinuities make it difficult to assess the public outcomes of federal research programs. This study maps the terms in which the purposes and the outcomes of Advanced Research Projects Agency-Energy -a relatively (...) young and innovatively structured federal research agency-have been discussed and reported. I find that ARPA-E’s creation and funding have been justified with reference to a broad repertoire of economic, environmental, and national security values, but that the agency has been evaluated only through intermediate scientific and economic metrics and study of internal organizational structure. I suggest that these means of assessment elide ARPA-E’s lack of the financial scale, long time horizon, built-in customer, and radical vision which have been historically important to high-impact federal innovation, and I recommend the tracking of metrics more directly related to ARPA-E’s public value purposes as the agency grows older. This discussion illustrates the inadequacy of currently widespread metrics and conventional wisdom for the design and assessment of societally relevant research. (shrink)

Science and technology (S&T) policy studies has explored the relationship between the structure of scientific research and the attainment of desired outcomes. Due to the difficulty of measuring them directly, S&T policy scholars have traditionally equated “outcomes” with several proxies for evaluation, including economic impact, and academic output such as papers published and citations received. More recently, scholars have evaluated science policies through the lens of Public Value Mapping, which assesses scientific programs against societal values. Missing from these approaches is (...) an examination of the social activities within the scientific enterprise that affect research outputs and outcomes. We contend that activities that significantly affect research trajectories take place at the levels of individual researchers and their communities, and that S&T policy scholars must take heed of this activity in their work in order to better inform policy. Based on primary research of two scientific communities—ecologists and sustainability scientists—we demonstrate that research agendas are actively shaped by parochial epistemic and normative concerns of the scientists and their disciplines. S&T policy scholarship that explores how scientists balance these concerns, alongside more formal science policies and incentive structures, will enhance understanding of why certain science policies fail or succeed and how to more effectively link science to beneficial social outcomes. (shrink)

This paper examines the broad social purpose of US climate science, which has benefitted from a public investment of more than $30 billion over the last 20 years. A public values analysis identifies five core public values that underpin the interagency program. Drawing from interviews, meeting observations, and document analysis, I examine the decision processes and institutional structures that lead to the implementation of climate science policy, and identify a variety of public values failures accommodated by this system. In contrast (...) to other cases which find market values frameworks (the profit as progress assumption) at the root of public values failures, this case shows how science values ( knowledge as progress ) may serve as an inadequate or inappropriate basis for achieving broader public values. For both institutions and individual decision makers, the logic linking science to societal benefit is generally incomplete, incoherent, and tends to conflate intrinsic and instrumental values. I argue that to be successful with respect to its motivating public values, the US climate science enterprise must avoid the assumption that any advance in knowledge is inherently good, and offer a clearer account of the kinds of research and knowledge advance likely to generate desirable social outcomes. (shrink)

For over 50 years, Minerva has been one of the leading independent journals in the study of ‘science, learning and policy’. Its pages have much to say about the origins and conduct of the ‘intellectual Cold War’, the defence of academic freedom, the emergence of modernization theory, and pioneering strategies in the social studies of science. This paper revisits Minerva through the life and times of its founding Editor, Edward Shils, and traces his influence on its early years – from (...) its association with the Congress for Cultural Freedom in the 1950s, to the higher reaches of research policy in the 1990s. At the close of his life, Minerva continued to espouse Shils’ commitment to what he saw as the fundamental Enlightenment traditions of consensus, civility, and community. In the 21st century, with the achievements of science producing rapid change in every walk of life, his legacy so far retains an established place in the history of scholarship. Whether that legacy will endure – and if so, what role Minerva will play in its defence – remain key questions for the coming generation. (shrink)

Here we present the framework of a new approach to assessing the capacity of research programs to achieve social goals. Research evaluation has made great strides in addressing questions of scientific and economic impacts. It has largely avoided, however, a more important challenge: assessing (prospectively or retrospectively) the impacts of a given research endeavor on the non-scientific, non-economic goals—what we here term public values —that often are the core public rationale for the endeavor. Research programs are typically justified in terms (...) of their capacity to achieve public values, and that articulation of public values is pervasive in science policy-making. We outline the elements of a case-based approach to public value mapping of science policy, with a particular focus on developing useful criteria and methods for assessing public value failure, with an intent to provide an alternative to market failure thinking that has been so powerful in science policy-making. So long as research evaluation avoids the problem of public values, science policy decision makers will have little help from social science in making choices among competing paths to desired social outcomes. (shrink)

The Congress for Cultural Freedom is remembered as a paramount example of the “cultural cold wars.” In this paper, I discuss the ways in which this powerful transnational organization sought to promote “science studies” as a distinct – and politically relevant – area of expertise, and part of the CCF broader agenda to offer a renewed framework for liberalism. By means of its Study Groups, international conferences and its periodicals, such as Minerva, the Congress developed into an influential forum for (...) examining the ways Big Science impacted the relations between science, society, and politics, thus constituting a semi-institutional niche for Science Studies before its professionalization within academia during the 1970s. I argue that the Congress contributed to the construction of public space in which the relations between science, society and politics were debated, and science was reconceptualized as a social activity. The vision of “science studies” the CCF-associated intellectuals promulgated was different from the science studies we know today. Yet, this alternative vision, in which the issues of science politics appeared inseparable from those of science policy, science organization, and science governance, constituted the “pre-history” of science studies today. (shrink)

The Congress for Cultural Freedom is remembered as a paramount example of the “cultural cold wars.” In this paper, I discuss the ways in which this powerful transnational organization sought to promote “science studies” as a distinct – and politically relevant – area of expertise, and part of the CCF broader agenda to offer a renewed framework for liberalism. By means of its Study Groups, international conferences and its periodicals, such as Minerva, the Congress developed into an influential forum for (...) examining the ways Big Science impacted the relations between science, society, and politics, thus constituting a semi-institutional niche for Science Studies before its professionalization within academia during the 1970s. I argue that the Congress contributed to the construction of public space in which the relations between science, society and politics were debated, and science was reconceptualized as a social activity. The vision of “science studies” the CCF-associated intellectuals promulgated was different from the science studies we know today. Yet, this alternative vision, in which the issues of science politics appeared inseparable from those of science policy, science organization, and science governance, constituted the “pre-history” of science studies today. (shrink)