If a human subject knows they are being measured, this knowledge may affect their attitudes and behaviour to such an extent that it affects the measurement results as well. This broad range of effects is shared under the term ‘reactivity’. Although reactivity is often seen by methodologists as a problem to overcome, in this paper I argue that some quite extreme reactive changes may be legitimate, as long as we are measuring phenomena that are not simple biological regularities. Legitimate reactivity (...) is reactivity which does not undermine the accuracy of a measure; I show that if such reactivity were corrected for, this would unjustifiably ignore the authority of the research subject. Applying this argument to the measurement of depression, I show that under the most commonly accepted models of depression there is room for legitimate reactivity. In the first part of the paper, I provide an inventory of the different types of reactivity that exist in the literature, as well as the different types of phenomena that one could measure. In the second part, I apply my argument to the measurement of depression with the PHQ-9 survey. I argue that depending on what kind of phenomenon we consider depression to be, we will accept different kinds of reactivity. I show that both under the harmful dysfunction model and the practical kinds model, certain reactive changes in measuring depression are best seen as legitimate recharacterizations of the underlying phenomenon, and define what legitimate means in this context. I conclude that in both models, biological aspects constrain characterization, but the models are not so strict that only one concept is acceptable, leaving room for reactivity. (shrink)

Philosophers of social science have emphasized mechanistic approaches to causal inquiry for some time now, showing why focusing on the mechanisms behind correlations is preferable to focusing on correlations alone (cf. Johnson 2006, Little 1991, Reiss 2007, 2009, Steel 2004, see also King, Keohane, and Verba 1994 for an example of purely correlational research). In Process Tracing: from Metaphor to Analytic Tool, political scientists Andrew Bennett and Jeffrey Checkel present a concrete method for finding evidence of causal mechanisms, process tracing. (...) Process tracers give evidence for causal relations in terms of the observable implications of the underlying causal mechanisms through which a putative cause affects some effect of interest. Such observable implications often take the form of a chain of events, or process, which connects cause and effect. Though Process Tracing contains applications of mechanistic reasoning unfamiliar to philosophers, and as such will be of interest to those working in the mechanist tradition, Bennett and Checkel’s own discussion of the philosophical foundations of process tracing is limited. The reader will have to delve deep into the volume’s contributed chapters for links between the literature on causation and this new method. (shrink)

When scientists or science reporters communicate research results to the public, this often involves ethical and epistemic risks. One such risk arises when scientific claims cause cognitive or behavioural changes in the audience that contribute to the self-fulfilment of these claims. I argue that the ethical and epistemic problems that such self-fulfilment effects may pose are much broader and more common than hitherto appreciated. Moreover, these problems are often due to a specific psychological phenomenon that has been neglected in the (...) research on science communication: many people tend to conform to ‘descriptive norms’, that is, norms capturing (perceptions of) what others commonly do, think, or feel. Because of this tendency, science communication may frequently produce significant social harm. I contend that scientists have a responsibility to assess the risk of this potential harm and consider adopting strategies to mitigate it. I introduce one such strategy and argue that its implementation is independently well motivated by the fact that it helps improve scientific accuracy. (shrink)

Many scientists routinely generalize from study samples to larger populations. It is commonly assumed that this cognitive process of scientific induction is a voluntary inference in which researchers assess the generalizability of their data and then draw conclusions accordingly. We challenge this view and argue for a novel account. The account describes scientific induction as involving by default a generalization bias that operates automatically and frequently leads researchers to unintentionally generalize their findings without sufficient evidence. The result is unwarranted, overgeneralized (...) conclusions. We support this account of scientific induction by integrating a range of disparate findings from across the cognitive sciences that have until now not been connected to research on the nature of scientific induction. The view that scientific induction involves by default a generalization bias calls for a revision of the current thinking about scientific induction and highlights an overlooked cause of the replication crisis in the sciences. Commonly proposed interventions to tackle scientific overgeneralizations that may feed into this crisis need to be supplemented with cognitive debiasing strategies against generalization bias to most effectively improve science. (shrink)

The innovation systems approach has swiftly spread out worldwide in the last three decades and stood as an important framework for policy-making in the fields of science, technology, and innovation. At the same time, there have been serious and untreated concerns in the literature about the theoretical soundness of this approach. Our discussion in this paper is based on the belief that a detailed analysis on epistemological foundations of the approach could shed a judgmental light on the aforementioned concerns. To (...) provide that analysis, we reconstructed and studied the nature and evolution of innovation systems approach as a case of conceptual revolution against the more established traditions in economics of innovation. Our analyses show that the rise of the systemic view of innovation include radical changes in conceptual structures pertaining to orthodox view of innovation. These developments also go so far as to include significant shifts in epistemological foundations of the old paradigm. These later shifts provide us with an epistemological base from which we can shelter the innovation systems approach from the hard criticisms rooted in a quasi-positivist point of view. That epistemological base also shows the path for the future development of the approach towards more robustness and precision. (shrink)

mechanism" is frequently encountered in the social science literature, but there is considerable confusion about the exact meaning of the term. The article begins by addressing the main conceptual issues. Use of this term is the hallmark of an approach that is critical of the explanatory deficits of correlational analysis and of the covering-law model, advocating instead the causal reconstruction of the processes that account for given macro-phenomena. The term "social mechanisms" should be used to refer to recurrent processes generating (...) a specific kind of outcome. Explanation of social macro-phenomena by mechanisms typically involves causal regression to lower-level elements, as stipulated by methodological individualism. While there exist a good many mechanism models to explain emergent effects of collective behavior, we lack a similarly systematic treatment of generative mechanisms in which institutions and specific kinds of structural configurations play the decisive role. Key Words: causal regression • correlational analysis • emergent effects • micro-macro processes • social mechanisms • structural determinants. (shrink)

In this interview, Daniel Little provides an overview of his life and work in academia. Among other things, he discusses an actor-centred approach to theory of social ontology. For Little, this approach complements the assumptions of critical realism, in that it accords full ontological importance to social structures, causal mechanisms, and enduring and influential normative systems. The approach casts doubt, however, on the idea of ‘strong emergence' of social structures, the idea that social structures have properties and causal powers that (...) cannot, in principle be explained by their constituents (social actors) and their relationships. Little’s approach to social ontology endorses instead the idea of relative explanatory autonomy. During the interview, many points of convergence become evident between this actor-centred approach to social ontology and the fundamental insights of critical realism. According to Little, analysis of social ontology also turns out to be especially relevant to philosophy of history. (shrink)

The observation that concepts used by social scientists are often problematic is not new; they have been described as Ballung concepts, cluster concepts, essentially contested, and reflexive; however, the need to work with these concepts remains. This article addresses the problem of variable choice in the social sciences by exploring and extending Woodward’s recommendations. This article demonstrates why Woodward’s criteria are difficult to apply in the social sciences and proposes an alternative, but complementary, framework for assessing variables.

This article argues that it is far from trivial to convert social science concepts into accurate categories on which algorithms work best. The literature raises this concern in a general way; for example, Deeks notes that legal concepts, such as proportionality, cannot be easily converted into code noting that ‘The meaning and application of these concepts is hotly debated, even among lawyers who share common vocabularies and experiences’ (Deeks in Va Law Rev 104, pp. 1529–1593, 2018). The example discussed here (...) is recidivism prediction, where the factors that are of interest are difficult to capture adequately through questionnaires because survey responses do not necessarily indicate whether the behaviour that is of interest is present. There is room for improvement in how questions are phrased, in the selection of variables, and by encouraging practitioners to consider whether a particular variable is the sort of thing that can be measured by questionnaires at all. (shrink)

Some explanations are relatively abstract: they abstract away from the idiosyncratic or messy details of the case in hand. The received wisdom in philosophy is that this is a virtue for any explanation to possess. I argue that the apparent consensus on this point is illusory. When philosophers make this claim, they differ on which of four alternative varieties of abstractness they have in mind. What’s more, for each variety of abstractness there are several alternative reasons to think that the (...) variety of abstractness in question is a virtue. I identify the most promising reasons, and dismiss some others. The paper concludes by relating this discussion to the idea that explanations in biology, psychology and social science cannot be replaced by relatively micro explanations without loss of understanding. (shrink)

The anti-causal prophecies of last century have been disproved. Causality is neither a ‘relic of a bygone’ nor ‘another fetish of modern science’; it still occupies a large part of the current debate in philosophy and the sciences. This investigation into causal modelling presents the rationale of causality, i.e. the notion that guides causal reasoning in causal modelling. It is argued that causal models are regimented by a rationale of variation, nor of regularity neither invariance, thus breaking down the dominant (...) Human paradigm. The notion of variation is shown to be embedded in the scheme of reasoning behind various causal models: e.g. Rubin’s model, contingency tables, and multilevel analysis. It is also shown to be latent – yet fundamental – in many philosophical accounts. Moreover, it has significant consequences for methodological issues: the warranty of the causal interpretation of causal models, the levels of causation, the characterisation of mechanisms, and the interpretation of probability. This book offers a novel philosophical and methodological approach to causal reasoning in causal modelling and provides the reader with the tools to be up to date about various issues causality rises in social science. (shrink)

Scientists may sometimes generalize from their samples to broader populations when they have not yet sufficiently supported this generalization. Do such hasty generalizations also occur in experimental philosophy? To check, we analyzed 171 experimental philosophy studies published between 2017 and 2023. We found that most studies tested only Western populations but generalized beyond them without justification. There was also no evidence that studies with broader conclusions had larger, more diverse samples, but they nonetheless had higher citation impact. Our analyses reveal (...) important methodological limitations of many experimental philosophy studies and suggest that philosophical training may not protect against hasty generalizations. (shrink)