Evidential pluralists, like Federica Russo and Jon Williamson, argue that causal claims should be corroborated by establishing both the existence of a suitable correlation and a suitable mechanism complex. At first glance, this fits well with mixed method research in the social sciences, which often involves a pluralist combination of statistical and mechanistic evidence. However, statistical evidence concerns a population of cases, while mechanistic evidence is found in individual case studies. How should researchers combine such general statistical evidence and specific (...) mechanistic evidence? This article discusses a very recent answer to this question, ‘multi-method large-N qualitative analysis’ or multi-method LNQA, popular in political science and international relations studies of rare events like democratic transitions and cease-fire agreements. Multi-method LNQA combines a comprehensive study of all relevant event cases with statistical analysis, in an attempt to solve the issues of generalization faced by other types of qualitative research, such as selection bias and lack of representativeness. I will argue that the kind of general causal claim that multi-method LNQA is after, however, is crucially different from the average treatment effect found in statistical analysis and can in fact only be supported with mechanistic evidence. I conclude from this that mixed method research, and thereby evidential pluralism, may be inappropriate in this context. (shrink)

The issue of causal comparability in the social sciences underlies matters of both generalization and extrapolation. After critiquing two existing interpretations of comparability, due to Hitchcock and Hausman, I propose a distinction between ontological and epistemic comparability. While the former refers to whether two cases are actually comparable, the latter respects that in cases of incomplete information, we need to rely on whatever evidence we have of comparability. I argue, using a political science case study, that in those cases of (...) imperfect information, an epistemic homogeneity criterion can be an adequate justification for generalization. (shrink)

This paper reviews all major theories of evidence such as the Bayesian theory, hypothetico-deductivism, satisfaction theories, error-statistics, Achinstein's explanationist theory and Cartwright's argument theory. All these theories fail to take adequate account of the context in which a hypothesis is established and used. It is argued that the context of an inquiry determines important facts about what evidence is, and how much and what kind has to be collected to establish a hypothesis for a given purpose.

This article examines two theses formulated by Russo and Williamson in their study of causal inference in the health sciences. The two theses are assessed against evidence from a specific case in the social sciences, i.e., research on the institutional determinants of the aggregate unemployment rate. The first Russo–Williamson Thesis is that a causal claim can only be established when it is jointly supported by difference-making and mechanistic evidence. This thesis is shown not to hold. While researchers in my case (...) study draw extensively on both types of evidence, one causal claim out of the three analyzed is established even though it is exclusively supported by mechanistic evidence. The second Russo–Williamson Thesis is that standard accounts of causality fail to handle the dualist epistemology highlighted in the first Thesis. I argue that a counterfactual-manipulationist account of causality—which is endorsed by many philosophers as well as many social scientists—can perfectly make sense of the typical strategy in my case study to draw on both difference-making and mechanistic evidence; it is just an instance of the common strategy of increasing evidential variety. (shrink)

Current philosophical accounts of causation suggest that the same causal assertion can have different meanings. Yet, in actual social-scientific practice, the possible meanings of some causal generalisations intended to support policy prescriptions are not always spelled out. In line with a standard referentialist approach to semantics, we propose and elaborate on four questions to systematically elucidate the meaning of causal generalisations. The analysis can be useful to a host of agents, including social scientists, policy-makers, and philosophers aiming at being socially (...) relevant. To illustrate our proposal, we analyse the complexities related to the meaning of causal generalisations in the context of a concrete case of economic research which is explicitly intended to guide public policy, namely, the OECD research on the causes of unemployment. (shrink)

This paper surveys and critically assesses existing theories of evidence with respect to four desiderata. A good theory of evidence should be both a theory of evidential support (i.e., be informative about what kinds of facts speak in favour of a hypothesis), and of warrant (i.e., be informative about how strongly a given set of facts speaks in favour of the hypothesis), it should apply to the non-ideal cases in which scientists typically find themselves, and it should be ‘descriptively adequate’, (...) i.e., able to adequately represent typical episodes of evidentiary reasoning. The theories surveyed here—Bayesianism, hypotheticodeductivism,satisfaction theories, error statistics as well as Achinstein’s and Cartwright’s theories—are all found wanting in important respects. I finally argue that a deficiency all these theories have in common is a neglect or underplaying of the epistemic context in which the episode of evidentiary reasoning takes place.Este artículo describe y valora críticamente diversas teorías de la evidencia en relación a cuatro desiderata. Una buena teoría de la evidencia debería ser tanto una teoría sobre el apoyo evidencial [evidential support] (ser informativa sobre qué tipos de hechos hablan a favor de la hipótesis) como sobre la justificación [warrant]; debería aplicarse en las situaciones no ideales en las que normalmente se encuentran los científicos; y debería ser ‘descriptivamente adecuada’, esto es, capaz de representar correctamente episodios típicos de razonamiento evidencial. Las teorías aquí revisadas—bayesianismo, hipotético-deductivismo, teorías de la satisfacibilidad, la estadística del error, así como las propuestas de Achinstein y Cartwright—se consideran deficientes en aspectos básicos. Argumentaré que un defecto común en todas ellas es que olvidan, o minusvaloran, el contexto epistémico en el que el episodio de razonamiento evidencial tiene lugar. (shrink)

In this thesis I investigate causal inquiry in the social sciences, drawing on examples from various disciplines and in particular from conflict studies. In a backlash against the pervasiveness of statistical methods, in the last decade certain social scientists have focused on finding the causal mechanisms behind observed correlations. To provide evidence for such mechanisms, researchers increasingly rely on ‘process tracing’, a method which attempts to give evidence for causal relations by specifying the chain of events connecting a putative cause (...) and effect of interest. I will ask whether the causal claims process tracers make are defensible, and where they are not defensible I will ask how we can improve the method. Throughout these investigations, I show that the conclusions of process tracing are constrained both by the causal structure ofthe social world and by social scientists’ aims and values. My central argument is this: all instances of social phenomena have causally relevant differences, which implies that any research design that requires some comparison between cases is limited by how we systematize these phenomena. Moreover, such research cannot rely on stable regularities. Nevertheless, to forego causal conclusions altogether is not the right response to these limitations; by carefully outlining our epistemic assumptions we can make progress in causal inquiry. While I use philosophical theories of causation to comment on the feasibility of a social scientific method, I also do the reverse: by investigating a popular contemporary method in the social sciences, I show to what extent our philosophical theories of causation are workable in practice. Thus, this thesis is both a methodological and a philosophical work. Every chapter discusses both a fundamental philosophical position on the social sciences and a relevant case study from the social sciences. (shrink)