In this paper, we present and discuss the findings of two experiments about reference change. Cases of reference change have sometimes been invoked to challenge traditional versions of semantic externalism, but the relevant cases have never been tested empirically. The experiments we have conducted use variants of the famous Twin Earth scenario to test folk intuitions about whether natural kind terms such as ‘water’ or ‘salt’ switch reference after being constantly (mis)applied to different kinds. Our results indicate that this is (...) indeed so. We argue that this finding is evidence against Saul Kripke’s causal-historical view of reference, and at least provisional evidence in favor of the causal source view of reference as suggested by Gareth Evans and Michael Devitt. (shrink)

Much of the recent movement organized under the heading “Experimental Philosophy” has been concerned with the empirical study of responses to thought experiments drawn from the literature on philosophical analysis. I consider what bearing these studies have on the traditional projects in which thought experiments have been used in philosophy. This will help to answer the question what the relation is between Experimental Philosophy and philosophy, whether it is an “exciting new style of [philosophical] research”, “a new interdisciplinary field that (...) uses methods normally associated with psychology to investigate questions normally associated with philosophy” (Knobe et al. 2012), or whether its relation to philosophy consists, as some have suggested, in no more than the word ‘philosophy’ appearing in its title, or whether the truth lies somewhere in between these two views. I first distinguishes different strands in Experimental Philosophy, negative and positive x-phi, and x-phi pursuing philosophy as opposed to x-phi as cognitive science. Next I review some ways in which Experimental Philosophy has been criticized. Finally, I consider what would have to be true for Experimental Philosophy to have one or another sort of relevance to philosophy, whether the assumptions required are true, how we could know it, and the ideal limits of the usefulness Experimental Philosophy to philosophy. I conclude x-phi cannot in principle be a replacement for traditional first person approaches because it yields the wrong kind of knowledge and that it can nonetheless be a practical aid in conducting philosophical thought experiments. n. (shrink)

In their widely cited article, Swain et al. report data that, purportedly, demonstrates instability of folk epistemic intuitions regarding the famous Truetemp case authored by Keith Lehrer. What they found is a typical example of priming, where presenting one stimulus before presenting another stimulus affects the way the latter is perceived or evaluated. In their experiment, laypersons were less likely to attribute knowledge in the Truetemp case when they first read a scenario describing a clear case of knowledge, and more (...) likely to ascribe knowledge when they first read a vignette describing a clear case of nonknowledge. We tried to replicate Swain et al. findings in three experiments: one devised in Polish, and the other two conducted in English. We found no priming effect for knowledge ratings regarding the Truetemp case – laypersons were similarly likely to attribute knowledge in all three investigated conditions. These three failed replication attempts are not decisive as to whether the priming effect in question occurs, nevertheless, the collected data puts Swain et al. conclusions about instability of epistemic intuitions in jeopardy. (shrink)

Do psychological traits predict philosophical views? We administered the PhilPapers Survey, created by David Bourget and David Chalmers, which consists of 30 views on central philosophical topics (e.g., epistemology, ethics, metaphysics, philosophy of mind, and philosophy of language) to a sample of professional philosophers (N = 314). We extended the PhilPapers survey to measure a number of psychological traits, such as personality, numeracy, well-being, lifestyle, and life experiences. We also included non-technical ‘translations’ of these views for eventual use in other (...) populations. We found limited to no support for the notion that personality or demographics predict philosophical views. We did, however, find that some psychological traits were predictive of philosophical views, even after strict correction for multiple comparisons. Findings include: higher interest in numeracy predicted physicalism, naturalism, and consequentialism; lower levels of well-being and higher levels of mental illness predicted hard determinism; using substances such as psychedelics and marijuana predicted non-realist and subjectivist views of morality and aesthetics; having had a transformative or self-transcendent experience predicted theism and idealism. We discuss whether or not these empirical results have philosophical implications, while noting that 68% of our sample of professional philosophers indicated that such findings would indeed have philosophical value. (shrink)

This paper defends a desire-based understanding of pleasurable and unpleasant experiences. More specifically, the thesis is that what makes an experience pleasant/unpleasant is the subject having a certain kind of desire about that experience. I begin by introducing the ‘Desire Account’ in more detail, and then go on to explain and refute a prominent set of contemporary counter-examples, based on subjects who might have ‘Reflective Blindness’, looking particularly at the example of subjects with depression. I aim to make the Desire (...) Account more persuasive, but also to clear up more widespread misunderstandings about depression in metaethics. For example, mistakes that are made by conflating two of depression’s most prominent symptoms: depressed mood and anhedonia. (shrink)

Recently, researchers have begun to empirically investigate the gender gap in philosophy and provide potential explanations for the underrepresentation of women in philosophy relative to their representation in other disciplines. This empirical research as well as research on the gender gap in Science, Technology, Engineering, and Mathematics fields has shed light on a priori, armchair explanations of the gender gap. For example, implicit bias and stereotype threat may contribute much less to the philosophy gender gap than previously thought. However, new (...) candidate contributing factors have emerged. Drawing on the theoretical resources concerning fixed mindsets in response to difficult tasks, a new theory suggests that practitioners in various fields, including philosophy, hold the belief that success in their fields requires natural brilliance. Further, the extent to which members of a field hold that belief predicts the diversity of the members of that field. Initial findings suggest that among the set of students who hold these beliefs, women are disproportionately disinterested in continuing in philosophy. Other hypotheses seem plausible, such as the idea that lay people hold gendered schemas about philosophy, but require more empirical support to be partial explanations. Future empirical research should focus on these plausible hypotheses, replications of previous findings, and investigating the effects of intersectionality within the gender gap. (shrink)

In this article, we analyse the evidential value of the corpus of experimental philosophy. While experimental philosophers claim that their studies provide insight into philosophical problems, some philosophers and psychologists have expressed concerns that the findings from these studies lack evidential value. Barriers to evidential value include selection bias and p-hacking. To find out whether the significant findings in x-phi papers result from selection bias or p-hacking, we applied a p-curve analysis to a corpus of 365 x-phi chapters and articles. (...) Our results suggest that this corpus has evidential value, although there are hints of p-hacking in a few parts of the x-phi corpus. (shrink)

Academics across widely ranging disciplines all pursue knowledge, but they do so using vastly different methods. Do these academics therefore also have different ideas about when someone possesses knowledge? Recent experimental findings suggest that intuitions about when individuals have knowledge may vary across groups; in particular, the concept of knowledge espoused by the discipline of philosophy may not align with the concept held by laypeople. Across two studies, we investigate the concept of knowledge held by academics across seven disciplines (N (...) = 1,581) and compare these judgments to those of philosophers (N = 204) and laypeople (N = 336). We find that academics and laypeople share a similar concept of knowledge, while philosophers have a substantially different concept. These experiments show that (a) in contrast to philosophers, other academics and laypeople attribute knowledge to others in some “Gettier” situations; (b) academics and laypeople are much less likely to attribute knowledge when reminded of the possibility of error, but philosophers are not affected by this reminder; and (c) non‐philosophy academics are overall more skeptical about knowledge than laypeople or philosophers. These findings suggest that academics across a wide range of disciplines share a similar concept of knowledge, and that this concept aligns closely with the intuitions held by laypeople, and differs considerably from the concept of knowledge described in the philosophical literature, as well as the epistemic intuitions of philosophers themselves. (shrink)

The aim of the paper is to determine the role of intuitions in Gettier cases. Critics of the Method of Cases argue that arguments developed within this method contains a premise that is justified by its intuitiveness; they also argue that intuitions are unreliable source of evidence. By contrast, Max Deutsch argues that this critique is unsound since intuitions do not serve as evidence for premises. In Gettier cases, an intuitive premise is justified by other arguments called G-Grounds. I propose (...) a different view on the role of intuition in Gettier cases. I introduce a distinction between concept-revision arguments and concept-application arguments. On the basis of this distinction and Craig’s and Spicer’s distinction between intuitions of intension and intuitions of extension, I show that (1) intuitions of extension do not serve as evidence for any G-Grounds; (2) intuitions of intension do play an evidential role for all G-Grounds, but (3) in the case of G-Grounds which are used as concept-application arguments, they are a poor source of evidence, while (4) in the case of G-Grounds used as concept-revision arguments, they could be a reliable source of evidence if they are intuitions of intension of a speaker immersed in philosophical discourse. (shrink)

In recent years a new discussion on the nature of philosophical expertise has emerged: whether philosophers possess a special kind of expertise, what such expertise would entail, how to measure it, and related concerns. The aim of the present article is to clarify certain related points across these debates in the hope of paving a clearer path forward, by addressing the following. (1) The expertise defense, which seems central to many discussions on methodology and expertise, has been misconstrued at times. (...) (2) Questions of expertise and methodology could be separated more clearly. (3) The study of expertise may be important in its own right; however, there may be good reasons to give priority to methodological concerns. (4) Finally, when viewed in light of methodological concerns, a new project emerges when engaging with recent contributions to the expertise debate. The present article attempts a brief outline of this project. (shrink)

A key challenge in experimental social science research is the incentivisation of subjects such that they take the tasks presented to them seriously and answer honestly. If subject responses can be evaluated against an objective baseline, a standard way of incentivising participants is by rewarding them monetarily as a function of their performance. However, the subject area of experimental philosophy is such that this mode of incentivisation is not applicable as participant responses cannot easily be scored along a true-false spectrum (...) by the experimenters. We claim that experimental philosophers’ neglect of and claims of unimportance about incentivisation mechanisms in their surveys and experiments has plausibly led to poorer data quality and worse conclusions drawn overall, potentially threatening the research programme of experimental philosophy in the long run. As a solution to this, we propose the adoption of the Bayesian Truth Serum, an incentive-compatible mechanism used in economics and marketing, designed for eliciting honest responding in subjective data designs by rewarding participant answers that are surprisingly common. We argue that the Bayesian Truth Serum (i) adequately addresses the issue of incentive compatibility in subjective data research designs and (ii) that it should be applied to the vast majority of research in experimental philosophy. Further, we (iii) provide an empirical application of the method, demonstrating its qualified impact on the distribution of answers on a number of standard experimental philosophy items and outline guidance for researchers aiming to apply this mechanism in future research by specifying the additional costs and design steps involved. (shrink)

A key challenge in experimental social science research is the incentivisation of subjects such that they take the tasks presented to them seriously and answer honestly. If subject responses can be evaluated against an objective baseline, a standard way of incentivising participants is by rewarding them monetarily as a function of their performance. However, the subject area of experimental philosophy is such that this mode of incentivisation is not applicable as participant responses cannot easily be scored along a true-false spectrum (...) by the experimenters. We claim that experimental philosophers’ neglect of and claims of unimportance about incentivisation mechanisms in their surveys and experiments has plausibly led to poorer data quality and worse conclusions drawn overall, potentially threatening the research programme of experimental philosophy in the long run. As a solution to this, we propose the adoption of the Bayesian Truth Serum, an incentive-compatible mechanism used in economics and marketing, designed for eliciting honest responding in subjective data designs by rewarding participant answers that are surprisingly common. We argue that the Bayesian Truth Serum (i) adequately addresses the issue of incentive compatibility in subjective data research designs and (ii) that it should be applied to the vast majority of research in experimental philosophy. Further, we (iii) provide an empirical application of the method, demonstrating its qualified impact on the distribution of answers on a number of standard experimental philosophy items and outline guidance for researchers aiming to apply this mechanism in future research by specifying the additional costs and design steps involved. (shrink)

Proponents of the “negative program” in experimental philosophy have argued that judgements in philosophical cases, also known as case judgements, are unreliable and that the method of cases should be either strongly constrained or even abandoned. Here we put one of the main proponent’s account of why philosophical cases may cause the unreliability of case judgements to the test. We conducted our test with thought experiments from physics, which exhibit the exact same supposedly “disturbing characteristics” of philosophical cases.

In this paper I defend the view that positing analytic, constitutive connections among concepts best explains certain semantic-cum-conceptual intuitions. Jerry Fodor and Eric Margolis and Stephen Laurence offer alternative explanations according to which such intuitions can be explained without positing analyticities. I argue that these alternative explanations fail. As a partial diagnosis of their failure, I suggest that critics have failed to recognize the extent to which a psychologized notion of analyticity must depart from the traditional notion of ‘truth in (...) virtue of meaning alone’. (shrink)

This paper examines a constellation of ethical and editorial issues that have arisen since philosophers started to conduct, submit and publish empirical research. These issues encompass concerns over responsible authorship, fair treatment of human subjects, ethicality of experimental procedures, availability of data, unselective reporting and publishability of research findings. This study aims to assess whether the philosophical community has as yet successfully addressed such issues. To do so, the instructions for authors, submission process and published research papers of 29 main (...) journals in philosophy have been considered and analyzed. In light of the evidence reported here, it is argued that the philosophical community has as yet failed to properly tackle such issues. The paper also delivers some recommendations for authors, reviewers and editors in the field. (shrink)

At first glance it might appear that experimental philosophers and feminist philosophers would make good allies. Nonetheless, experimental philosophy has received criticism from feminist fronts, both for its methodology and for some of its guiding assumptions. Adding to this critical literature, I raise questions concerning the ways in which “differences” in intuitions are employed in experimental philosophy. Specifically, I distinguish between two ways in which differences in intuitions might play a role in philosophical practice, one which puts an end to (...) philosophical conversation and the other which provides impetus for beginning one. Insofar as experimental philosophers are engaged in deploying “differences” in intuitions in the former rather than the latter sense, I argue that their approach is antithetical to feminist projects. Moreover, this is even the case when experimental philosophers deploy “differences” in intuitions along lines of gender. (shrink)

Max Deutsch’s new book argues against the commonly held ‘myth’ that philosophical methodology characteristically employs intuitions as evidence. While I am sympathetic to the general claim that philosophical methodology has been grossly oversimplified in the intuition literature, the particular claim that it is a myth that philosophers rely on intuitions as evidence is open to several very different interpretations. The plausibility and consequences of a rejection of the ‘myth’ will depend on the notion of evidence one employs, the notion of (...) intuition one holds, and how one understands the idea of ‘relying on’ or ‘employing’ something as evidence. I describe what I take to be the version of The Myth which is most plausibly undermined by Deutsch’s arguments; however, I also argue that the falsity of this myth has only minimal consequences for the viability of the experimental philosophy research project. (shrink)

This article examines whether people share the Gettier intuition (viz. that someone who has a true justified belief that p may nonetheless fail to know that p) in 24 sites, located in 23 countries (counting Hong Kong as a distinct country) and across 17 languages. We also consider the possible influence of gender and personality on this intuition with a very large sample size. Finally, we examine whether the Gettier intuition varies across people as a function of their disposition to (...) engage in “reflective” thinking. (shrink)

Within the existing metaphilosophical literature on experimental philosophy, a great deal of attention has been devoted to the claim that there are large differences in philosophical intuitions between people of different demographic groups. Some philosophers argue that this claim has important metaphilosophical implications; others argue that it does not. However, the actual empirical work within experimental philosophy seems to point to a very different sort of metaphilosophical question. Specifically, what the actual empirical work suggests is that intuitions are surprisingly robust (...) across demographic groups. Prior to empirical study, it seemed plausible that unexpected patterns of intuition found in one demographic group would not emerge in other demographic groups. Yet, again and again, empirical work obtains the opposite result: that unexpected patterns found in one demographic group actually emerge also in other demographic groups. I cite 30 studies that find this sort of robustness. I then argue that to the extent that metaphilosophical work is to engage with the actual findings from experimental philosophy, it needs to explore the implications of the surprising robustness of philosophical intuitions across demographic differences. (shrink)

In what sense, if any, are philosophers experts in their domain of research and what could philosophical expertise be? The above questions are particularly pressing given recent methodological disputes in philosophy. The so-called expertise defense recently proposed as a reply to experimental philosophers postulates that philosophers are experts qua having improved intuitions. However, this model of philosophical expertise has been challenged by studies suggesting that philosophers’ intuitions are no less prone to biases and distortions than intuitions of non-philosophers. Should we (...) then give up on the idea that philosophers possess some sort of expertise? In this paper, I argue that instead of focusing on intuitions, we may understand the relevant results of philosophical practice more broadly and investigate the other kind of expertise they would require. My proposal is inspired by a prominent approach to investigating expert performance from psychology and suggests where and how to look for expertise in the results characteristic of philosophical practice. In developing this model, I discuss the following three candidates for such results: arguments, theories, and distinctions. Whether philosophers could be shown to be expert intuiters or not, there are interesting domains where we could look for philosophical expertise, beyond intuitions. (shrink)

The anglophone philosophy profession has a well-known problem with gender equity. A sig-nificant aspect of the problem is the fact that there are simply so many more male philoso-phers than female philosophers among students and faculty alike. The problem is at its stark-est at the faculty level, where only 22% - 24% of philosophers are female in the United States (Van Camp 2014), the United Kingdom (Beebee & Saul 2011) and Australia (Goddard 2008).<1> While this is a result of the (...) percentage of women declining at each point through-out the standard career trajectory, recent large-scale studies in the United States (Paxton et al. 2012) and Australia (Goddard et al. 2008) have identified a key drop-off point as the transi-tion between taking introductory classes and majoring in philosophy. So why do dispropor-tionately few female students choose to major in philosophy? (shrink)

Why is there female under-representation among philosophy majors? We survey the hypotheses that have been proposed so far, grouping similar hypotheses together. We then propose a chronological taxonomy that distinguishes hypotheses according to the stage in undergraduates’ careers at which the hypotheses predict an increase in female under-representation. We then survey the empirical evidence for and against various hypotheses. We end by suggesting future avenues for research.

Religious disagreement is an emerging topic of interest in social epistemology. Little is known about how philosophers react to religious disagreements in a professional context, or how they think one should respond to disagreement. This paper presents results of an empirical study on religious disagreement among philosophers. Results indicate that personal religious beliefs, philosophical training, and recent changes in religious outlook have a significant impact on philosophers' assessments of religious disagreement. They regard peer disagreement about religion as common, and most (...) surveyed participants assume one should accord weight to the other's opinion. Theists and agnostics are less likely to assume they are in a better epistemic position than their interlocutors about religious questions compared with atheists, but this pattern only holds for participants who are not philosophers of religion. Continental philosophers think religious beliefs are more like preferences than analytic philosophers, who regard religious beliefs as fact-like. (shrink)

Financial incentives, learning, group consultation, and increased experimental control are among the experimental techniques economists have successfully used to deflect the behavioral challenge posed by research conducted by such scholars as Tversky and Kahneman. These techniques save the economic armchair to the extent that they align laypeople judgments with economic theory by increasing cognitive effort and reflection in experimental subjects. It is natural to hypothesize that a similar strategy might work to address the experimental or restrictionist challenge to armchair philosophy. (...) To test this hypothesis, a randomized controlled experiment was carried out, as well as two lab experiments. Three types of knowledge attribution tasks were used. No support for the hypothesis was found. The paper describes the close similarities between the economist’s response to the behavioral challenge, and the expertise defense against the experimental challenge, and presents the experiments, results, and an array of robustness checks. The upshot is that these results make the experimental challenge all the more forceful. (shrink)

This paper presents new evidence on the impact of socioeconomic status and education on knowledge attribution. I examine a variety of cases, including vignettes where agents have been Gettiered, have false beliefs, and possess knowledge. Early work investigated whether SES might be associated with knowledge attribution :429–460, 2001; Seyedsayamdost in Episteme 12:95–116, 2014). But these studies used college education as a dummy variable for SES. I use the recently developed Great British Class Survey :219–250, 2013) to measure SES. The paper (...) reports evidence against an association between SES and patterns of knowledge ascription, and reports mixed evidence about education effects. (shrink)

We study questionnaire responses to situations in which sacrificing one life may save many other lives. We demonstrate gender differences in moral judgments: males are more supportive of the sacrifice than females. We investigate a source of the endorsement of the sacrifice: antisocial preferences. First, we measure individual proneness to spiteful behavior, using an experimental game with monetary stakes. We demonstrate that spitefulness can be sizable—a fifth of our participants behave spitefully—but it is not associated with gender. Second, we find (...) that gender is consistently associated with responses even when we account for individual differences in the propensity to spitefulness. (shrink)

I bet you don’t practice your philosophical intuitions. What’s your excuse? If you think philosophical training improves the reliability of philosophical intuitions, then practicing intuitions should improve them even further. I argue that philosophers’ reluctance to practice their intuitions highlights a tension in the way that they think about the role of intuitions in philosophy.

Intuitions is presented as a counterpart of Rethinking Intuition ( DePaul and Ramsey 1998 ). 1 After 16 years, it revisits the topic of the place of intuitions in philosophy in light of two developments...

To address the underrepresentation of women in philosophy effectively, we must understand the causes of the early loss of women. In this paper we challenge one of the few explanations that has focused on why women might leave philosophy at early stages. Wesley Buckwalter and Stephen Stich offer some evidence that women have different intuitions than men about philosophical thought experiments. We present some concerns about their evidence and we discuss our own study, in which we attempted to replicate their (...) results for 23 different responses to 14 scenarios . We also conducted a literature search to see if other philosophers or psychologists have tested for gender differences in philosophical intuitions. Based on our findings, we argue that that it is unlikely that gender differences in intuitions play a significant role in driving women from philosophy. (shrink)

This entry addresses the nature and epistemological role of intuition by considering the following questions: (1) What are intuitions?, (2) What roles do they serve in philosophical (and other “armchair”) inquiry?, (3) Ought they serve such roles?, (4) What are the implications of the empirical investigation of intuitions for their proper roles?, and (5) What is the content of intuitions prompted by the consideration of hypothetical cases?

The field of experimental philosophy has received considerable attention, essentially for producing results that seem highly counter-intuitive and at the same time question some of the fundamental methods used in philosophy. A substantial part of this attention has focused on the role of intuitions in philosophical methodology. One of the major contributions of experimental philosophy on this topic has been concrete evidence in support of intuitional diversity; the idea that intuitions vary systematically depending on variables such as ethnicity, socioeconomic background, (...) or gender. Because of the important implications, these findings have been the subject of extensive debate. Despite the seeming significance of the findings and despite all the debates that the experimental philosophy movement has prompted, what has not been examined systematically is the reproducibility of the results. Instead, the reported findings have been simply accepted as established facts. We set out to replicate a wide range of experiments and surprisingly failed to reproduce many of the reported findings, some of which are from the most cited and attention grabbing papers of the field. We draw two conclusions from our findings. The first is that the instability of intuitions has been exaggerated by experimental philosophers. Intuitions appear to be more uniform across different demographic groups. The argument that intuitions need to be discarded because they depend on arbitrary factors such as ethnicity, socioeconomic background, or gender does not seem tenable anymore. The second conclusion is that experimental philosophy needs a better system to ensure the reproducibility of published findings. The current research-publication system of various empirical fields, especially those employing statistical methods, leads to an overproduction of false-positive findings in the published literature. Unless changes are made to the current research-publication system, this overproduction is likely to continue, in experimental philosophy as well as other disciplines. (shrink)

This article examines whether people share the Gettier intuition (viz. that someone who has a true justified belief that p may nonetheless fail to know that p) in 24 sites, located in 23 countries (counting Hong-Kong as a distinct country) and across 17 languages. We also consider the possible influence of gender and personality on this intuition with a very large sample size. Finally, we examine whether the Gettier intuition varies across people as a function of their disposition to engage (...) in “reflective” thinking. (shrink)

In this paper, I discuss the effects of using thought experiments for the purpose of conceptual clarification on students’ hermeneutical abilities. On the one hand, by providing opportunities to explore the scope of normatively loaded concepts, thought experiments can effectively help students to interpret their social and moral reality more adequately, which in some cases might even help to reduce existing hermeneutical injustices. On the other hand, given their notorious susceptibility to distorting factors that are philosophically irrelevant, they can also (...) push students into accepting idiosyncratic intuitions that they don’t really share and thereby further impair their hermeneutical abilities. After setting out this dilemma in more detail, I will propose various strategies for facilitating the safe use of thought experiments that instructors can use to effectively exploit the empowering potential of thought experiments. (shrink)

This paper examines a constellation of ethical and editorial issues that have arisen since philosophers started to conduct, submit and publish empirical research. These issues encompass concerns over responsible authorship, fair treatment of human subjects, ethicality of experimental procedures, availability of data, unselective reporting and publishability of research findings. This study aims to assess whether the philosophical community has as yet successfully addressed such issues. To do so, the instructions for authors, submission process and published research papers of 29 main (...) journals in philosophy have been considered and analyzed. In light of the evidence reported here, it is argued that the philosophical community has as yet failed to properly tackle such issues. The paper also delivers some recommendations for authors, reviewers and editors in the field. (shrink)

Naturalistic philosophers rely on literature search and review in a number of ways and for different purposes. Yet this article shows how processes of literature search and review are likely to be affected by widespread and systematic biases. A solution to this problem is offered here. Whilst the tradition of systematic reviews of literature from scientific disciplines has been neglected in philosophy, systematic reviews are important tools that minimize bias in literature search and review and allow for greater reproducibility and (...) transparency. If naturalistic philosophers wish to reduce bias in their research, they should then supplement their traditional tools for literature search and review by including systematic methodologies. (shrink)