Studies in experimental philosophy claim to document intuition variation. Some studies focus on demographic group-variation; Colaçoet al., for example, claim that age generates intuition variation regarding knowledge attribution in a fake-barn scenario. Other studies claim to show intuition variation when comparing the intuition of philosophers to that of non-philosophers. The main focus has been on documenting intuition variation rather than uncovering what underlying factor(s) may prompt such a phenomenon. We explore a number of suggested explanatory hypotheses put forth by Colaçoet (...) al., as well as an attempt to test Sosa's claim that intuition variance is a result of people ‘filling in the details’ of a thought experiment differently from one another. We show (i) that people respond consistently across conditions aimed at ‘filling in the details’ of thought experiments, (ii) that risk attitude does not seem relevant to knowledge ascription, (iii) that people's knowledge ascriptions do not vary due to views about defeasibility of knowledge. Yet, (iv) we find no grounds to reject that a large proportion of people appear to adhere to so-called subjectivism about knowledge, which may explain why they generally have intuitions about the fake-barn scenario that vary from those of philosophers. (shrink)

When experimental philosophers carry out studies on thought experiments, some participants are excluded based on certain exclusion criteria, mirroring standard social science vignette methodology. This involves excluding people that do not pay attention or who miscomprehend the scenario presented in thought experiments. However, experimental philosophy studies sometimes exclude an alarmingly high number of participants. We argue that this threatens the external and internal validity of the conclusions being drawn and we show how a simple visualization of thought experiments can reduce (...) exclusion rates significantly. Furthermore, we argue that focus should not merely be on how many are excluded, but also why they are excluded, and we highlight the role of comprehension questions in this regard. Philosophical thought experiments often rely on the acceptance of certain key premises that may be regarded contestable, and asking comprehension questions involving such key assumptions could be problematic as that may result in some participants being inadvertently excluded from the study, potentially creating a selection bias. (shrink)

Studies in experimental philosophy claim to document intuition variation. Some studies focus on demographic group-variation; Colaço et al., for example, claim that age generates intuition variation regarding knowledge attribution in a fake-barn scenario. Other studies claim to show intuition variation when comparing the intuition of philosophers to that of non-philosophers. The main focus has been on documenting intuition variation rather than uncovering what underlying factor(s) may prompt such a phenomenon. We explore a number of suggested explanatory hypotheses put forth by (...) Colaço et al., as well as an attempt to test Sosa's claim that intuition variance is a result of people ‘filling in the details’ of a thought experiment differently from one another. We show (i) that people respond consistently across conditions aimed at ‘filling in the details’ of thought experiments, (ii) that risk attitude does not seem relevant to knowledge ascription, (iii) that people's knowledge ascriptions do not vary due to views about defeasibility of knowledge. Yet, (iv) we find no grounds to reject that a large proportion of people appear to adhere to so-called subjectivism about knowledge, which may explain why they generally have intuitions about the fake-barn scenario that vary from those of philosophers. (shrink)

Self-fulfillment of theories is argued to be a threat to social science in at least two ways. First, a realist might worry that self-fulfillment constitutes a threat to the idea that social science is a proper science consistent with a realist approach that develops true and successful statements about the world. Second, one might argue that the potential self-fulfilling nature of social science theories potentially undermines the ethical integrity of social scientists. We argue that if one accepts that social science (...) theories are not based on laws akin to those that govern natural reality or acknowledges that if one can predict self-fulfillment via a meta-theory that explains the underlying regularities of the self-fulfilling change, the threat to realism is dismantled. Furthermore, on the basis of these arguments, we show that if one is unable to predict the consequences of a theory, it is difficult to ascribe moral responsibility at the individual level. It is, therefore, not the potential self-fulfillment of theories per se that poses an ethical challenge, in contrast to claims in the literature. (shrink)

When experimental philosophers carry out studies on thought experiments, some participants are excluded based on certain exclusion criteria, mirroring standard social science vignette methodology. This involves excluding people that do not pay attention or who miscomprehend the scenario presented in thought experiments. However, experimental philosophy studies sometimes exclude an alarmingly high number of participants. We argue that this threatens the external and internal validity of the conclusions being drawn and we show how a simple visualization of thought experiments can reduce (...) exclusion rates significantly. Furthermore, we argue that focus should not merely be on how many are excluded, but also why they are excluded, and we highlight the role of comprehension questions in this regard. Philosophical thought experiments often rely on the acceptance of certain key premises that may be regarded contestable, and asking comprehension questions involving such key assumptions could be problematic as that may result in some participants being inadvertently excluded from the study, potentially creating a selection bias. (shrink)

Rapid individual cognitive phenotyping holds the potential to revolutionize domains as wide‐ranging as personalized learning, employment practices, and precision psychiatry. Going beyond limitations imposed by traditional lab‐based experiments, new efforts have been underway toward greater ecological validity and participant diversity to capture the full range of individual differences in cognitive abilities and behaviors across the general population. Building on this, we developed Skill Lab, a novel game‐based tool that simultaneously assesses a broad suite of cognitive abilities while providing an engaging (...) narrative. Skill Lab consists of six mini‐games as well as 14 established cognitive ability tasks. Using a popular citizen science platform (N = 10,725), we conducted a comprehensive validation in the wild of a game‐based cognitive assessment suite. Based on the game and validation task data, we constructed reliable models to simultaneously predict eight cognitive abilities based on the users’ in‐game behavior. Follow‐up validation tests revealed that the models can discriminate nuances contained within each separate cognitive ability as well as capture a shared main factor of generalized cognitive ability. Our game‐based measures are five times faster to complete than the equivalent task‐based measures and replicate previous findings on the decline of certain cognitive abilities with age in our large cross‐sectional population sample (N = 6369). Taken together, our results demonstrate the feasibility of rapid in‐the‐wild systematic assessment of cognitive abilities as a promising first step toward population‐scale benchmarking and individualized mental health diagnostics. (shrink)