During multiple testing, researchers often adjust their alpha level to control the familywise error rate for a statistical inference about a joint union alternative hypothesis (e.g., “H1,1 or H1,2”). However, in some cases, they do not make this inference. Instead, they make separate inferences about each of the individual hypotheses that comprise the joint hypothesis (e.g., H1,1 and H1,2). For example, a researcher might use a Bonferroni correction to adjust their alpha level from the conventional level of 0.050 (...) to 0.025 when testing H1,1 and H1,2, find a significant result for H1,1 (p < 0.025) and not for H1,2 (p > .0.025), and so claim support for H1,1 and not for H1,2. However, these separate individual inferences do not require an alpha adjustment. Only a statistical inference about the union alternative hypothesis “H1,1 or H1,2” requires an alpha adjustment because it is based on “at least one” significant result among the two tests, and so it refers to the familywise error rate. Hence, an inconsistent correction occurs when a researcher corrects their alpha level during multiple testing but does not make an inference about a union alternative hypothesis. In the present article, I discuss this inconsistent correction problem, including its reduction in statistical power for tests of individual hypotheses and its potential causes vis-à-vis error rate confusions and the alpha adjustment ritual. I also provide three illustrations of inconsistent corrections from recent psychology studies. I conclude that inconsistent corrections represent a symptom of statisticism, and I call for a more nuanced inference-based approach to multiple testing corrections. (shrink)

Scientists often adjust their significance threshold during null hypothesis significance testing in order to take into account multiple testing and multiple comparisons. This alpha adjustment has become particularly relevant in the context of the replication crisis in science. The present article considers the conditions in which this alpha adjustment is appropriate and the conditions in which it is inappropriate. A distinction is drawn between three types of multiple testing: disjunction testing, conjunction testing, (...) and individual testing. It is argued that alpha adjustment is only appropriate in the case of disjunction testing, in which at least one test result must be significant in order to reject the associated joint null hypothesis. Alpha adjustment is inappropriate in the case of conjunction testing, in which all relevant results must be significant in order to reject the joint null hypothesis. Alpha adjustment is also inappropriate in the case of individual testing, in which each individual result must be significant in order to reject each associated individual null hypothesis. The conditions under which each of these three types of multiple testing is warranted are examined. It is concluded that researchers should not automatically assume that alpha adjustment is necessary during multiple testing. Illustrations are provided in relation to joint studywise hypotheses and joint multiway ANOVAwise hypotheses. (shrink)

Bechtel and Mundale (1999) argue that multiple realizability is not plausible. They point out that neuroscientists assume that psychological traits are realized similarly in homologous brain structures and contend that a biological aspect of the brain that is relevant to neuropsychological state individuation provides evidence against multiple realizability. I argue that Bechtel and Mundale adduce the wrong sort of evidence against multiple realizability. Homologous traits do not provide relevant evidence. It is homoplasious traits of brains that can (...) provide evidence for or against multiple realizability. (shrink)

When conceived as an empirical claim, it is natural to wonder how one might test the hypothesis of multiple realization. I consider general issues of testability, show how they apply specifically to the hypothesis of multiple realization, and propose an auxiliary assumption that, I argue, must be conjoined to the hypothesis of multiple realization to ensure its testability. I argue further that Bechtel and Mundale go astray because they fail to appreciate the need for this auxiliary assumption. (...) †To contact the author, please write to: Department of Philosophy, University of Wisconsin–Madison, 5185 Helen C. White Hall, 600 North Park Street, Madison, WI 53706; e‐mail: [email protected]. (shrink)

In response to comments, I repeat and further support the proposal that valence and arousal cannot serve as independent factors of motivated distance perception, but can be incorporated into the model as features of motivational direction. I articulate the importance of eliciting experiences to predict the direction of motivational direction, suggest additional ways to measure motivational direction, and direct the reader to extensive literatures that have illustrated conditions that give rise to approach and avoidance. Finally, I conjecture on how the (...) motivated distance perception model can be further developed. (shrink)

ABSTRACTThis article considers some analogies for religion which are so common in our ordinary language that they might pass without notice. I explore five in detail to show how each in different ways limits what we can say, and indeed think, about religion. By using multiple religious belonging as an example, I am able to compare the things we ordinarily say about religion with the complexities of real, lived religion and illustrate some of the ways in which our analogies (...) for religion fall short. Many of these analogies are so ‘natural’ – so deeply embedded in the ways ordinary language works – that without this specific attention, they can shape what can be said about religion without the speaker noticing. Often, this makes things which the sociological evidence shows people are getting on and doing, like practising multiple religious belonging, seem ‘impossible’ when we try to describe them. By paying attention to the analogies which underlie this sensation, I am able to show that a wider variety of analogies, used with more conscious attention, can be employed to allow us to think more clearly about complex lived religion, including multiple religious belonging. (shrink)

Duhem's and Quine's holistic theses, when properly understood, allow methodologically responsible ways of resolving a conflict between a theoretical system and experience; they only deny the possibility of doing it in an epistemically persuasive way. By developing a "string" model of scientific tests I argue that the pattern of interaction between the elements of a theoretical system arising in response to multiple adverse data can be helpful in locating a "weak spot" in it. Combining this model with anti-holistic arguments (...) of Popper, Greenwood, and Lakatos significantly reinforces their joint power. (shrink)

A form of context-appropriate verificationism is proposed that distinguishes between scientific theories as evolving systems of ideas and operationally-specified, testable formal-empirical models. Theories undergo three stages : a formative, exploratory, heuristic phase of theory conception, a developmental phase of theory-pruning and refinement, and a mature, rigorous phase of testing specific, explicit models. The first phase depends on Feyerabendian open possibility, the second on theoretical plausibility and internal coherence, and the third on testability. Multiple perspectives produce variety necessary for (...) theory formation, whereas explicit agreement on evaluative criteria is essential for testing. Hertzian observer-mechanics of empirical-deductive scientific models are outlined that use semiotic operations of measurement/evaluation, computation, and physical action/construction. If models can be fully operationalized, then they can be intersubjectively verified irrespective of metaphysical, theoretical, value-, or culture-based disagreements. Verificationism can be expanded beyond simple predictive efficacy to incorporate testing for pragmatic, functional efficacy in engineering, medicine, and design contexts. Such a more open, pragmatist, operationalist, epistemically-constructivist perspective is suggested in which verification is contingent on the type of assertion, its intended purpose, degree and reliability of model-based evidence, and existence of alternate, competing predictive models. Suggestions for epistemological hygiene amidst the world-wide pandemic of misinformation and propaganda are offered. (shrink)

Entangled states provide the necessary tools for conceptual tests of quantum mechanics and other alternative theories. These tests include local hidden variables theories, pre- and postselective quantum mechanics, QND measurements, complementarity, and tests of quantum mechanics itself against, e.g., the so-called causal communication constraint. We show how to produce various nonlocal entangled states of multiple cavity fields that are useful for these tests, using cavity QED techniques. First, we discuss the generation of the Bell basis states in two entangled (...) cavities, when there is at most one photon in either of the cavities, and then a straightforward generalization to similar N-cavity states. We then show how to produce a nonlocal entangled state when there is precisely one photon hiding in three cavities. These states can be produced by sending appropriately prepared atoms through the cavities. As applications we briefly review two proposals: one to test quantum mechanics against the causal communication constraint using a two-cavity entangled state and the other to test pre- and postselective quantum mechanics using a three-cavity entangled state. The outcome of the latter experiment can be discussed from the viewpoint of the consistent histories interpretation of quantum mechanics and therefore provides an opportunity to subject quantum cosmological ideas to laboratory tests. Finally, we point out the relation between these schemes and the schemes suggested for quantum computing, teleportation, and quantum copying. (shrink)

This article reviews recent work aimed at developing a new framework, based on signal detection theory, for understanding the relationship between explicit (e.g., recognition) and implicit (e.g., priming) memory. Within this framework, different assumptions about sources of memorial evidence can be framed. Application to experimental results provides robust evidence for a single-system model in preference to multiple-systems models. This evidence comes from several sources including studies of the effects of amnesia and ageing on explicit and implicit memory. The framework (...) allows a range of concepts in current memory research, such as familiarity, recollection, fluency, and source memory, to be linked to implicit memory. More generally, this work emphasizes the value of modern computational modelling techniques in the study of learning and memory. (shrink)

The effects of striatal dopamine (DA) on behavior have been widely investigated over the past decades, with “phasic” burst firings considered as the key expression of a reward prediction error responsible for reinforcement learning. Less well studied is “tonic” DA, where putative functions include the idea that it is a regulator of vigor, incentive salience, disposition to exert an effort and a modulator of approach strategies. We present a model combining tonic and phasic DA to show how different outflows triggered (...) by either intrinsically or extrinsically motivating stimuli dynamically affect the basal ganglia by impacting on a selection process this system performs on its cortical input. The model, which has been tested on the simulated humanoid robot iCub interacting with a mechatronic board, shows the putative functions ascribed to DA emerging from the combination of a standard computational mechanism coupled to a differential sensitivity to the presence of DA across the striatum. (shrink)

This study aims to explore the multiple mediating effects of political skills and entrepreneurial opportunity recognition between perceived entrepreneurship education and innovation. Structural equation is used to analyze data collected from 269 Chinese student entrepreneurs. Results showed that (1) There is a positive relationship between perceptions of entrepreneurship education and perceptions of innovation, (2) political skills and entrepreneurial opportunity recognition separately play a mediating role between perceived entrepreneurship education and innovation, and (3) political skills and entrepreneurial opportunity recognition play (...) a chain mediating effect between perceived entrepreneurship education and innovation. (shrink)

We offer a case-study in irrationality, showing that even in a high stakes context, intelligent and well trained professionals may adopt dominated practices. In multiple-choice tests one cannot distinguish lucky guesses from answers based on knowledge. Test-makers have dealt with this problem by lowering the incentive to guess, through penalizing errors (called formula scoring), and by eliminating various cues for outperforming random guessing (e.g., a preponderance of correct answers in middle positions), through key balancing. These policies, though widespread and (...) intuitively appealing, are in fact ‘‘irrational’’, and are dominated by alternative solutions. Number-right scoring is superior to formula scoring, and key randomization is superior to key balancing. We suggest that these policies have persisted since all stake-holders – test-makers, test-takers and test-coaches – share the same faulty intuitions. (shrink)

This article considers the experiences of health consumers who have undergone testing for human immunodeficiency virus antibodies, T cells, and viral load. These HIV-related tests are deployed for the purposes of making definitive diagnoses; yet some test consumers experience ambiguous outcomes. Drawing on an analysis of differing end-user experiences of these tests, where consumers' knowledge reflected the multiplicity and heterogeneity in test design, the author explores how these experiences reflect particular knowledges about these tests. The article contributes to efforts (...) analyzing how health consumers are active end users co-constructing the social meaning of technologies in mutual relationship with other users. The author discusses how this new knowledge can be used to delineate a greater role for consumer evaluation of medical testing within a broader understanding of test design and performance. Relevant links are made to issues such as genetic testing and assessing claims about the efficacy of medical tests. (shrink)

This article explores the extent to which multiple-choice history/social studies exams measure student knowledge of social studies content. This article presents descriptive statistics that quantify the findings from a qualitative study. Data for this study were collected from 13 tenth-grade world history students in an urban classroom in New York State. Each participant answered 15 multiple-choice questions that had appeared on previous versions of the Global History and Geography Regents exam, the high-stakes exam they would have to take (...) at the end of the school year. As a small-scale exploratory study, the findings are not what quantitative researchers would call generalizable. Nevertheless, the findings raise questions about what tests measure, their effectiveness, and what constitutes social-studies knowledge. (shrink)

Multiple goals balancing is an important but not yet fully validated dimension of complex problem solving (CPS). The present study used process data to explore how solvers clarify goals, set priorities, and balance conflicting goals. We extracted behavioral indicators of goal pursuit from the log data of 3,201 students on the third subtask of the “Ticket” task in the PISA 2012 CPS test. Cluster analysis was used to identify 10 groups that varied in goal pursuit behavior. Logistics and least-squares (...) regression analysis were used to explore how goal pursuit affected task scores and CPS proficiency. The results showed that competent solvers clarified goals and weighed priorities more effectively. They also made trade-offs between conflicting goals. The importance of theoretically-driven log data analysis and coping strategies in the face of multiple goals conflict scenarios was discussed. (shrink)

Previous research has suggested that an effective strategy for debiasing judgments is to have participants "consider the opposite." The present research proposes that considering any plausible alternative outcome for an event, not just the opposite outcome, leads participants to simulate multiple alternatives, resulting in debiased judgments. Three experiments tested this hypothesis using an explanation task paradigm. Participants in all studies were asked to explain either 1 hypothetical outcome (single explanation conditions) or 2 hypothetical outcomes (multiple explanation conditions) to (...) an event; after the explanation task, participants made likelihood judgments. The results of Studies 1 and 2 indicated that debiasing occurred in all multiple explanation conditions, including those that did not involve the opposite outcome. Furthermore, the findings indicated that debiased judgments resulted from participants' spontaneous consideration of additional alternatives in making their likelihood judgments. The results of Study 3 also identified the perceived plausibility of the explained alternative as an important moderating variable in debiasing. (shrink)

The crisis of replication has led many to blame statistical significance tests for making it too easy to find impressive looking effects that do not replicate. However, the very fact it becomes difficult to replicate effects when features of the tests are tied down actually serves to vindicate statistical significance tests. While statistical significance tests, used correctly, serve to bound the probabilities of erroneous interpretations of data, this error control is nullified by data-dredging, multiple testing, and other biasing (...) selection effects. Arguments claiming to vitiate statistical significance tests attack straw person variants of tests that commit well-known fallacies and misinterpretations. There is a tension between popular calls for preregistration – arguably, one of the most promising ways to boost replication – and accounts that downplay error probabilities: Bayes Factors, Bayesian posteriors, likelihood ratios. By underscoring the importance of error control for well testedness, the replication crisis points to reformulating tests so as to avoid fallacies and report the extent of discrepancies that are and are not indicated with severity. (shrink)

The ?Dimensioned? view analyzes (multiple) realization in terms of compositional relation, and the ?Flat? view analyzes (multiple) realization in terms of causal-functional mechanism. The two different analyses of realization lead to the disagreement about whether realization is transitive. The two views, perhaps not surprisingly, have different consequences on testing for multiple realization, and prescribe different ?reconstructions? for the evidential significance of observation for multiple realization. I examine the differences between the two views on testing (...) for multiple realization within a model-selection theoretical framework. I claim that the model-selection theoretical framework provides a ground to discuss and assess evidence for multiple realization. (shrink)

It is commonly hypothesized that scientists are more likely to engage in data falsification and fabrication when they are subject to pressures to publish, when they are not restrained by forms of social control, when they work in countries lacking policies to tackle scientific misconduct, and when they are male. Evidence to test these hypotheses, however, is inconclusive due to the difficulties of obtaining unbiased data. Here we report a pre-registered test of these four hypotheses, conducted on papers that were (...) identified in a previous study as containing problematic image duplications through a systematic screening of the journal PLoS ONE. Image duplications were classified into three categories based on their complexity, with category 1 being most likely to reflect unintentional error and category 3 being most likely to reflect intentional fabrication. We tested multiple parameters connected to the hypotheses above with a matched-control paradigm, by collecting two controls for each paper containing duplications. Category 1 duplications were mostly not associated with any of the parameters tested, as was predicted based on the assumption that these duplications were mostly not due to misconduct. Categories 2 and 3, however, exhibited numerous statistically significant associations. Results of univariable and multivariable analyses support the hypotheses that academic culture, peer control, cash-based publication incentives and national misconduct policies might affect scientific integrity. No clear support was found for the “pressures to publish” hypothesis. Female authors were found to be equally likely to publish duplicated images compared to males. Country-level parameters generally exhibited stronger effects than individual-level parameters, because developing countries were significantly more likely to produce problematic image duplications. This suggests that promoting good research practices in all countries should be a priority for the international research integrity agenda. (shrink)

The past two decades have witnessed a revival of interest in multiple realization and multiply realized kinds. Bechtel and Mundale’s (1999) illuminating discussion of the subject must no doubt be credited with having generated much of this renewed interest. Among other virtues, their paper expresses what seems to be an important insight about multiple realization: that unless we keep a consistent grain across realized and realizing kinds, claims alleging the multiple realization of psychological kinds are vulnerable to (...) refutation. In this paper I argue that, intuitions notwithstanding, the terms of their recommendation make it impossible to follow, while also misleadingly insinuating that its application virtually guarantees mind-brain identity. Instead of a matching of grains, what multiple realization really requires is a principled method for adjudicating upon differences between tokens. Shapiro’s (2000) work on multiple realization can be understood as an attempt to adumbrate just such a method. While his “causal relevance” criterion can easily be mistaken for Bechtel and Mundale’s grain requirement, my analysis reveals exactly where and why these two tests diverge. (shrink)

Two experiments were conducted to examine adult learners' ability to extract multiple statistics in simultaneously presented visual and auditory input. Experiment 1 used a cross‐situational learning paradigm to test whether English speakers were able to use co‐occurrences to learn word‐to‐object mappings and concurrently form object categories based on the commonalities across training stimuli. Experiment 2 replicated the first experiment and further examined whether speakers of Mandarin, a language in which final syllables of object names are more predictive of category (...) membership than English, were able to learn words and form object categories when trained with the same type of structures. The results indicate that both groups of learners successfully extracted multiple levels of co‐occurrence and used them to learn words and object categories simultaneously. However, marked individual differences in performance were also found, suggesting possible interference and competition in processing the two concurrent streams of regularities. (shrink)

Repetition learning is an efficient way to enhance memory performance in our daily lives and educational practice. However, it is unclear to what extent repetition or multiple exposures modulate different types of memory over time. The inconsistent findings on it may be associated with encoding strategy. In this study, participants were presented with pairs of pictures once or three times and were asked to make a same/similar/different judgment. By this, an elaborative encoding is more required for the “same” and (...) “similar” conditions than the “different” condition. Then after intervals of 10 min, 1 day, and 1 week, they were asked to perform a recognition test to discriminate a repeated and a similar picture, followed by a remember/know/guess assessment and a contextual judgment. The results showed that after learning the objects three times, both item memory and contextual memory improved. Multiple exposures enhanced the hit rate for the “same” and “similar” conditions, but did not change the false alarm rate significantly. The recollection, rather than the familiarity, contributed to the repetition effect. In addition, the memory enhancement was manifested in each encoding condition and retention interval, especially for the “same” condition and at 10-min and 1-day intervals. These results clarify how repetition influences item and contextual memories during discriminative learning and suggest that multiple exposures render the details more vividly remembered and retained over time when elaborative encoding is emphasized. (shrink)

This study aimed to investigate the serial-multiple mediation effect of professional identity, psychological capital, work-related stress, and work-related wellbeing among intensive care unit nurses in China. The cross-sectional survey was conducted from January 2017 to May 2017 in two Grade III A general hospitals in Jining, Shandong Province, China. Cluster sampling was used to recruit participants from the two hospitals. A total of 330 ICU nurses participated in the study. The nurses’ work stress scale, Chinese nurse’s professional identity scale, (...) the PsyCap questionnaire, and Chinese work-related wellbeing scale were used to collect the data. Descriptive analysis, independent-samples t-test, one-way analysis of variance, Pearson correlation analysis, linear regression analysis, and structural equation modeling were used to analyze the data. The average score for the work-related wellbeing of ICU nurses was 85.91 ± 13.94. Work-related stress, professional identity, and PsyCap correlated significantly with work-related wellbeing. The major predictors of work-related wellbeing were PsyCap, work-related stress, professional identity, and monthly salary. The serial-multiple mediation effects of professional identity and PsyCap in the relationship between work-related stress and work-related wellbeing were statistically significant. Positive professional identity and PsyCap were sequentially associated with decreased work-related stress, which in turn was related to increased work-related wellbeing among ICU nurses. Therefore, this study aims to explore the impact of ICU nurses’ work-related stress on work-related wellbeing, as well as the mediating effect of professional identity and PsyCap. It is hoped that hospital care managers will pay attention to the mental health of ICU nurses, increase their professional identity, and reduce work-related stress to improve the quality of the ICU nursing service and stabilize nursing work. (shrink)

Multiple team membership is a form of work organization extensively used nowadays to flexibly deploy human resources across multiple simultaneous projects. Individual members bring in their cognitive resources in these multiple teams and at the same time use the resources and competencies developed while working together. We test in an experimental study whether working in MTM as compared to a single team yields more individual performance benefits in estimation tasks. Our results fully support the group-to-individual transfer of (...) learning, yet the hypothesized benefits of knowledge variety and broader access to meta-knowledge relevant to the task in MTM as compared to single teams were not supported. In addition, we show that individual estimates improve only when members are part of groups with low or average collective estimation errors, while confidence in individual estimates significantly increases only when the collective confidence in the group estimates is average or high. The study opens valuable venues for using the dynamic model of G-I transfer of learning to explore individual learning in MTM. (shrink)

Variational evolutionary theory as advocated by Darwin is not a single theory, but a bundle of related but independent theories, namely: (a) variational evolution; (b) gradualism rather than large leaps; (c) processes of phyletic evolution and of speciation; (d) causes for the formation of varying individuals in populations and for the action of selective agents; and (e) all organisms evolved from a common ancestor. The first four are nomological-deductive explanations and the fifth is historical-narrative. Therefore evolutionary theory must be divided (...) into nomological and historical theories which are both testable against objective empirical observations. To be scientific, historical evolutionary theories must be based on well corroborated nomological theories, both evolutionary and functional. Nomological and general historical evolutionary theories are well tested and must be considered as strongly corroborated scientific theories. Opponents of evolutionary theory are concerned only with historical evolutionary theories, having little interest in nomological theory. Yet given a well corroborated nomological evolutionary theory, historical evolutionary theories follow automatically. If understood correctly, both forms of evolutionary theories stand on their own as corroborated scientific theories and should not be labeled as facts. (shrink)