Note posted 9 Jun 08 : Modifications made today include a new section on predictive validity, and addition of recently published article and in in-press article, both by Nosek & Hansen, under the "CULTURE VS. PERSON" heading, which replaces a previously listed unpublished ms. of theirs. I continue to encourage all interested to send material that they are willing to be included on this page. Please also to let me know about errors, including faulty links.

The Defining Issues Test (DIT) has been widely used in psychological experiments to assess one’s developmental level of moral reasoning in terms of postconventional reasoning. However, there have been concerns regarding whether the tool is biased across people with different genders and political and religious views. To address the limitations, in the present study, I tested the validity of the brief version of the test, that is, the behavioral DIT, in terms of the measurement invariance and differential item (...) functioning (DIF). I could not find any significant non-invariance at the test level or any item demonstrating practically significant DIF at the item level. The findings indicate that neither the test nor any of its items showed a significant bias toward any particular group. As a result, the collected validity evidence supports the use of test scores across different groups, enabling researchers who intend to examine participants’ moral reasoning development across heterogeneous groups to draw conclusions based on the scores. (shrink)

Introduction The Defining Issues Test (DIT) aimed to measure one’s moral judgment development in terms of moral reasoning. The Neo-Kohlbergian approach, which is an elaboration of Kohlbergian theory, focuses on the continuous development of postconventional moral reasoning, which constitutes the theoretical basis of the DIT. However, very few studies have directly tested the internal structure of the DIT, which would indicate its construct validity. Objectives Using the DIT-2, a later revision of the DIT, we examined whether a bi-factor model (...) or 3-factor CFA model showed a better model fit. The Neo-Kohlbergian theory of moral judgment development, which constitutes the theoretical basis for the DIT-2, proposes that moral judgment development occurs continuously and that it can be better explained with a soft-stage model. Given these assertions, we assumed that the bi-factor model, which considers the Schema-General Moral Judgment (SGMJ), might be more consistent with Neo-Kohlbergian theory. Methods We analyzed a large dataset collected from undergraduate students. We performed confirmatory factor analysis (CFA) via weighted least squares. A 3-factor CFA based on the DIT-2 manual and a bi-factor model were compared for model fit. The three factors in the 3-factor CFA were labeled as moral development schemas in Neo-Kohlbergian theory (i.e., personal interests, maintaining norms, and postconventional schemas). The bi-factor model included the SGMJ in addition to the three factors. Results In general, the bi-factor model showed a better model fit compared with the 3-factor CFA model although both models reported acceptable model fit indices. Conclusion We found that the DIT-2 scale is a valid measure of the internal structure of moral reasoning development using both CFA and bi-factor models. In addition, we conclude that the soft-stage model, posited by the Neo-Kohlbergian approach to moral judgment development, can be better supported with the bi-factor model that was tested in the present study. (shrink)

This paper looks at the question of what it means for a psychological test to have construct validity. I approach this topic by way of an analysis of recent debates about the measurement of implicit social cognition. After showing that there is little theoretical agreement about implicit social cognition, and that the predictive validity of implicit tests appears to be low, I turn to a debate about their construct validity. I show that there are two questions at stake: First, (...) what level of detail and precision does a construct have to possess such that a test can in principle be valid relative to it? And second, what kind of evidence needs to be in place such that a test can be regarded as validated relative to a given construct? I argue that construct validity is not an all-or-nothing affair. It can come in degrees, because both our constructs and our knowledge of the explanatory relation between constructs and data can vary in accuracy and level of detail, and a test can fail to measure all of the features associated with a construct. I conclude by arguing in favor of greater philosophical attention to processes of construct development. (shrink)

Purpose: This study aimed to develop a stroke effectiveness test in table tennis based on the temporal game structure to assess the ball speed and ball placement of the players, with a purpose to analyze its reproducibility and validity. Methods: Nineteen male table tennis players participated in this study. The test was performed twice during the first session and once during the second session to assess the intrasession and intersession reproducibility, respectively. Moreover, the test was examined on (...) its ability to discriminate between regional and local performance-level players and on the relationship between the test results and the table tennis performance to assess the discriminant and concurrent validity, respectively. In general, the test consisted of 11 simulated rallies of 2–5 balls with the effort and rest ratio of 0.5, and focused on attack with offensive strokes at defensive balls delivered by a robot randomly between the left and right positions on the table. Results: Ball speed, ball placement, and ball speed-ball placement index showed satisfactory reliability and agreement outcomes. Additionally, the Bland-Altman plots show the systematic error of the analyses closer to 0, and that most values were within the limits of agreements. Concerning validity analyses, regional players had higher scores of ball placement and ball speed-ball placement index as well as made fewer errors than local players. Moreover, ball placement, ball speed-ball placement index, and percentage error presented a strong and significant correlation with table tennis performance. However, ball speed was slightly different between the regional than local players and this variable was not related to table tennis performance. Conclusion: Our findings show evidences that the test is reproducible. Moreover, discriminant and concurrent validity are confirmed for ball placement and ball speed-ball placement index. (shrink)

Attempts by 20th century philosophers of science to define inductive concepts and methods concerning the support provided to scientific theories by empirical data have been unsuccessful. Although 20th century philosophers of science largely ignored statistical methods for testing theories, when they did address them they argued against rather than for their use. In contrast, this study demonstrates that traditional statistical methods used for validating computer simulation models provide tests of the scientific theories that those models may embody. This study shows (...) that these statistical methods are applicable regardless of whether the scientific theory or model is deterministic, stochastic, or chaos-based in nature. Traditional statistical methods, such as hypothesis testing, test theories by providing measures of their goodness-of-fit with the portion of the world the theories describe. Nothing more is needed to portray the agreement between theory and the world. Furthermore, the statistical measures of goodness-of-fit are not ampliative inductive measures. Therefore, the ultimate value and direction of the 20 th century ampliative inductive program within philosophy of science is thrown into question. This study also suggests that advanced statistical, visualization, and hybrid quantitative qualitative methods hold promise for offering scientists additional methods for testing scientific theories through validating their computer model representations. As a prerequisite to the above discussions, this study proves that scientific theories, when applied to concrete physical systems, can indeed be represented by computer models. (shrink)

The concept of emotional intelligence (EI) has drawn a great amount of scholarly interest in recent years; however, attempts to measure individual differences in this ability remain controversial. Although the Mayer–Salovey–Caruso Emotional Intelligence Test (MSCEIT) remains the flagship test of EI, no study has comprehensively examined the full interpretive argument tying variation in observed test performance to variation in the underlying ability. Employing a modern perspective on validation, this article reviews and synthesizes available evidence and discusses (...) sources of concern at every level of the interpretive argument. It is argued that a focus on causal explanation of observed variation in test performance would significantly improve the validity of the MSCEIT as a measure of EI. (shrink)

BackgroundThe aim of this study was to explore the construct validity and diagnostic properties of the Reading the Mind in the Eyes Test in non-demented patients with amyotrophic lateral sclerosis.MaterialsA total of 61 consecutive patients and 50 healthy controls were administered the 36-item RMET. Additionally, patients underwent a comprehensive assessment of social cognition via the Story-Based Empathy Task, which encompasses three subtests targeting Causal Inference, Emotion Attribution, and Intention Attribution, as well as global cognitive [the Edinburgh Cognitive and Behavioral (...) ALS Screen ] and behavioral screening [the Frontal Behavioral Inventory ; the Dimensional Apathy Scale ; the Beck Depression Inventory ; and the State and Trait Anxiety Inventory-Y]. The construct validity of the RMET was tested by regressing it within a stepwise model that encompassed as predictors the abovementioned cognitive and behavioral measures, covarying for demographic and motor confounders. Receiver-operating characteristics analyses allowed exploring intrinsic and post-test properties of the RMET both in discriminating patients from HCs and in identifying patients with a defective SET-EA performance.ResultsThe RMET was solely predicted by the SET-EA and SET-IA. RMET scores showed high accuracy both in discriminating patients from HCs and in identifying patients with a defective SET-EA score, with adequate-to-optimal both intrinsic and post-test properties.DiscussionThe RMET is a convergently and divergently valid measure of affective social cognition in non-demented ALS patients, also featuring optimal intrinsic and post-test diagnostic properties in both case-control and case-finding scenarios. (shrink)

Background: The Multidimensional Inventory for Religious/Spiritual Well-Being was developed in order to address a religious/spiritual dimension as being an important part of psychological well-being. In the meantime, the instrument has been successfully applied in numerous studies. Subsequently, a short version, the MI-RSWB 12 was constructed, especially for the use in clinical assessment. Here it is intended to contribute to the further development of the MI-RSWB 12 by investigating its structural validity through structural equation modeling.Materials and Methods: A total sample of (...) 1,097 German-speaking adults from the normal population filled in the MI-RSWB 12 via an online-survey. In line with theoretical assumptions 5 different factor structure models for the MI-RSWB 12 were tested: a single-factor model, a model with four correlated RSWB dimensions, a single higher-order model with four lower order factors, a two higher-order model with four lower order factors, a bifactor model, which includes four specific RSWB dimensions.Results: The single-factor model provided the poorest model fit, with no indices falling within the acceptable range. The four-factor, two higher-order factors and the bifactor models showed overall acceptable fit indices. With regard to the Akaike information criterion, the four-factor model demonstrated superiority compared to both the two higher-order factor model and the bifactor model, which in turn showed did not differ from each other.Conclusion: Four different MI-RSWB 12 sub-scales should be calculated in future studies, while a general factor and two higher order factors are statistically valid as well. Further applications of the MI-RSWB 12, especially in the clinical patient groups, are encouraged. (shrink)

This study assessed the International Critical Thinking Essay Test (ICTET-A) for inter-rater reliability, internal reliability, and criterion validity. A self-selecting sample of participants (N = 100) completed the ICTET-A and a comparison test online. We found the ICTET-A items to have moderate to good levels of inter-rater reliability, and overall excellent inter-rater consistency for total test scores. The test had good internal reliability. There was a strong correlation between scores on the ICTET-A and the comparison (...) class='Hi'>test. Factor analysis showed that scores were best explained with one factor, suggesting the test measures a single construct. The ICTET-A can therefore be considered a valid measure of critical thinking. Additionally, we propose a short form of the test. (shrink)

Three studies investigated implicit brand attitudes and their relation to explicit attitudes, prod- uct usage, and product differentiation. Implicit attitudes were measured using the Implicit As- sociation Test (IAT; Greenwald, McGhee, & Schwartz, 1998). Study 1 showed expected differ- ences in implicit attitudes between users of two leading yogurt brands, also revealing significant correlations between IAT-measured implicit attitudes and explicit attitudes. In Study 2, users of two fast food restaurants (McDonald’s and Milk Bar) showed implicit attitudi- nal preference for (...) their favorite restaurant. In Study 3, implicit attitudes of users of two soft drinks (Coca-Cola and Pepsi) predicted brand preference, product usage, and brand recognition in a blind taste test. A meta-analytic combination of the three studies showed that the use of IAT measures increased the prediction of behavior relative to explicit attitude measures alone. (shrink)

Critics of animal modeling have advanced a variety of arguments against the validity of the practice. The point of one such form of argument is to establish that animal modeling is pointless and therefore immoral. In this article, critical arguments of this form are divided into three types, the pseudoscience argument, the disanalogy argument, and the predictive validity argument. I contend that none of these criticisms currently succeed, nor are they likely to. However, the connection between validity and morality is (...) important, suggesting that critical efforts would be instructive if they addressed it in a more nuanced way. (shrink)

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, internal consistency was (...) assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a)Intention to use; (b)perceived barriers; and (c)well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale= 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (rangeHscale= 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N= 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N= 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs. (shrink)

In the context of theistic religions, God representations are an important factor in explaining associations between religion/spirituality and well-being/mental health. Although the limitations of self-report measures of God representations are widely acknowledged, well-validated implicit measures are still unavailable. Therefore, we developed an implicit Attachment to God measure, the Apperception Test God Representations. In this study, we examined reliability and validity of an experimental scale based on attachment theory. Seventy-one nonclinical and 74 clinical respondents told stories about 15 cards with (...) images of people. The composite Attachment to God scale is based on scores on two scales that measure dimensions of Attachment to God: God as Safe Haven and God as Secure Base. God as Safe Haven scores are based on two subscales: Asking Support and Receiving Support from God. Several combinations of scores on these latter subscales are used to assess Anxious and Avoidant attachment to God. A final scale, Percentage Secure Base, measures primary appraisal of situations as nonthreatening. Intraclass correlation coefficients showed that the composite Attachment to God scale could be scored reliably. Associations of scores on the ATGR scales and on the explicit Attachment to God Inventory with scores on implicitly and explicitly measured distress partly confirmed the validity of the ATGR scales by demonstrating expected patterns of associations. Avoidant attachment to God seemed to be assessed more validly with the implicit than with the explicit scale. Patients scored more insecure on the composite Attachment to God scale and three subscales than nonpatients. (shrink)

The present study investigated the construct validity of the Test Anxiety Questionnaire, a revised and shortened version of the German Test Anxiety Inventory, by comparing it with math anxiety. A sample of German fifth- and sixth-grade students was analyzed. Math anxiety was measured by a German adaptation of the Math Anxiety Questionnaire. A significant but moderate correlation between test anxiety and math anxiety was found. In regression analyses, math anxiety predicted math performance whereas test anxiety explained (...) additional variance for both math and overall performance. It can be concluded that math and test anxiety have overlaps, but do not constitute the same construct. Thus, the results support the construct validity of the PAF indicating its usefulness in practical application. (shrink)

The Mental Health Literacy Scale is the most widely used and strong theory-based measurement tool to gain an understanding of mental health knowledge and ability. This study aimed to test the psychometric properties of the Chinese version of the Mental Health Literacy Scale and to document the norm and its influential factors of mental health literacy among nurses. The MHLS was translated following Brislin’s translation model and tested with a sample of 872 clinical registered nurses. The Jefferson Scale of (...) Empathy-Health Professionals, Patient Health Questionnaire-2, and Generalized Anxiety Disorder-2 were administered to assess convergent validity. The minimum average partial test, parallel analysis and confirmatory factor analysis supported 4 first-order 2 second-order structure. The 4 factors were named “knowledge of mental disorder,” “ability to seek information and help,” “recognition of mental disorder,” and “acceptance of patients with mental illness,” with factor 1-3 were summarized into MHLS-Core and factor 4 as MHLS-SA. The MHLS-C was moderately negatively correlated with the PHQ-2 and GAD-2 and highly positively correlated with JSE-HP. The Cronbach’s α was 0.85 for the overall scale and 0.89 and 0.93 for two subscales. The test-retest reliability was good, with intraclass correlation coefficients of 0.80 for the whole scale, and 0.79 and 0.94 for two subscales. As an approximately normal distribution, the 50th percentile for the MHLS-C was 99, with 50th percentiles of 74 and 20 for MHLS-Core and MHLS-SA. Higher position, higher professional credentials, higher hospital hierarchy, other specialist hospital, psychiatric hospital and unmarried status were positive predictors. The 29-item MHLS-C, with two subscales of MHLS-Core and MHLE-SA, is a stable and validated tool to measure mental health literacy. MHLS-Core could be used independently to measure the core content of mental health literacy. It may be applicable for Chinese health professionals, but need further validation among the general public. MHL curriculum and a targeted culturally appropriate program for acceptance for health professionals, especially for those in general hospitals and with less working tenure, may be recommended. (shrink)

To facilitate recruitment of conscript cyber soldiers in Sweden, the Cyber Test for Future Soldiers was developed as a complement to the existing generic enrolment test. Consisting of several parts, CTFS measures different aspects of computer-related knowledge and cognitive abilities that we believe are of particular relevance to cyber security. This article describes the evaluation regarding CTFS’s validity and reliability based on data from 62 conscripts that took the test and the 27 selected conscripts finishing the training (...) 1 year later. Reliability was predicted through internal consistency and test–retest measures. Cronbach’s alpha for CTFS ranges from 0.79 to 0.86 whereas the test–retest reliability is 0.60. Evidence regarding validity was collected based on test content and internal structure. Convergent, discriminant, and predictive evidence are also presented. Perhaps most importantly, CTFS could predict the cyber soldiers’ performance during their training and added incremental validity to I-prov 2000. When adjusted for range restriction, I-prov 2000 predicted 20% of the variation in course score, while 34% of the variance was explained when CTFS was used in conjunction with I-prov 2000. The results show that CTFS already in its first version is adding value for the Swedish Armed Forces. (shrink)

The Discounting Inventory, originally developed in polish language, allows the measurement of individual differences in the delay, probabilistic, effort, and social discounting rates. The present study attempted to validate the DI’s psychometric properties using German university students and to compare the results to those from a sample of Polish university students. Over four hundred participants completed the DI and traditional discounting measures. A confirmatory factor analyses indicated that the original four-factor model of the DI provided an excellent fit for the (...) German data and internal consistency was high. These outcomes were similar, if not superior, to those from the Polish sample. DI scores strongly correlated with traditional discounting measures scores in both samples, replicating previous results. These findings indicate that the DI is a valid measure for use in a sample from another cultural setting, which is potentially useful to both researchers and practitioners. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

Despite the importance of knowing the cognitive capabilities of children with neurodevelopmental conditions, less than one-third of children with cerebral palsy participate in standardized assessments. Globally, approximately 50% of people with cerebral palsy have an intellectual disability and there is significant risk for domain-specific cognitive impairments for the majority of people with cerebral palsy. However, standardized cognitive assessment tools are not accessible to many children with cerebral palsy, as they require manual manipulation of objects, verbal response and/or speeded response. As (...) such, standardised assessment may result in an underestimation of abilities for children with significant motor and/or speech impairment. The overall aim of the project is to examine and compare the psychometric properties of standardised cognitive assessment tools that have been accommodated for use with either a switch device or eye-gaze control technologies, with the specific aims to: Examine the psychometric properties of accommodated assessment tools by comparing the performance of typically developing children on six cognitive assessment tools administered via standardised versus accommodated administration; Describe and compare the performance and user experience of children with cerebral palsy on six accommodated cognitive assessments administered via switch or eye-gaze control technologies. Secondary aims are to: Describe the completion rates and time to complete assessments of participants in each group; Within the group with cerebral palsy, examine the effects of condition-specific characteristics and demographics on participation. This protocol paper describes a two-phase validation and acceptability study that utilizes a mixed-model design. This study will collect concurrent data from 80 typically developing children and 40 children with cerebral palsy, who use switch or eye-gaze control technology as alternate access communication methods. The set of instruments will measure receptive vocabulary, fluid reasoning, sustained attention, vision perception, visuospatial working memory and executive functions. Data analyses will be conducted using SPSS v. 25 and R v 4.1.0. SPSS Sample Power 3 was used for power computation and allows for a 10% drop out rate. Quantitative descriptive statistics, measurement agreement data plotting, bivariate and multiple regressions analysis will be conducted using appropriate methods. (shrink)

Social attachment can explain well the bond between users and social media, but existing research lacks measures of social attachment scales. To this end, this study takes attachment theory as the basis for scale development. On the basis of the development of multidimensional scales for adult, brand, and local attachment, it combines existing relevant studies on social attachment, selects three representative social media such as TikTok, WeChat, and MicroBlog as theoretical samples, explores the concept and structure of social attachment, and (...) develops a social attachment scale through qualitative interviews and open-ended questionnaires. This study applied SPSS 24.0 and Mplus 7.0 to test the social attachment scale. The findings reveal that social attachment consists of three constructs: social connection, social dependence and social identity, and the scale possesses high reliability and validity. This study has developed and validated a social attachment scale in the context of social software use, realizing a quantitative study of social attachment and providing a basis for future empirical research related to social attachment. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

We evaluated the reliability, validity, and differential item functioning (DIF) of a shorter version of the Defining Issues Test-1 (DIT-1), the behavioral DIT (bDIT), measuring the development of moral reasoning. 353 college students (81 males, 271 females, 1 not reported; age M = 18.64 years, SD = 1.20 years) who were taking introductory psychology classes at a public University in a suburb area in the Southern United States participated in the present study. First, we examined the reliability of the (...) bDIT using Cronbach’s α and its concurrent validity with the original DIT-1 using disattenuated correlation. Second, we compared the test duration between the two measures. Third, we tested the DIF of each question between males and females. Findings reported that first, the bDIT showed acceptable reliability and good concurrent validity. Second, the test duration could be significantly shortened by employing the bDIT. Third, DIF results indicated that the bDIT items did not favour any gender. Practical implications of the present study based on the reported findings are discussed. (shrink)

This article discusses the need for more satisfactory implicit measures in consumer psychology and assesses the theoretical foundations, validity, and value of the Implicit Association Test (IAT) as a measure of implicit consumer social cognition. Study 1 demonstrates the IAT’s sensitivity to explicit individual differences in brand attitudes, ownership, and usage frequency, and shows their correlations with IAT-based measures of implicit brand attitudes and brand relationship strength. In Study 2, the contrast between explicit and implicit measures of attitude toward (...) the ad for sportswear advertisements portraying African American (Black) and European American (White) athlete–spokespersons revealed different patterns of responses to explicit and implicit measures in Black and White respondents. These were explained in terms of self-presentation biases and system justification theory. Overall, the results demonstrate that the IAT enhances our understanding of consumer responses, particularly when consumers are either unable or unwilling to identify the sources of influence on their behaviors or opinions. (shrink)

Professionals in business and law, healthcare providers, educators, policymakers, consumers, and higher education practitioners value ethical reasoning skills. Because of this, we concentrated campus-wide reaccreditation efforts to help students actively engage in ER. In doing so, we re-conceptualized the ER process, implemented campus-wide ER interventions designed to be experienced by all undergraduate students, and created the ethical reasoning identification test to measure students’ ability to engage in a foundational step in the ER process. Using factor analysis, we demonstrated internal (...) validity evidence for ERIT scores. More specifically, confirmatory factor analysis provided support for a unidimensional factor structure, meaning stakeholders can report and analyze ERIT total scores. The unidimensional factor structure was replicated using two independent samples. Across all samples, ERIT scores demonstrated reliability consistent with professional standards. In addition, we collected external validity evidence for ERIT scores. The ERIT was sensitive to slight differences in ER training. That is, students experiencing a 75-min intervention performed better on the test compared to students without this experience. Overall, results suggested that our ER intervention may effectively increase students ER abilities and the ERIT demonstrated great potential for assessing foundational ethical reasoning skills. To further examine validity, researchers should consider known groups analyses with varying “doses” of the ER intervention, as well as measurement invariance studies. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

How does one scientifically verify a psychometric instrument designed to assess the mental competence of medical patients who are asked to consent to medical treatment? Aside from satisfying technical requirements like statistical reliability, results yielded by such a test must conform to at least some accepted pretheoretical desiderata; for example, determinations of competence, as measured by the test, must capture a minimal core of accepted basic intuitions about what competence means and what a theory of competence is supposed (...) to do. The concepts of “face validity” and “content validity” are both important here. Face validity “indicates that an instrument appears to test what it is supposed to and that it is a plausible method for doing so” (Portney and Watkins 2000, 82). Content validity “means that the test contains all the elements that reflect the variable being studied” (Portney and.. (shrink)

A script concordance test was developed as an innovative tool for assessing ethical reasoning ability. An SCT of 12 medical ethical vignettes were constructed from the UNESCO Casebook on Human Dignity and Human Rights. The vignettes were reviewed by a panel of 15 medical experts before administration to a panel of 18 clinicians. The clinician’s answers were used to constitute the scoring key. The SCT was then administered to first and final year medical students. Data were analysed using SPSS. (...) Internal consistency was assessed using Cronbach’s alpha. SCT performance was tested for association with sex, year of study and race by comparing the mean SCT scores between categories within each variable. Internal consistency as measured by Cronbach’s alpha values, ranging from 0.597 to 0.902, indicated high intra-vignette reliability for 10 of the vignettes. Inter-vignette reliability was high at 0.797. Mean SCT scores were not significantly different between students of different gender, year of study and ethnicity. However, each vignette was able to distinguish between overall poor and good test performers. The SCT was able to differentiate between students with varying degrees of ethical reasoning ability. (shrink)