Note posted 9 Jun 08 : Modifications made today include a new section on predictive validity, and addition of recently published article and in in-press article, both by Nosek & Hansen, under the "CULTURE VS. PERSON" heading, which replaces a previously listed unpublished ms. of theirs. I continue to encourage all interested to send material that they are willing to be included on this page. Please also to let me know about errors, including faulty links.

The concept of emotional intelligence (EI) has drawn a great amount of scholarly interest in recent years; however, attempts to measure individual differences in this ability remain controversial. Although the Mayer–Salovey–Caruso Emotional Intelligence Test (MSCEIT) remains the flagship test of EI, no study has comprehensively examined the full interpretive argument tying variation in observed test performance to variation in the underlying ability. Employing a modern perspective on validation, this article reviews and synthesizes available evidence and discusses sources of concern at (...) every level of the interpretive argument. It is argued that a focus on causal explanation of observed variation in test performance would significantly improve the validity of the MSCEIT as a measure of EI. (shrink)

The Defining Issues Test (DIT) has been widely used in psychological experiments to assess one’s developmental level of moral reasoning in terms of postconventional reasoning. However, there have been concerns regarding whether the tool is biased across people with different genders and political and religious views. To address the limitations, in the present study, I tested the validity of the brief version of the test, that is, the behavioral DIT, in terms of the measurement invariance and differential item functioning (...) (DIF). I could not find any significant non-invariance at the test level or any item demonstrating practically significant DIF at the item level. The findings indicate that neither the test nor any of its items showed a significant bias toward any particular group. As a result, the collected validity evidence supports the use of test scores across different groups, enabling researchers who intend to examine participants’ moral reasoning development across heterogeneous groups to draw conclusions based on the scores. (shrink)

Introduction The Defining Issues Test (DIT) aimed to measure one’s moral judgment development in terms of moral reasoning. The Neo-Kohlbergian approach, which is an elaboration of Kohlbergian theory, focuses on the continuous development of postconventional moral reasoning, which constitutes the theoretical basis of the DIT. However, very few studies have directly tested the internal structure of the DIT, which would indicate its construct validity. Objectives Using the DIT-2, a later revision of the DIT, we examined whether a bi-factor model (...) or 3-factor CFA model showed a better model fit. The Neo-Kohlbergian theory of moral judgment development, which constitutes the theoretical basis for the DIT-2, proposes that moral judgment development occurs continuously and that it can be better explained with a soft-stage model. Given these assertions, we assumed that the bi-factor model, which considers the Schema-General Moral Judgment (SGMJ), might be more consistent with Neo-Kohlbergian theory. Methods We analyzed a large dataset collected from undergraduate students. We performed confirmatory factor analysis (CFA) via weighted least squares. A 3-factor CFA based on the DIT-2 manual and a bi-factor model were compared for model fit. The three factors in the 3-factor CFA were labeled as moral development schemas in Neo-Kohlbergian theory (i.e., personal interests, maintaining norms, and postconventional schemas). The bi-factor model included the SGMJ in addition to the three factors. Results In general, the bi-factor model showed a better model fit compared with the 3-factor CFA model although both models reported acceptable model fit indices. Conclusion We found that the DIT-2 scale is a valid measure of the internal structure of moral reasoning development using both CFA and bi-factor models. In addition, we conclude that the soft-stage model, posited by the Neo-Kohlbergian approach to moral judgment development, can be better supported with the bi-factor model that was tested in the present study. (shrink)

Purpose: This study aimed to develop a stroke effectiveness test in table tennis based on the temporal game structure to assess the ball speed and ball placement of the players, with a purpose to analyze its reproducibility and validity. Methods: Nineteen male table tennis players participated in this study. The test was performed twice during the first session and once during the second session to assess the intrasession and intersession reproducibility, respectively. Moreover, the test was examined on its ability (...) to discriminate between regional and local performance-level players and on the relationship between the test results and the table tennis performance to assess the discriminant and concurrent validity, respectively. In general, the test consisted of 11 simulated rallies of 2–5 balls with the effort and rest ratio of 0.5, and focused on attack with offensive strokes at defensive balls delivered by a robot randomly between the left and right positions on the table. Results: Ball speed, ball placement, and ball speed-ball placement index showed satisfactory reliability and agreement outcomes. Additionally, the Bland-Altman plots show the systematic error of the analyses closer to 0, and that most values were within the limits of agreements. Concerning validity analyses, regional players had higher scores of ball placement and ball speed-ball placement index as well as made fewer errors than local players. Moreover, ball placement, ball speed-ball placement index, and percentage error presented a strong and significant correlation with table tennis performance. However, ball speed was slightly different between the regional than local players and this variable was not related to table tennis performance. Conclusion: Our findings show evidences that the test is reproducible. Moreover, discriminant and concurrent validity are confirmed for ball placement and ball speed-ball placement index. (shrink)

BackgroundThe aim of this study was to explore the construct validity and diagnostic properties of the Reading the Mind in the Eyes Test in non-demented patients with amyotrophic lateral sclerosis.MaterialsA total of 61 consecutive patients and 50 healthy controls were administered the 36-item RMET. Additionally, patients underwent a comprehensive assessment of social cognition via the Story-Based Empathy Task, which encompasses three subtests targeting Causal Inference, Emotion Attribution, and Intention Attribution, as well as global cognitive [the Edinburgh Cognitive and Behavioral (...) ALS Screen ] and behavioral screening [the Frontal Behavioral Inventory ; the Dimensional Apathy Scale ; the Beck Depression Inventory ; and the State and Trait Anxiety Inventory-Y]. The construct validity of the RMET was tested by regressing it within a stepwise model that encompassed as predictors the abovementioned cognitive and behavioral measures, covarying for demographic and motor confounders. Receiver-operating characteristics analyses allowed exploring intrinsic and post-test properties of the RMET both in discriminating patients from HCs and in identifying patients with a defective SET-EA performance.ResultsThe RMET was solely predicted by the SET-EA and SET-IA. RMET scores showed high accuracy both in discriminating patients from HCs and in identifying patients with a defective SET-EA score, with adequate-to-optimal both intrinsic and post-test properties.DiscussionThe RMET is a convergently and divergently valid measure of affective social cognition in non-demented ALS patients, also featuring optimal intrinsic and post-test diagnostic properties in both case-control and case-finding scenarios. (shrink)

Three studies investigated implicit brand attitudes and their relation to explicit attitudes, prod- uct usage, and product differentiation. Implicit attitudes were measured using the Implicit As- sociation Test (IAT; Greenwald, McGhee, & Schwartz, 1998). Study 1 showed expected differ- ences in implicit attitudes between users of two leading yogurt brands, also revealing significant correlations between IAT-measured implicit attitudes and explicit attitudes. In Study 2, users of two fast food restaurants (McDonald’s and Milk Bar) showed implicit attitudi- nal preference for their (...) favorite restaurant. In Study 3, implicit attitudes of users of two soft drinks (Coca-Cola and Pepsi) predicted brand preference, product usage, and brand recognition in a blind taste test. A meta-analytic combination of the three studies showed that the use of IAT measures increased the prediction of behavior relative to explicit attitude measures alone. (shrink)

This study assessed the International Critical Thinking Essay Test (ICTET-A) for inter-rater reliability, internal reliability, and criterion validity. A self-selecting sample of participants (N = 100) completed the ICTET-A and a comparison test online. We found the ICTET-A items to have moderate to good levels of inter-rater reliability, and overall excellent inter-rater consistency for total test scores. The test had good internal reliability. There was a strong correlation between scores on the ICTET-A and the comparison test. Factor analysis showed (...) that scores were best explained with one factor, suggesting the test measures a single construct. The ICTET-A can therefore be considered a valid measure of critical thinking. Additionally, we propose a short form of the test. (shrink)

Fully automated vehicles (AVs) hold promise toward providing numerous societal benefits including reducing road fatalities. However, we are uncertain about how individuals’ perceptions will influence their ability to accept and adopt AVs. The 28-item Automated Vehicle User Perception Survey (AVUPS) is a visual analog scale that was previously constructed, with established face and content validity, to assess individuals’ perceptions of AVs. In this study, we examined construct validity, via exploratory factor analysis and subsequent Mokken scale analyses. Next, internal (...) consistency was assessed via Cronbach’s alpha (α) and 2-week test–retest reliability was assessed via Spearman’s rho (ρ) and intraclass correlation coefficient (ICC). The Mokken scale analyses resulted in a refined 20-item AVUPS and three Mokken subscales assessing specific domains of adults’ perceptions of AVs: (a)Intention to use; (b)perceived barriers; and (c)well-being. The Mokken scale analysis showed that all item-coefficients of homogeneity (H) exceeded 0.3, indicating that the items reflect a single latent variable. The AVUPS indicated a strong Mokken scale (Hscale= 0.51) with excellent internal consistency (α = 0.95) and test–retest reliability (ρ = 0.76, ICC = 0.95). Similarly, the three Mokken subscales ranged from moderate to strong (rangeHscale= 0.47–0.66) and had excellent internal consistency (range α = 0.84–0.94) and test–retest reliability (range ICC = 0.84–0.93). The AVUPS and three Mokken subscales of AV acceptance were validated in a moderate sample size (N= 312) of adults living in the United States. Two-week test–retest reliability was established using a subset of Amazon Mechanical Turk participants (N= 84). The AVUPS, or any combination of the three subscales, can be used to validly and reliably assess adults’ perceptions before and after being exposed to AVs. The AVUPS can be used to quantify adults’ acceptance of fully AVs. (shrink)

Critics of animal modeling have advanced a variety of arguments against the validity of the practice. The point of one such form of argument is to establish that animal modeling is pointless and therefore immoral. In this article, critical arguments of this form are divided into three types, the pseudoscience argument, the disanalogy argument, and the predictive validity argument. I contend that none of these criticisms currently succeed, nor are they likely to. However, the connection between validity (...) and morality is important, suggesting that critical efforts would be instructive if they addressed it in a more nuanced way. (shrink)

Background: The Multidimensional Inventory for Religious/Spiritual Well-Being was developed in order to address a religious/spiritual dimension as being an important part of psychological well-being. In the meantime, the instrument has been successfully applied in numerous studies. Subsequently, a short version, the MI-RSWB 12 was constructed, especially for the use in clinical assessment. Here it is intended to contribute to the further development of the MI-RSWB 12 by investigating its structural validity through structural equation modeling.Materials and Methods: A total sample (...) of 1,097 German-speaking adults from the normal population filled in the MI-RSWB 12 via an online-survey. In line with theoretical assumptions 5 different factor structure models for the MI-RSWB 12 were tested: a single-factor model, a model with four correlated RSWB dimensions, a single higher-order model with four lower order factors, a two higher-order model with four lower order factors, a bifactor model, which includes four specific RSWB dimensions.Results: The single-factor model provided the poorest model fit, with no indices falling within the acceptable range. The four-factor, two higher-order factors and the bifactor models showed overall acceptable fit indices. With regard to the Akaike information criterion, the four-factor model demonstrated superiority compared to both the two higher-order factor model and the bifactor model, which in turn showed did not differ from each other.Conclusion: Four different MI-RSWB 12 sub-scales should be calculated in future studies, while a general factor and two higher order factors are statistically valid as well. Further applications of the MI-RSWB 12, especially in the clinical patient groups, are encouraged. (shrink)

The present study investigated the construct validity of the Test Anxiety Questionnaire, a revised and shortened version of the German Test Anxiety Inventory, by comparing it with math anxiety. A sample of German fifth- and sixth-grade students was analyzed. Math anxiety was measured by a German adaptation of the Math Anxiety Questionnaire. A significant but moderate correlation between test anxiety and math anxiety was found. In regression analyses, math anxiety predicted math performance whereas test anxiety explained additional variance for (...) both math and overall performance. It can be concluded that math and test anxiety have overlaps, but do not constitute the same construct. Thus, the results support the construct validity of the PAF indicating its usefulness in practical application. (shrink)

In the context of theistic religions, God representations are an important factor in explaining associations between religion/spirituality and well-being/mental health. Although the limitations of self-report measures of God representations are widely acknowledged, well-validated implicit measures are still unavailable. Therefore, we developed an implicit Attachment to God measure, the Apperception Test God Representations. In this study, we examined reliability and validity of an experimental scale based on attachment theory. Seventy-one nonclinical and 74 clinical respondents told stories about 15 cards with (...) images of people. The composite Attachment to God scale is based on scores on two scales that measure dimensions of Attachment to God: God as Safe Haven and God as Secure Base. God as Safe Haven scores are based on two subscales: Asking Support and Receiving Support from God. Several combinations of scores on these latter subscales are used to assess Anxious and Avoidant attachment to God. A final scale, Percentage Secure Base, measures primary appraisal of situations as nonthreatening. Intraclass correlation coefficients showed that the composite Attachment to God scale could be scored reliably. Associations of scores on the ATGR scales and on the explicit Attachment to God Inventory with scores on implicitly and explicitly measured distress partly confirmed the validity of the ATGR scales by demonstrating expected patterns of associations. Avoidant attachment to God seemed to be assessed more validly with the implicit than with the explicit scale. Patients scored more insecure on the composite Attachment to God scale and three subscales than nonpatients. (shrink)

To facilitate recruitment of conscript cyber soldiers in Sweden, the Cyber Test for Future Soldiers was developed as a complement to the existing generic enrolment test. Consisting of several parts, CTFS measures different aspects of computer-related knowledge and cognitive abilities that we believe are of particular relevance to cyber security. This article describes the evaluation regarding CTFS’s validity and reliability based on data from 62 conscripts that took the test and the 27 selected conscripts finishing the training 1 year (...) later. Reliability was predicted through internal consistency and test–retest measures. Cronbach’s alpha for CTFS ranges from 0.79 to 0.86 whereas the test–retest reliability is 0.60. Evidence regarding validity was collected based on test content and internal structure. Convergent, discriminant, and predictive evidence are also presented. Perhaps most importantly, CTFS could predict the cyber soldiers’ performance during their training and added incremental validity to I-prov 2000. When adjusted for range restriction, I-prov 2000 predicted 20% of the variation in course score, while 34% of the variance was explained when CTFS was used in conjunction with I-prov 2000. The results show that CTFS already in its first version is adding value for the Swedish Armed Forces. (shrink)

Social attachment can explain well the bond between users and social media, but existing research lacks measures of social attachment scales. To this end, this study takes attachment theory as the basis for scale development. On the basis of the development of multidimensional scales for adult, brand, and local attachment, it combines existing relevant studies on social attachment, selects three representative social media such as TikTok, WeChat, and MicroBlog as theoretical samples, explores the concept and structure of social attachment, and (...) develops a social attachment scale through qualitative interviews and open-ended questionnaires. This study applied SPSS 24.0 and Mplus 7.0 to test the social attachment scale. The findings reveal that social attachment consists of three constructs: social connection, social dependence and social identity, and the scale possesses high reliability and validity. This study has developed and validated a social attachment scale in the context of social software use, realizing a quantitative study of social attachment and providing a basis for future empirical research related to social attachment. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

This article discusses the need for more satisfactory implicit measures in consumer psychology and assesses the theoretical foundations, validity, and value of the Implicit Association Test (IAT) as a measure of implicit consumer social cognition. Study 1 demonstrates the IAT’s sensitivity to explicit individual differences in brand attitudes, ownership, and usage frequency, and shows their correlations with IAT-based measures of implicit brand attitudes and brand relationship strength. In Study 2, the contrast between explicit and implicit measures of attitude toward (...) the ad for sportswear advertisements portraying African American (Black) and European American (White) athlete–spokespersons revealed different patterns of responses to explicit and implicit measures in Black and White respondents. These were explained in terms of self-presentation biases and system justification theory. Overall, the results demonstrate that the IAT enhances our understanding of consumer responses, particularly when consumers are either unable or unwilling to identify the sources of influence on their behaviors or opinions. (shrink)

Professionals in business and law, healthcare providers, educators, policymakers, consumers, and higher education practitioners value ethical reasoning skills. Because of this, we concentrated campus-wide reaccreditation efforts to help students actively engage in ER. In doing so, we re-conceptualized the ER process, implemented campus-wide ER interventions designed to be experienced by all undergraduate students, and created the ethical reasoning identification test to measure students’ ability to engage in a foundational step in the ER process. Using factor analysis, we demonstrated internal (...) class='Hi'>validity evidence for ERIT scores. More specifically, confirmatory factor analysis provided support for a unidimensional factor structure, meaning stakeholders can report and analyze ERIT total scores. The unidimensional factor structure was replicated using two independent samples. Across all samples, ERIT scores demonstrated reliability consistent with professional standards. In addition, we collected external validity evidence for ERIT scores. The ERIT was sensitive to slight differences in ER training. That is, students experiencing a 75-min intervention performed better on the test compared to students without this experience. Overall, results suggested that our ER intervention may effectively increase students ER abilities and the ERIT demonstrated great potential for assessing foundational ethical reasoning skills. To further examine validity, researchers should consider known groups analyses with varying “doses” of the ER intervention, as well as measurement invariance studies. (shrink)

A script concordance test was developed as an innovative tool for assessing ethical reasoning ability. An SCT of 12 medical ethical vignettes were constructed from the UNESCO Casebook on Human Dignity and Human Rights. The vignettes were reviewed by a panel of 15 medical experts before administration to a panel of 18 clinicians. The clinician’s answers were used to constitute the scoring key. The SCT was then administered to first and final year medical students. Data were analysed using SPSS. Internal (...) consistency was assessed using Cronbach’s alpha. SCT performance was tested for association with sex, year of study and race by comparing the mean SCT scores between categories within each variable. Internal consistency as measured by Cronbach’s alpha values, ranging from 0.597 to 0.902, indicated high intra-vignette reliability for 10 of the vignettes. Inter-vignette reliability was high at 0.797. Mean SCT scores were not significantly different between students of different gender, year of study and ethnicity. However, each vignette was able to distinguish between overall poor and good test performers. The SCT was able to differentiate between students with varying degrees of ethical reasoning ability. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

ObjectiveThe objective of this study was to validate the computerized Symbol Digit Modalities Test in a Swiss pediatric cohort, in comparing the Swiss sample to the Canadian norms. Secondly, we evaluated sex effects, age-effects, and test–retest reliability of the c-SDMT in comparison to values obtained for the paper and pencil version of the Symbol Digit Modalities Test.MethodsThis longitudinal observational study was conducted in a single-center setting at the University Children’s Hospital of Bern. Our cohort consisted of 86 children aged from (...) 8 to 16 years. The cohort included both healthy participants and patients hospitalized for a non-neurological disease. Forty eight participants were assessed during two testing sessions with the SDMT and the c-SDMT.ResultsTest–retest reliability was high in both tests. A reliable change index was calculated for the SDMT and the c-SDMT corrected for practice effects. While a significant age effect on information processing speed was observed, no such effect was found for sex. When data on the c-SDMT performance of the Swiss cohort was compared with that from a Canadian cohort, no significant difference was found for the mean time per trial in any age group. Norm values for age groups between 8 and 16 years in the Swiss cohort were established.ConclusionNorms for the c-SDMT between the Swiss and the Canadian cohort were comparable. The c-SDMT is a valid alternative to the SDMT. It is a feasible and easy to administer bedside tool due to high reliability and the lack of motor demands. (shrink)

Background: The Bene-Anthony Family Relations Test is one of the most widely used measures of family dynamics seen from a child’s perspective. However, the most common issue surrounding this test is the lack of accurate normative scores for use with non-white ethnic groups. The purpose of this study was to examine the BAFRT’s reliability and validity for use with Arab children, as well as to provide normative data for this group. Methods: The BAFRT was translated into Arabic and back-translated (...) to ensure accuracy. The test was administered to a cohort of 394 Arab children, consisting of both cognitively normal children and children diagnosed with a psychological disorder, all aged 5–8 years old. Test-retest reliability was assessed using a sub-set of children and validity was tested against clinical status as well as CBCL and SDQ measures. Normative measures were calculated after examining the impact of influencing variables such as age and gender. Results: Statistical analyses showed that in our cohort of Arab children the BAFRT has good test-retest reliability, correlates well with measures of emotional and behavioral adjustment, and discriminates accurately between clinical and non-clinical children. Age, gender, and clinical status all significantly impacted upon BAFRT scores and therefore normative values are presented from our cohort when considering these variables. Conclusion: The normative scores we present will provide researchers and clinicians an appropriate reference point for the comparison of scores from Arab children and a starting point for future research into this area. (shrink)

This article addresses the ability of Parallel Distributed Processing (PDP) networks to generate stagewise cognitive development in accordance with Piaget's theory of cognitive epigenesis. We carried out a replication study of the simulation experiments by McClelland (1989) and McClelland and Jenkins (1991) in which a PDP network learns to solve balance scale problems. In objective tests motivated from catastrophe theory, a mathematical theory of transitions in epigenetical systems, no evidence for stage transitions in network performance was found. It is concluded (...) that PDP networks lack the ability to recover the positive outcomes of analogous catastrophe analyses of real cognitive developmental data. In an attempt to further characterize the learning behaviour of PDP networks, we carried out a second simulation study using the discrimination‐shift paradigm. The results thus obtained indicate that PDP learning is compatible with the learning of stimulus‐response relationships, not with the acquisition of mediating rules such as conceived in (neo‐)Piagetian theory. In closing, we speculate about the feasibility of simulating stagewise development with alternative network architectures. (shrink)

The present study was conducted as part of a larger study that aimed to compare moral judgment competence and moral preferences among Pakistani students of public and private sector educational institutes and religious institutes and also to measure the pattern of development of moral judgment competence of students within these institutes. The validation study completed in two phases, during the 1st phase data were collected from the students of grade 8 to 16 from public sector schools and colleges of Rawalpindi (...) city. Very low mean c-score was observed, the test came out to be valid on preference hierarchy criterion but its validity on the cognitive-affective parallelism and Quasi- simplex structure criteria could not be established due to low c-scores of the sample. In the second phase an additional sample from one private sector and two public sector universities was collected. The analysis of the combined sample showed no significant improvement of c-scores. The test meets well the preference hierarchy criterion but on the other two criteria results remain inconclusive due to low variance in the sample. The low c-scores are explained on the basis of three assumptions; poor quality of education, dogmatic religiosity, and weak and instable political structure of Pakistani society. (shrink)

This study describes the methodology used by Marcos Y. Lopez of the Centro Escolar University in developing and validating The CEU-Lopez Critical Thinking Test. The test is a multi-aspect general-knowledge critical thinking test designed for Filipino students in tertiary level. It uses Ennis’s conception of critical thinking in the development of test items. The use of verbal reports of thinking to establish validity and fairness of multiple-choice critical thinking test is based on the study by Norris in validating his (...) co-authored Test on Appraising Observations. Verbal reports of thinking are useful in establishing validity and fairness of multiple-choice critical thinking tests for they provide evidence to judge whether good thinking is in general associated with choosing answers credited by the key as correct and poor thinking is associated with choosing unkeyed answers . The eight processes employed in developing and validating this multiple-choice critical thinking test are as follows: test conceptualization, development of a test plan, development of test items, face and content validation of the test, revision of the test items, pre try-out of the test, actual try-out of the test, and construct validation of the test using verbal reports of thinking. The CEU-Lopez Critical Thinking Test consists of 87 items that focus on five aspects of critical thinking: deduction, credibility judgment, assumption identification, induction, and meaning. (shrink)

The Musical Emotion Discrimination Task (MEDT) is a short, non-adaptive test of the ability to discriminate emotions in music. Test-takers hear two performances of the same melody, both played by the same performer but each trying to communicate a different basic emotion, and are asked to determine which one is “happier”, for example. The goal of the current study was to construct a new version of the MEDT using a larger set of shorter, more diverse music clips and an adaptive (...) framework to expand the ability range for which the test can deliver measurements. The first study analysed responses from a large sample of participants (N = 624) to determine how musical features contributed to item difficulty, which resulted in a quantitative model of musical emotion discrimination ability rooted in Item Response Theory (IRT). This model informed the construction of the adaptive MEDT. A second study contributed preliminary evidence for the validity and reliability of the adaptive MEDT, and demonstrated that the new version of the test is suitable for a wider range of abilities. This paper therefore presents the first adaptive musical emotion discrimination test, a new resource for investigating emotion processing which is freely available for research use. (shrink)

This review of 122 research reports (184 independent samples, 14,900 subjects) found average r ϭ .274 for prediction of behavioral, judgment, and physiological measures by Implicit Association Test (IAT) measures. Parallel explicit (i.e., self-report) measures, available in 156 of these samples (13,068 subjects), also predicted effectively (average r ϭ .361), but with much greater variability of effect size. Predictive validity of self-report was impaired for socially sensitive topics, for which impression..

Teachers’ social-emotional competence is considered important to master the social and emotional challenges inherent in their profession and to build positive teacher-student relationships. In turn, this is key to both teachers’ occupational well-being and positive student development. Nonetheless, an instrument assessing the profession-specific knowledge and skills that teachers need to master the social and emotional demands in the classroom is still lacking. Therefore, we developed the Test of Regulation in and Understanding of Social Situations in Teaching (TRUST), which is a (...) theory-based situational judgment test measuring teachers’ knowledge about strategies for emotion regulation and relationship management in emotionally and socially challenging situations with students. Results from three studies (N = 166 in-service teachers, N = 73 in-service teachers, N = 107 pre-service teachers) showed satisfactory internal consistency for both the emotion regulation and relationship management subtests. Furthermore, confirmatory factor analyses supported the differentiation between the two facets of social-emotional competence. Regarding convergent validity, results from Study 3 revealed a positive association between the profession-specific TRUST and pre-service teachers’ general emotional intelligence. Furthermore, small to moderate correlations with the Big Five personality traits provided evidence for the discriminant validity of TRUST. In Studies 1 and 2, we found evidence for a correlation with external criteria, that is, teachers with higher test scores reported providing more emotional support for students and having better teacher-student relationships. For teachers’ occupational well-being, we found a link with symptoms of depersonalization and job satisfaction, but none for emotional exhaustion. We will discuss the use of TRUST in research, for the evaluation of interventions, in teacher education, and professional development and will illustrate ideas for enhancing the tool. (shrink)

We evaluated the reliability, validity, and differential item functioning (DIF) of a shorter version of the Defining Issues Test-1 (DIT-1), the behavioral DIT (bDIT), measuring the development of moral reasoning. 353 college students (81 males, 271 females, 1 not reported; age M = 18.64 years, SD = 1.20 years) who were taking introductory psychology classes at a public University in a suburb area in the Southern United States participated in the present study. First, we examined the reliability of the (...) bDIT using Cronbach’s α and its concurrent validity with the original DIT-1 using disattenuated correlation. Second, we compared the test duration between the two measures. Third, we tested the DIF of each question between males and females. Findings reported that first, the bDIT showed acceptable reliability and good concurrent validity. Second, the test duration could be significantly shortened by employing the bDIT. Third, DIF results indicated that the bDIT items did not favour any gender. Practical implications of the present study based on the reported findings are discussed. (shrink)