The ADHD Rating Scale—5 for Children and Adolescents, School Version, has been adopted and validated to be used in assessing ADHD among school children within Western contexts. However, there are few assessment tools in use for identifying ADHD characteristics in children in Sudan. Therefore, this study aimed to investigate the psychometric properties of this rating scale in the context of Sudan. To accomplish this, data were collected on a sample of 3,742 school-aged children and adolescents as reported by their teachers. (...) Psychometric properties can be classified as very good, with very high reliability, and high construct validity tested by exploratory and confirmatory factor analysis. Thus, the ADHD Rating Scale—5 for Children and Adolescents, School Version, is valid, reliable, and suitable to use for assessing ADHD symptoms among children and adolescents in the Sudanese context. (shrink)

Two experiments report on the construction of the Sense of Agency Rating Scale (SOARS), a new measure for quantifying alterations to agency. In Experiment 1, 370 participants completed a preliminary version of the scale following hypnosis. Factor analysis revealed two underlying factors: Involuntariness and Effortlessness. In Experiment 2, this two factor structure was confirmed in a sample of 113 low, medium and high hypnotisable participants. The two factors, Involuntariness and Effortlessness, correlated significantly with hypnotisability and pass rates for ideomotor, challenge (...) and cognitive items. Twelve week test-retest correlations showed that Involuntariness was highly stable, but Effortlessness only moderately stable. Analysis of the combined datasets from Experiments 1 and 2 showed both SOARS scores were significantly related to the derived factors of Woody, Barnier, and McConkey's (2005) 4-factor model of hypnotisability. This scale clarifies conceptual confusion around agentive action and provides empirical support for a multifactorial account of sense of agency. (shrink)

(2008). Addressing measurement limitations in affective rating scales: Development of an empirical valence scale. Cognition & Emotion: Vol. 22, No. 1, pp. 180-192.

Different types of well-being are likely to be associated with different kinds of behaviors. The first objective of this study was, from a subjective well-being perspective, to examine whether harmony in life and satisfaction with life are related differently to cooperative behaviors depending on individuals’ social value orientation. The second objective was, from a methodological perspective, to examine whether language-based assessments calledcomputational language assessments(CLA), which enable respondents to answer with words that are analyzed using natural language processing, demonstrate stronger correlations (...) with cooperation than traditional rating scales. Participants reported their harmony in life, satisfaction with life, and social value orientation before taking part in an online cooperative task. The results show that the CLA of overall harmony in life correlated with cooperation (all participants:r= 0.18,p 0.05). No significant correlations (measured by the CLA or traditional rating scales) were found between satisfaction with life and cooperation. In conclusion, our study reveals an important behavioral difference between different types of subjective well-being. To our knowledge, this is the first study supporting the validity of self-reported CLA over traditional rating scales in relation to actual behaviors. (shrink)

An extension to a rating system for tracking the evolution of parameters over time using continuous variables is introduced. The proposed rating system assumes a distribution for the continuous responses, which is agnostic to the origin of the continuous scores and thus can be used for applications as varied as continuous scores obtained from language testing to scores derived from accuracy and response time from elementary arithmetic learning systems. Large-scale, high-stakes, online, anywhere anytime learning and testing inherently comes with a (...) number of unique problems that require new psychometric solutions. These include (1) the cold start problem, (2) problem of change, and (3) the problem of personalization and adaptation. We outline how our proposed method addresses each of these problems. Three simulations are carried out to demonstrate the utility of the proposed rating system. (shrink)

This study aimed to develop the Three-Dimensional Filial Piety Scale and explore its psychometric properties. Based on Wang’s Three-Dimensional Filial Piety Model, our study employed a review of the current literature, in-depth interviews, and feedback from experts and the target group. An initial 36-item scale using a bipolar Likert 6-point rating scale was developed. Then item analysis and exploratory factor analysis were conducted with sample 1 (n = 617) to explore the dimensions and final items, and a 15-item scale with (...) three factors was obtained. After that, confirmatory factor analysis was conducted to validate the 3-factor structure obtained through exploratory factor analysis with sample 2 (n = 585). Next, we tested criterion-related validity with sample 3 (n = 248) and test-retest reliability with sample 4 (n = 67). The results supported the model on which this scale was based and showed three dimensions of filial piety, namely the balance of interests, good affections, and family role norms. As a valid, reliable scale, the Three-Dimensional Filial Piety Scale can therefore be used in the Chinese context to measure filial piety for people of different genders, ages, and cohabitation situations. (shrink)

A study was conducted to investigate the perceptions of academic dishonesty in fifth-grade students. Two methods were used to gather data: a sorting task, which was used to indirectly assess the students' perceptions, and a rating scale task, which was used to externally validate the results of the sorting task. Results of the multidimensional scaling analysis yielded two dimensions, the first being tests/homework and papers, and the second, more ambiguous appearing to differentiate based on seriousness.

To address the need for a valid and reliable scale of youth leadership potential based on the development theory of leadership, the current study developed the Youth Leadership Potential Scale (YLPS) and investigated its factor structure and psychometric properties in a sample of 696 students (grades 7-9) in China. Exploratory structural equation modeling (ESEM) identified a five-factor solution comprising leadership information, leadership attitude, communication skills, decision-making skills, and stress management skills. ESEM within confirmatory factor analysis demonstrated an adequate fit for (...) this structure. The scale showed good composite reliability and measurement invariance across different gender and grade/age groups. The scale also showed sufficient concurrent validity with the Coping Self-Efficacy Scale, the Chinese Roets Rating Scale for Leadership, and the Leadership Skills Inventory. Furthermore, criterion-related validity was supported by the relationship between YLPS scores and the length of student leadership positions. The results suggest that the YLPS is a valid and pragmatic measure for assessing youth leadership potential. The current study is the first to develop a youth leadership potential scale based on the development theory of leadership. (shrink)

The 2015 Paris Agreement set a global warming limit of 2°C above preindustrial levels. Corporations play an important role in achieving this objective, and methods have recently been developed to map global climate targets to specific industries, and individual corporations within those industries. In this article, we assess whether Sustainability ratings capture corporate performance in meeting the 2°C target. We analyze nine rating schemes used by investors and three commonly used in academic studies. Most rating schemes do consider corporate greenhouse (...) gas emissions in their analysis, whereas only a minority scale emissions by factors that have the potential to allow benchmarking against science-based targets. None take the final step of mapping climate indicators against the 2°C target. Furthermore, we find a lack of consistency in the climate change ratings of the databases used in academic studies. These results are concerning in the context of being able to meet global climate change goals. (shrink)

Objective: Present research examined children’s behavioural and cognitive functioning by using data from a screening study based on reports given by parents and teachers, and investigated the strongest predictors of children’s fluid intelligence. Method: Scales: Conners Early Childhood Behaviour Scale and Behaviour Rating Inventory of Executive Function-Preschool were filled out by parents and teachers of preschool children. Raven’s Coloured Progressive Matrices was used to measure fluid intelligence among preschool children. Results: Parent-teacher concordance was low to moderate. Working memory in (...) BRIEF-P estimated by teachers and parents mediated the relationship between inattention/hyperactivity in CEC BEH [S] and fluid intelligence among preschoolers. The difficulties with working memory assessed by teachers and parents were significant predictors of Raven scores; however, predictions based on teachers’ assessments were stronger. Conclusion: Clinicians should collect reports from various observers in order to implement prevention programs and optimize clinical diagnoses for children. Information from both parents and teachers give significant and complementary contribution to understanding difficulties with cognitive and behavioural functioning of preschoolers. (shrink)

Research and policymaking on positive mental health and well-being have increased within the last decade, partly fueled by decreasing levels of well-being in the general population and among at-risk groups. However, measurement of well-being often takes place in the absence of reflection on the underlying theoretical conceptualization of well-being. This disguises the fact that different rating scales of well-being often measure very different phenomena because rating scales are based on different philosophical assumptions, which represent radically different foundational views (...) about the nature of well-being. The aim of this paper is to examine the philosophical foundation of the Satisfaction with Life Scale in order to clarify the underlying normative commitments and the psychometric compromises involved in the translation of theory into practice. SWLS is widely used by psychologists, public health professionals, economists, and is popular in national and international surveys of well-being. This paper introduces the philosophical theory of life satisfaction and explores how three central discussions within life satisfaction theory are reflected in the construction of the SWLS; Whether we should be equally satisfied with our past, present and future, Whether we should be satisfied with all the various domains of our lives, and How to avoid the trap of “false consciousness”, i.e. that people fail to recognize the injustice or misfortune of their lives. In the end, life satisfaction theory is contrasted with affective foundational theories of well-being, to explore the magnitude and limits of SWLS as a rating scale based on life satisfaction theory. (shrink)

Measuring psychological attributes, such as motivation, typically involves rating scales, assuming that an attribute can be ordered, and that ratings represent this order. Previously, only the first assumption had been tested, albeit limited. First, we checked the ordinal structure of motivation, looking at whether people can establish transitive relations between motivation levels in pairwise comparisons; and we found different ordering patterns: strict transitive, weak transitive, changing order, and intransitivity. The rate of intransitivity was similar to that found previously and (...) was somewhat higher than we obtained when we asked participants to compare definitely quantitative attributes. Second, we checked if specific ordering patterns were related to individual interpretations of the statements that deviated from expected motivation types. Indeed, about a third of participants miscategorized statements, and these deviant interpretations were related to intransitivity as well as weak transitivity. Third, we checked whether Likert ratings represent the order of motives obtained from pairwise comparisons. We found rather homomorphic representation: ratings correlated with the order, but they did not differentiate between different ordering patterns and hierarchies of motives. We conclude that the Likert rating scale provides less information about respondents than pairwise ordering. The findings question the mainstream practice of using rating scales without testing underlying assumptions. (shrink)

As a special group of police officer, prison police have to endure more work stress and have significant work-family conflict, which may lead to more physical and mental health problems and need to be noticed by the society. The Work-Family Conflict Scale is a brief self-report scale that measures the conflict that an individual experiences between their work and family roles and the extent they interfere with one another. However, there is limited data on the scale’s psychometric properties. The aim (...) of this study was to examine the dimensionality and reliability of the Chinese version of the WFCS. The study sample was made up of a total of 717 Chinese prison police. The Rasch Rating Scale Model was used to determine the latent structure and estimate the quality of items and reliability of scale. The principle component analysis showed that the assumption of unidimensionality was fulfilled. The infit and outfit mean square statistics were of a reasonable range, and point-measure correlations indicted good model fit of each item. The item-person separation and reliability indices both met psychometric standards, illustrating good reliability. The person-item map indicated acceptable fit of items and persons, suggesting an alignment between persons and items. In addition, no evidence emerged of differential item functioning across different gender groups. Overall, the WFCS has good reliability and validity, and can be used to accurately evaluate the level of work-family conflict in Chinese prison police. (shrink)

The rating of perceived exertion can be used to monitor the exercise intensity during laboratory and specific tests, training sessions, and to estimate the internal training load of the athletes. The aim of the present study was to develop and validate a specific pictorial perceived exertion scale for soccer players called GOAL Scale. The pictorial GOAL Scale was validated for twenty under-17 soccer players. In the validation phase, the athletes were evaluated in a progressive protocol involving stimuluses of 3 min (...) with 1 min for the rest into the stages until the voluntary exhaustion in Maximal Cardiopulmonary Effort Test, and in the Yo Yo Intermittent Recovery Test – Level 1. The RPE identified by the GOL Scale, by the Borg Scale 6 – 20 and by the Cavasini Scale, as well as the heart rate, perceptual of the heart rate and the blood lactate concentration were immediately evaluated after each stage of both tests. Spearman’s correlation coefficient was used. Construct scale validity was examined by regressing GOAL Scale against Borg Scale 6 – 20 and Cavasini Scale and concurrent scale validity was investigated by regressing GOAL Scale against HR, beats/min and blood lactate concentration during two progressive tests. There was a significant correlation values of the GOAL Scale with Borg Scale, Cavasini Scale, %HRmax, HR and lactate during tests. The results evidenced concurrent and construct validity of the GOAL Scale across a wide range of exercise intensity. The absence of verbal anchors makes the use of this instrument to soccer, futsal and beach soccer athletes of different languages and different literacy levels possible. (shrink)

This brief commentary treats Polanyi’s newly found lecture, “Rules of Rightness,” as an occasion to revisit some earlier claims I made about the use of rating scales in social science research. It serves as something of an interim report on an ongoing inquiry into what an effective response to social science would look like from a Polanyian perspective.

ContextBehavioral observation scales are important for understanding and assessing social skills. In the context of collaborative problem-solving skills, considered essential in the 21st century, there are no validated scales in French that can be adapted to different CPS tasks. The aim of this study is to adapt and validate, by annotating a new video corpus of dyadic interactions that we have collected, two observational scales allowing us to qualitatively assess CPS skills: the Social Performance Rating Scale and (...) the Social Skills of Collaboration Scale.MethodThe construct validity of these two scales was assessed by exploratory factor analysis and inter-item correlations. We also checked inter-judge agreement using inter-class correlation coefficients. Internal consistency was determined using Cronbach’s alpha and convergent and divergent validity by assessing correlations between the two scales and measures of depression and alexithymia. Finally, the discriminative properties of the two scales were analyzed by comparing the scores obtained by a group of anxious individuals and a non-anxious control group.ResultsThe results show that our two scales have excellent inter-item correlations. Internal consistency is excellent. Inter-rater agreement ranged from moderate to high. Finally, convergent validity was significant with the alexithymia scale, as was divergent validity with the depression scale. Anxious individuals had lower scores on both scales than non-anxious individuals.ConclusionBoth scales show good psychometric properties for assessing social skills relevant to different collaborative tasks. They also identify individuals with difficulties in social interaction. Thus, they could allow monitoring the effectiveness of training social skills useful in CPS. (shrink)

The Group Cohesiveness Scale measures patient-rated group cohesiveness. The English version of the scale has demonstrated good psychometric properties. This study describes the validation of the Czech version of the GCS. A total of 369 patients participated in the study. Unlike the original study, the ordinal confirmatory factor analysis supported a two-dimensional solution. The analysis demonstrated the existence of two moderately to highly associated domains of group cohesiveness—affective and behavioral. The two-dimensional model was invariant across genders, age, education, and time (...) up to factor means level. Internal consistency reached satisfactory values for both domains. In terms of convergent validity, only weak association was found between the GCS domains and the group working alliance measured by the Group Outcome Rating Scale. This is the first revision of the factor structure of the GCS in the European context. The scale showed that the Czech version of the GCS is a valid and reliable brief tool for measuring both aspects of group cohesiveness. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Diagnostic Criteria, Psychological Tests, and Ratings Scales: Extending the HistoryPeter Zachar, PhD (bio)Le moigne narrates a history of the development of psychiatric ratings scales as hybrids between psychological tests and diagnostic categories. In his telling, psychological tests seek to quantify population-based traits on which every person has a position and which tend to be conceptualized as being stable. Personality traits are often conceptualized as dispositions. Diagnostic categories (...) represent not trait-like properties of populations but episodic states consisting of clusters of symptoms experienced by individuals with disorders. Ratings, scales, he notes, are hybrids between the two. They are used to quantify psychiatric symptom clusters so that change over time can be measured. Le Moigne argues that these distinctions were initially suggested during the development of measures that could assess outcomes in psychopharmacological treatment studies.With respect to depression, Le Moigne writes that in the 1970s and 1980s something akin to depressive personality was reconceptualized as a temperament. A key move, somewhat reflective of Kraepelin’s notion of a depressive temperament, was to view a dysthymic temperament as both a predisposing factor and an attenuated form of depression. Thus, an episodic state commandeered the predisposing–dispositional role that was assigned to stable personality traits.This conceptual shift allowed test-like ratings scales to be seen as useful for quantifying not just stable traits, but salient features of episodic states that are potentially subject to change in response to interventions. To put it another way, in the development of a psychological test, one goal is to have high test-retest reliability (i.e., stability of measurement). With rating scales used to measure change, one wants the scores to not be as stable; ideally the scores on the later assessments will be lower. According to Le Moigne, when dysthymia was subsequently placed on axis I of the Diagnostic and Statistical Manual of Mental Disorders (DSM)-III (as a syndrome) and segregated from personality disorders which were placed on axis II, personality traits were evicted from the conceptualization of depressive disorders.One perennial feature of psychiatry and psychology is that even if an older idea is superseded [End Page 253] in the view of some thinkers, it can still attract adherents. Indeed, interest in understanding a relationship between personality and attenuated states did not fully disappear. For example, based on research in genetics, the schizophrenia spectrum concept included not only schizophrenia, but also milder conditions such that were conceptualized as personality disorders; that is, schizotypal personality disorder and paranoid personality disorder (Kety, Rosenthal, Wender, & Schulsinger, 1971).During the development of the DSM-IV, some people wanted to add depressive personality disorder to the manual (Phillips, Hirschfeld, Shea, & Gunderson, 1995). It seems to have become a territorial dispute between mood disorder specialists and personality disorder specialists The mood disorders specialists challenged the personality disorder specialists to differentiate depressive personality disorder from early onset, chronic dysthymia. They were able to do so by using criteria such as critical, blaming, and derogatory toward self. After the mood disorders work group proposed incorporating some of those criteria into a revised criteria set for dysthymia, the two sets overlapped. The result was the old criteria for dysthymia were printed in DSM-IV and criteria for depressive personality disorder and the revised criteria for dysthymia were both placed in the appendix.In the DSM-5, Axis II was eliminated and personality disorders were placed alongside all the syndromic symptom clusters at the same level. Even so, interest in attenuated presentations as personality-related lingered still. During the development of the DSM-5 there was some thought to using diagnostic spectra as a meta-structure for organizing the manual (Andrews et al., 2009). One idea was to move some personality disorders into a best fitting spectrum, akin to attenuated forms. This did occur with schizotypal personality disorder which is both in the DSM-5 chapter on schizophrenia and in the chapter on personality disorder. In the schizophrenia chapter it is positioned as the earliest emerging disorder on the spectrum. There was also some interest in grouping avoidant personality disorder with the anxiety disorders, but the evidence supporting such a change was not available.These issues may... (shrink)

ObjectiveWhen regaining consciousness, patients who emerge from a minimally conscious state (EMCS) present with different levels of functional disability, which pose great challenges for treatment. This study investigated the frontoparietal activity in EMCS patients and its effects on functional disability.Materials and methodsIn this preliminary study, 12 EMCS patients and 12 healthy controls were recruited. We recorded a resting-state scalp electroencephalogram (EEG) for at least 5 min for each participant. Each patient was assessed using the disability rating scale (DRS) to determine (...) the level of functional disability. We analyzed the EEG power spectral density and sensor-level functional connectivity in relation to the patient’s functional disability.ResultsIn the frontoparietal region, EMCS patients demonstrated lower relative beta power (P < 0.01) and higher weighted phase lag index (wPLI) values in the theta (P < 0.01) and gamma (P < 0.01) bands than healthy controls. The frontoparietal theta wPLI values of EMCS patients were positively correlated with the DRS scores (rs = 0.629, P = 0.029). At the whole-brain level, EMCS patients only had higher wPLI values in the theta band (P < 0.01) than healthy controls. The whole-brain theta wPLI values of EMCS patients were also positively correlated with the DRS scores (rs = 0.650, P = 0.022). No significant difference in the power and connectivity between the frontoparietal region and the whole brain in EMCS patients was observed.ConclusionEMCS patients still experience neural dysfunction, especially in the frontoparietal region. However, the theta connectivity in the frontoparietal region did not increase specifically. At the level of the whole brain, the same shift could also be seen. Theta functional connectivity in the whole brain may underlie different levels of functional disability. (shrink)

In this study, we examined moral issues and gender differences in ethical judgment using Reidenbach and Robin’s [Journal of Business Ethics9 (1990) 639) multidimensional ethics scale (MES). A total of 340 undergraduate students were asked to provide ethical judgment by rating three moral issues in the MES labeled: ‚sales’, ‚auto’, and ‚retail’ using three ethics theories: moral equity, relativism, and contractualism. We found that female students’ ratings of ethical judgment were consistently higher than that of male students across two out (...) of three moral issues examined (i.e., sales and retails) and ethics theories; providing support for Eagly’s [1987, Sex Differences in Social Behavior: A Social-role Interpretation. (Lawrence Erlbaum Associates, Inc, Hillsdale, NJ, England)] social role theory. After controlling for moral issues, women’s higher ratings of ethical judgment over men’s became statistically non-significant. Theoretical and practical implications based on the study’s findings are provided. (shrink)

This research explored the feasibility of using multidimensional scaling (MDS) analysis in novel combination with other techniques to study comprehension of epistemic adverbs expressing doubt and certainty (e.g., evidently, obviously, probably ) as they relate to health communication in clinical settings. In Study 1, Australian English speakers performed a dissimilarity-rating task with sentence pairs containing the target stimuli, presented as “doctors' opinions.” Ratings were analyzed using a combination of cultural consensus analysis (factor analysis across participants), weighted-data classical-MDS, and cluster analysis. (...) Analyses revealed strong within-community consistency for a 3-dimensional semantic space solution that took into account individual differences, strong statistical acceptability of the MDS results in terms of stress and explained variance, and semantic configurations that were interpretable in terms of linguistic analyses of the target adverbs. The results confirmed the feasibility of using MDS in this context. Study 2 replicated the results with Canadian English speakers on the same task. Semantic analyses and stress decomposition analysis were performed on the Australian and Canadian data sets, revealing similarities and differences between the two groups. Overall, the results support using MDS to study comprehension of words critical for health communication, including in future studies, for example, second language speaking patients and/or practitioners. More broadly, the results indicate that the techniques described should be promising for comprehension studies in many communicative domains, in both clinical settings and beyond, and including those targeting other aspects of language and focusing on comparisons across different speech communities. (shrink)

The study of pragmatic competence has gained increasing importance within second language assessment over the last three decades. However, its study in L2 language testing is still scarce. The aim of this paper is to research the extent to which pragmatic competence as defined by the Common European Framework of Reference for Languages (CEFR) has been accommodated in the task descriptions and rating scales of two of the most popular Oral Proficiency Interviews (OPIs) at a C1 level: Cambridge’s Certificate (...) in Advanced English (CAE) and Trinity’s Integrated Skills in English (ISE) III. To carry out this research, OPI tests are first defined, highlighting their differences from L2 pragmatic tests. After pragmatic competence in the CEFR is examined, focusing on the updates in the new descriptors, CAE and ISE III formats, structure and task characteristics are compared, showing that, while the formats and some characteristics are found to differ, the structures and task types are comparable. Finally, we systematically analyse CEFR pragmatic competence in the task skills and rating scale descriptors of both OPIs. The findings show that the task descriptions incorporate mostly aspects of discourse and design competence. Additionally, we find that each OPI is seen to prioritise different aspects of pragmatic competence within their rating scale, with CAE focusing mostly on discourse competence and fluency, and ISE III on functional competence. Our study shows that the tests fail to fully accommodate all aspects of pragmatic competence in the task skills and rating scales, although the aspects they do incorporate follow the CEFR descriptors on pragmatic competence. It also reveals a mismatch between the task competences being tested and the rating scale. To conclude, some research lines are proposed. (shrink)