An Extensive Knowledge Mapping Review of Measurement and Validity in Language Assessment and SLA Research

Frontiers in Psychology 11 (2020)
  Copy   BIBTEX

Abstract

This study set out to investigate intellectual domains as well as the use of measurement and validation methods in language assessment research and second language acquisition published in English in peer-reviewed journals. Using Scopus, we created two datasets: a dataset of core journals consisting of 1,561 articles published in four language assessment journals, and a dataset of general journals consisting of 3,175 articles on language assessment published in the top journals of SLA and applied linguistics. We applied document co-citation analysis to detect thematically distinct research clusters. Next, we coded citing papers in each cluster based on an analytical framework for measurement and validation. We found that the focus of the core journals was more exclusively on reading and listening comprehension assessment, facets of speaking and writing performance such as raters and validation, as well as feedback, corpus linguistics, and washback. By contrast, the primary focus of assessment research in the general journals was on vocabulary, oral proficiency, essay writing, grammar, and reading. The secondary focus was on affective schemata, awareness, memory, language proficiency, explicit vs. implicit language knowledge, language or semantic awareness, and semantic complexity. With the exception of language proficiency, this second area of focus was absent in the core journals. It was further found that the majority of citing publications in the two datasets did not carry out inference-based validation on their instruments before using them. More research is needed to determine what motivates authors to select and investigate a topic, how thoroughly they cite past research, and what internal and external factors lead to the sustainability of a Research Topic in language assessment.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 92,227

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

The Validity of National Curriculum Assessment.Gordon Stobart - 2001 - British Journal of Educational Studies 49 (1):26 - 39.
Econometric Approaches to the Measurement of Research Productivity.Cinzia Daraio - 2019 - In Wolfgang Glänzel, Henk F. Moed, Ulrich Schmoch & Mike Thelwall (eds.), Springer Handbook of Science and Technology Indicators. Springer Verlag. pp. 633-666.
The appeal to robustness in measurement practice.Alessandra Basso - 2017 - Studies in History and Philosophy of Science Part A 65-66 (C):57-66.
Measurement units and theory construction.Warren W. Tryon - 1996 - Journal of Mind and Behavior 17 (3):213-228.
Reconsidering the Construct Validity of “Political Knowledge”.Craig M. Burnett - 2016 - Critical Review: A Journal of Politics and Society 28 (3-4):265-286.

Analytics

Added to PP
2020-09-05

Downloads
463 (#42,355)

6 months
458 (#3,600)

Historical graph of downloads
How can I increase my downloads?