Assessing pragmatic competence in oral proficiency interviews at the C1 level with the new CEFR descriptors

Lodz Papers in Pragmatics 16 (1):87-121 (2020)
  Copy   BIBTEX

Abstract

The study of pragmatic competence has gained increasing importance within second language assessment over the last three decades. However, its study in L2 language testing is still scarce. The aim of this paper is to research the extent to which pragmatic competence as defined by the Common European Framework of Reference for Languages (CEFR) has been accommodated in the task descriptions and rating scales of two of the most popular Oral Proficiency Interviews (OPIs) at a C1 level: Cambridge’s Certificate in Advanced English (CAE) and Trinity’s Integrated Skills in English (ISE) III. To carry out this research, OPI tests are first defined, highlighting their differences from L2 pragmatic tests. After pragmatic competence in the CEFR is examined, focusing on the updates in the new descriptors, CAE and ISE III formats, structure and task characteristics are compared, showing that, while the formats and some characteristics are found to differ, the structures and task types are comparable. Finally, we systematically analyse CEFR pragmatic competence in the task skills and rating scale descriptors of both OPIs. The findings show that the task descriptions incorporate mostly aspects of discourse and design competence. Additionally, we find that each OPI is seen to prioritise different aspects of pragmatic competence within their rating scale, with CAE focusing mostly on discourse competence and fluency, and ISE III on functional competence. Our study shows that the tests fail to fully accommodate all aspects of pragmatic competence in the task skills and rating scales, although the aspects they do incorporate follow the CEFR descriptors on pragmatic competence. It also reveals a mismatch between the task competences being tested and the rating scale. To conclude, some research lines are proposed.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 90,616

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Ethical Competence for Teachers: A Possible Model.Roxana-Maria Ghiațău - 2015 - Symposion: Theoretical and Applied Inquiries in Philosophy and Social Sciences 2 (3):387–403.
The Concept of Political Competence.Matthias Brinkmann - 2018 - Critical Review: A Journal of Politics and Society 30 (3):163-193.
Character Competence of the Corporation.Subhash Sharma - 2002 - Journal of Human Values 8 (2):107-118.

Analytics

Added to PP
2020-10-17

Downloads
16 (#774,858)

6 months
3 (#447,120)

Historical graph of downloads
How can I increase my downloads?

Citations of this work

No citations found.

Add more citations

References found in this work

Speech Acts: An Essay in the Philosophy of Language.John Rogers Searle - 1969 - Cambridge, England: Cambridge University Press.
Speech Acts: An Essay in the Philosophy of Language.John Searle - 1969 - Philosophy and Rhetoric 4 (1):59-61.
Relevance theory.Deirdre Wilson & Dan Sperber - 2002 - In L. Horn & G. Ward (eds.), The Handbook of Pragmatics. Blackwell. pp. 607-632.
Intercultural Pragmatics.Istvan Kecskes - 2013 - Oxford University Press USA.

View all 7 references / Add more references