Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter Mouton June 9, 2022

Assessing verbal interaction: towards European harmonization. Insights from the co-operation between Spanish and French language exams for Higher Education (CertAcles/CLES)

Julia Zabala Delgado and Laurent Rouveyrol EMAIL logo

Abstract

Verbal interaction has been the subject of a growing interest among language professionals in Europe since the CEFR was published in 2001; in linguistics, verbal interaction has long been studied. In the Bakhtinian approach, it is even considered “the fundamental reality of language”. All types of interaction share the fact that they are dynamically co-constructed by participants. How then can we assess or certify interactional competence on an individual basis when dynamic instability prevails? What criteria can be defined in order to deconstruct interactional competence into specific operational criteria, if interaction is intrinsically multidimensional? These are the questions that we address in this paper. To do so, this paper presents the insights gained as a result of the co-operation between two certification systems: CertAcles (Spain) and CLES (France), both belonging to NULTE (Network of University Language Testers in Europe). These certification systems have agreed to collaborate extensively, sharing their constructs and assessment routines. As a result, CertAcles is shifting towards more contextualized tasks and CLES is considering adopting descriptive assessment scales for interaction (C1 level). We hope to demonstrate that the materialization of scientific collaboration of this kind can help improve individual systems.


Corresponding author: Laurent Rouveyrol, Université Côte d’Azur, French Riviera, France, E-mail:

References

Bachman, Lyle F. 1988. Problems in examining the validity of the ACTFL oral proficiency interview. Studies in Second Language Acquisition 10. https://doi.org/10.1017/S0272263100007282.Search in Google Scholar

Bachman, Lyle F. 2007. What is the construct? The dialectic of abilities and contexts in defining constructs in language assessments. Language testing reconsidered, 41–72. Otawa, Ontario: University of Ottawa Press.10.2307/j.ctt1ckpccf.9Search in Google Scholar

Bachman, Lyle F. & Adrian S. Palmer. 1981. The construct validation of the FSI oral interview. Language Learning 31. 167–186. https://doi.org/10.1111/j.1467-1770.1981.tb01373.x.Search in Google Scholar

Bachman, Lyle F. & Adrian S. Palmer. 2010. Language assessment in practice. Oxford: Oxford University Press.Search in Google Scholar

Bakhtin, Mikhaïl. 1977 [1929]. Le marxisme et la philosophie du langage: essai d’application de la méthode sociologique en linguistique. Paris: Éditions de Minuit.Search in Google Scholar

Bakhtin, Mikhaïl. 1984 [1952–53]. Esthétique de la création verbale. Paris: Gallimard, Coll. N.R.F.Search in Google Scholar

Bakhtin, Mikhaïl. 1986. Speech genres and other late essays. Austin: University of Texas Press.Search in Google Scholar

Brown, H. Douglas & Priyanvada Abeywickrama. 2010. Language assessment: Principles and classroom practices. White Plains, NY: Pearson Education.Search in Google Scholar

Chalhoub-Deville, Micheline & Craig Deville. 2005. A look back at and forward to what language testers measure. In Eli Hinkel (ed.), Handbook of research in second language teaching and learning, 815–832. Mahwah, NJ: Lawrence Erlbaum Associates.Search in Google Scholar

Chapelle, Carol. 1998. Construct definition and validity inquiry in SLA research. In Lyle F. Bachman & Andrew D. Cohen (eds.), Interfaces between second language acquisition and language testing research, 32–70. New York: Cambridge University Press.10.1017/CBO9781139524711.004Search in Google Scholar

Council of Europe. 2020. Common European Framework of Reference for Languages: Learning, teaching, assessment – Companion volume. Strasbourg: Council of Europe Publishing.Search in Google Scholar

Cushing, Sarah. 2017. Corpus linguistics in language testing research. Language Testing 34(4). 441–449. https://doi.org/10.1177/0265532217713044.Search in Google Scholar

Figueras, Neus. 2004. Docencia, evaluación y contexto de uso real de la lengua oral. en Vademécum para la formación de profesores. Enseñar español como segunda lengua (L2)/lengua extranjera (LE). Madrid: SGEL, Sociedad General Española de Librería.Search in Google Scholar

Fulcher, Glenn. 1996. Does thick description lead to smart tests? A data-based approach to rating scale construction. Language Testing 13. 208–238. https://doi.org/10.1177/026553229601300205.Search in Google Scholar

Galaczi, Evelina D. 2008. Peer–peer interaction in a speaking test: The case of the first certificate in English examination. Language Assessment Quarterly 5(2). 89–119. https://doi.org/10.1080/15434300801934702.Search in Google Scholar

Galaczi, Evelina & Lynda Taylor. 2018. Interactional competence: Conceptualisations, operationalisations, and outstanding questions. Language Assessment Quarterly 15(3). 1–18. https://doi.org/10.1080/15434303.2018.1453816.Search in Google Scholar

Green, Anthony. 2014. Exploring language assessment and testing: Language in action. Oxon: Routledge.10.4324/9781315889627Search in Google Scholar

Henning, Grant. 1992. The ACTFL oral proficiency interview: Validity evidence. System 20. 365–372. https://doi.org/10.1016/0346-251x(92)90046-6.Search in Google Scholar

Kane, Michael T. 2006. Content-related validity evidence in test development. In Thomas M. Haladyna & Steven M. Downing (eds.), The handbook of test development. New York: Routledge.10.4324/9780203874776.ch7Search in Google Scholar

Kane, Michael T. 2013. Validating the interpretations and uses of test scores. Journal of Educational Measurement 50(1). 1–73. https://doi.org/10.1111/jedm.12000.Search in Google Scholar

Khabbazbashi, Nahal. 2017. Topic and background knowledge effects on performance in speaking assessment. Language Testing 34(1). 23–48. https://doi.org/10.1177/0265532215595666.Search in Google Scholar

Khabbazbashi, Nahal & Evelina D. Galaczi. 2020. A comparison of holistic, analytic, and part marking models in speaking assessment. Language Testing 37(3). 333–360. https://doi.org/10.1177/0265532219898635.Search in Google Scholar

Kramsch, Claire. 1986. From language proficiency to interactional competence. The Modern Language Journal 70(4). 366–372. https://doi.org/10.1111/j.1540-4781.1986.tb05291.x.Search in Google Scholar

Kunnan, Antony J. 2009. Testing for citizenship: The US naturalization test. Language Assessment Quarterly 6(1). 89–97. https://doi.org/10.1080/15434300802606630.Search in Google Scholar

Lazaraton, Anne. 2004. Qualitative research methods in language test development and validation. European language testing in a global context. In Michael Milanovic & Cyril Weir (eds.), Proceedings of the ALTE Barcelona Conference July 2001, 51–73. Cambridge: Cambridge University Press.Search in Google Scholar

Lukácsi, Zoltan. 2020. Standard setting and internal validation of a novel approach adopted for assessing speaking. Training, Language and Culture 4(4). 9–22.10.22363/2521-442X-2020-4-4-9-22Search in Google Scholar

Lumley, Tom & Tim F. McNamara. 1995. Rater characteristics and rater bias: Implications for training. Language Testing 12(1). 54–71. https://doi.org/10.1177/026553229501200104.Search in Google Scholar

Luoma, Sari. 2004. Assessing speaking. Cambridge: Cambridge University Press.10.1017/CBO9780511733017Search in Google Scholar

Manoïlov, Pascale & Claire Tardieu. 2015. Rétroaction corrective et reprise dans le contexte de l’apprentissage en tandems Français-Anglais à l’université. Recherches en Didactique des Langues et Cultures. Les Cahiers de l’Acedle 12(3). Hal shs-01423167.10.4000/rdlc.986Search in Google Scholar

McNamara, Tim. 1996. Measuring second language performance. London & New York: Longman.Search in Google Scholar

McNamara, Tim. 2008. The socio-political and power dimensions of tests. Encyclopedia of Language and Education 7. 415–427.10.1007/978-0-387-30424-3_190Search in Google Scholar

Messick, Samuel. 1996. Validity and washback in language testing. Language Testing 13(3). 241–256. https://doi.org/10.1177/026553229601300302.Search in Google Scholar

North, Brian & Enrica Picardo. 2016. Developing illustrative descriptors of aspects of mediation for the CEFR. Strasbourg: Council of Europe.10.1017/S0261444816000100Search in Google Scholar

Ockey, Gary. 2018. Oral language proficiency tests. The TESOL Encyclopedia of English language teaching. New Jersey: John Wiley & Sons.10.1002/9781118784235.eelt0234Search in Google Scholar

Ockey, Gary & Zhi Li. 2015. New methods and not so new methods for assessing oral communication. Language Value 7. 1–21. https://doi.org/10.6035/LanguageV.2015.7.2.Search in Google Scholar

O’Sullivan, Barry. 2012. Assessing speaking. The Cambridge guide to second language assessment, 234–246. New York, NY: Cambridge University Press.10.1002/9781118411360.wbcla084Search in Google Scholar

Piccardo, Enrica. 2013. L’évaluation en langues by E. Huver and C. Springer. The Canadian Modern Language Review/La revue canadienne des langues vivantes 69(4). 516–520.Search in Google Scholar

Polyakova, Oksana & Julia Zabala. 2016. State testing system in the Russian language for foreigners and the language accreditation model for the Spanish association of language centres in higher education: Towards mutual recognition. In María Luisa Carrió-Pastor (ed.), New challenges for language testing: Towards mutual recognition of qualifications, 119–140. Newcastle: Cambridge Scholar Publishing.Search in Google Scholar

Purpura, James E. 2016. Second and foreign language assessment. The Modern Language Journal 100. 190–208. https://doi.org/10.1111/modl.12308.Search in Google Scholar

Roever, Carsten & Tim McNamara. 2006. Language testing: The social dimension. International Journal of Applied Linguistics 16(2). 242–258. https://doi.org/10.1111/j.1473-4192.2006.00117.x.Search in Google Scholar

Rouveyrol, Laurent, Claire Maury-Rouan & Robert Vion. 2005. A linguistic toolbox for discourse analysis: Towards a multidimensional handling of verbal interactions. Discourse Studies 7(3). 289–314. https://doi.org/10.1177/1461445605052188.Search in Google Scholar

Skehan, Peter. 2009. Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied linguistics 30(4). 510–532. https://doi.org/10.1093/applin/amp047.Search in Google Scholar

Turner, Jean. 1998. Assessing speaking. Annual Review of Applied Linguistics 18. 192–207. https://doi.org/10.1017/s0267190500003548.Search in Google Scholar

Turner, Carolyn E. & John A. Upshur. 2002. Rating scales derived from student samples: Effects of the scale maker and the student sample on scale content and students’ scores. TESOL Quarterly 36. 49–70. https://doi.org/10.2307/3588360.Search in Google Scholar

Van Lier, Leo. 1989. Reeling, writhing, drawling, stretching, and fainting in coils: Oral proficiency interviews as conversation. TESOL Quarterly 23. 489–508. https://doi.org/10.2307/3586922.Search in Google Scholar

Vion, Robert. 1992. La Communication Verbale. Paris: Hachette.Search in Google Scholar

Vygotsky, Lev S. 1978. Mind in society: The development of higher psychological processes. Massachusetts: Harvard University Press.Search in Google Scholar

Vygotsky, Lev S. 1986. Thought and language. Massachusetts: The MIT Press.Search in Google Scholar

Williamson, David M., Xiaoming Xi & F. Jay Breyer. 2012. A framework for evaluation and use of automated scoring. Educational Measurement: Issues and Practice 31(1). 2–13. https://doi.org/10.1111/j.1745-3992.2011.00223.x.Search in Google Scholar

Young, Richard. 2000. Interactional competence: Challenges for validity. Paper presented at the American Association for Applied Linguistics, Vancouver, BC.Search in Google Scholar

Zabala-Delgado, Julia & Barbara Sawicka. 2019. Mutual recognition of certification systems: The case of SERMO and ACLES. Language Learning in Higher Education 9(2). 289–319. https://doi.org/10.1515/cercles-2019-0017.Search in Google Scholar

Received: 2021-12-16
Accepted: 2022-02-25
Published Online: 2022-06-09
Published in Print: 2022-05-25

© 2022 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 5.12.2022 from frontend.live.degruyter.dgbricks.com/document/doi/10.1515/cercles-2022-2039/html
Scroll Up Arrow