2026
Plenary Speech
Xun Yan
Innovating the assessment of argumentation: The story behind the evolution of a local writing assessment
Assessing the construct of argumentation in second language writing is a perennial concern for both language testing and second language writing specialists. While scholarship in L2 writing has substantially deepened the theoretical construct of argumentation, language testing research must constrain its operationalization to ensure reliability, validity, and practicality. In large-scale assessments, argumentation is often captured indirectly, folded into broader categories such as organization or task completion. Local assessments, however, can serve as productive sites to explore more direct and fine-grained approaches to assessment argumentation. This talk traces the evolution of a local writing placement test designed to measure argumentation more directly and serve a complex network of stakeholders associated with the local writing program. Largely through a community of practice approach, this collaborative work has involved developing a shared construct definition among stakeholders, revising writing tasks to elicit argumentation, validating new rating scales, and exploring technological tools to automate selected processes. Ultimately, these innovations can strengthen alignment between assessment and instruction, enhancing the instructional effectiveness of L2 writing instructors and the learning experience of L2 writers.

Xun Yan is a professor of Linguistics, Second Language Acquisition and Teacher Education, and Educational Psychology at the University of Illinois Urbana-Champaign. His research interests include speaking and writing assessment, psycholinguistic and computational approaches to language testing, and language assessment literacy. His work can be found in Applied Linguistics, Assessing Writing, Journal of Second Language Writing, Language Assessment Quarterly, Language Learning, Language Testing, Studies in Second Language Acquisition, TESOL Quarterly, among others. He is a co-editor for Language Testing. Xun was the recipient of the ETS TOEFL Essentials New Scholar award in 2022 and the ILTA/Sage Best Book Award in 2024.
