2017
Workshop
Yasuyo Sawaki
An Introduction to Generalizability Theory for Analyzing Language Assessment Data
Generalizability theory (G theory; Brennan, 2001; Cronbach, Gleser, Nanda & Rajaratnam, 1972; Shavleson & Webb, 1991) is a statistical analysis technique that can be used to examine the consistency of information obtained from assessment instruments for both norm-referenced and criterion-referenced assessment score interpretations. A strength of G theory is its flexibility, which allows simultaneous modeling of multiple sources of measurement error that contribute to score variability. G theory can be used for analyzing the reliability of an existing assessment instrument as well as exploring an optimal measurement design of a new instrument. The purpose of this workshop is to provide participants with an overview of key concepts of univariate and multivariate G theory and a step-by-step introduction to conducting a G-theory analysis of language assessment data by using the computer program, mGENOVA (Brennan, 1999). No previous experience or knowledge of G theory is required to attend this workshop, while participants are expected to have some familiarity with classical test theory.
Yasuyo Sawaki is a Professor of Applied Linguistics at the School of Education, Waseda University in Tokyo, Japan. Sawaki earned her PhD degree in applied linguistics with a specialization in language assessment from the University of California, Los Angeles (UCLA) in 2003. Upon graduation, she took a position as a research scientist at Educational Testing Service in New Jersey, in the U.S. In 2009 she returned to Japan and joined the Waseda University faculty. Currently, she teaches various courses including language assessment, academic writing, and teacher education. Sawaki is interested in a variety of research topics in language assessment ranging from the validation of large-scale international English language assessments to the role of assessment in classroom English language instruction. Sawaki is currently an Executive Board member of the Japan Language Testing Association (JLTA), Secretary and Treasurer of the Asian Association for Language Assessment (AALA), and a member of the Editorial Advisory Board of the Language Assessment Quarterly journal (Routledge).