Developing a Web-Based Intelligent Language Assessment Platform Powered by Natural Language Processing Technologies

Authors

  • Sarah Löber Hector Research Institute of Education Sciences and Psychology, University of T¨ubingen; LEAD Graduate School and Research Network, University of T¨ubingen
  • Björn Rudzewitz Hector Research Institute of Education Sciences and Psychology, LEAD Graduate School and Research Network, University of T¨ubingen
  • Daniela Verratti Souto Hector Research Institute of Education Sciences and Psychology, University of T¨ubingen
  • Luisa Ribeiro-Flucht Hector Research Institute of Education Sciences and Psychology, University of T¨ubingen; LEAD Graduate School and Research Network, University of T¨ubingen
  • Xiaobin Chen Hector Research Institute of Education Sciences and Psychology, University of T¨ubingen; LEAD Graduate School and Research Network, University of T¨ubingen

DOI:

https://doi.org/10.3384/ecp211010

Keywords:

ICALL, language assessment, language testing, automatic scoring, formative assessment, data collection, SLA

Abstract

We introduce System, an intelligent language assessment platform and reusable module that streamlines the creation, administration and scoring of language proficiency tests supported by Natural Language Processing (NLP) technologies. As a first implementation, we realized an automatic pipeline for the Elicited Imitation Test (EIT), a popular test format that has been widely adopted in language learning research for general proficiency and formative assessments. The platform can be extended to other test formats and assessment types. System is a valuable tool for standardizing data collection in Second Language Acquisition (SLA) and Intelligent Computer Assisted Language Learning (ICALL) research as well as serving as an application for classroom assessment. In this paper, we present the design of the system and a preliminary evaluation of LLMs for generating language errors in EIT items. We conclude with a future outlook as well as limitations. 

Downloads

Published

2024-10-15

Issue

Proceedings of the 13th Workshop on Natural Language Processing for Computer Assisted Language Learning (NLP4CALL 2024)

Section

Contents

License

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.