Analyzing Log File Data to Evaluate Computer-Assisted Language Learning Exercises
Keywords
Authors
Issue Date
2017-06-16
Language
en
Document type
Journal Title
Journal ISSN
Volume Title
Publisher
Title
ISSN
Volume
Issue
Startpage
Endpage
DOI
Abstract
This study aimed at evaluating the appropriateness of a CALL system’s exercises and examining the relationship between exercise types and difficulty level by analyzing log file data. There were 233 participants and 5 exercise types (graphic choice, inline speech choice, inline text choice, text choice, and speech choice) in this study. The appropriateness of the exercises is determined by using two criteria. [1] The proportion of learners who answered a given question correctly (the P-values) should be between .20 and .80. And [2] the percentage of correct responses of B1 learners should be larger than the percentage of correct responses of A2 learners, which in turn should be larger than the percentage of correct responses of A1 learners. The results show that 203 out of 976 exercises meet both criteria. The graphic choice type is generally easy, the text choice exercises (text choice and inline text choice) are moderately difficult, and the speech choice exercises (speech choice and inline speech choice) are most challenging.
Description
Citation
Supervisor
Faculty
Faculteit der Letteren