Analyzing Log File Data to Evaluate Computer-Assisted Language Learning Exercises
This study aimed at evaluating the appropriateness of a CALL system’s exercises and examining the relationship between exercise types and difficulty level by analyzing log file data. There were 233 participants and 5 exercise types (graphic choice, inline speech choice, inline text choice, text choice, and speech choice) in this study. The appropriateness of the exercises is determined by using two criteria.  The proportion of learners who answered a given question correctly (the P-values) should be between .20 and .80. And  the percentage of correct responses of B1 learners should be larger than the percentage of correct responses of A2 learners, which in turn should be larger than the percentage of correct responses of A1 learners. The results show that 203 out of 976 exercises meet both criteria. The graphic choice type is generally easy, the text choice exercises (text choice and inline text choice) are moderately difficult, and the speech choice exercises (speech choice and inline speech choice) are most challenging.
Faculteit der Letteren