Reflection (Week 12)
I had an experience of using English tests on computers. It’s a test on general English. The test required listening and reading skills from students and they needed to do short-answer, cloze, and multiple-choice questions. This is actually a placement test on computer, of which the result would be used for identifying targets for English remedial courses. Students whose result was at or below certain levels were strongly advised to take the remedial courses. I think the experience did show some advantages and disadvantages mentioned in the reading.
First, by clicking the mouse once at the end of the test, the students could get the result. This is a great advantage as students are always eager to know their performance. The effect of knowing the result immediately after the test was effective. When the students know that so many of them are eligible for the remedial courses, they started asking each other questions like “oh… are you joining?” The immediate result successfully threatened the students and made them aware of their poor English level.
In addition, the computer chose the questions for the students according to the student’s level. It prevented students from being frustrated by the difficult questions. I saw that everyone was surprisingly concentrated on the test without giving up and falling asleep on the desk like they did in ordinary paper-and-pencil exams.
However, there was a bad side of using a computer based assessment in that experience. As mentioned in the reading, it requires the user to have some computer literacy. To me, it doesn’t only mean the test taker but also the teacher. After the test, the system would generate an Excel file containing the test results. The teacher needed to save the file for administration purposes. Teachers with little computer knowledge would find this process scary. They were also nervous when they instructed the students to input the personal information before the test started, as they were afraid of making mistakes affecting the result. The presence of the technician was needed for every session, keeping the technician from his other duties.
One other problem was the time for each test session. Due to the large number of classes taking the test (around 1000 students in 7 days), the length of each session was limited to 30 minutes, with only 15-20 minutes actually for the test. When the time was up, students who had not finished the test should skip all questions until the result was generated. Would this affect the result? The students expressed doubts about the result afterward. Also, the students could skip the difficult questions and but couldn’t get back to them later. Once they had move forward to the next question, no amendments were allowed. The students would feel frustrated as well.
The final disadvantage that I have from that experience of using a computer-based assessment is about the management. Without doubt, computer-based assessments are convenient, but do the management people have enough knowledge of using them appropriately? The test was not just a tool for locating the targets for remedial classes, but it was also used as a post-course test indicating how much progress the students had in their English after taking the remedial courses. There were several remedial courses, e.g., courses on writing, grammar, and presentation skills. No matter which course the students take, they did the same test as the indicator of progress. I couldn’t understand the rationale. The students came to me and asked why. Would there be some theories that I don’t know supporting such a decision? Hope that I can find it out.