Home List of Titles A comparison of an innovative web-based assessment tool utilizing confidence measurement to the traditional multiple choice, short answer and problem solving questions
Please use this identifier to cite or link to this item: http://hdl.handle.net/1959.3/25434
- A comparison of an innovative web-based assessment tool utilizing confidence measurement to the traditional multiple choice, short answer and problem solving questions
- Farrell, Graham N.
- Computerized assessment is playing a major role in IT education, with extensive utilization of the multiple choice question (MCQ) format. This is mainly due to the ease of adaptation of MCQs into the internet environment, offering extensive advantages to both the student and the instructors. This study analyzes the results of students' grades using an alternative web-based assessment tool and the more traditional modes of assessment, being Multiple Choice Questions, Short answers and Problem Solving (Scenario) questions. The Multiple Choice Questions with Confidence Measurement (MCQCM) is a web based assessment tool that permits the student to register their level of confidence in their answer, and was included as a revision tool for the duration of the semester and as a component of the final exam. Additionally the exam also contained questions using more traditional methods for assessment. A total 43 students sat the final exam producing some interesting results. The statistical analysis indicated that the correlation between the MCQCM and the other alternatives ranges from strong to medium. In addition it appears that the MCQCM demonstrated equal to slightly stronger convergence of validity compared to the traditional MCQ method and the other alternative assessment methods.
- Publication type
- Conference paper
- Research centre
- Swinburne University of Technology. Faculty of Information and Communication Technologies
- Research into E-Assessment : Proceedings 10th Computer Assisted Assessment International Conference, Loughborough University, England, United Kingdom, 04-05 July 2006, p. 195-202
- Publication year
- Innovative web-based assessment tool; Confidence measurement; Multiple choice assessments; Short answer assessments; Problem solving assessments; Comparative analysis; Convergence validity; Reliability
- Professional Development Loughborough University
- Publisher URL
- Peer reviewed