Much attention has been paid in the recent literature to the notions of validity, thoroughness, and effectiveness of different Usability Evaluation Methods (UEMs). Calculation of these makes sense if a study aims to compare UEMs, but not, it is argued here, if a study aims to evaluate a given application. Illustrated by a case study employing different UEMs, it is argued here that for practitioners, UEMs serve to supplement, rather than compete against, each other. The study shows also that it is not possible to calculate validity, thoroughness, and effectiveness in actual usability studies.
Proceedings of the 7th International Conference on Work with Computer Systems (WWCS 2004), Kuala Lumpur, Malaysia, 29 June - 03 July 2004 / H.M. Khalid, M.G. Helander and A.W. Yeo (eds.),