Mobile evaluation: what the data and the metadata told us

Search Swinburne Research Bank

Home

List of Titles

Please use this identifier to cite or link to this item: http://hdl.handle.net/1959.3/235845

Download PDF (Published version) (Adobe Acrobat PDF, -1 bytes)

Title: Mobile evaluation: what the data and the metadata told us
Author(s): Pedell, Sonja; Graham, Connor; Kjeldskov, Jesper; Davies, Jessica
Abstract: Evaluating mobile applications to identify usability problems presents a unique set of challenges. Not only is it difficult to capture data on an application that is inherently mobile, but generating an authentic environment of use is also problematic. This paper compares two traditional user-based approaches to evaluate a mobile system: one laboratory-based and the other in the field. These data serve as a basis for the primary focus of this study: the effectiveness of 'metadata' generated from 'rapid reflections'. These data were collected by the evaluators after each day of evaluation in order to investigate the quality of metadata in relation to the data of the two evaluation methods. The study also found that the laboratory study identified typical usability problems with the system at a more detailed level whilst the field study identified characteristic problems of mobile use. The metadata findings summarised the major findings in a useful way, but generally were less specific and reflected subjective theories of individual researchers.
Publication type: Conference paper
Source: Proceedings of the 2003 Australasian Computer Human Interaction Conference (OzCHI 2003), Brisbane, Queensland, Australia, 26-28 November 2003 / Stephen Viller and Peta Wyeth (eds.), pp. 96-105
Publication year: 2003
Keyword(s): Data; Evaluation methods; Metadata; Mobile applications; Mobile devices; Mobile evaluation; Mobile systems; Usability
Publisher: Computer Human Interaction Special Interest Group
ISBN: 9781864997385, 1864997389
Publisher URL: http://www.ergonomics.org.au/chisig.aspx
Full text
Peer reviewed