Title page for ETD etd-05192004-122952

Type of Document Master's Thesis
Author Selvaraj, Prakaash V
Author's Email Address Cash@vt.edu
URN etd-05192004-122952
Title Comparative Study of Synchronous Remote and Traditional In-Lab Usability Evaluation Methods.
Degree Master of Science
Department Industrial and Systems Engineering
Advisory Committee
Advisor Name Title
Smith-Jackson, Tonya L. Committee Chair
Choong, Yee-yin Committee Member
Kleiner, Brian M. Committee Member
  • remote usability evaluation
  • critical incidents
  • usability method
  • synchronous remote usability testing
Date of Defense 2004-03-24
Availability unrestricted
Traditional in lab usability evaluation has been used as the ‘standard’ evaluation method for evaluating and improving usability of software user interfaces (Andre, Williges, & Hartson, 2000). However, traditional in lab evaluation has its drawbacks such as availability of representative end users, high cost of testing and lack of true representation of a user’s actual work environment. To counteract these issues various alternative and less expensive usability evaluation methods (UEMs) have been developed over the past decade. One such UEM is the Remote Usability Evaluation method.

Remote evaluation is a relatively new area and lacks empirical data to support the approach. The need for empirical support was addressed in this study. The overall purpose of this study was to determine the differences in the effectiveness of the two evaluation types, the remote evaluation approach (SREM) and the traditional evaluation approach, in collecting usability data. This study also compared the effectiveness between the two methods based on user type, usability novice users and usability experienced users. Finally, the hypothesis that users, in general, will prefer the remote evaluation approach of reporting to the traditional in-lab evaluation approach was also tested. Results indicated that, in general, the synchronous remote approach is at least as effective as the traditional in lab usability evaluation approach in collecting usability data across all user types. However, when user type was taken into consideration, it was found that there was a significant difference in the high severity negative critical incident data collected between the two approaches for the novice user group. The traditional approach collected significantly more high severity negative critical incident data than the remote approach. Additionally, results indicate that users tend to be more willing to participate in the same approach as the one they participated previously. Recommendations for usability evaluators for conducting the SREM approach and areas for future research are identified in the study.

  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  Thesis_Prakaash_Selvaraj.pdf 403.43 Kb 00:01:52 00:00:57 00:00:50 00:00:25 00:00:02
  Vita_Prakaash.pdf 32.85 Kb 00:00:09 00:00:04 00:00:04 00:00:02 < 00:00:01

Browse All Available ETDs by ( Author | Department )

dla home
etds imagebase journals news ereserve special collections
virgnia tech home contact dla university libraries

If you have questions or technical problems, please Contact DLA.