Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR
This is a review of research article , “Are three methods better than one? A comparative assessment of usability evaluation’’ by Walji et al ‘.
The main objective of this study is to comparatively evaluate the effectiveness of three different methods involving end-users for detecting usability problems in an EHR:user testing,semi-structured interviews and surveys.
Data were collected at two major urban dental schools from faculty, residents and dental students to assess the usability of a dental EHR for developing a treatment plan. These included user testing (N=32), semi-structured interviews (N=36), and surveys (N=35).
The three methods together identified a total of 187 usability violations: 54% via user testing, 28% via the semi-structured interview and 18% from the survey method, with modest overlap. These usability problems were classified into 24 problem themes in 3 broad categories. User testing covered the broadest range of themes (83%), followed by the interview (63%) and survey (29%) methods.
Use of multi-method approach to test the usability of HIT provides a more comprehensive picture of Usability challanges.
Three methods includes user testing,semi-structured interviews and open-ended surveys are complementary and it provides unique insight for software development.
- Muhammad F. Walji, Elsbeth Kalenderian, Mark Piotrowski, Duong Tran, Krishna K. Kookal, Oluwabunmi Tokede, Joel M. White, Ram Vaderhobli, Rachel Ramoni, Paul C. Stark, Nicole S. Kimmes, Maxim Lagerweij, Vimla L. Patel, Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR, International Journal of Medical Informatics, Volume 83, Issue 5, May 2014, Pages 361-367, ISSN 1386-5056, http://dx.doi.org/10.1016/j.ijmedinf.2014.01.010. (http://www.sciencedirect.com/science/article/pii/S1386505614000239).