Volume 12, Issue 4, August 2017

Introduction to Volume 12, Issue 4, August 2017

Bill Albert and James (Jim) R. Lewis

We are delighted to publish an editorial by Susan Hura titled “Usability Testing of Spoken Conversational Systems.” She provides valuable insights around the evaluation of voice interface systems. She describes specific issues around evaluating voice interfaces that are in an early stage of development, such as the use of “Wizard of Oz” testing. Her comprehensive review of the evaluation of voice interface systems gives usability practitioners a valuable set of guidelines […] [Read More]


Invited Essay: Usability Testing of Spoken Conversational Systems

Susan L. Hura

The philosophy behind usability testing for speech-enabled systems is shared with general usability practices, but many usability practitioners have little or no experience testing speech interfaces, and the specific techniques required for collecting valid and reliable data are not widely understood. Spoken language and conversation have a number of properties that should influence the methods used to test speech user interfaces […] [Read More]


Order Effects in Usability Questionnaires

Stephanie B. Linek

Usually, websites consist of several components (e.g., a homepage and subsections) that can be very different from each other. Thus, it can be advantageous to assess the usability separately for each part. Hence the question arises if and how the order in which the usability evaluation was done influences the results. The presented empirical study investigated order effects for the arrangement of the usability evaluation of the components of a website.  […] [Read More]


Revisiting the Factor Structure of the System Usability Scale

James (Jim) R. Lewis and Jeff Sauro

In 2009, we published a paper in which we showed how three independent sources of data indicated that, rather than being a unidimensional measure of perceived usability, the System Usability Scale apparently had two factors: Usability (all items except 4 and 10) and Learnability (Items 4 and 10). In that paper, we called for other researchers to report attempts to replicate that finding. The published research since 2009 has consistently failed to replicate that factor structure. […] [Read More]


A Next-Generation Augmented Reality Platform for Mass Casualty Incidents (MCI)

Fatih DemirSalman AhmadPrasad CalyamDuo JiangRui Huang, and Isa Jahnke

It is vitally important to coordinate resources, information sharing, and two-way communication between medical incident commanders (ICs) and first medical responders (paramedics) at mass casualty incidents (MCI) sites. Information at the time of disasters also needs to be effectively analyzed and presented through intelligent user interfaces. Such interfaces need to be easy-to-use by ICs to foster critical decisions that can potentially reduce mortality rates. […] [Read More]