Articles by James R. (Jim) Lewis, Ph.D

Dr. Lewis is a senior human factors engineer (at IBM since 1981). He has published influential papers in the areas of usability testing and measurement. His books include Practical Speech User Interface Design and (with Jeff Sauro) Quantifying the User Experience (now in its second edition).

Introduction to Volume 13, Issue 4

We are delighted to publish an editorial by Marc Hassenzahl titled “A Personal Journey Through User Experience.” The author explores the relationship between function, beauty, and pleasure in product design from a historical perspective. In his essay, he argues that many in the usability community have historically neglected the importance of hedonics in our research […] [Read More]

Introduction to Volume 13, Issue 3

For our May 2018 issue, we start with an invited essay from Jeff Kelley on the origins of the Wizard of Oz (WoZ) prototyping methodology in the lab directed by one of the fathers of modern human factors engineering—Alphonse Chapanis.  Widely regarded as the originator of the WoZ method, in his essay, “Wizard of Oz […] [Read More]

Item Benchmarks for the System Usability Scale

Abstract From humble beginnings, the SUS has become a valuable tool in the toolkits of usability and user experience practitioners and researchers. We have developed regression equations that compute benchmarks for SUS items based on an overall SUS score. A review of the SUS literature on published benchmarks for the means of overall SUS scores […] [Read More]

Introduction to Volume 13, Issue 2

We are delighted to publish an editorial by Elizabeth Rosenzweig, Aaron Nathan, Nicholas Manring, and Tejaswini Rao Racherla titled “Creating a Culture of Self- Reflection and Mutual Accountability.” The authors explore the topic of bias in user research, with a particular focus on UX professionals evaluating their own designs. They argue that potential bias can […] [Read More]

Introduction to Volume 13, Issue 1

For our November 2017 issue, we start with an invited essay from Bill Gribbons on “Is It Time to Drop the ‘U’ (From UX)?”  In this thoughtful and provocative contribution, he argues for and considers the potential consequences of changing the way we refer to our field—specifically, changing from “User Experience” to “Experience Design.” In […] [Read More]

Can I Leave This One Out? The Effect of Dropping an Item From the SUS

Abstract There are times when user experience practitioners might consider using the System Usability Scale (SUS), but there is an item that just doesn’t work in their context of measurement. For example, the first item is “I think I would like to use this system frequently.” If the system under study is one that would […] [Read More]

Introduction to Volume 12, Issue 4

We are delighted to publish an editorial by Susan Hura titled “Usability Testing of Spoken Conversational Systems.” She provides valuable insights around the evaluation of voice interface systems. She describes specific issues around evaluating voice interfaces that are in an early stage of development, such as the use of “Wizard of Oz” testing. Her comprehensive […] [Read More]

Revisiting the Factor Structure of the System Usability Scale

Abstract In 2009, we published a paper in which we showed how three independent sources of data indicated that, rather than being a unidimensional measure of perceived usability, the System Usability Scale apparently had two factors: Usability (all items except 4 and 10) and Learnability (Items 4 and 10). In that paper, we called for […] [Read More]