Articles by Jeff Sauro

Dr. Sauro is a six-sigma trained statistical analyst and founding principal of MeasuringU, a customer experience research firm based in Denver. He has conducted usability tests and statistical analysis for companies such as Google, eBay, Walmart, Autodesk, Lenovo, and Dropbox, and has published over 20 peer-reviewed research articles and 5 books, including Customer Analytics for Dummies.

Item Benchmarks for the System Usability Scale

Abstract From humble beginnings, the SUS has become a valuable tool in the toolkits of usability and user experience practitioners and researchers. We have developed regression equations that compute benchmarks for SUS items based on an overall SUS score. A review of the SUS literature on published benchmarks for the means of overall SUS scores […] [Read More]

SUPR-Qm: A Questionnaire to Measure the Mobile App User Experience

Abstract In this paper, we present the SUPR-Qm, a 16-item instrument that assesses a user’s experience of a mobile application. Rasch analysis was used to assess the psychometric properties of items collected from four independent surveys (N = 1,046) with ratings on 174 unique apps. For the final instrument, estimates of internal consistency reliability were […] [Read More]

Can I Leave This One Out? The Effect of Dropping an Item From the SUS

Abstract There are times when user experience practitioners might consider using the System Usability Scale (SUS), but there is an item that just doesn’t work in their context of measurement. For example, the first item is “I think I would like to use this system frequently.” If the system under study is one that would […] [Read More]

Revisiting the Factor Structure of the System Usability Scale

Abstract In 2009, we published a paper in which we showed how three independent sources of data indicated that, rather than being a unidimensional measure of perceived usability, the System Usability Scale apparently had two factors: Usability (all items except 4 and 10) and Learnability (Items 4 and 10). In that paper, we called for […] [Read More]

The Challenges and Opportunities of Measuring the User Experience

Not too long ago it seemed the biggest challenge facing companies was justifying any investment in usability and the user experience (Bias & Mayhew, 2005). While that has not entirely gone away, increasingly I see organizations facing a new challenge. Instead of worrying about how to justify any investment in the user experience, the shift […] [Read More]

SUPR-Q: A Comprehensive Measure of the Quality of the Website User Experience

Abstract A three part study conducted over five years involving 4,000 user responses to experiences with over 100 websites was analyzed to generate an eight-item questionnaire of website quality—the Standardized User Experience Percentile Rank Questionnaire (SUPR-Q). The SUPR-Q contains four factors: usability, trust, appearance, and loyalty. The factor structure was replicated across three studies with […] [Read More]

The Relationship Between Problem Frequency and Problem Severity in Usability Evaluations

Abstract The relationship between problem frequency and severity has been the subject of an ongoing discussion in the usability literature. There is conflicting evidence as to whether more severe problems affect more users or whether problem severity and frequency are independent, especially in the cases where problem severity is based on the judgment of the […] [Read More]

Rent a Car in Just 0, 60, 240 or 1,217 Seconds? – Comparative Usability Measurement, CUE-8

Abstract This paper reports on the approach and results of CUE-8, the eighth in a series of Comparative Usability Evaluation studies. Fifteen experienced professional usability teams simultaneously and independently measured a baseline for the usability of the car rental website Budget.com. The CUE-8 study documented a wide difference in measurement approaches. Teams that used similar […] [Read More]