Developers' Needs and Severity Conceptions of Usability Problems

Abstract

To improve products effectively, usability testing reports must be comprehensible for developers. How-ever, it remains unclear which information is helpful and whether developers agree on the severity of usability issues with usability researchers. In this case study, a team of software developers rated three forms of usability feedback: (1) a low-detailed presentation of obtrusive usability problems, (2) a low-detailed list of aggregated problems, and (3) a high-detailed list of unique and aggregated usability prob-lems. Furthermore, developers and usability researchers independently created criteria for low, medium, and high severe usability problems, based on their respective expertise. Our analyses indicate that (1) and (3) were both perceived as helpful. Moreover, agreement within each group and between both groups was high, indicating that developers and usability researchers can have a similar understanding regarding the severity of usability issues.