A benchmark usability study of the tactical decision making under stress decision support system

Abstract

This study evaluates the usability of a U.S. Navy Decision Support System (DSS). The DSS was developed to enhance the performance of tactical decision makers within a Navy Combat Information Center. The goals of this study were to test the DSS against usability criteria and objectives to track future redesign efforts and system improvements. The purpose of this analysis was to (1) assess the system's usability, (2) identify problems areas in the graphical user interface, (3) report trends in user feedback, and (4) provide recommendations addressing major usability issues encountered by participants. The study tested whether the DSS met the usability objectives of (a) 90% successful task completion, (b) ease of use ratings of somewhat easy or better, and (c) satisfaction ratings of somewhat satisfied or better. The DSS did not meet these usability objectives for task completion or ease or use, however the DSS did meet the usability objective for user satisfaction. All participants reported that they enjoyed working with the DSS and believed that it would be a significant step forward in information management. Based on the usability data gathered in the study, recommendations are provided to address the usability issues