This paper presents the lessons learned when a computational GOMS modeling tool was used to evaluate user interface concepts and team structure designs for a new class of military shipboard workstations. The lessons are both encouraging and cautionary: For example, computational GOMS models scaled well to a large and complex task involving teams of users. Interruptability and working memory constructs had to be added to conventional GOMS model concepts. However, two surprises emerged: First, the non-psychological aspects of the model construction were the practical bottleneck. Second, user testing data in this domain were difficult to collect and lacked definition, meaning that the model provided a better characterization of the design details than the user testing data. Included in these lessons are recommendations for future model applications and modeling methodology development.

No abstract

The public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing the burden, to the Department of Defense, Executive Services and Communications Directorate (0704-0188). Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. [ PLEASE DO NOT RETURN YOUR SPONSORING/MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR'S ACRONYM(S) SPONSOR/MONITOR'S REPORT NUMBER(S) THIS PAGE INTENTIONALLY LEFT BLANK] ABSTRACTThis report summarizes an investigation of the application of a spatialized audio interface over headphones for use in submarine sonar operations and training that was performed in the period from

Public reporting burden for the collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Abstract Computational tools and techniques for modeling team performance have advanced significantly in recent years. However, there have been few efforts to combine complementary modeling approaches. In the Manning Affordability Initiative, we have applied three modeling technologies to experimental data from a single domain (air defense warfare), a single scenario, and common watchstation technologies (current AEGIS technology and an advanced prototype). The conclusion of this multi-year project in early 2002 offers an opportunity to review the findings. The proposed panelists will summarize a human-in-the-loop experiment conducted to provide modeling data and present findings from efforts to integrate three modeling approaches for design and design validation. Team Optimal Design (TOD) focuses on team modeling. The Integrated Performance Modeling Environment (IPME) uses a general task modeling technique that applies well to individuals or teams. The GOMS Language Evaluation and Analysis Tool (GLEAN) combines individual models of users interacting as a team. IntroductionThe completion this year of the Manning Affordability Initiative (MAI), sponsored by the Office of Naval Research, offers the military R&D community an opportunity to assess a human-centered approach to designing and manning Navy systems. The project consisted of three initiatives. Prototype watchstations were developed using human-centered design methods to enable watchstanders to access

conducted in compliance with all applicable federal regulations governing the protection of human subjects in research.The authors wish to acknowledge Derek Schwaller, our biomedical engineer, for his tireless, conscientious achievements in instrumentation, data gathering, digital editing and signal analysis. Special acknowledgment is due to Surgeon Commander Steven Ryder, Royal Navy for invaluable guidance during the design of this research and clinical evaluation of our selected "patients". We greatly appreciate the voluntary efforts of LT Michael Waltz, MC, who took over as medical monitor for LT Jackman MC, and who, was not only able to enlist our highly trained medical listeners on short notice, but also endured at least five hours as a subject himself. We appreciate the efforts of all our participants for their conscientious performance, patience and endurance in such a demanding task. We are intensely grateful to Lynne Marshall for her extensive editorial efforts as a reviewer to help make this report more clearly convey our findings.This research is dedicated to Thomas E. Hanna, a Braveheart who led by example. Thanks for your confidence and support from the onset.Joseph S Russotti, is Principal Investigator, and Thomas P. Santoro, LT Robert Jackman, MC, LT Deborah White, MSC, are all Associate Investigators on this project at the Naval Submarine Medical Research Laboratory. The co-authors are listed in alphabetical order since each contributed equally to this research project.ii SUMMARY PAGEThe Problem: Conventional stethoscopes cannot function effectively unless ambient noise is maintained at approximate examination-room levels. This serious limitation inhibits diagnosis and monitoring of patients in a variety of common military medical situations: in field hospitals, in high ambient noise environments such as engine rooms, in vehicles such as ambulances, fixed and rotary wing aircraft, or in hyperbaric chamber treatment facilities. Trying to measure blood pressure, determining if a faint heart-beat is present in a casualty, or listening to respiratory events can be nearly impossible under field conditions.The Approach: The objective of this project was to evaluate commercial off-the-shelf (COTS) products and recommend one or several compact noise-reducing/canceling stethoscopes for field, medical-transport, and shipboard use, in moderately noisy environments (up to 90 dB SPL). At the onset of this project a working group was convened to assess Navy need and requirements for a noise-reducing stethoscope for casualty care and general medical use. In general terms, given present and projected COTS state-of-the-art technology, a modular approach using a simpler device tailored to the application, will be more cost-effective, for general-issue, than a single device. We selected three such simpler devices for laboratory testing using both the listening-headsets provided, and a highly accurate active noise cancellation (ANC) headset.The Findings: Laboratory data show exceptional performance of noise reducti...