Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing this collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT RETURN YOUR FORM TO THE ABOVE ADDRESS. REPORT DATE (DD-MM-YYYY DISTRIBUTION / AVAILABILITY STATEMENTApproved for public release; distribution is unlimited. SUPPLEMENTARY NOTES14. ABSTRACT Previous research on Distributed Mission Training (DMT) shows that pilots and Airborne Warning and Control System (AWACS) weapons directors rate DMT as highly effective for training multiship, multibogey air combat. DMT exercises were also used as opportunities for pilots participating in Flight Lead Upgrade (FLUG) training to gain experience in planning, briefing, leading, and debriefing 4-ship missions in an intensive air-to-air threat environment. We describe a 4-phase research program at the Air Force Research Laboratory, Warfighter Training Research Division (AFRL/HEA) in Apr 99 to assess the effectiveness of using DMT to augment FLUG training. We reviewed training records at one F-16 base to identify 4-ship FLUG missions that would benefit most from DMT experience and establish baseline rates for sorties repeated due to noneffective upgrading pilot proficiency. A 5-day DMT-FLUG protocol was developed targeting these missions. DMT-FLUG training exercises were conducted over one year. During these exercises, upgrading pilots led several missions of increasing complexity using the AFRL 4-ship DMT testbed in Mesa AZ with AWACS weapons controllers from AFRL's research facility at Brooks AFB TX. We assessed transfer to aircraft training through review of training records and interviews with both upgrading pilots and their instructors. Eight out of 12 upgrading pilots participating in DMT-FLUG successfully completed the program without any repeated missions, one pilot repeated one mission, two transferred out of fighters, and one pilot was still in training. We discuss pilots' and AWACS weapons directors' performance within DMT and identify mission tasks most appropriate for DMT.

REPORT DOCUMENTATION PAGEForm Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing this collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggeslions for reducing this burden to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT RETURN YOUR FORM TO THE ABOVE ADDRESS. training events at DMT platforms with computer-generated constructive models. The systems were integrated over a wide geographic area through secure networks carrying voice, video, data, and image information. The objectives of RoadRunner '98 were to: (a) demonstrate the state-of-the-art DMT technologies, (b) identify the strengths and weaknesses of these technologies, (c) explore how to best use this new training environment for desired and enhanced levels of team training effectiveness, and (d) develop a research and development agenda for the future. This report describes the RoadRunner '98 DMT system, the training missions included in the exercise, and results in terms of mission performance and feedback from participants. DMT strenths and areas for improvement are discussed together with recommendations for future training research exercises. REPORT DATE (DD-MM-YYYY) SUBJECT TERMS EXECUTIVE SUMMARYRoadRunner '98 was a research exercise designed to assess the technical feasibility and training potential of Distributed Mission Training (DMT). RoadRunner '98 was sponsored by the Air Force Modeling and Simulation Office (USAF/XOC) and conducted by the Air Force Research Laboratory, Warfighter Training Research Division (AFRL/HEA) and the Theater Air Command and Control Simulation Facility (TACCSF). DMT is an emerging training concept in which warfighters will use advanced, real-time simulators located around the world to conduct mission training in a virtual battlespace. As envisioned by Air Combat Command (ACC), DMT will complement current squadron training and large-force exercises by providing additional experience in performing tasks and missions that are infrequently practiced or highly constrained. Using DMT, warfighters will be able to interact with each other and with computergenerated forces to conduct composite force missions unconstrained by limitations of cost, safety, and security. The objectives of RoadRunner '98 were to determine whether state-of-theart DMT technologies were capable of supporting composite force training exercises over a wide area network and to va...

An experimental training program tests the DMT mettle through some tough terrain. MISSION TRAINING THE GOAL OF DISTRIBUTED MISSION TRAINING IS TO PROVIDE INDIVIDUALS with opportunities to train for real-world operational missions in an environment that is not constrained by security, cost, and safety restrictions. Even the most elaborate realworld field exercises place severe limitations on participants so they cannot really train the way they will operate. Unlike a training range, pilots in a virtual flight training environment can fly, attack, and defend themselves as they would in wartime. More importantly, they can then review their actions, discuss what they did well or poorly during training, decide how they would do it differently in the future, and then practice new plans in subsequent training events. IMPLEMENTING DISTRIBUTEDHere, we present a case analysis of a DMT implementation. An experimental training program named Road Runner'9 8 was conducted at the U.S. Air Force Research Laboratory to evaluate the training effectiveness of DMT systems. RoadRunner'98 combined virtual (man-in-theloop) training events on DMT platforms with computer-generated constructive models. The systems were integrated over a wide geographic area through secure networks carrying voice, data, and image information.The objectives of RoadRunner'98 were to demonstrate the state-of-the-art DMT technologies, identify the strengths and shortfalls of these COMMUNICATIONS OF THE ACM September I 999/Vol. 42. No. 9

No abstract

Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching existing data sources, gathering and maintaining the data needed, and completing and reviewing this collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestions for reducing this burden to Department of Defense, Washington Headquarters Services, Directorate for Information Operations and Reports (0704-0188), 1215 Jefferson Davis Highway, Suite 1204, Arlington, VA 22202-4302. Respondents should be aware that notwithstanding any other provision of law, no person shall be subject to any penalty for failing to comply with a collection of information if it does not display a currently valid OMB control number. PLEASE DO NOT RETURN YOUR FORM TO THE ABOVE ADDRESS. REPORT DATE (DD-MM-YYYY) SPONSORING / MONITORING AGENCY NAME(S) AND ADDRESS(ES) 10. SPONSOR/MONITOR'S ACRONYM(S) AFRL SPONSOR/MONITOR'S REPORT NUMBER(S) Air Force Research Laboratory Warfighter Training Research Division 6030 South Kent Street Mesa AZ 85212-6061 AFRL-HE-AZ-TR-2002-0192 DISTRIBUTION / AVAILABILITY STATEMENTApproved for public release; distribution is unlimited. ABSTRACTTraining specialists and subject-matter experts at the Air Force Research Laboratory's Mesa Research Site have been characterizing Distributed Mission Training (DMT) scenarios in terms of specific learning objectives linked to mission-essential competencies and to the underlying knowledge, skills, and experiences that are required for successful combat performance. As part of scenario characterization, we have identified the mission characteristics and levels of those characteristics that are important for complexity indexing. Techniques for determining overall scenario complexity and for relating scenario characteristics to mission essential competencies have been developed. This report presents results from a validation study comparing the new, analytically based complexity methodology with an empirically based approach. In addition, applications of the new assessment to both F-15 and F-16 weapon system capability and scenario characteristics to learning objectives while controlling overall complexity are discussed together with plans for developing DMT instructor support systems. SUBJECT TERMS