Creating virtual environments for evaluating human-machine teaming

Abstract

With the emergence of robots on the battlefield, it is critical for the Marine Corps to tactically integrate existing unmanned assets with manned systems during Marine Air Ground Task Force (MAGTF) operations. In parallel, the Marine Corps must also look forward to identify capability gaps that future unmanned systems might address. To do both requires extensive field testing, which is often unfeasible and always costly. This effort proposes the use of virtual environments (VE), virtual reality (VR) and agent-based modeling to conduct scenario-based assessments of Manned-Unmanned Teaming (MUM-T) during combat operations. To pursue such goals, the project examined a variety of relevant tactical scenarios where Marines and robots act in concert to achieve specific mission objectives. Such tactical scenarios are further assessed using deterministic combat simulations to create a valid methodology for behavior creation and assessment within each scenario-specific problem space. Support for a complete range of combat simulations was determined as a necessary part of VE design explorations since specific MUM-T tactics, techniques and procedures (TTPs) are expected to co-evolve constantly as sensor, communication and vehicle capabilities continue to improve. Such diversity was supported through establishment of the MOVES Live Virtual Constructive (LVC) Laboratory for diverse simulation tools. Additionally two general approaches for the coordination of Manned-Unmanned Teaming (MUM-T) behaviors were considered, each beginning with a high-level description of expected behaviors. Completion of the goal tasks indicates that combined human-robot teams have achieved a desired world state. This research surveyed a large variety of combat models and visualization tools to create the best and broadest possible environment for Marine Corps decision-makers to understand the complexity and warfighting value of the MUM-T battlespace. Even more broadly, shared VEs can potentially be used during force-development efforts to plan for the integration of human-machine teams into Naval combat forces. As the DoD is generally unfamiliar with such operations but is eagerly anticipating their development, it is quite clear that the use of live, virtual, constructive (LVC) simulations to wargame these capabilities becomes fundamental for all progress. Ultimately such human-machine teaming co-development is the critical path needed to expand Navy/Marine capabilities and avoid Navy/Marine vulnerabilities.