Virtual Perspectives Augmenting Natural Experience – Raytheon – DARPA

Crew Augmentation

Traditional combat vehicle designs have small windows that improve protection, but limit visibility. GXV-T sought solutions with multiple onboard sensors and technologies to provide high-resolution, 360-degree situational awareness while keeping the vehicle enclosed.

Enhanced 360-degree Awareness with Virtual Windows
Honeywell International demonstrated its windowless cockpit in an all-terrain vehicle (ATV) with an opaque canopy. The 3-D near-to-eye goggles, optical head-tracker and wrap-around Active Window Display screens provide real-time, high-resolution views outside the vehicle. In off-road courses, drivers have completed numerous tests using the system in roughly the same time as drivers in All Terrain Vehicles (ATVs) with full visibility.

Virtual Perspectives Augmenting Natural Experience (V-PANE)
A tactical vehicle offers limited visibility and data for decision-making, especially when moving rapidly through unfamiliar territory. Raytheon BBN Technologies’ V-PANE technology demonstrator fuses data from multiple vehicle-mounted video and LIDAR cameras to create a real-time 3-D model of the vehicle and its nearby surroundings. In a final Phase 2 demonstration, drivers and commanders in a windowless recreational vehicle successfully switched among multiple virtual perspectives to accurately maneuver the vehicle and detect targets of interest during both low- and high-speed travel.
Off-Road Crew Augmentation (ORCA)

A second CMU NREC technology demonstration, ORCA aims to predict in real time the safest and fastest route and when necessary, enable a vehicle to drive itself off-road – even around obstacles. In Phase 2 testing, drivers using the ORCA aids and visual overlays traveled faster between waypoints and eliminated nearly all pauses to determine their routes. The team found autonomy improved either vehicle speed or risk posture, and sometimes both.

more : Virtual Perspectives Augmenting Natural Experience – Raytheon – DARPA