Evaluation Of Pilot Flight Performance And Cockpit Interaction With A Mixed Reality Headset In A Helicopter Simulator

Abstract

The demand for pilots is expected to increase in the future. More efficient and cost-effective training methods are required to meet the growing demand. Currently, training is carried out both in a real helicopter and in simulation. However, simulation-based training with a mixed reality (MR) headset has the potential to complement the traditional methods by offering an affordable, movable training platform, and safe training environment for helicopter pilots. MR technology holds a unique advantage in helicopter simulator training, as it integrates physical controls and instruments, creating a more authentic and engaging experience that surpasses virtual reality alone in terms of realism and immersion. This enables pilots to practice complex procedures that require manual interaction with cockpit elements, such as pressing buttons or adjusting knobs, in a way that virtual reality simulations may not fully replicate. However, mixed reality technology also has its own set of challenges. This study investigates the benefits, drawbacks, and limitations of employing a mixed reality headset as a visual system within a helicopter simulation environment. To achieve this goal, a piloted simulation campaign was conducted at the German Aerospace Center’s (DLR) Air Vehicle Simulator (AVES). A MR headset and a projection dome were utilized as the two visual systems under comparison. Pilots were instructed to perform standard flight maneuvers and malfunction procedures. The evaluation focuses on the comparison of the visual systems regarding presence, simulation sickness and flight performance.