Eye Tracking Technology To Control Fighter Jets In Development

Experts at BAE Systems are developing technologies to enable pilots to control the fighter jet of the future with the blink of an eye.

As military domains become more contested, technologies become more complex, and sources of data multiply it is crucial that pilots are able to quickly access, assess and act on critical information. BAE Systems’ specialist team of Human Factors engineers collaborate with pilots to better understand and anticipate their needs in this challenging environment. These insights shape the intuitive technologies that the team is developing for the cockpit of the future.

One area the team is focusing on is technologies that enable pilots to control the cockpit in new ways.

"In terms of future concepts, we are looking at what we are calling a ‘wearable cockpit’. Here, you remove many of the physical elements of the cockpit, and replace it with a virtual display, projected through the helmet," said Lead Technologist Jean Page. "Essentially, it’s a software-only cockpit that’s upgradeable, adaptable and reconfigurable.”

“In such a world, we need to think about what controls are critical to the pilot and then make them easier to manage. Eye-tracking gives you the option of looking at something to highlight it and then making a gesture to ‘press’ a button, rather than having a series of physical buttons on the aircraft.”

In cockpit design terms, simply understanding where a pilot is looking during a particular phase of a mission is hugely beneficial. For example, enhancing the effectiveness of warning signals so that the pilot is given the right cues and subsequently making it easier for them to react.

"The really clever bit will be that based on where the pilot is looking, we can infer the pilot’s goal and use intelligent systems to support task performance and reduce the pilot’s workload," Page said. "We want to do it in a way that doesn’t always ask for permission, because that would get very annoying very quickly but equally, it is essential that it is always evident to the pilot what task the intelligent system is performing.”

BAE Systems Human Factors team demonstrated this approach in the future combat aircraft concept model, Tempest, which was unveiled for the first time at the 2018 Farnborough International Air Show. This concept model, developed by the U.K. Ministry of Defense, RAF and industry partners including BAE Systems illustrates how technologies such as eye tracking will shape the types of cockpit we expect to see in the combat air systems of the future.

(Image provided with BAE Systems news release)

FMI: www.baesystems.com