RSAF uses simulators & AI to better determine pilot potential

Actions
https://www.mindef.gov.sg/web/wcm/connect/pioneer/354a20c1-98c7-4b82-b151-996f1b91517d/09jun23_news1-thumbnail.jpg?MOD=AJPERES&CACHEID=ROOTWORKSPACE.Z18_1QK41482LG0G10Q8NM8IUA1051-354a20c1-98c7-4b82-b151-996f1b91517d-oYYhovr /web/wcm/connect/pioneer/354a20c1-98c7-4b82-b151-996f1b91517d/09jun23_news1-thumbnail.jpg?MOD=AJPERES&CACHEID=ROOTWORKSPACE.Z18_1QK41482LG0G10Q8NM8IUA1051-354a20c1-98c7-4b82-b151-996f1b91517d-oYYhovr /web/portal/pioneer/article/regular-article-detail/ops-and-training/2023-Q2/09jun23_news1
/web/portal/pioneer/article/regular-article-detail/ops-and-training/2023-Q2/09jun23_news1
09jun23_news1
09 Jun 2023 | OPS & TRAINING

RSAF uses simulators & AI to better determine pilot potential

//Report by Thrina Tham / Photos by Chai Sian Liang

Through an experimental programme using flight simulators and sports wearables, as well as data analytics and artificial intelligence, the RSAF aims to train and assess pilot trainees more effectively. 

Pilot trainee 2nd Lieutenant Natalie Quahe taking down a target in a flight simulator at the Project SOAR Simulator Centre.

Where do pilots look at when flying? Do they remain calm in the face of an engine breakdown? How precise are their controls as they pursue and take down a target?

The Republic of Singapore Air Force (RSAF) can now answer these questions. Under a new trial programme – Project SOAR – the air force is using simulators and biometric sensors, paired with data analytics, to train and assess its pilot trainees.

Typically, pilot trainees fresh out of Basic Military Training are sent to the Air Grading Centre (AGC) in Australia, after passing their screening and aptitude test. There, they are assessed by flying the CT-4B training aircraft.

With Project SOAR, they undergo a 10-day training at the Air Force Training Command in Singapore, before the AGC.

The high-fidelity flight simulator can inject different scenarios and environments, such as bad weather, into pilot training.

Trainees take on different scenarios in the advanced, high-fidelity simulators at the Project SOAR Simulator Centre – while wearing equipment that capture their eye movement, facial expressions, electrocardiogram or ECG levels (that tracks heart beat and rhythm) and more.

The data is pumped into an artificial intelligence (AI) programme that is able to predict the pilot's flying potential and help improve their performance.

This allows them to learn basic flying techniques like take-off and landing, as well as go through scenarios like combat manoeuvres or handling emergencies.

Live data collected during the simulation is put through an AI programme to better assess the pilot trainee’s fly potential as well as strengths and weaknesses.

Project SOAR uses data analytics and artificial intelligence to make sense of live data collected from the trainee's flight simulation. Trainees are given a debrief after each mission to learn from their mistakes.

"With data being collected in the background, along with the debriefing, (the project) can improve the instructor's assessment of the trainees, and the trainees' learning is accelerated," said Major (MAJ) Jeremy Lim, who heads SOAR.

Currently, instructors assess trainees by accompanying them on live flights to observe how they fly. This is a load on them as they note their observations on paper, while guiding the trainees and watching out for the environment, added MAJ Lim.

About 250 trainees have gone through Project SOAR since its first run in September 2021.

Trainees also don an eye tracker that is able to accurately pinpoint where they are looking at.

This means that instructors are able to advise the pilot trainees if they are fixing their gaze (for example, watching their altitude meter too much) instead of scanning both the outside and inside of the aircraft.

To integrate the wearables for this project, the RSAF partnered with DSO National Laboratories and the Ministry of Defence's Future Systems and Technology Directorate.

Feedback from trainees and instructors about the programme has been positive, says MAJ Lim.

Project SOAR began in January 2020, with its first run of trainees starting in September 2021. Since then, 250 trainees have gone through the programme.

The feedback from trainees and instructors has been positive, said MAJ Lim. who is also a qualified F-16 pilot and flying instructor.

"Project SOAR was able to give trainees that (flying) experience before live flying… (They are then) able to work on their weaknesses during a live flight and emerge as a stronger pilot."

The programme is in its experimental stage and will be evaluated for further use in assessing pilot trainees.

Suggested Reading
RSAF's latest helicopters turn fully operational
Cover story
RSAF's latest helicopters turn fully operational
MILESTONES
11-Apr-24

The H225M medium-lift and CH-47F heavy-lift helicopters will enhance the RSAF's capabilities in operations ranging from search and rescue to disaster relief to troop lift.

Finding her wings as a C-130 pilot
Finding her wings as a C-130 pilot
PEOPLE
18-Mar-24

Despite taking a longer route, former graduate analyst CPT Fiona Lee realised her dream to be become an RSAF pilot.

训练将在全新的新加坡武装部队军训城和战斗回路中开始
Cover story
训练将在全新的新加坡武装部队军训城和战斗回路中开始
OPS & TRAINING
28-Feb-24

从今年开始,随着三个新的器件化作战训练场和新加坡武装部队军训城的逐步开放,士兵们将能够进行更真实、更有效地训练。

LATIHAN AKAN BERMULA DI BANDAR SAFTI BAHARU & LITAR MEDAN TEMPUR
Cover story
LATIHAN AKAN BERMULA DI BANDAR SAFTI BAHARU & LITAR MEDAN TEMPUR
OPS & TRAINING
28-Feb-24

Mulai tahun ini, anggota tentera akan dapat berlatih dengan lebih realistik dan berkesan apabila tiga Litar Pertempuran Berinstrumen baharu dan Bandar SAFTI dibuka secara progresif.

Training set to begin in new SAFTI City & battle circuits
Cover story
Training set to begin in new SAFTI City & battle circuits
OPS & TRAINING
28-Feb-24

Starting this year, soldiers will be able to train more realistically and effectively as three new Instrumented Battle Circuits and SAFTI City progressively open up.

国防部购置8架F-35A战斗机;平台升级步入正轨 Feature
国防部购置8架F-35A战斗机;平台升级步入正轨
OPS & TRAINING
28-Feb-24

除了之前宣布购置12架F-35B外,还购置了8架全新的F-35A战斗机,这是建设强大新加坡武装部队的稳定、长期投资的一部分。

MINDEF AKAN PEROLEH 8 JET PEJUANG F-35A; NAIK TARAF PLATFORM SEDANG DIJALANKAN Feature
MINDEF AKAN PEROLEH 8 JET PEJUANG F-35A; NAIK TARAF PLATFORM SEDANG DIJALANKAN
OPS & TRAINING
28-Feb-24

Pemerolehan lapan jet pejuang F-35A baharu, sebagai tambahan kepada 12 jet pejuang F-35B yang diumumkan sebelum ini, merupakan sebahagian daripada pelaburan jangka panjang yang stabil untuk membina SAF yang kukuh.

MINDEF to acquire 8 F-35A fighter jets; platform upgrades on track Feature
MINDEF to acquire 8 F-35A fighter jets; platform upgrades on track
OPS & TRAINING
28-Feb-24

The acquisition of eight new F-35A fighter planes, in addition to 12 F-35Bs previously announced, are part of a steady, long-term investment to build a strong SAF.

SAF personnel recognised for supporting Australia flood relief operations
SAF personnel recognised for supporting Australia flood relief operations
PEOPLE
27-Feb-24

Over 50 medals were awarded to SAF personnel for their contributions overseas, which included flood relief operations and counter-terrorism efforts.

Behind the RSAF's static display at S'pore Airshow 2024 Feature
Behind the RSAF's static display at S'pore Airshow 2024
COMMUNITY
20-Feb-24

Get a rare behind-the-scenes glimpse of the challenging overnight towing operation as the Republic of Singapore Air Force (RSAF) prepares for its static display at the Singapore Airshow 2024!