ABOUT
Genre: Serious Game/Simulation
Engine: Unity
Time Frame: 15 weeks
INTRODUCTION
Language and phraseology is a very important part of air traffic control, but most current simulations don’t prioritize teaching it. Using AI and voice recognition, our team created a virtual reality teaching simulation for air traffic controllers, where players can interact in real time with AI pilots to help planes safely land and take off.
As project lead, I worked on big-picture tasks such as documentation, presentations, and task management, as well as creating portions of the VR environment in Unity.
GOALS
The team began by researching air traffic and defining the problem. Once we had determined the issue, we began brainstorming solutions that would give users the best experience while fitting the client’s needs.
The team began by researching air traffic and defining the problem. Once we had determined the issue, we began brainstorming solutions that would give users the best experience while fitting the client’s needs.
Objectives
- Create a single scenario for an air traffic training simulation in VR.
- Use VR and voice recognition to create a flexible communication system.
- Bring an element of fun into a usually-stressful work environment.
DOCUMENTATION
As project lead, I created the majority of the documentation and presentations for the project, including a short game design document and a series of update presentations for the client.
PROCESS
Once the art style and goals of the game were established, the team began building the game in Unity. I used Jira to manage the team’s tasks in order to reach the goals set out in the GDD and assisted in-engine with environment creation and VR testing.
I also had the opportunity to visit Embry-Riddle Aeronautical University, where I spoke with real air traffic control students and professors and had the opportunity to see the university’s simulations in action.
RESULTS
The final product was a gamified VR simulation with voice recognition and GPT-4 integration, allowing air traffic controllers to speak directly into the simulation and watch planes respond to their commands in real time.
View the demo here: