Simulation of Pan-Tilt-Zoom Tracking for Augmented Reality Air Traffic Control

Charles Hamesse, Benoit Pairet, Rihab Lahouli, Timothee Freville, Rob Haelterman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Using Augmented Reality (AR) technology for Air Traffic Control (ATC) holds great promise but comes with a number of technical challenges. In addition to displaying the position of surrounding aircraft, a zoomed-in view of a certain aircraft captured with a Pan-Tilt-Zoom (PTZ) camera is also very useful in practice. This is to allow the ATC officer to perform the visual checks that they typically do with large binoculars, directly with the AR headset. Therefore, the PTZ camera has to be able to track the aircraft in a fast and robust manner to produce images suitable to be projected on the AR headset. Unfortunately, PTZ tracking algorithms are notoriously hard to implement, since the captured images depend on the PTZ controls, which depend on the outputs of the tracking algorithm, which depend on the images. In this paper, we describe our generic framework which leverages 3D simulation to design PTZ tracking algorithms and offer an in-depth explanation of how we use it in the context of AR ATC.

Original languageEnglish
Title of host publication2021 International Conference on 3D Immersion, IC3D 2021 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665458306
DOIs
Publication statusPublished - 2021
Event2021 International Conference on 3D Immersion, IC3D 2021 - Virtual, Brussels, Belgium
Duration: 8 Dec 2021 → …

Publication series

Name2021 International Conference on 3D Immersion, IC3D 2021 - Proceedings

Conference

Conference2021 International Conference on 3D Immersion, IC3D 2021
Country/TerritoryBelgium
CityVirtual, Brussels
Period8/12/21 → …

Keywords

  • Air Traffic Control
  • Aircraft
  • Augmented Reality
  • Pan Tilt Zoom
  • Visual Tracker

Fingerprint

Dive into the research topics of 'Simulation of Pan-Tilt-Zoom Tracking for Augmented Reality Air Traffic Control'. Together they form a unique fingerprint.

Cite this