The increasing presence of Unmanned Aerial Vehicles (UAVs) in both civilian and military domains highlights the need for reliable detection systems for monitoring and surveillance. Although RGB cameras provide high-resolution imagery for UAV detection, their performance degrades significantly under low-light conditions. Conversely, thermal sensors are effective in detecting heat signatures, but lack the spatial resolution required for accurate localization. To overcome these limitations, this study explores a multimodal UAV detection approach based on the fusion of RGB and infrared (IR) data. We introduce a novel dataset comprising synchronized RGB and IR imagery of UAVs, captured from different viewpoints. The dataset includes recordings of several UAV models operating under various lighting and background conditions, ensuring a comprehensive benchmark for detection tasks. To present some metrics, we trained state-of-the-art deep learning-based object detection models on our data. The results demonstrate that by using a specific dataset, the detection accuracy can be enhanced, particularly in challenging conditions such as sunshine, sunset, and darkness, including different and variable backgrounds. This study highlights the potential of multimodal sensing for UAV detection and provides a foundation for future research on robust aerial surveillance systems.

Multi-Perspective RGB and Infrared Dataset for UAV Detection

Tavaris D.;Toma A.;Foresti G. L.;Scagnetto I.
;
Martinel N.
2025-01-01

Abstract

The increasing presence of Unmanned Aerial Vehicles (UAVs) in both civilian and military domains highlights the need for reliable detection systems for monitoring and surveillance. Although RGB cameras provide high-resolution imagery for UAV detection, their performance degrades significantly under low-light conditions. Conversely, thermal sensors are effective in detecting heat signatures, but lack the spatial resolution required for accurate localization. To overcome these limitations, this study explores a multimodal UAV detection approach based on the fusion of RGB and infrared (IR) data. We introduce a novel dataset comprising synchronized RGB and IR imagery of UAVs, captured from different viewpoints. The dataset includes recordings of several UAV models operating under various lighting and background conditions, ensuring a comprehensive benchmark for detection tasks. To present some metrics, we trained state-of-the-art deep learning-based object detection models on our data. The results demonstrate that by using a specific dataset, the detection accuracy can be enhanced, particularly in challenging conditions such as sunshine, sunset, and darkness, including different and variable backgrounds. This study highlights the potential of multimodal sensing for UAV detection and provides a foundation for future research on robust aerial surveillance systems.
File in questo prodotto:
File Dimensione Formato  
Multi-Perspective_RGB_and_Infrared_Dataset_for_UAV_Detection.pdf

accesso aperto

Descrizione: Multi-Perspective RGB and Infrared Dataset for UAV Detection
Tipologia: Versione Editoriale (PDF)
Licenza: Creative commons
Dimensione 3.23 MB
Formato Adobe PDF
3.23 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11390/1315024
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 1
social impact