166 147

Title

Enhancing Information Fusion from UAV-Captured High-Altitude Infrared Imagery through Machine Learning

  Mustafa El-Taie 1 * ,   Aaras Y. Kraidi 2

1  Digital Charging Solutions GmbH, Germany
    (Mustafa.iessa@gmail.com)

2  University of Technology and Applied Science, Shinas, Oman
    (aaras.kraidi@shct.edu.om)


Doi   :   https://doi.org/10.54216/IJAACI.040204

Received: April 07, 2023 Revised: June 02, 2023 Accepted: August 26, 2023

Abstract :

Unmanned aerial vehicles (UAVs) equipped with high-altitude infrared imaging have revolutionized data collection, providing better spatial and temperature resolutions. However, an effective way to fuse and interpret this multidimensional data remains a challenge. Therefore, this research tackles this issue by incorporating machine learning specifically the YOLO object detector to fuse and analyze information from UAV-captured high-altitude infrared images. The process entails a careful fusion of data, feature extraction, and model configuration that is tailored to the unique qualities of infrared imagery. Furthermore, the confabulated YOLO model performs exceptionally well in detecting and localizing objects within the thermal spectrum. Results showed precise identification of objects as well as their localization thus indicating potential for advanced aerial surveillance and monitoring. This research represents a significant advancement in situation awareness across environmental monitoring, infrastructure inspection, and disaster response among other areas hence demonstrating the transformative ability of machine learning in aerial imaging analysis.

Keywords :

Machine Learning; Unmanned Aerial Vehicles; Infrared Image Processing; Information Fusion; Remote Sensing; Image Data Integration; Sensor Fusion.

References :

[1]    Munir, A., Kwon, J., Lee, J. H., Kong, J., Blasch, E., Aved, A. J., & Muhammad, K. (2021). FogSurv: A fog-assisted architecture for urban surveillance using artificial intelligence and data fusion. IEEE Access, 9, 111938-111959.

[2]    Zhao, X., Xia, Y., Zhang, W., Zheng, C., & Zhang, Z. (2023). YOLO-ViT-Based Method for Unmanned Aerial Vehicle Infrared Vehicle Target Detection. Remote Sensing, 15(15), 3778.

[3]    Tan, Y., Li, G., Cai, R., Ma, J., & Wang, M. (2022). Mapping and modelling defect data from UAV captured images to BIM for building external wall inspection. Automation in Construction, 139, 104284.

[4]    Zhang, X., He, Z., Ma, Z., Wang, Z., & Wang, L. (2021). Llfe: A novel learning local features extraction for uav navigation based on infrared aerial image and satellite reference image matching. Remote Sensing, 13(22), 4618.

[5]    Shao, Z., Cheng, G., Li, D., Huang, X., Lu, Z., & Liu, J. (2021). Spatio-temporal-spectral-angular observation model that integrates observations from UAV and mobile mapping vehicle for better urban mapping. Geo-spatial Information Science, 24(4), 615-629.

[6]    Ptak, B., PieczyƄski, D., Piechocki, M., & Kraft, M. (2022). On-board crowd counting and density estimation using low altitude unmanned aerial vehicles—looking beyond beating the benchmark. Remote Sensing, 14(10), 2288.

[7]    Wang, J., Wang, Y., Liu, L., Yin, H., Ye, N., & Xu, C. (2023). Weakly supervised forest fire segmentation in uav imagery based on foreground-aware pooling and context-aware loss. Remote Sensing, 15(14), 3606.

[8]    Tong, K., & Wu, Y. (2022). Deep learning-based detection from the perspective of small or tiny objects: A survey. Image and Vision Computing, 123, 104471.

[9]    Heidari, A., Jafari Navimipour, N., Unal, M., & Zhang, G. (2023). Machine learning applications in internet-of-drones: systematic review, recent deployments, and open issues. ACM Computing Surveys, 55(12), 1-45.

[10] Chang, Y., Li, D., Gao, Y., Su, Y., & Jia, X. (2023). An Improved YOLO Model for UAV Fuzzy Small Target Image Detection. Applied Sciences, 13(9), 5409.

[11] Wang, Y., Zou, H., Yin, M., & Zhang, X. (2023). SMFF-YOLO: A Scale-Adaptive YOLO Algorithm with Multi-Level Feature Fusion for Object Detection in UAV Scenes. Remote Sensing, 15(18), 4580.

[12] Yang, J., Yang, H., Wang, F., & Chen, X. (2022, December). A modified YOLOv5 for object detection in UAV-captured scenarios. In 2022 IEEE International Conference on Networking, Sensing and Control (ICNSC) (pp. 1-6). IEEE.

[13] Allen, R., & Mazumder, M. (2020, March). Toward an autonomous aerial survey and planning system for humanitarian aid and disaster response. In 2020 IEEE Aerospace Conference (pp. 1-11). IEEE.

[14] Mohsan, S. A. H., Khan, M. A., Noor, F., Ullah, I., & Alsharif, M. H. (2022). Towards the unmanned aerial vehicles (UAVs): A comprehensive review. Drones, 6(6), 147.

[15] Lyu, M., Zhao, Y., Huang, C., & Huang, H. (2023). Unmanned Aerial Vehicles for Search and Rescue: A Survey. Remote Sensing, 15(13), 3266.


Cite this Article as :
Style #
MLA Mustafa El-Taie , Aaras Y. Kraidi. "Enhancing Information Fusion from UAV-Captured High-Altitude Infrared Imagery through Machine Learning." International Journal of Advances in Applied Computational Intelligence, Vol. 4, No. 2, 2023 ,PP. 33-40 (Doi   :  https://doi.org/10.54216/IJAACI.040204)
APA Mustafa El-Taie , Aaras Y. Kraidi. (2023). Enhancing Information Fusion from UAV-Captured High-Altitude Infrared Imagery through Machine Learning. Journal of International Journal of Advances in Applied Computational Intelligence, 4 ( 2 ), 33-40 (Doi   :  https://doi.org/10.54216/IJAACI.040204)
Chicago Mustafa El-Taie , Aaras Y. Kraidi. "Enhancing Information Fusion from UAV-Captured High-Altitude Infrared Imagery through Machine Learning." Journal of International Journal of Advances in Applied Computational Intelligence, 4 no. 2 (2023): 33-40 (Doi   :  https://doi.org/10.54216/IJAACI.040204)
Harvard Mustafa El-Taie , Aaras Y. Kraidi. (2023). Enhancing Information Fusion from UAV-Captured High-Altitude Infrared Imagery through Machine Learning. Journal of International Journal of Advances in Applied Computational Intelligence, 4 ( 2 ), 33-40 (Doi   :  https://doi.org/10.54216/IJAACI.040204)
Vancouver Mustafa El-Taie , Aaras Y. Kraidi. Enhancing Information Fusion from UAV-Captured High-Altitude Infrared Imagery through Machine Learning. Journal of International Journal of Advances in Applied Computational Intelligence, (2023); 4 ( 2 ): 33-40 (Doi   :  https://doi.org/10.54216/IJAACI.040204)
IEEE Mustafa El-Taie, Aaras Y. Kraidi, Enhancing Information Fusion from UAV-Captured High-Altitude Infrared Imagery through Machine Learning, Journal of International Journal of Advances in Applied Computational Intelligence, Vol. 4 , No. 2 , (2023) : 33-40 (Doi   :  https://doi.org/10.54216/IJAACI.040204)