Welcome to Scholar Publishing Group

Machine Learning Theory and Practice, 2025, 5(1); doi: 10.38007/ML.2025.050106.

Anti drone intelligent tracking and aiming system optimized by computer vision and deep learning

Author(s)

Wenjie Jiang, Liuqing Yang

Corresponding Author:
Wenjie Jiang
Affiliation(s)

Guangzhou College of Commerce, Guangzhou College of Commerce, School of Information Technology & Engineering, Guangzhou, 511363, China

Abstract

This paper proposes an anti drone intelligent tracking and aiming system based on computer vision and deep learning optimization to address the challenges of dataset scarcity, difficulty in small target recognition, low efficiency of embedded deployment, and limited detection range in drone visual inspection. A ground to air unmanned aerial vehicle (UAV) dataset GA Fly, consisting of 10800 4K images, was constructed in this study, covering diverse shooting angles, lighting conditions, and target scales. The experiment showed that low altitude complex backgrounds significantly interfere with detection accuracy. At the algorithmic level, a YOLO Drone detection model was designed, which achieved a 6.1% improvement in mAP50:95 and an 82% reduction in the number of detection head parameters in small object detection tasks through multi-scale dense connection modules (MDC) and mixed head structures (MSH); By combining LAMP pruning and knowledge distillation techniques, the model parameters were compressed by 88% while maintaining an accuracy improvement of 0.4%. In terms of embedded deployment, based on the Jetson AGX Orin platform, real-time inference of 14.7ms is achieved through CUDA and TensorRT acceleration, which is 54.4% faster than the unoptimized model. In addition, a pan tilt camera tracking system has been developed, which uses PD control algorithm and 12 bit PWM drive to stably track flight targets at a lateral speed of 53.6km/h and a longitudinal speed of 18km/h within a range of 7-66 meters. Experimental verification shows that the detection accuracy of our method in complex backgrounds is improved by 30.6% compared to the traditional YOLO series, with a gimbal tracking response speed of 31Hz and an embedded inference delay of less than 15ms. Future research will focus on multimodal fusion detection, lightweight neural architecture search, and hardware system upgrades.

Keywords

Computer vision; Deep learning; Drone detection; Intelligent tracking; Embedded system.

Cite This Paper

Wenjie Jiang, Liuqing Yang. Anti drone intelligent tracking and aiming system optimized by computer vision and deep learning. Machine Learning Theory and Practice (2025), Vol. 5, Issue 1: 53-63. https://doi.org/10.38007/ML.2025.050106.

References

[1] Zhang M. Design of Object Segmentation and Feature Extraction Based On Deep Learning for AFM Image Processing and Analysis System[J]. Procedia Computer Science, 2025, 262: 982-991.

[2] Cai Y. Design and Implementation of a Cross Platform i0s Application Development Framework Based on YAI Configuration Files[J]. Procedia Computer Science, 2025, 262: 939-947.

[3] Pan H. Design and Implementation of a Cloud Computing Privacy-Preserving Machine Learning Model for Multi-Key Fully Homomorphic Encryption[J]. Procedia Computer Science, 2025, 262: 887-893.

[4] Wang C. Research on Modeling and Forecasting High-Frequency Financial Data Based on Histogram Time Series[J]. Procedia Computer Science, 2025, 262: 894-900.

[5] Wei X. Research on Preprocessing Techniques for Software Defect Prediction Dataset Based on Hybrid Category Balance and Synthetic Sampling Algorithm[J]. Procedia Computer Science, 2025, 262: 840-848.

[6] Guo Y. Research on Investment Bank Risk Monitoring and Early Warning Model Combining Factor Analysis and Artificial Neural Network[J]. Procedia Computer Science, 2025, 262: 878-886.

[7] Zhao F. Design and Implementation of Data Quality Optimization Strategy and Multi-Level Data Governance Platform based on Big Data Processing and Dynamic Rule Extension[J]. Procedia Computer Science, 2025, 262: 638-647.

[8] Wang Y. Research on Self Powered Industrial Vibration Monitoring and Abnormal Alarm System Based on Friction Nanogenerator and MEMS Technology[J]. Procedia Computer Science, 2025, 262: 666-674.

[9] Cui N. Research and Application of Traffic Simulation Optimization Algorithm Based on Improved Road Network Topology Structure[C]//The International Conference on Cyber Security Intelligence and Analytics. Springer, Cham, 2025: 156-163.

[10] Lai L. Research and Design of Data Security Risk Assessment Model Based on Fusion of Deep Learning and Analytic Hierarchy Process (AHP)[J]. Procedia Computer Science, 2025, 262: 747-756.

[11] Zhang J. Design and Implementation of a Fuzzy Testing Framework for Hyper-V Virtualization Engine Based on Nested Virtualization and Coverage Orientation[C]//The International Conference on Cyber Security Intelligence and Analytics. Springer, Cham, 2025: 176-183.

[12] Wei Z. Construction of Supply Chain Finance Game Model Based on Blockchain Technology and Nash Equilibrium Analysis[J]. Procedia Computer Science, 2025, 262: 901-908.

[13] Yang D, Liu X. Collaborative Algorithm for User Trust and Data Security Based on Blockchain and Machine Learning[J]. Procedia Computer Science, 2025, 262: 757-765.

[14] Zhang X. Optimization and Implementation of Time Series Dimensionality Reduction Anti-fraud Model Integrating PCA and LSTM under the Federated Learning Framework[J]. Procedia Computer Science, 2025, 262: 992-1001.

[15] Jiang Y. Research on the Optimization of Digital Object System by Integrating Metadata Standard and Machine Learning Algorithm[J]. Procedia Computer Science, 2025, 262: 849-858.

[16] An C. Research on High Frequency Financial Transaction Data Modeling and Cloud Computing Implementation Based on SSA-GA-BP Model[J]. Procedia Computer Science, 2025, 262: 859-867.

[17] Yang, D., & Liu, X. (2025). Research on Large-Scale Data Processing and Dynamic Content Optimization Algorithm Based On Reinforcement Learning. Procedia Computer Science, 261, 458-466.

[18] Li B. The Promoting Role of Data Analysis Technology in Sustainable Energy[J]. European Journal of Engineering and Technologies, 2025, 1(1): 32-38.

[19] Chen A. Research on Intelligent Code Search Technology Based on Deep Learning[J]. Pinnacle Academic Press Proceedings Series, 2025, 2: 137-143.

[20] Pan Y. Research on the Design of a Real-Time E-Commerce Recommendation System Based on Spark in the Context of Big Data[C]//2025 IEEE International Conference on Electronics, Energy Systems and Power Engineering (EESPE). IEEE, 2025: 1028-1033.

[21] Xu Q. Enhancing User Experience in Enterprise-Level Web Applications through Technological Innovation[J]. Journal of Computer, Signal, and System Research, 2025, 2(4): 90-96.

[22] Tu, X. (2025). The Application and Prospect of Machine Learning in Improving Production Efficiency. Artificial Intelligence and Digital Technology, 2(1), 27-33.

[23] Chen, H., Yang, Y., & Shao, C. (2021). Multi-task learning for data-efficient spatiotemporal modeling of tool surface progression in ultrasonic metal welding. Journal of Manufacturing Systems, 58, 306-315.

[24] Chen, H., Wang, Z., & Han, A. (2024). Guiding Ultrasound Breast Tumor Classification with Human-Specified Regions of Interest: A Differentiable Class Activation Map Approach. In 2024 IEEE Ultrasonics, Ferroelectrics, and Frequency Control Joint Symposium (UFFC-JS) (pp. 1-4). IEEE.

[25] Huang, Jiangnan. "Online Platform user Behavior Prediction and Decision Optimization based on Deep Reinforcement Learning." In 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), pp. 1-6. IEEE, 2025.

[26] Ma, Zhuoer. "Research and Development of Financial Contract Text Information Extraction System based on M-BiLSTM and Our-M Models." In 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), pp. 1-7. IEEE, 2025.

[27] Xiu L. Research on the Design of Modern Distance Education System Based on Agent Technology[J]. Pinnacle Academic Press Proceedings Series, 2025, 2: 160-169.

[28] Xiu L. Analyses of Online Learning Behaviour Based on Linear Regression Algorithm[C]//2025 IEEE International Conference on Electronics, Energy Systems and Power Engineering (EESPE). IEEE, 2025: 1333-1338.

[29] Chen, H., Zhu, Y., Zuo, J., Kabir, M. R., & Han, A. (2024). TranSpeed: Transformer-based Generative Adversarial Network for Speed-of-sound Reconstruction in Pulse-echo Mode. In 2024 IEEE Ultrasonics, Ferroelectrics, and Frequency Control Joint Symposium (UFFC-JS) (pp. 1-4). IEEE.

[30] Jiang, Yixian. "Research on Random Sampling Data Diffusion Technique in the Construction of Digital Object System Test Dataset." In 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), pp. 1-6. IEEE, 2025.

[31] Fu, Yilin. "Design and Empirical Analysis of Financial Quantitative Trading Model based on VMD-DCNN-SGRU Architecture and Integrated System." In 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), pp. 1-7. IEEE, 2025.

[32] Tu, Xinran. "Feature Selection and Classification of Electronic Product Fault Short Text by Integrating TF-IDF and Wor D2vec." In 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), pp. 1-6. IEEE, 2025.

[33] Hao, Linfeng. "Research on Automatic Driving Road Object Detection Algorithm Integrating Multi Scale Detection and Boundary Box Regression Optimization." In 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), pp. 1-6. IEEE, 2025.

[34] Zhou, Yixin. "Design and Implementation of Online Log Anomaly Detection Model based on Text CM and Hierarchical Attention Mechanism." In 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE), pp. 1-6. IEEE, 2025.

[35] Chen, H., Zuo, J., Zhu, Y., Kabir, M. R., & Han, A. (2024). Polar-Space Frequency-Domain Filtering for Improved Pulse-echo Speed of Sound Imaging with Convex Probes. In 2024 IEEE Ultrasonics, Ferroelectrics, and Frequency Control Joint Symposium (UFFC-JS) (pp. 1-4). IEEE.

[36] Varatharajah, Y., Chen, H., Trotter, A., & Iyer, R. K. (2020). A Dynamic Human-in-the-loop Recommender System for Evidence-based Clinical Staging of COVID-19. In HealthRecSys@ RecSys (pp. 21-22).

[37] Sheng, Cheng. "Strategies and Practices of Enterprise Financial Accounting and Financial Management in the New Financial Environment." (2025). International Journal of Social Sciences and Economic Management, 6(1), 124-133

[38] Sheng, Cheng. "The Impact and Path of Financial Technology on Accounting and Financial Informatization under the Background of Technological Revolution." (2025). International Journal of Business Management and Economics and Trade, 6(1),52-61

[39] Guo Y. Technology Application and Focus in Financial Investment Banking[J]. European Journal of Business, Economics & Management, 2025, 1(1): 104-110.

[40] Zhang X. Application of Real Time Machine Learning Models in Financial Fraud Identification[J]. European Journal of Business, Economics & Management, 2025, 1(2): 1-7.

[41] Jiang Y. Automation and Life Cycle Management Optimization of Large-Scale Machine Learning Platforms[J]. Artificial Intelligence and Digital Technology, 2025, 2(1): 20-26.

[42] Yan J. Research on Application of Big Data Mining and Analysis in Image Processing[J]. Pinnacle Academic Press Proceedings Series, 2025, 2: 130-136.

[43] Chen, X. (2025). Research on the Application of Multilingual Natural Language Processing Technology in Smart Home Systems. Journal of Computer, Signal, and System Research, 2(5), 8-14.

[44] Shen, D. (2025). AI-Driven Clinical Decision Support Optimizes Treatment Accuracy for Mental Illness. Journal of Medicine and Life Sciences, 1(3), 81-87.