Design of Intelligent Navigation Glasses Based on Multi-sensor Fusion
(School of Engineering, Xi'an Siyuan University, Xi'an 710038, China)
Abstract
To address the independent travel challenges faced by visually impaired individuals, a multi-sensor-fusion-based intelligent guide glasses system is designed. The system uses the STM32F103RCT6 as the core controller and integrates a K210 vision module, a laser ranging module, an MPU6050 attitude sensor, GPS, Bluetooth, and a voice module to achieve environmental perception, obstacle avoidance, fall warning, and remote monitoring. Test results show that the K210 achieves an obstacle recognition accuracy between 88% and 98%, with laser ranging errors of less than 5 cm. The fall detection accuracy reaches 93.3% with a response time of 1.2 s. The GPS positioning error is 2.8 m, the Bluetooth communication success rate within 10 m is 99.5%, and the voice broadcast accuracy is 97%. The system demonstrates strong real-time performance and high reliability, effectively enhancing the safety and autonomy of visually impaired individuals during travel.
Keywords
intelligent navigation glasses; multi-sensor fusion; STM32 microcontroller; K210 visual recognition; obstacle detection; remote monitoring system
References
- [1] Yin Zhangxuan, Lun Jiaqi, Cheng Shibo, etc Design of Intelligent Control System for Multi functional Guide Glasses Based on ESP32 [J]. Instrument Technology, 2025 (6): 13-17, 52
- [2] Li Yi, Xie Jiarong, Qiu Zhiye, etc Design and Implementation of Intelligent Guide Glasses System [J]. Internet of Things Technology, 2025, 15 (23): 97-102
- [3] Tao Binbin, Bi Chunkai Design and Implementation of Laser Ranging System Based on Monocular Guidance [J]. Journal of Tianjin University of Technology, 2022, 38 (5): 20-26
- [4] Ma Zairong, Lou Xufeng, Wu Maonian, etc Design of special smart glasses for the blind tactile paving based on MobilenetV1 [J]. Internet of Things Technology, 2023, 13 (12): 76-80
- [5] Kang Xinyao, Wang Jun, Yan Bixi, etc Research on Calibration Method of Visual Measurement System Integrating Laser Ranging [J]. Laser Journal, 2025, 46 (8): 54-59
- [6] Li Yanqiao Research on the Design of Intelligent Travel Products for Visually Impaired People [D]. Beijing: North China University of Technology, 2024
- [7] Liu Chang Research on the Design of Intelligent Glasses for Visually Impaired Groups [D]. Shenyang: Shenyang University of Aeronautics and Astronautics, 2023
- [8] Zhao Xuejian, Ye Hao, Jia Wei, etc A review of AGV path planning and obstacle avoidance algorithms [J]. Small and Micro Computer Systems, 2024, 45 (3): 529-541
- [9] Zhao Qian, Shi Yuqiang Research on Real time Path Planning and Obstacle Avoidance of AGV by Integrating Improved A * Algorithm and DWA [J]. Modern Manufacturing Engineering, 2025 (5): 91-98
- [10] Wang Qin, Wei Lisheng AGV dynamic obstacle avoidance path planning algorithm based on improved HLO and dynamic window [J]. Journal of Electronic Measurement and Instrumentation, 2025, 39 (2): 213-221
Funding
2025 Shaanxi Province College Students Innovation and Entrepreneurship Training Program Project (S202513121020)
About the authors
Sun Junbing (2004-), male, Han ethnicity, from Changzhi, Shanxi, undergraduate student, research interests include embedded system design; Corresponding author: Wang Pengtao (1981-), male, Han ethnicity, from Xi'an, Shaanxi, associate professor, bachelor's degree, research interests include intelligent manufacturing control.