Research on Acousto-optic Adaptive Mapping Technology Based on STFT Algorithm
(TPV Display Technology (Xiamen) Co., Ltd., Xiamen 361101, China)
Abstract
The conversion of audio signals into light usually involves converting the frequency information of the audio signals into the intensity, color, or brightness changes of the light signals, resulting in the phenomenon of insufficient color and intensity of the light signals and display delay. A control method for audio acoustic signal adaptive mapping of optical signal technology is proposed in this paper. In the preprocessing stage, it extracts the spectral characteristics of the spectral energy and spectral center, focusing on analyzing various characteristics of pitch, timbre, rhythm and dynamic changes in audio signals. According to the mapping of the spectral center of the audio signals onto the color spectrum, different frequencies correspond to different colors, and the brightness of the light is controlled according to the spectral energy level. The results show that sound-light adaptive mapping technology based on STFT algorithm has significant advantages in speed and effectiveness of audio frequency mapping color display, verifying the effectiveness of the proposed color mapping and display delay strategy.
Keywords
LED; liquid crystal display; FFT; window function; spectrum analysis
References
- [1] Chen Xiaomei, Wang Xiaowei, Zhong Bo, et al. Speech intelligibility evaluation algorithm using dual spectral features [J]. Acoustic Technology, 2022, 41 (5): 678-684
- [2] Ai Xuezhong, Yuan Tianqi, Yan Min, et al. Application of Time Frequency Analysis Method in Boiler Pressure Pipeline Leakage Detection [J]. Acoustic Technology, 2022, 41 (2): 282-287
- [3] Hong Qinzhi, Wang Zhijun, Guo Yifan, et al. A FFT optimization method supporting mixed processing of multiple data blocks [J]. Journal of Xi'an University of Electronic Science and Technology, 2022, 49 (6): 42-50
- [4] Zhou Zhou Optimization and Implementation of FFT Design Based on FPGA [D]. Chengdu: University of Electronic Science and Technology of China, 2023
- [5] Li Shouchuang Research on Signal Processing Technology of Real time Spectrum Analyzer [D]. Hangzhou: Hangzhou University of Electronic Science and Technology, 2023
- [6] Li Shuai, Li Jing Error analysis of spectral signals based on MATLAB simulation [J]. Industrial Control Computer, 2021, 34 (1): 86-87+89
- [7] Liu Yuanling, Wang Jinli Design of LED Numerical Control Constant Current Drive Power Supply Based on Frequency Tracking [J]. Electronic Devices, 2023, 46 (5): 1406-1412
- [8] Su Ran, Zheng Xifeng, Chen Yu, et al. The Influence of Temperature Fluctuations on the Main Parameters of White Balance and Image Tone of LED Display Screen [J]. Journal of Luminescence, 2023, 44 (2): 346-355
- [9] Ren Keqiang, Wang Chuanqiang Design of Multi channel Serial Port Driven TFT LCD Display System Based on STM32F4 [J]. LCD&Display, 2020, 35 (5): 449-455
- [10] Yang Chaopu, Fang Wenqing, Liu Mingbao, et al. Low color temperature adjustment and spectral analysis of LED backlit LCD screens [J]. Journal of Luminescence, 2019, 40 (12): 1531-1537
- [11] Jiang Yusheng, Liang Ni, He Guoqi Analysis and Application of SPI Interface Driver Based on MDM9607 Platform [J]. Modern Information Technology, 2023, 7 (2): 149-152
- [12] Sheng Yang Boyan Design of Arduino Display and Control Module Based on SPI Bus [J]. Microcontrollers and Embedded System Applications, 2020, 20 (3): 74-76+80
- [13] Liu Wei ICNI Health Control System Based on SPI Full Duplex Communication [J]. Electronic Measurement Technology, 2024, 47 (19): 34-43
- [14] Yang Zihe, Peng Qiuyu, Li Zhanyi, et al. Design and Implementation of SPI Interface Simulation [J]. Technology and Innovation, 2022 (19): 121-123+126
About the authors
Ye Linjun (1974-), male, Han ethnicity, from Pinghe, Fujian, is a senior engineer with a master's degree. His research interests include embedded software systems and Android TV systems; Chen Peiwen (1975-), male, Han ethnicity, from Huian, Fujian, is an engineer with a bachelor's degree. His research interests include LCD flat panel display technology and smart display systems.