Article Details

Title · Authors · Abstract · Keywords · DOI · References

Application Research on Digital Human-assisted Industrial Simulation Systems

ZHU Wenhua, LIU Huiyu, FAN Haoran, ZHAO Chuan, MA Kang

(School of Computer and Information Engineering, Shanghai Polytechnic University, Shanghai 201209, China)

Section：Intelligent Manufacturing · Vol. 2026, Issue 10 · Pages：160-164,169 · 2096-4706（2026）10-0160-06 · CLC number：TP311.1 · Document code：A · DOI：10.19850/j.cnki.2096-4706.2026.10.030

Abstract

Traditional simulation systems often suffer from outdated interaction methods and lack intelligent capabilities, making it difficult to meet the demands of modern enterprises for industrial production line training and demonstration. This paper utilizes a real gyroscope production line as a carrier to construct a digital human-assisted industrial simulation system that integrates local large models with VR environments. The system employs Unity3D to build a virtual production line, deploys a local large model via Ollama, develops a ChatFlow application integrated with a knowledge base in Dify, and enables API access through edge devices. By combining speech recognition and digital human driving technology, it achieves natural language interactive Q&A regarding production line processes, equipment operational status, and related information. Research findings validate that the constructed system meets the intelligent requirements of traditional industrial simulation systems while adapting to enterprise needs in industrial training, demonstrations, and science popularization.

Keywords

digital human; Artificial Intelligence; industrial production line simulation; voice interaction

References

  1. [1] RIDWAN L. Emotion-aware Multimodal Human-computer Interaction to Enhance Student Engagement in Smart Education [EB/OL].[2025-12-03].https://www.researchgate.net/publication/395847982_Emotion-Aware_Multimodal_Human-Computer_Interaction_to_Enhance_Student_Engagement_in_Smart_Education.
  2. [2] KANIVETS O V，KANIVETS I M，PIDHORNA S V，et al. Design and Validation of a Virtual Reality-based Training Program for Student Learning on Tractor-plough Setup [EB/OL].（2025-11-14）[2025-12-03].https://ceur-ws.org/Vol-4096/paper8.pdf.
  3. [3] MA L，XIONG J J，WANG X，et al. Development of a Unity3D-based Virtual Simulation Tool for Hydrogen Fuel Cell Performance Testing in Engineering Education [J/OL].Computer Applications in Engineering Education，2025，33（6）：e70095（2025-10-31）[2025-12-03].https://doi.org/10.1002/cae.70095.
  4. [4] LIU S G，ZHAI T T，HU Y F，et al. Virtual Simulation Training System for Unity 3D Intelligent Manufacturing Production Line [C]//2025 44th Chinese Control Conference （CCC）.Chongqing：IEEE，2025：9413-9418.
  5. [5] RAZAKOV M A，NAZAROVA V A，DEREVYANKO D A，et al. Virtual Technological Line Simulator for the Production of Chocolate [EB/OL].[2025-12-03].https://www.researchgate.net/publication/391724899_Virtual_Technological_Line_Simulator_for_the_Production_of_Chocolate.
  6. [6] JAROSZ M，NAWROCKI P，ŚNIEŻYŃSKI B，et al. Multi-platform Intelligent System for Multimodal Human-computer Interaction [J].Computing and Informatics，2021，40（1）：83-103.
  7. [7] YANG X D，LIU J H，LYU N J ，et al. A Review of Cable Layout Design and Assembly Simulation in Virtual Environments [J].Virtual Reality and Intelligent Hardware，2019，1（6）：543-557.
  8. [8] JEONG Y，KOBER C，FETTE M. Integrating Large Language Models and Digital Twins in Manufacturing: Opportunities and Challenges for Production Logistics and Assembly Environments [C]//IFIP International Conference on Advances in Production Management Systems.Cham：Springer Nature Switzerland，2025：528-542.
  9. [9] Zhang Ting, Lai Jiandu, Zhang Jingjing, etc Research on Visual Interaction Design of Virtual Digital Human Based on Common Attention [J]. Packaging Engineering, 2025, 46 (14): 121-131
  10. [10] Zhang Conglin, Wang Quanjing, Chen Qingkui Industrial Robot Simulation Teaching Experimental System Based on Unity 3D [J]. Mechanical and Electrical Engineering Technology, 2023, 52 (5): 67-70177
  11. [11] Yu Panlei, Gao Yufei, Yuan Huiyong, etc Unity based production line visualization intelligent monitoring system [J]. Modular Machine Tool and Automation Processing Technology, 2025 (1): 1-4, 9
  12. [12] Li Yibo, Bai Yanhong Construction of Visualization Model for Digital Twin System of Automated Production Line [J]. Industrial Control Computer, 2024, 37 (10): 141-142145
  13. [13] Zhu Hong, Xing Huanwu, Xiao Xuepeng, etc Research and Implementation of Virtual Simulation Training System for Unity 3D Intelligent Manufacturing Production Line [J]. Intelligent Manufacturing, 2024 (5): 123-128
  14. [14] Ma Shilong, Wu Fenghua, Yang Zhehai, etc Development of Unity 3D Virtual Simulation Teaching System for Digital Twin Robot Motor Production Line [J]. Shandong Industrial Technology, 2025 (1): 32-40
  15. [15] Shige, Wang Min, Wang Jing, etc Research on Virtual Simulation Teaching System Based on Unity 3D and Interpolation Trajectory Planning Algorithm [J]. Automation and Instrumentation, 2025 (6): 231-234240

Funding

University Industry University Research Innovation Fund Project "Digital Twin of Engineering CNC Lighting Workstation" (2022BC098)

About the authors

Zhu Wenhua (1968-), male, Han ethnicity, from Wuxi, Jiangsu, is a specially appointed professor and doctoral student with research interests in intelligent manufacturing and artificial intelligence.