面向通用轨迹智能的大模型多任务统一建模方法
(合肥讯飞数码科技有限公司 人工智能研究院,安徽 合肥 230088)
摘要
现有轨迹处理技术多针对单一任务构建独立模型,难以有效挖掘不同任务轨迹数据间的深层关联与规律,制约了轨迹智能的泛化能力。针对这一问题,文章对基于Transformer的纯轨迹模态多任务建模技术进行了研究,提出了多任务统一建模模型(MultiTaskModel)。该模型在编码阶段引入控制域,将控制Token与轨迹数据域的嵌入向量拼接,作为轨迹点的整体表征向量;在解码阶段,通过控制Token来识别不同任务并解析模型输出结果。本文在船舶航行公开数据集上进行了多组实验,相比传统单任务基线方法,3小时窗口的预测误差降低了12.20%;训练后的下游轨迹预测任务效果提升了6.81%;训练后的下游轨迹匹配任务的匹配准确率达94.15%。实验表明,本文提出的方法实现了轨迹匹配等多种下游任务的统一建模,并能够有效提升轨迹预测的性能。
关键词
轨迹大模型;多任务学习;统一建模;时间序列预测
参考文献
- [1] Forti N,Millefiori L M,Braca P,et al. Prediction of Vessel Trajectories From AIS Data via Sequence-To-Sequence Recurrent Neural Networks [C]//ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing,2020:8936-8940.
- [2] Nguyen D,Vadaine R,Hajduch G,et al. GeoTrackNet—A Maritime Anomaly Detector Using Probabilistic Neural Network Representation of AIS Tracks and A Contrario Detection [J].IEEE Transactions on Intelligent Transportation Systems,2021,23(6):5655-5667.
- [3] Capobianco S,Millefiori L M,Forti N,et al. Deep Learning Methods for Vessel Trajectory Prediction Based on Recurrent Neural Networks [J].IEEE Transactions on Aerospace and Electronic Systems,2021,57(6):4329-4346.
- [4] Murray B,Perera L P. An AIS-based deep learning framework for regional ship behavior prediction [J/OL].Reliability Engineering and System Safety,2021,215:107819.https://doi.org/10.1016/j.ress.2021.107819.
- [5]Li M Z,Li B,Qi Z G,et al. Enhancing Maritime Navigational Safety: Ship Trajectory Prediction Using ACoAtt-LSTM and AIS Data [J/OL].ISPRS International Journal of Geo-Information,2024,13(3):85.https://doi.org/10.3390/ijgi13030085.
- [6] Huang F L,Liu Z R,Li X H,et al. Vessel Trajectory Prediction Based on AIS Data: Dual-Path Spatial–Temporal Attention Network with Multi-Attribute Information [J/OL].Journal of Marine Science and Engineering,2024,12(11):2031. https://doi.org/10.3390/jmse12112031.
- [7] 王一禾,张秀凤,肖方兵.基于AIS数据和STGCN的船舶轨迹插值预报方法 [J].水运管理,2025,47(3):29-32.
- [8] Gehring J,Auli M,Grangier D,et al.Convolutional Sequence to Sequence Learning [C]// Proceedings of the 34th International Conference on Machine Learning,2017:1243-1252.
- [9] Wu X Y,Chen J F,Xiong C Q,et al. Vessel Trajectory Prediction Method Based on the Time Series Data Fusion Model [J].Promet-Traffic & Transportation,2024,36(6):1160-1175.
- [10] Spadon G,Kumar J,Eden D,et al. Multi-path Long-term Vessel Trajectories Forecasting with Probabilistic Feature Fusion for Problem Shifting [J/OL].Ocean Engineering,2024,312:119138.https://doi.org/10.1016/j.oceaneng.2024.119138.
- [11] Nguyen D,Fablet R. A Transformer Network With Sparse Augmented Data Representation and Cross Entropy Loss for AIS-Based Vessel Trajectory Prediction [J].IEEE Access,2024,12:21596-21609.
- [12] 高龙,吴俊峰,杨柱天,等.基于时空特征融合的TCNformer船舶航迹长期预测 [J].海军航空大学学报,2024,39(4):437-444,491.
- [13] Qiang H M,Guo Z Y,Chu Z,et al. Motion-inspired Spatial-temporal Transformer for Accurate Vessel Trajectory Prediction [J/OL].Engineering Applications of Artificial Intelligence,2025,148:110391.https://doi.org/10.1016/j.engappai.2025.110391.
- [14] Wang W T,Xiong W,Ouyang X,et al. TPTrans: Vessel Trajectory Prediction Model Based on Transformer Using AIS Data [J/OL].ISPRS International Journal of Geo-Information,2024,13(11):400.https://doi.org/10.3390/ijgi13110400.
- [15] Gong J C,Li H H,Jiao H,et al. Uncertainty-aware ship Trajectory Prediction via Spatio-Temporal Graph Transformer[J/OL].Transportation Research Part E: Logistics and Transportation Review,2025,203:104315.https://doi.org/10.1016/j.tre.2025.104315.
- [16] Radford A,Kim J W,Xu T,et al. Robust Speech Recognition via Large-scale Weak Supervision [C]//ICML'23: Proceedings of the 40th International Conference on Machine Learning,2023:28492-28518.
作者简介
张宋诚(1988—),男,汉族,湖北黄冈人,算法工程师,硕士研究生,研究方向:自然语言处理、大模型行业应用;通信作者:吴飞(1987—),男,汉族,江西九江人,高级工程师,副院长,硕士研究生,研究方向:自然语言处理、大模型行业应用。