Article Details

Abstract

The system takes “analysis and judgment = data + model” as its core idea, and it achieves efficient identification and accurate tracking of behaviors contained in data based on data governance and custom modeling analysis. The system adopts micro-service architecture, uses container technology to achieve high availability and elastic expansion, and comprehensively applies multi-model databases to build a modeling and analysis system with standardized, systematic, scenario-based and intelligent features. Among them, the data governance process covers the entire chain of aggregation, verification, classification, warehousing, and cleaning, ensuring data quality and consistency. The model layer disassembles complex data analysis methods into intuitive and easy to use operator components. Through convenient drag and drop interaction, operator components can be freely combined and configured according to the needs of actual applications to build highly targeted, high flexibility analysis model. The system has been tested in actual application, and its quality and efficiency have been significantly improved.

Keywords

data governance; zero-code modeling; operator; Machine Learning; visual analysis

References

1. [1] ROWLEY J. The Wisdom Hierarchy: Representations of the DIKW Hierarchy [J].Journal of Information and Communication Science，2007，33（2）：163-180.
2. [2] WHITEHEAD J E J，GOLAND Y Y. WebDAV: A Network Protocol for Remote Collaborative Authoring on the Web [C]//ECSCW'99: Proceedings of the Sixth European Conference on Computer Supported Cooperative Work.Norwell：Kluwer Academic Publishers，1999：291-310.
3. [3] Wang Songli, Jing Yinan, He Zhenying, etc Overview of Database Management Systems Supporting Mixed Transactions and Analytical Processing [J]. Journal of Software, 2024, 35 (1): 405-429
4. [4] FERGUSON A L，PFAENDTNER J. Characteristics of Impactful Machine Learning Contributions to the Journal of Physical Chemistry [J].The Journal of Physical Chemistry A，2023，127（2）：415-417.
5. [5] Wan Xiaoji, Li Hailin Analysis of Financial Multivariate Time Series Data Based on Feature Representation [J]. Statistics and Decision Making, 2015 (23): 151-155
6. [6] CHEN T Q，GUESTRIN C. XGBoost: A Scalable Tree Boosting System [C]//KDD'16: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.New York：ACM，2016：785-794.
7. [7] SINGH P. Airflow [M]//Learn PySpark.Berkeley：Apress，2019：67-84.
8. [8] Yu Jian, Zhao Mankun, Gao Jie, etc Research on Graph Neural Network Social Recommendation Algorithm Based on Higher Order and Temporal Features [J]. Computer Science, 2023, 50 (3): 49-64
9. [9] Tang Xuefei, Fan Zhiqiang Structured Data Kinship Analysis Method Based on Metadata Mapping Relationship [J]. Modern Electronic Technology, 2022, 45 (16): 67-70
10. [10] Li Ying, Wei Fenglin Analysis of the Evolution of SQL Standard in Database Language [J]. Information Technology and Standardization, 2011 (9): 50-52
11. [11] Liu Yue Exploring the Path of Integrated Development of Central Counterparty Clearing in Derivatives Markets [J]. China Securities and Futures, 2024 (4): 74-82
12. [12] VLASTELICA M，PAULUS A，MUSIL V，et al. Differentiation of Blackbox Combinatorial Solvers [J/OL].arXiv:1912.02175 [cs.LG].（2019-12-04）.https://arxiv.org/abs/1912.02175.
13. [13] Zhang Lifang Research on Dense Subgraph Mining Algorithm [D]. Jinan: Shandong University, 2022
14. [14] Qiao Shaojie, Han Nan, Zhang Kaifeng, etc Overlapping Community Detection Algorithm in Complex Network Big Data [J]. Journal of Software, 2017, 28 (3): 631-647
15. [15] Cao Jun Analysis of Google's PageRank Technology [J]. Intelligence Journal, 2002 (10): 15-18
16. [16] Li Fan, Zhao Shu, Chen Jie, etc Acquisition of structural hole occupants based on weighted mediation centrality [J]. Journal of Nanjing University: Natural Science, 2017, 53 (4): 756-763
17. [17] Yan Hongren, Ma Guoshuai, Qian Yuhua Unsupervised feature selection based on node degree centrality [J]. Data Collection and Processing, 2019, 34 (2): 312-321
18. [18] Pan Shucan, Xu Qinglin Label propagation algorithm that integrates feature vector centrality and label entropy [J]. Computer Engineering and Science, 2020, 42 (8): 1489-1499
19. [19] ROCHAT Y. Closeness Centrality Extended to Unconnected Graphs: The Harmonic Centrality Index [C]//Applications of Social Network Analysis ASNA.Zurich：ASNA，2009：1-14.
20. [20] ELSEIDY M，ABDELHAMID E，SKIADOPOULOS S，et al. GraMi: Frequent Subgraph and Pattern Mining in a Single Large Graph [C]//Proceedings of the VLDB Endowment.Hangzhou：VLDB Endowment，2014：517-528.
21. [21] Zhao Cong Research on the Application of Visualization Library D3.js [J]. Information Technology and Informatization, 2015 (2): 107-109

About the authors

He Xianying (1980-), male, Han ethnicity, from Chengde, Hebei Province, assistant researcher, master's degree, research direction: data mining; Wang Linjing (1988-), male, Han ethnicity, from Qitaihe, Heilongjiang Province, is a second level police chief with a bachelor's degree. His research direction is economic crime investigation; Fu Hao (1995-), male, Han ethnicity, from Jiamusi, Heilongjiang Province, is a fourth level police chief with a bachelor's degree. His research direction is economic crime investigation; Chen Peng (1984-), male, Han ethnicity, from Huaibei, Anhui Province, engineer, master's degree, research direction: cloud computing.