Article Details

Title · Authors · Abstract · Keywords · DOI · References

Research Review of Chinese Spelling Correction

SHEN Youzhi1, CHENG Chunlei1,2, JU Zedong1, GONG Zhufan1

(1.College of Computer Science, Jiangxi University of Chinese Medicine, Nanchang 330004, China; 2.Jiangxi Provincial Key Laboratory of Chinese Medicine Artificial Intelligence, Nanchang 330004, China)

Section：Computer Technology · Vol. 2025, Issue 8 · Pages：138-145 · 2096-4706（2025）08-0138-08 · CLC number：TP391.1；TP301.1 · Document code：A · DOI：10.19850/j.cnki.2096-4706.2025.08.025

Abstract

Chinese Spelling Correction (CSC) is a crucial foundational task in Natural Language Processing (NLP), and provides support for the downstream tasks and research. The research in the field of CSC tasks continues to develop, mainly divided into error correction methods based on N-Gram language models, Deep Learning, and Large Language Models (LLMs). Firstly, the characteristics of the N-Gram language model and its application in CSC are analyzed, revealing its advantages in capturing contextual information. Secondly, methods based on Deep Learning improve the accuracy of error correction through deep neural networks and are widely used in Chinese text processing. At the same time, the rise of LLMs provides new ideas for spelling correction, demonstrating their enormous potential in dealing with complex language phenomena. This review provides a detailed overview of the current research status in the CSC field, providing a reference for scholars engaged in related research.

Keywords

Chinese text; spelling correction; N-Gram language model; Deep Learning; Large Language Model

References

  1. [1] KONDRAK G. N-Gram Similarity and Distance [C]//String Processing and Information Retrieval (SPIRE 2005).Buenos Aires：Springer Nature，2005：115-126.
  2. [2] XIE W J，HUANG P J，ZHANG X R，et al. Chinese Spelling Check System Based on N-Gram Model [C]//Proceedings of the Eighth SIGHAN Workshop on Chinese Language Processing (SIGHAN-8).Beijing：ACL，2015：128-136.
  3. [3] HUANG Q，HUANG P J，ZHANG X R，et al. Chinese Spelling Check System Based on Tri-Gram Model [C]//Proceedings of the Third CIPS-SIGHAN Joint Conference on Chinese Language Processing.Wuhan：ACL，2014：173-178.
  4. [4] YU J J，LI Z H. Chinese Spelling Error Detection and Correction Based on Language Model, Pronunciation, and Shape [C]//Proceedings of the Third CIPS-SIGHAN Joint Conference on Chinese Language Processing.Wuhan：ACL，2014：220-223.
  5. [5] YEH J-F，LI S-F，WU M-R，et al. Chinese Word Spelling Correction Based on N-Gram Ranked Inverted Index List [C]//Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing.Nagoya：ACL，2013：43-48.
  6. [6] YU L-C，LEE L-H，TSENG Y-H，et al. Overview of SIGHAN 2014 Bake-off for Chinese Spelling Check [C]//Proceedings of the Third CIPS-SIGHAN Joint Conference on Chinese Language Processing.Wuhan：ACL，2014：126-132.
  7. [7] VASWANI A，SHAZEER N，PARMAR N，et al. Attention Is All You Need [C]//31st International Conference on Neural Information Processing Systems.Long Beach：Curran Associates Inc，2017：6000-6010.
  8. [8] SCHMIDHUBER J. Deep Learning in Neural Networks: An Overview [J].Neural Networks，2015，61：85-117.
  9. [9] WANG D M，SONG Y，LI J，et al. A Hybrid Approach to Automatic Corpus Generation for Chinese Spelling Check [C]//Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing.Brussels：ACL，2018：2517-2527.
  10. [10] ZHANG S H，HUANG H R，LIU J C，et al. Spelling Error Correction with Soft-Masked BERT [C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics.Online：ACL，2020：882-890.
  11. [11] ZHU C X，YING Z Q，ZHANG B Y，et al. MDCSpell: A Multi-task Detector-corrector Framework for Chinese Spelling Correction [C]//Findings of the Association for Computational Linguistics.Dublin：ACL，2022：1244-1253.
  12. [12] LIU S L，SONG S K，YUE T C，et al. CRASpell: A Contextual Typo Robust Approach to Improve Chinese Spelling Correction [C]//Findings of the Association for Computational Linguistics.Dublin：ACL，2022：3008-3018.
  13. [13] WU H Q，ZHANG S H，ZHANG Y C，et al. Rethinking Masked Language Modeling for Chinese Spelling Correction [C]//Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics.Toronto：ACL，2023：10743-10756.
  14. [14] LIU L F，WU H Q，ZHAO H. Chinese Spelling Correction as Rephrasing Language Model [J/OL].arXiv:2308.08796 [cs.CL].[2024-10-02].https://arxiv.org/abs/2308.08796.
  15. [15] CHENG X Y，XU W D，CHEN K L，et al. SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check [C]//Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Online：ACL，2020：871-881.
  16. [16] XU H-D，LI Z L，ZHOU Q Y，et al. Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking [J/OL].arXiv:2105.12306 [cs.CL].[2024-10-02].https://arxiv.org/abs/2105.12306.
  17. [17] LI J H，WANG Q，MAO Z D，et al. Improving Chinese Spelling Check by Character Pronunciation Prediction：The Effects of Adaptivity and Granularity [J/OL].arXiv:2210.10996 [cs.CL].[2024-10-04].https://arxiv.org/abs/2210.10996.
  18. [18] LIANG Z H，QUAN X J，WANG Q F. Disentangled Phonetic Representation for Chinese Spelling Correction [J/OL].arXiv:2305.14783 [cs.CL].[2024-10-05].https://arxiv.org/abs/2305.14783?context=cs.CL.
  19. [19] WU H Q，ZHANG S H，ZHANG Y C，et al. Rethinking Masked Language Modeling for Chinese Spelling Correction [J/OL].arXiv:2305.17721 [cs.CL].[2024-10-07].https://arxiv.org/abs/2305.17721?context=cs.
  20. [20] ZHAO W X，ZHOU K，LI J Y，et al. A Survey of Large Language Models [J/OL].arXiv:2303.18223 [cs.CL].[2024-09-20].https://arxiv.org/abs/2303.18223.
  21. [21] KAPLAN J，MCCANDLISH S，HENIGHAN T，et al. Scaling Laws for Neural Language Models [J/OL].arXiv:2001.08361 [cs.LG].[2024-09-20].https://arxiv.org/abs/2001.08361?file=2001.08361.
  22. [22] WU T Y，HE S Z，LIU J P，et al. A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development [J].IEEE/CAA Journal of Automatica Sinica，2023，10（5）：1122-1136.
  23. [23] ANIL R，DAI A M，FIRAT O，et al. PaLM 2 Technical Report [J/OL].arXiv:2305.10403 [cs.CL].[2024-09-10].https://arxiv.org/abs/2305.10403v3#.
  24. [24] LI K T，HU Y，HE L，et al. C-LLM: Learn to Check Chinese Spelling Errors Character by Character [J/OL].arXiv:2406.16536 [cs.CL].[2024-09-10].https://arxiv.org/abs/2406.16536.
  25. [25] LI Y H，HUANG H J，MA S R，et al. On the （in） Effectiveness of Large Language Models for Chinese Text Correction [J/OL].arXiv:2307.09007 [cs.CL].[2024-09-16].https://arxiv.org/abs/2307.09007?context=cs.CL.
  26. [26] DONG M，CHEN Y J，ZHANG M，et al. Rich Semantic Knowledge Enhanced Large Language Models for Few-shot Chinese Spell Checking [J/OL].arXiv:2403.08492 [cs.CL].[2024-09-16].https://arxiv.org/abs/2403.08492.
  27. [27] ZHOU H Q，LI Z H，ZHANG B，et al. A Simple yet Effective Training-free Prompt-free Approach to Chinese Spelling Correction Based on Large Language Models [J/OL].arXiv:2410.04027 [cs.CL].[2024-09-16].https://arxiv.org/abs/2410.04027?context=cs.CL.

Funding

Natural Science Foundation of Jiangxi Province (20224BAB206102); Science and Technology Research Project of Jiangxi Provincial Department of Education (GJJ2200923); National Natural Science Foundation of China (82260988); Jiangxi Provincial Health and Family Planning Commission - Science and Technology Plan Project (202211404)

About the authors

Shen Youzhi (1997-), male, Han ethnicity, from Jiujiang, Jiangxi Province, is currently pursuing a master's degree in natural language processing; Corresponding author: Cheng Chunlei (1976-), male, Han ethnicity, from Nanchang, Jiangxi Province, associate professor, master's supervisor, PhD, research direction: machine learning, knowledge representation and learning, knowledge graph; Ju Zedong (1998-), male, Han ethnicity, from Shuozhou, Shanxi Province, currently pursuing a master's degree in natural language processing; Gong Zhufan (2000-), male, Han ethnicity, from Nanchang, Jiangxi, currently pursuing a master's degree in natural language processing.