Journal Search Engine
Search Advanced Search Adode Reader(link)
Download PDF Export Citaion korean bibliography PMC previewer
ISSN : 1229-9618(Print)
ISSN : 2671-7506(Online)
Chinese Studies Vol.96 pp.117-143
DOI : http://dx.doi.org/10.14378/KACS.2026.96.96.6

Analyzing the Differences in Chinese Writing Error Tagging for Korean Learners between AI and Human Teachers

Yan Shuai
建国大学GLOCAL创新学院副教授(ysanywhere@163.com)。

Abstract

With the wide application of large language models in language education, their capability boundaries in academic-level error tagging urgently need examination. This study takes 30 Chinese compositions by Korean learners from the HSK Dynamic Composition Corpus, strictly follows the corpus tagging code, and compares ChatGPT (GPT-5.3) with professional teachers in error tagging. Quantitatively, precision, recall, and F1-score evaluate tagging quality. Qualitatively, four typical scenarios are analyzed to explore human-machine differences. Three findings emerge. First, teachers significantly outperform ChatGPT in precision (98.82% vs. 21.61%), recall (93.31% vs. 18.96%), and F1-score (0.96 vs. 0.20). Over half of ChatGPT's errors are format violations, not content misjudgments. Second, ChatGPT's performance declines stepwise from HSK levels A to C, while teachers maintain high precision across levels. In A-level texts, ChatGPT detects subtle errors teachers overlook. Third, both agree on rule-governed explicit errors, but differ in semantic differentiation, cultural judgment, and tagging granularity. This study clarifies the capability boundaries of large language models in academic corpus tagging and provides empirical evidence for human-machine collaborative interlanguage tagging systems.

초록

Figure

Table