基于RoBERTa-MTL融合语言特征的有害文本识别OA
Toxic Text Detection Based on RoBERTa-MTL for Integrating Linguistic Features
[目的]针对传统文本识别模型在应对社交媒体有害言论多样性和隐蔽性时的局限性,探索更精准、高效的识别方法,以提升有害言论识别的准确性与泛用性,助力构建健康安全的网络环境.[方法]提出了一种基于Ro-BERTa和多任务模型联合学习的方法,利用RoBERTa提取文本词向量,构建共享编码器和多个单任务编码器分别提取通用特征和专属特征,将两类特征融合生成文本的最终特征表达.[结果/结论]实验结果表明,多任务模型在精确率、准确率、召回率、F1 上比传统的文本分类提升了10%左右,说明多任务模型能更充分地挖掘不同类型有害文本之间的关联,提升模型对有害言论检测的效果.
[Purpose]To address the limitations of traditional text recognition models in handling the diverse and subtle nature of toxic con-tent on social media,we aim to develop more precise and efficient detection methods.This will improve the accuracy and generalizability of toxic content identification,thereby fostering a healthier and safer online environment.[Method]This study proposes a method based on RoBERTa and multi-task joint learning,which utilizes RoBERTa to extract text embeddings,constructs a shared encoder and multiple task-specific encoders to capture general and task-specific features respectively,and integrates these two types of features to generate the final representation of the text.[Result/Conclusion]The experimental results demonstrate that the multi-task model improves accuracy,precision,and recall by approximately 10%compared to traditional text classification methods.Furthermore,in contrast to traditional sin-gle-task toxic content detection methods,the multi-task model can leverage the relationships between different types of toxic content,thereby improving the overall performance of toxic content detection.
张新生;张颢泷;马玉龙;王润周
西安建筑科技大学管理学院 西安 710055西安建筑科技大学管理学院 西安 710055西安建筑科技大学管理学院 西安 710055西安建筑科技大学管理学院 西安 710055
社会科学
有害文本有害言论识别多任务模型RoBERTaBiLSTM
toxic texttoxic comment classificationmulti-task learningRoBERTaBiLSTM
《情报杂志》 2026 (1)
75-82,8
教育部人文社会科学规划基金项目"泛在信息社会下AI生成式虚假信息风险感知及治理路径研究"(编号:24YJA630129)陕西省社会科学基金年度项目"AIGC时代下生成式虚假信息风险感知及治理路径研究"(编号:2024R055)陕西省自然科学基础研究计划项目"AIGC背景下虚假信息演化、识别及治理研究"(编号:2025JC-YBMS-1100)研究成果.
评论