基于轻量级预训练模型的微博情感分析算法研究OA
Lightweight pre-training model-based Weibo sentiment analysis algorithm research
针对微博中文本内容特征复杂难以提取的问题,本文提出了一种基于轻量级预训练模型的文本情感分析算法模型.首先,模型引入神经网络正则化失活算法改进损失函数,通过增加正则化实现有监督的数据增强.其次,在算法层面,融入卷积以及时序注意力双通道网络结构,提升算法对长文本特征的提取效率.最后,为了解决多层模型带来的特征丢失问题,引入残差网络来提高模型的鲁棒性.在酒店评论公共数据集以及微博评论数据集上进行实验,结果表明,相较于基线模型,本文提出的模型在两个数据集准确率分别提高了 1.33和1.41个百分点,实验验证了该算法有效提高了轻量级文本情感分析模型的特征捕捉能力和情感分析的准确性.
The challenge of extracting complex textual features from Weibo posts has been tackled through the proposal of a text-sentiment analysis algorithm built on a lightweight pre-trained model.First,the loss function was refined by introducing a neural-network dropout regularization algorithm,through which supervised data augmentation was achieved.Second,at the algorithmic level,a dual-channel network combining convolution and temporal attention was incorporated,so that the efficiency of long-text feature extraction was enhanced.Finally,to mitigate the feature loss introduced by deep architectures,residual connections were employed to improve robustness.Experiments were carried out on a public hotel-review dataset and a Weibo-comment dataset.The results indicated that,relative to the baseline model,classification accuracy was increased by 1.33 and 1.41 percentage points on the two datasets,respectively,thereby demonstrating that the proposed algorithm effectively strengthens the feature-capturing capability and sentiment-analysis accuracy of lightweight models.
刘浩然;孙子鉴;杨子朋;崔晗;翟聆妤
燕山大学信息科学与工程学院,河北秦皇岛 066004||燕山大学河北省特种光纤与光纤传感重点实验室,河北秦皇岛 066004燕山大学信息科学与工程学院,河北秦皇岛 066004||燕山大学河北省特种光纤与光纤传感重点实验室,河北秦皇岛 066004燕山大学信息科学与工程学院,河北秦皇岛 066004||燕山大学河北省特种光纤与光纤传感重点实验室,河北秦皇岛 066004燕山大学信息科学与工程学院,河北秦皇岛 066004||燕山大学河北省特种光纤与光纤传感重点实验室,河北秦皇岛 066004燕山大学信息科学与工程学院,河北秦皇岛 066004||燕山大学河北省特种光纤与光纤传感重点实验室,河北秦皇岛 066004
信息技术与安全科学
情感分析轻量级预训练模型自然语言处理深度学习文本处理
sentiment analysislightweight pre-trained modelnatural language processingdeep learningtext processing
《燕山大学学报》 2026 (4)
369-376,8
国家自然科学基金资助项目(62106214)河北省自然科学基金资助项目(D2024203008)
评论