基于知识蒸馏的分子性质预测及其可扩展性分析OACHSSCD
Molecular Property Prediction Based on Knowledge Distillation and Its Scalability Analysis
知识蒸馏通过将复杂教师模型中的知识迁移至精简学生模型,能够保持预测精度的同时降低计算成本.针对分子性质预测任务,构建了基于多任务加权优化损失函数的知识蒸馏框架,基于 SchNet、DimeNet++和 TensorNet三种图神经网络模型,系统探究了其在特定领域和跨领域知识蒸馏中的有效性.在量子化学领域,知识蒸馏基于 QM9 数据集训练教师模型,指导学生模型预测同数据集内未见过的量子力学性质,验证了其在提升预测精度和模型效率两方面的潜力;在跨领域中,知识蒸馏将 QM9 预训练的教师模型应用于 ESOL、FreeSolv,验证了所提方法在跨领域小样本训练数据环境中的预测精度.结果表明,知识蒸馏为增强分子表征学习提供了一种有效学习途径,可为材料科学与药物研发领域中对于高预测精度、低计算成本的核心需求提供关键技术支撑.
Knowledge distillation maintains predictive accuracy while reducing computational costs by transferring knowledge from complex teacher models to streamlined student models.This paper constructs a knowledge distil-lation framework based on a multi-task weighted optimization loss function specifically for molecular property pre-diction tasks.Using three graph neural network models,namely SchNet,DimeNet++,and TensorNet,the effectiveness of the framework in both domain-specific and cross-domain knowledge distillation settings was inves-tigated systematically.In the domain-specific scenario,teacher models trained on the QM9 dataset guide student models in predicting unseen quantum mechanical properties within the same dataset,verifying the potential of the proposed method for enhancing precision and efficiency.In the cross-domain scenarios,knowledge distillation is employed to transfer QM9-pretrained teacher embeddings to experimental datasets such as ESOL(solubility)and FreeSolv(hydration free energy),the predictive accuracy of the proposed method in cross-domain,small-sample training environments was demonstraed.The results indicate that knowledge distillation is a robust strategy for en-hancing molecular representation learning,providing critical technical support for the core requirements of high precision and low computational cost in materials science and drug discovery.
李宝磊;刘祥;刘琨;游文涛;赵紫威;孟军霞
赣南师范大学 数学与计算机科学学院,江西 赣州 341000||赣南师范大学 智能制造与未来能源学院,江西 赣州 341000赣南师范大学 数学与计算机科学学院,江西 赣州 341000赣南师范大学 数学与计算机科学学院,江西 赣州 341000赣南师范大学 数学与计算机科学学院,江西 赣州 341000赣南师范大学 数学与计算机科学学院,江西 赣州 341000赣南师范大学 智能制造与未来能源学院,江西 赣州 341000
信息技术与安全科学
知识蒸馏图神经网络分子性质预测跨领域迁移
knowledge distillationgraph neural networksmolecular property predictioncross-domain transfer
《南阳师范学院学报》 2026 (3)
40-47,8
国家自然科学基金青年项目"有序层状/无序岩盐富锂锰基正极材料精准构筑及锰电化学活性机理研究"(52202220)江西省教育厅科技项目"面向材料设计的模型辅助多目标优化方法研究"(GJJ2501104).
评论