深度学习模型在可见-近红外光谱分析中的应用进展OA
Advances in Applications of Deep Learning Models in Visible-Near Infrared Spectroscopy Analysis
可见-近红外(Vis-NIR)光谱分析具有高维、非线性及背景干扰等特点,其分析能力因深度学习(DL)模型的引入而显著增强.本文系统综述了近年来自动编码器(AE)、长短期记忆网络(LSTM)、卷积神经网络(CNN)、深度信念网络(DBN)及Transformer等模型的基本机理及其在Vis-NIR光谱分析中的应用.在食品检测领域,Vis-NIR光谱结合CNN及其变体等模型实现了品质无损检测与在线分选,并通过注意力机制增强了模型的可解释性.在环境监测领域,针对Vis-NIR光谱特征信号弱、干扰强的特点,提出了一维卷积神经网络(1D-CNN),实现了光谱信息特征解析;将其应用于土壤、水体参数的定性与定量分析,通过多源数据融合、数据增强及 Transformer 混合架构,提升了模型泛化能力.在农业与林业监测领域,针对Vis-NIR光谱噪声大、样本稀缺的特点,运用数据增强、特征选择算法并结合1D-CNN实现了林业品种分类、环境温度检测及病害筛查.在矿产品分析领域,为克服Vis-NIR光谱的"异物同谱"干扰与非线性的难题,采用1D-CNN提升了岩性识别与矿物属性反演的精度.此外,Vis-NIR光谱结合DL也被用于古陶瓷断代、塑料分类和禽蛋活力检测等领域.未来,Vis-NIR光谱中的DL模型应在模型架构、数据增强和可解释性等方面融合创新;同时,随着标准化与规范化应用的推进,该技术将朝着更可靠、更易推广的方向发展.
Visible-near-infrared(Vis-NIR)spectroscopy is characterized by high dimensionality,nonlinearity,and background interference,yet its analytical capabilities have been significantly enhanced by the introduction of deep learning(DL)models.This paper systematically reviews the advances in the application of DL from 2018 to 2025,outlining the fundamental mechanisms of models such as autoencoders(AE),long short-term memory networks(LSTM),convolutional neural networks(CNN),deep belief networks(DBN),and Transformers,as well as their use in Vis-NIR spectral analysis.In the field of food inspection,Vis-NIR spectroscopy combined with CNN and its variants enables nondestructive quality testing and online sorting,while attention mechanisms and Transformers improve model interpretability to address the ″black box″ problem.For environmental monitoring,where Vis-NIR spectral features are weak and heavily interfered,1D-CNN has successfully extracted spectral characteristics for quantitative and qualitative analysis.Through multi-source data fusion,data augmentation,and hybrid transformer architectures,model generalization and the inversion accuracy of soil and water parameters have been enhanced.In agricultural and forestry monitoring,faced with noisy spectra and scarce samples,integrated approaches using data augmentation,feature selection algorithms,and 1D-CNN have achieved species classification,environmental stress monitoring,and disease screening.In mineral product analysis,to overcome the challenges such as spectral similarity among different materials(same spectrum for different objects)and nonlinearity,1D-CNN has improved lithological identification and mineral property inversion,with interpretability methods further increasing model transparency.Additionally,Vis-NIR spectroscopy combined with DL has been successfully applied in areas such as dating ancient ceramics,plastic sorting,and vitality detection of poultry eggs.Looking forward,DL models in Vis-NIR spectroscopy will see integrated innovations in model architecture,data augmentation,and interpretability.By promoting standardization and normative application,this technology is expected to develop toward greater reliability and broader adoption.
孙杰;刘恒钦;赵洁;安雅睿;刘曙
上海理工大学材料与化学学院,上海 200093||上海海关工业品与原材料检测技术中心,上海 201210上海理工大学材料与化学学院,上海 200093||上海海关工业品与原材料检测技术中心,上海 201210上海海关工业品与原材料检测技术中心,上海 201210上海理工大学材料与化学学院,上海 200093上海海关工业品与原材料检测技术中心,上海 201210
可见-近红外光谱深度学习可解释性数据增强评述
Visible-near infrared spectroscopyDeep learningInterpretabilityData augmentationReview
《分析化学》 2026 (5)
825-836,12
海关总署科技项目(No.2024HK186)资助. Supported by the Scientific Research Project of the General Administration of Customs of the People's Republic of China(No.2024HK186).
评论