首页|期刊导航|数据采集与处理|基于策略梯度的黑盒模型显著性解释方法

基于策略梯度的黑盒模型显著性解释方法OA

Policy Gradient-Based Saliency Explanation Method for Black-Box Models

中文摘要英文摘要

作为可信人工智能的核心支撑技术,机器学习模型的可解释性在自动化决策系统中扮演重要角色,其中显著性解释能够以热力图的形式直观揭示模型决策依据,已成为可解释人工智能的关键研究方向.然而,现有方法存在根本性缺陷:基于扰动的方法受限于人工设计的分布假设,计算效率与泛化能力难以兼顾;基于梯度的方法需要预设模型结构,无法解释黑盒模型;基于线性近似的方法因局部过度简化引入模型偏差.本文提出一种基于策略梯度的黑盒模型显著性解释方法 Polixplain,将Deletion Score作为核心奖励信号,通过可导松弛技术嵌入策略梯度优化流程,实现忠实性目标的端到端优化.采用图像分类任务作为验证载体,其高维特征空间与可视化直观性为解释方法的多维度评估提供了理想测试环境.Polixplain方法在解释忠实性以及热力图的人类可理解性方面均超越了多种现有解释方法.

As a core enabling technology for trustworthy artificial intelligence,research on the interpretability of machine learning models plays a vital role in automated decision-making systems.Among them,saliency-based explanations,which intuitively reveal the basis of model decisions in the form of heatmaps,have become a key research direction in explainable artificial intelligence.However,existing approaches suffer from fundamental limitations:Perturbation-based methods are constrained by manually designed distributional assumptions,making it difficult to balance computational efficiency and generalization ability;gradient-based methods require prior knowledge of the model's internal structure and thus fail to explain black-box models;and linear-approximation-based methods introduce model bias due to excessive local simplification.To address these limitations,we propose Polixplain,a policy-gradient-based saliency explanation method for black-box models.By using the Deletion Score as the core reward signal and incorporating a differentiable relaxation technique into the policy gradient optimization process,Polixplain enables end-to-end optimization toward the faithfulness objective.Image classification tasks are adopted as the experimental testbed,where the high-dimensional feature space and intuitive visual representation provide an ideal environment for multidimensional evaluation of explanation methods.Polixplain outperforms a range of existing explanation methods in terms of both explanation faithfulness and the human interpretability of the generated heatmaps.

果宇涵;丁立中;韦秋宁

北京理工大学计算机学院,北京 100081北京理工大学计算机学院,北京 100081北京理工大学计算机学院,北京 100081

信息技术与安全科学

可解释性黑盒解释显著性图强化学习策略梯度

interpretabilityblack-box explanationsaliency mapreinforcement learningpolicy gradient

《数据采集与处理》 2026 (5)

1366-1377,12

国家重点研发计划项目(2022YFB2703100). National Key Research and Development Project(No.2022YFB2703100).

10.16337/j.1004-9037.2026.05.008

评论