WKCN:基于小波-KAN协同优化的自适应图像描述算法OA
WKCN:adaptive image description algorithm based on wavelet-KAN collaborative optimization
针对图像描述任务中多尺度纹理表征不足、特征融合冗余及动态语义建模有限的核心挑战,提出一种基于小波-Kolmogorov-Arnold网络(KAN)协同优化的自适应图像描述算法WKCN.首先,设计小波-KAN多尺度非线性增强模块(WKMNE),通过Daubechies-4小波基对图像频带特征进行分解,并结合KAN网络的B样条插值实现纹理非线性增强;其次,提出基于KAN的自适应特征融合机制(KAN-AFF),动态生成空间与通道双权重,以融合ResNet50提取的全局特征与WKMNE输出的频域特征;最后,构建KAN增强动态解码器(KED),将Transformer中的静态前馈网络替换为可学习的KAN激活函数模块,增强语义映射能力.在MSCOCO数据集上的实验表明,WKCN在BLEU-1(81.1)、ROUGE-L(59.1)和CIDEr(133.6)等指标上均达到最优性能;消融实验验证了多尺度特征提取与动态解码的协同效应;超参数分析实验验证了各种超参数选取的合理性;跨数据集实验(Flickr30k、NoCaps)进一步证实了模型具有良好的泛化能力,可视化分析实验直观展现了 WKCN的有效性.WKCN为跨模态语义生成任务提供了一种可验证的非线性优化范式.
This study addressed key challenges in image captioning,including inadequate multi-scale texture representation,redundant feature fusion,and limited dynamic semantic modeling.This paper proposed a novel algorithm named WKCN based on wavelet-KAN collaborative optimization.It designed the wavelet-KAN multi-scale nonlinear enhancement(WKMNE)modu-le to decompose image features using Daubechies-4 wavelet bases and enhance textures via B-spline interpolation in KAN.A KAN-based adaptive feature fusion(KAN-AFF)mechanism dynamically generated spatial and channel weights to integrate global features from ResNet50 and frequency-domain features from WKMNE.Finally,a KAN-enhanced dynamic decoder(KED)replaced the static feed-forward network in Transformer with a learnable KAN activation module to strengthen semantic mapping.Experiments on the MSCOCO dataset show that WKCN achieves optimal scores on BLEU-1(81.1),ROUGE-L(59.1)and CIDEr(133.6).Ablation studies confirme the synergy between multi-scale feature extraction and dynamic deco-ding.Hyperparameter analysis verifies the rationality of parameter selection.Cross-dataset tests on Flickr30k and NoCaps demonstrate strong generalization capability.Visualization analyses illustrate the model's effectiveness intuitively.This work provides a verifiable nonlinear optimization paradigm for cross-modal semantic generation tasks.
何世鹏;郑豪
南京中医药大学人工智能与信息技术学院/江苏省智慧中医药健康服务工程研究中心,南京 210023南京中医药大学人工智能与信息技术学院/江苏省智慧中医药健康服务工程研究中心,南京 210023||南京晓庄学院信息工程学院,南京 211171
信息技术与安全科学
图像描述小波卷积Kolmogorov-Arnold动态特征融合多尺度建模动态解码
image captioningwavelet convolutionKolmogorov-Arnoldadaptive feature fusionmulti-scale modelingdynamic decoding
《计算机应用研究》 2026 (3)
696-703,8
国家自然科学基金资助项目(61976118)江苏省研究生科研创新计划资助项目(KYCX25_2266)
评论