首页|期刊导航|中北大学学报(自然科学版)|基于STM32微控制器的MCUVLM-RWKV视觉-语言模型研究

基于STM32微控制器的MCUVLM-RWKV视觉-语言模型研究OA

Research on MCUVLM-RWKV Vision-Language Model Based on STM32 Microcontroller

中文摘要英文摘要

随着人工智能在安防、工业和农业等领域的广泛应用,边缘设备在视觉推理任务中的需求不断增长.然而,受限于硬件资源,针对STM32的视觉-语言模型部署方案仍相对缺乏.为应对这一问题,本文提出了一种面向STM32的视觉-语言模型MCUVLM-RWKV.该模型融合了轻量化视觉编码器、轻量化视觉特征映射器和具备双模式运行机制的RWKV解码器三大核心模块,可完成图像描述任务.实验结果表明,在STM32的运行内存与存储限制下,MCUVLM-RWKV在BLEU-4、ROUGE-L和METEOR等评价指标上均优于多种主流模型,其中ROUGE-L指标达到55.7,显著高于其他对比模型,表明该模型在长序列推理任务中具有更强的建模能力.此外,MCUVLM-RWKV在参数规模与推理内存占用方面表现优异,进一步验证了其在微控制器场景下的推理性能与部署可行性.

With the widespread application of artificial intelligence in fields such as security,industry,and agriculture,the demand for edge devices on vision reasoning tasks continues to grow.However,due to hardware constraints,deployment schemes of vision-language models designed for STM32 microcontrollers remain relatively scarce.To address this problem,this paper proposes an STM32-oriented vision-language model,MCUVLM-RWKV.The model integrates three core modules:a lightweight vision encoder,a lightweight vision feature mapper,and an RWKV decoder with a dual-mode operation mechanism,enabling image captioning tasks.Experimental results show that under the memory and storage limitations of STM32,MCUVLM-RWKV outperforms several mainstream models in evaluation metrics such as BLEU-4,ROUGE-L,and METEOR.Specifically,the ROUGE-L score reaches 55.7,which is significantly higher than that of other comparative models,indicating stronger modeling capability in long-sequence reasoning tasks.In addition,MCUVLM-RWKV demonstrates excellent performance in terms of parameter scale and inference memory consumption,further verifying its reasoning efficiency and deployment feasibility in MCU scenarios.

朱忠诺;邵星灵;李秀源;邓瑞祥;徐悦梅;张强

中北大学 仪器与电子学院,山西 太原 030051中北大学 电气与控制工程学院,山西 太原 030051中北大学 仪器与电子学院,山西 太原 030051中北大学 电气与控制工程学院,山西 太原 030051中北大学 电气与控制工程学院,山西 太原 030051中北大学 电气与控制工程学院,山西 太原 030051

信息技术与安全科学

STM32视觉-语言模型边缘计算内存优化RWKV图像描述

STM32vision-language modeledge computingmemory optimizationRWKVimage captioning

《中北大学学报(自然科学版)》 2026 (1)

71-79,9

国家自然科学基金资助项目(62203404)

10.62756/jnuc.issn.1673-3193.2025.09.0014

评论