融合大语言模型的智能音控大屏系统设计与实现OA
Design and Implementation of an Intelligent Voice-controlled Display System Integrating Large Language Models
为推进生产运营管理平台的"数智化"转型,提升大屏功能模块的智能化水平与人机交互能力,本文融合大语言模型(LLM)及相关技术,构建智能音控大屏系统.该系统的人机交互终端模块通过自动语音识别技术将移动端用户语音口令转为文本,并利用文语合成技术实现语音播报;以本地部署的 LLM 为基座,结合检索增强生成、提示词及领域知识库等技术,构建用于解析用户语音口令并生成控制大屏操作的文本指令的增强控制模块;采用 WebSocket 协议和 HTTP 协议实现各模块与大屏功能模块的数据通信.测试结果表明,该系统能有效识别和解析用户语音口令,并准确执行大屏功能模块的相关控制功能,其可靠性、准确性与鲁棒性均达到预期要求,能够为相关行业应用 LLM 及其相关技术进行系统智能化升级改造提供借鉴和参考.
To advance the"digital and intelligent"transformation of the production operations management platform and enhance the intelligence and human-machine interaction capabilities of the large-screen functional modules,this paper integrates large language models(LLMs)and related technologies to build an intelligent voice-controlled large-screen system.The system's human-machine interaction terminal module uses automatic speech recognition(ASR)technology to convert voice commands from mobile users into text,and employs text-to-speech synthesis technology to generate voice announcements.Based on a locally deployed LLM,the system incorporates technologies such as retrieval-augmented generation,prompts,and domain-specific knowledge bases to build an enhanced control module capable of parsing user voice commands and generating text instructions for controlling the large-screen display.The WebSocket and HTTP protocols are used to facilitate data communication between the various modules and the large-screen functional modules.Test results indicate that the system can effectively recognize and parse user voice commands and accurately execute the relevant operational control functions of the large-screen modules.Its reliability,accuracy,and robustness all meet the expected requirements,providing valuable insights and references for related industries seeking to upgrade and modernize their systems through the application of LLMs and related technologies.
彭龙江
上海西派埃智能化系统有限公司,上海 200233||重庆鲁班机器人技术研究院,重庆 400714
信息技术与安全科学
大语言模型检索增强生成提示词知识库音控
large language modelsretrieval-augmented generationpromptsknowledge basevoice-control
《自动化与信息工程》 2026 (3)
23-31,9
评论