基于视觉词典与多尺度特征融合的药品外包装图像检索系统设计与实践OA
Design and Practice of Drug Outer Packaging Image Retrieval System Based on Visual Dictionary and Multi-Scale Feature Fusion
目的 开发药品外包装检索模型,并将其集成于医院门诊药房发药系统中,以优化门诊发药业务流程,提升发药环节工作效率及安全性.方法 提出一种基于尺度不变特征转换(Scale-Invariant Feature Transform,SIFT)与加速稳健特征(Speeded Up Robust Features,SURF)融合的特征提取方法;结合局部聚合描述子向量(Vector of Locally Aggregated Descriptors,VLAD)特征编码的药品外包装图像检索算法,对收集的门诊常用药品外包装图像进行训练,以关键步骤运行时间、预测概率向量、预测结果作为该模型的评价指标.利用Windows Form设计一个交互可视控件,药师可直接通过操作界面调用该算法.结果 基于特征融合的视觉词典模型相较于基于SIFT的视觉词典模型在生成视觉词典、VLAD编码以及训练总时长方面耗时较短,且预测性能更佳,准确度可达99.02%,单一样本平均输出的概率值为94.77%.经过本研究算法优化后的门诊药房发药系统在取药等待时间、发药差错数量方面,相较于优化前均有显著改善,且差异均具有统计学意义(P<0.05).结论 将SIFT与SURF进行特征融合并采用VLAD进行特征编码的算法集成于门诊药房发药系统中,能够精准检索药品外包装名称,在药剂师配药环节中发挥辅助作用,提高工作效率,减少发药差错引发的一系列医疗纠纷问题.
Objective To develop a drug outer packaging retrieval model and integrate it into the drug dispensing system of the hospital outpatient pharmacy,in order to optimize the outpatient drug dispensing business process and improve the work efficiency and safety of the drug dispensing link.Methods A Feature extraction method based on the fusion of scale-invariant feature transform(SIFT)and speeded up robust features(SURF)was proposed.The drug outer packaging image retrieval algorithm combining vector of locally aggregated descriptors(VLAD)feature coding was used to train the collected outer packaging images of commonly used outpatient drugs.The running time of key steps,the prediction probability vector and the prediction result were taken as the evaluation indicators of this model.An interactive visual control was designed using Windows Form,and the algorithm was directly invoked by pharmacists through the operator interface.Results The visual dictionary model based on feature fusion took less time in generating the visual dictionary,VLAD encoding and the total training time compared with the visual dictionary model based on SIFT.Moreover,it has better prediction performance,with an accuracy of up to 99.02%and an average probability value of 94.77%for a single sample output.The outpatient pharmacy dispensing system optimized by the algorithm in this study has significantly improved in terms of waiting time for dispensing and the number of dispensing errors compared with that before optimization,and the differences were statistically significant(P<0.05).Conclusion Integrating the algorithm of feature fusion of SIFT and SURF and feature coding with VLAD into the dispensing system of the outpatient pharmacy can accurately retrieve the names of drug outer packaging,play an auxiliary role in the dispensing process of pharmacists,improve work efficiency,and reduce a series of medical disputes caused by dispensing errors.
聂和愉;王明举;于涛;吴伟;张进
十堰市太和医院(湖北医药学院附属医院)信息资源部,湖北 十堰 442000十堰市太和医院(湖北医药学院附属医院)信息资源部,湖北 十堰 442000十堰市太和医院(湖北医药学院附属医院)信息资源部,湖北 十堰 442000十堰市太和医院(湖北医药学院附属医院)信息资源部,湖北 十堰 442000十堰市太和医院(湖北医药学院附属医院)信息资源部,湖北 十堰 442000
医药卫生
门诊药房特征融合视觉词典发药差错药事服务局部聚合描述子向量(VLAD)特征编码检索系统
outpatient pharmacyfeature fusionvisual dictionarymedication dispensing errorpharmaceutical servicesvector of locally aggregated descriptors(VLAD)feature codingretrieval system
《中国医疗设备》 2025 (11)
12-19,8
"十四五"湖北省高等学校优势特色学科群(现代医学)项目(2024XKQT31)2024年度十堰市引导性科研项目(24Y069).
评论