基于结构感知的煤矿标准文档解析方法OA
Structure-aware parsing method for coal mine standard documents
为了提升煤矿安全相关标准文档在智能化应用中的知识供给效率与合规判定准确性,解决传统检索增强生成(Retrieval-Augmented Generation,RAG)系统因物理切片导致的语义表征漂移与逻辑边界缺失问题,研究并构建了一种结构感知逻辑切片算法(Structure-Aware Logic-al Chunking,SALC).首先,基于微调的 LayoutLMv3(Layout Language Model version 3)模型融合文本、布局及图像特征,对文档进行细粒度语义标注;其次,设计了语义冲突自校正的文档拓扑解析算法,构建了携带完整路径语义的文档树(Document Tree with Path Semantics,DTPS);最后,采用语义检索标签驱动的动态聚合策略,生成结构完整的逻辑切片.试验结果表明,模型的宏观 F1 值(Marco F1)和条款级 F1 值(Clause-Level F1)分别达到 93.53%、91.79%,优于基于Transformer 的双向编码器表示模型(Bidirectional Encoder Representations from Transformers,BERT)及文档理解 Transformer 模型(Document Understanding Transformer,Donut).在端到端检索评估中,SALC 算法的检索命中率(Hit Rate)达到 93.36%,平均倒数排名(Mean Reciprocal Rank,MRR)为 0.89,上下文精确率(Context Precision)为 71.92%,优于递归分块策略(Recursive Character Text Splitter,RCTS)及结构层次化解析模型 QD-RAG(Query Decomposition-Driven It-erative Retrieval-Augmented Generation,QD-RAG).SALC 相较于煤矿领域文档解析模型CMSE-KGM(Coal Mine Safety Equipment Knowledge Graph Construction Method,CMSE-KGM)和 PRoPE-UIE(Prompt Relation oriented Parsing Engine-Universal Information Extraction,PRoPE-UIE),命中率分别提升了 3.60 个百分点 和 6.94 个百分点,平均倒数排名分别提升了0.09 和 0.06.针对不同文档长度的解析结果表明,SALC 针对页数超过 20 页的长文档及OCR(Optical Character Recognition,OCR)识别噪声干扰场景的检索命中率为 82.17%,显著优于对比模型.消融实验进一步验证了拓扑自校正与动态聚合策略的有效性.
To enhance the efficiency of knowledge supply and the accuracy of compliance determination for coal mine safety relev-ant standard documents in intelligent applications,and to address the issues of semantic representation drift and lack of logical boundaries caused by physical chunking in traditional Retrieval-Augmented Generation(RAG)systems,this study proposes and con-structs a Structure-Aware Logical Chunking(SALC)algorithm.First,based on a fine-tuned Layout Language Model version 3(Lay-outLMv3)model,the method integrates text,layout,and image features to perform fine-grained semantic annotation on documents.Second,a semantic conflict self-correcting document topology parsing algorithm is designed to construct a Document Tree with Path Semantics(DTPS).Finally,a semantic retrieval tag-driven dynamic aggregation strategy is employed to generate structurally com-plete logical chunks.Experimental results show that the model achieves a Macro F1 score of 93.53%and a Clause-Level F1 score of 91.79%,outperforming Bidirectional Encoder Representations from Transformers(BERT)and Document Understanding Trans-former(Donut).In end-to-end retrieval evaluation,the SALC algorithm achieves a Hit Rate of 93.36%,a Mean Reciprocal Rank(MRR)of 0.89,and a Context Precision of 71.92%,surpassing the Recursive Character Text Splitter(RCTS)and the Query Decom-position driven iterative Retrieval Augmented Generation(QD-RAG)model.Compared with the coal mine domain document pars-ing models of Coal Mine Safety Equipment Knowledge Graph Construction Method(CMSE-KGM)and Prompt Relation oriented Parsing Engine-Universal Information Extraction(PRoPE-UIE),SALC improves the Hit Rate by 3.60 and 6.94 percentage points re-spectively,the MRR by 0.09 and 0.06.Results regarding different document lengths indicate that SALC maintains a Hit Rate of 82.17%for long documents exceeding 20 pages and scenarios with Optical Character Recognition(OCR)noise interference,signific-antly outperforming comparative models.Ablation studies further validate the effectiveness of the topology self-correction and dy-namic aggregation strategies.
杨海军;刘江;王唯丞;王胜杰
国家能源集团宁夏煤业有限责任公司,宁夏 银川 750002国能榆林能源有限责任公司,陕西 榆林 719000中煤科工集团重庆研究院有限公司,重庆 400039国能数智科技开发(北京)有限公司,北京 100010
矿业与冶金
煤矿安全智能化应用数智赋能检索增强生成结构感知切片文档拓扑解析语义对齐
coal mine safetyintelligent applicationdigital-intelligent enablingretrieval-augmented generationstructure-aware chunkingdocument topology parsingsemantic alignment
《煤矿安全》 2026 (6)
12-24,13
国家科技重大专项基金资助项目(2025ZD1700805)天地科技股份有限公司科技创新创业资金专项资助项目(2024-TDZD013-05)
评论