基于大模型多智能体协作的高价值专利识别方法研究OACHSSCD
The High-Value Patent Identification Method Based on Large Language Models and Multi-Agent Collaboration
[目的/意义]当前高价值专利识别方法普遍存在对评估指标内涵理解不深、对专利文本语义挖掘与逻辑推理不足等问题,导致模型在高价值专利特征认知、泛化性能与结果可解释性等方面表现受限.基于上述不足,本文提出一种基于大模型多智能体协作的高价值专利识别方法.[方法/过程]本文构建技术、经济、法律三维专利特征体系,利用大模型提炼各维度评估准则,迭代优化形成结构化指南,并基于指南构建三维度的评估智能体,通过多智能体协同机制实现高价值专利识别.[结果/结论]结果表明,本文方法在人工智能专利数据集上准确率和F1值分别达到了0.81与0.80,能够自动生成评估理由,显著提升决策透明性与可解释性,在低资源及跨领域场景下表现优异,优于现有主流方法,为专利识别范式向可解释生成式转变提供了新思路.
[Purpose/Significance]International research on patent value assessment has progressively developed quantitative indicators(e.g.,citation counts,family size,claim metrics)and machine-learning classifiers built on engi-neered features.However,three interrelated limitations remain.First,most methods rely on surface-level indicators or feature aggregation and therefore fail to capture deep semantic relations,causal signals,and argumentative structure embedded in patent texts.Second,prevalent end-to-end discriminative models operate as"black boxes",offering little human-readable justification and limiting trust for decision-makers and policymakers.Third,many approaches show weak transferability:they perform poorly in low-resource settings and across technological domains because they lack prin-cipled,multi-dimensional evaluation frameworks.To address this gap,the paper proposes an interpretable,generative framework for high-value patent identification that leverages multi-agent collaboration built on large language models(LLMs).[Method/Process]The study first defined a patent evaluation framework covering three complementary dimen-sions:technical,economic,and legal.Using an LLM's contextual and chain-of-thought capabilities,the study synthe-sized explicit evaluation criteria for each dimension and iteratively refined them into a structured guideline.Empirically,the study used IncoPat's global patent database.Based on the"Classification of Strategic Emerging Industries and Corre-spondence Table with International Patent Classification",the study constructed retrieval queries and obtained 375591 granted invention patents in the artificial intelligence field.The study adopted IncoPat's"He Xiang value score"as the value indicator,treating patents with a score of 10 as high-value(positive class)and the remainder as non-high-value(negative class).From this corpus,the study randomly sampled 1000 high-value patents and 1000 non-high-value pa-tents to ensure class balance,and partitioned them into training,validation,and test sets in a 6∶2∶2 ratio.The core analy-sis used the DeepSeek-R1 to implement three evaluative agents(technical,economic,legal)and a collaborative reasoning protocol that aggregates agent outputs and generates human-readable rationales.[Result/Conclusion]On the AI patent test set,the proposed multi-agent LLMs framework achieves an accuracy of 0.81 and an F1 score of 0.80.It consistently pro-duces structured,logic-grounded rationales,overcoming the interpretability gap that persists in most state-of-the-art international models.Moreover,in low-resource and cross-domain experiments,the method demonstrates stronger gene-ralization than mainstream indicator-driven or end-to-end discriminative approaches.By integrating multi-dimensional patent value criteria with generative reasoning mechanisms,this work provides a scalable and transparent alternative to black-box evaluation pipelines that currently dominate patent analytics.The proposed paradigm aligns with the global shift toward trustworthy AI and explainable intellectual property analytics,offering actionable insights for technology evaluation,strategic decision-making,and innovation governance in both industrial and policy contexts.
张志豪;杨子良;朱作箫;袁家旭;何喜军;乔晚馨
北京工业大学经济与管理学院,北京 100124北京工业大学经济与管理学院,北京 100124北京工业大学经济与管理学院,北京 100124北京工业大学经济与管理学院,北京 100124北京工业大学经济与管理学院,北京 100124北京工业大学经济与管理学院,北京 100124
社会科学
高价值专利识别大语言模型多智能体协作可解释性
high-value patent identificationlarge language modelsmulti-agent collaborationinterpretability
《现代情报》 2026 (6)
60-75,16
国家自然科学基金青年项目"大模型赋能的高价值专利个性化交易推荐方法与应用研究"(项目编号:72404020)中国博士后科学基金第76批面上项目"大模型赋能的专利技术供需匹配方法与应用研究"(项目编号:2024M760177)北京市自然科学基金面上项目"大模型赋能的北京技术交易市场供需数据质量评估方法与应用研究"(项目编号:9252002)北京自然科学基金青年项目"北京在线医疗服务质量智能评估、影响机制及干预策略研究"(项目编号:9264021).
评论