Survey on explainable knowledge graph reasoning methods

Yi XIA; Mingjng LAN; Xiaohui CHEN; Junyong LUO; Gang ZHOU; Peng HE

doi:10.11959/j.issn.2096-109x.2022063

您当前的位置：

首页 >

文章列表页 >

Survey on explainable knowledge graph reasoning methods

Comprehensive Review | 更新时间：2024-06-03

- Survey on explainable knowledge graph reasoning methods
- Chinese Journal of Network and Information Security Vol. 8, Issue 5, Pages: 1-25(2022)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.2096-109x.2022063
  CLC： TP309
- Online First：2022-10，
  
  Published：15 October 2022
- 稿件说明：
移动端阅览
Yi XIA, Mingjng LAN, Xiaohui CHEN, et al. Survey on explainable knowledge graph reasoning methods[J]. Chinese Journal of Network and Information Security, 2022, 8(5): 1-25.
DOI：

Yi XIA, Mingjng LAN, Xiaohui CHEN, et al. Survey on explainable knowledge graph reasoning methods[J]. Chinese Journal of Network and Information Security, 2022, 8(5): 1-25. DOI： 10.11959/j.issn.2096-109x.2022063.

摘要

近年来，以深度学习模型为基础的人工智能研究不断取得突破性进展，但其大多具有黑盒性，不利于人类认知推理过程，导致高性能的复杂算法、模型及系统普遍缺乏决策的透明度和可解释性。在国防、医疗、网络与信息安全等对可解释性要求严格的关键领域，推理方法的不可解释性对推理结果及相关回溯造成较大影响，因此，需要将可解释性融入这些算法和系统中，通过显式的可解释知识推理辅助相关预测任务，形成一个可靠的行为解释机制。知识图谱作为最新的知识表达方式之一，通过对语义网络进行建模，以结构化的形式描述客观世界中实体及关系，被广泛应用于知识推理。基于知识图谱的知识推理在离散符号表示的基础上，通过推理路径、逻辑规则等辅助手段，对推理过程进行解释，为实现可解释人工智能提供重要途径。针对可解释知识图谱推理这一领域进行了全面的综述。阐述了可解释人工智能和知识推理相关概念。详细介绍近年来可解释知识图谱推理方法的最新研究进展，从人工智能的3个研究范式角度出发，总结了不同的知识图谱推理方法。提出对可解释的知识图谱推理研究前景和未来研究方向。

Abstract

In recent years

deep learning models have achieved remarkable progress in the prediction and classification tasks of artificial intelligence systems.However

most of the current deep learning models are black box

which means it is not conducive to human cognitive reasoning process.Meanwhile

with the continuous breakthroughs of artificial intelligence in the researches and applications

high-performance complex algorithms

models and systems generally lack the transparency and interpretability of decision making.This makes it difficult to apply the technologies in a wide range of fields requiring strict interpretability

such as national defense

medical care and cyber security.Therefore

the interpretability of artificial intelligence should be integrated into these algorithms and systems in the process of knowledge reasoning.By means of carrying out explicit explainable intelligence reasoning based on discrete symbolic representation and combining technologies in different fields

a behavior explanation mechanism can be formed which is an important way for artificial intelligence to realize data perception to intelligence perception.A comprehensive review of explainable knowledge graph reasoning was given.The concepts of explainable artificial intelligence and knowledge reasoning were introduced briefly.The latest research progress of explainable knowledge graph reasoning methods based on the three paradigms of artificial intelligence was introduced.Specifically

the ideas and improvement process of the algorithms in different scenarios of explainable knowledge graph reasoning were explained in detail.Moreover

the future research direction and the prospect of explainable knowledge graph reasoning were discussed.

关键词

Keywords

references

RISSOLA E A , BAHRAINIAN S A , CRESTANI F . Personality recognition in conversations using capsule neural networks [C ] // Proceedings of the Int Conf on Web Intelligence . 2019 : 180 - 187 .

SADAK F , SAADAT M , HAJIYAVAND A M . Real-time deep learning-based image recognition for applications in automated positioning and injection of biological cells [J ] . Computers in Biology and Medicine , 2020 , 125 ( 10 ): 103976 .

VALMADRE J , BERTINETTO L , HENRIQUES J , et al . End-to-end representation learning for correlation filter based tracking [C ] // Proceedings of the IEEE Conf on Computer Vision and Pattern Recognition . 2017 : 2805 - 2813 .

MILLEN J . A survey of methods for explaining black box models [J ] . Computing Reviews , 2019 , 60 ( 4 ): 175 - 176 .

DOSHI-VELEZ F , KIM B . Towards a rigorous science of interpretable machine learning [J ] . arXiv preprint arXiv:1702.08608 , 2017 .

ZHANG Y U , TINO P , LEONARDIS A , et al . A survey on neural network interpretability [J ] . arXiv preprint arXiv:2012.14261 , 2021 .

成科扬 , 王宁 , 师文喜 , 等 . 深度学习可解释性研究进展 [J ] . 计算机研究与发展 , 2020 , 57 ( 6 ): 1208 - 1217 .

CHENG K Y , WANG N , SHI W X , et al . Research advances in the interpretability of deep learning [J ] . Journal of Computer Research and Development , 2020 , 57 ( 6 ): 1208 - 1217 .

GAWEHN E , HISS J A , SCHNEIDER G . Deep learning in drug discovery [J ] . Molecular Informatics , 2016 , 35 ( 1 ): 3 - 14 .

方滨兴 . 定义网络空间安全 [J ] . 网络与信息安全学报 , 2018 , 4 ( 1 ): 1 - 5 .

FANG B X . Define cyberspace security [J ] . Chinese Journal of Network and Information Security , 2018 , 4 ( 1 ): 1 - 5 .

HOFMAN J M , SHARMA A , WATTS D J . Prediction and explanation in social systems [J ] . Science , 2017 , 355 ( 6324 ): 486 - 488 .

胡浩 , 刘玉岭 , 张玉臣 , 等 . 基于攻击图的网络安全度量研究综述 [J ] . 网络与信息安全学报 , 2018 , 4 ( 9 ): 1 - 16 .

HU H , LIU Y L , ZHANG Y C , et al . Survey of attack graph based network security metric [J ] . Chinese Journal of Network and Information Security , 2018 , 4 ( 9 ): 1 - 16 .

CHEN X , JIA S , XIANG Y . A review:knowledge reasoning over knowledge graph [J ] . Expert Systems with Application , 2020 , 141 ( 3 ): 1 - 21 .

AMIT S . Introducing the knowledge graph [R ] . America:Official Blog of Google , 2012 .

DAVID G , MARK S , JAESIK C , et al . XAI-Explainable artificial intelligence [J ] . Science Robotics , 2019 , 4 ( 37 ): 7120 .

官赛萍 , 靳小龙 , 贾岩涛 , 等 . 面向知识图谱的知识推理研究进展 [J ] . 软件学报 , 2018 , 29 ( 10 ): 2966 - 2994 .

GUAN S P , JIN X L , JIA Y T , et al . Knowledge reasoning over knowledge graph:a survey [J ] . Journal of Software , 2018 , 29 ( 10 ): 2966 - 2994 .

WANG Q , MAO Z , WANG B , et al . Knowledge graph embedding:a survey of approaches and applications [J ] . IEEE Transactions on Knowledge and Data Engineering , 2017 , 29 ( 12 ): 2724 - 2743 .

ARORA S . A Survey on graph neural networks for knowledge graph completion [J ] . arXiv preprint arXiv:2007.12374 , 2020 .

LIPTON Z C . The mythos of model interpretability [J ] . Communications of the ACM , 2016 , 61 ( 10 ): 31 - 57 .

KRIZHEVSKY A , SUTSKEVER I , HINTON G E . Imagenet classification with deep convolutional neural networks [J ] . Advances in Neural Information Processing Systems , 2012 , 25 ( 2 ): 84 - 90 .

PAPERNOT N , MCDANIEL P , JHA S , et al . The limitations of deep learning in adversarial settings [C ] // Proceedings of 2016 IEEE European Symp on Security and Privacy . 2016 : 372 - 387 .

SUCHANEK F M , KASNECI G , WEIKUM G . Yago:a core of semantic knowledge [C ] // Proceedings of the 16th Int Conf on World Wide Web . 2007 : 697 - 706 .

AUER S , BIZER C , KOBILAROV G , et al . Dbpedia:a nucleus for a Web of open data [M ] // Proceedings of the Semantic Web . Berlin : Springer , 2007 .

BOLLACKER K , EVANS C , PARITOSH P , et al . Freebase:a collaboratively created graph database for structuring human knowledge [C ] // Proceedings of the 2008 ACM SIGMOD Int Conf on Management of Data . 2008 : 1247 - 1250 .

HU S , ZOU L , YU J X , et al . Answering natural language questions by subgraph matching over knowledge graphs [J ] . IEEE Trans on Knowledge and Data Engineering , 2017 , 30 ( 5 ): 824 - 837 .

PALUMBO E , RIZZO G , TRONCY R . Entity2rec:learning user-item relatedness from knowledge graphs for top-n item recommendation [C ] // Proceedings of the 7th ACM Conf on Recommender Systems . 2017 : 32 - 36 .

宋蕾 , 马春光 , 段广晗 . 机器学习安全及隐私保护研究进展 [J ] . 网络与信息安全学报 , 2018 , 4 ( 8 ): 1 - 11 .

SONG L , MA C G , DUAN G H . Machine learning security and privacy:a survey [J ] . Chinese Journal of Network and Information Security , 2018 , 4 ( 8 ): 1 - 11 .

任奎 , 孟泉润 , 闫守琨 , 等 . 人工智能模型数据泄露的攻击与防御研究综述 [J ] . 网络与信息安全学报 , 2021 , 7 ( 1 ): 1 - 10 .

REN K , MENG Q R , YAN S K , et al . Survey of artificial intelligence data security and privacy protection [J ] . Chinese Journal of Network and Information Security , 2021 , 7 ( 1 ): 1 - 10 .

BADER S , GRANGEL-GONZALE Z , NANJAPPA P , et al . A knowledge graph for industry 4.0 [C ] // Proceedings of the 2020 European Semantic Web Conf . 2020 : 465 - 480 .

ISA B , MSBC D . Open-CyKG:an open cyber threat intelligence knowledge graph [J ] . Knowledge-Based Systems , 2021 ,233:107524.

刘知远 , 孙茂松 , 林衍凯 , 等 . 知识表示学习研究进展 [J ] . 计算机研究与发展 , 2016 , 53 ( 2 ): 247 - 261 .

LIU Z Y , SUN M S , LIN Y K , et al . Knowledge representation learning:a review [J ] . Journal of Computer Research and Development , 2016 , 53 ( 2 ): 247 - 261 .

LECUE , FREDDY . On the role of knowledge graphs in explainable AI [J ] . Semantic Web , 2020 , 11 ( 1 ): 41 - 51 .

刘峤 , 李杨 , 段宏 , 等 . 知识图谱构建技术综述 [J ] . 计算机研究与发展 , 2016 , 53 ( 3 ): 582 - 600 .

LIU Q , LI Y , DUAN H , et al . Knowledge graph construction techniques [J ] . Journal of Computer Research and Development , 2016 , 53 ( 3 ): 582 - 600 .

刘潇 , 刘书洋 , 庄韫恺 , 等 . 强化学习可解释性基础问题探索和方法综述 [J ] . 软件学报 , 2021 .

LIU X , LIU S Y , ZHUANG W K , et al . Explainable reinforcement learning:basic problems exploration and a survey [J ] . Journal of Software , 2021 .

EHRLINGER L , WOLFRAM W . Towards a definition of knowledge graphs [C ] // Proceedings of the Posters and Demos Track of 12th International Conference on Semantic Systems - SEMANTiCS2016 and 1st International Workshop on Semantic Change ＆Evolving Semantics (SuCCESS16) . 2016 .

CHEN X , CHEN H J , ZHANG N Y , et al . OWL reasoning over big biomedical data [C ] // Proceedings of the 2013 IEEE Int Conf on Big Data . 2013 : 29 - 36 .

ZHANG D H , YUAN Z X , LIU H , et al . Learn to walk with dual agents for knowledge graph reasoning [C ] // Proceedings of the 2022 AAAI Conf on Artificial Intelligence . 2022 : 5932 - 5941 .

ZOU Y , FININ T , CHEN H . F-OWL:an inference engine for semantic Web [C ] // Proceedings of the Int Conf on Formal Approaches to Agent-based Systems . 2004 : 238 - 248 .

SIRIN E , PARSIA B , GRAU B C , et al . Pellet:a practical OWL DL reasoner [J ] . Journal of Web Semantics , 2007 , 5 ( 2 ): 51 - 53 .

WEI Y Z , LUO J , XIE H Y . KGRL:an OWL2 RL reasoning system for large scale knowledge graph [C ] // Proceedings of the 12th Int Conf on Semantics,Knowledge and Grids . 2016 : 83 - 89 .

ZHOU J , MA L , LIU Q , et al . Minerva:a scalable OWL ontology storage and inference system [C ] // Proceedings of the Asian Conf on the Semantic Web . 2006 : 429 - 443 .

SOMA R , PRASANNA V K . Parallel inferencing for OWL knowledge bases [C ] // Proceedings of the 37th Int Conf on Parallel Processing . 2008 : 75 - 82 .

MARX M , KRÖTZSCH M , THOST V . Logic on mars:ontologies for generalised property graphs [C ] // Proceedings of the 26th Int Joint Conf on Artificial Intelligence . 2017 : 118 - 1194 .

CHEN Y , GOLDBERG S , WANG D Z , et al . Ontological pathfinding:mining first-order knowledge from large knowledge bases [C ] // Proceedings of the 2016 Int Conf on Management of Data . 2016 : 835 - 846 .

HAO J H , CHEN M H , YU W C , et al . Universal representation learning of knowledge bases by jointly embedding instances and ontological concepts [C ] // Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery ＆ Data Mining (KDD '19) . 2019 : 1709 - 1719 .

KULMANOV M , LIU-WEI W , YAN Y , et al . El Embeddings:geometric construction of models for the description logic el++ [C ] // Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI-19) . 2019 : 6103 - 6109 .

DENG S , ZHANG N , LI L , et al . Ontoed:low-resource event detection with ontology embedding [J ] . arXiv preprint arXiv:2105.10922 , 2021 .

SCHOENMACKERS S , ETZIONI O , WELD D S , et al . Learningfirst-order horn clauses from Web text [C ] // Proceedings of the 2010 Conf on Empirical Methods in Natural Language Processing . 2010 : 1088 - 1098 .

LANDWEHR N , KERSTING K , RAEDT L D . Integrating naive Bayes and FOIl [J ] . Journal of Machine Learning Research , 2007 , 8 ( 5 ): 481 - 507 .

LANDWEHR N , PASSERINI A , RAEDT L D , et al . Fast learning of relational kernels [J ] . Machine Learning , 2010 , 78 ( 3 ): 305 - 342 .

NAKASHOLE N , SOZIO M , SUCHANEK F M , et al . Query-time reasoning in uncertain RDF knowledge bases with soft and hard rules [J ] . VLDS , 2012 , 884 ( 6 ): 15 - 20 .

GALÁRRAGA L , TELIOUDI C , HOSE K , et al . Fast rule mining in ontological knowledge bases with AMIE+ [J ] . The Int Journal on Very Large Data Bases , 2015 , 24 ( 6 ): 707 - 730 .

GALÁRRAGA L , TELIOUDI C , HOSE K , et al . Amie:association rule mining under incomplete evidence in ontological knowledge bases [C ] // Proceedings of the 22nd Int Conf on World Wide Web . 2013 : 413 - 422 .

WANG Z C , LI J Z . RDF2Rules:learning rules from RDF knowledge bases by mining frequent predicate cycles [J ] . arXiv preprint arXiv:1512.07734 , 2015 .

KOK S , DOMINGOS P . Learning the structure of Markov logic networks [C ] // Proceedings of the 22nd Int Conf on Machine Learning . 2005 : 441 - 448 .

RICHARDSON M , DOMINGOS P . Markov logic networks [J ] . Machine Learning , 2006 , 62 ( 1-2 ): 107 - 136 .

ONDREJ K , JESSE D . Markov logic networks for knowledge base completion:a theoretical analysis under the MCAR assumption [C ] // Proceedings of the 35th Uncertainty in Artificial Intelligence Conf . 2020 : 1138 - 1148 .

DE-RAEDT L , KIMMIG A , TOIVONEN H . A probabilistic prolog and its application in link discovery [C ] // Proceedings of the 20th Int Joint Conf on Artifical Intelligence . 2007 : 2462 - 2467 .

CUSSENS J . Parameter estimation in stochastic logic programs [J ] . Machine Learn , 2001 , 44 ( 3 ): 245 - 271 .

WANG W Y , MAZAITIS K , COHEN W W . Programming with personalized pagerank:a locally groundable first-order probabilistic logic [C ] // Proceedings of the 22nd ACM Int Conf on Information ＆Knowledge Management . 2013 : 2129 - 2138 .

HAVELIWALA T H . Topic-sensitive PageRank:a context-sensitive ranking algorithm for Web search [J ] . IEEE Trans on Knowledge and Data Engineering , 2003 , 15 ( 4 ): 784 - 796 .

KIMMIG A , BACH S H , BROECHELER M , et al . A short introduction to probabilistic soft logic [C ] // Proceedings of the NIPS Workshop on Probabilistic Programming:Foundations and Applications . 2012 : 1 - 4 .

PUJARA J , MIAO H , GETOOR L , et al . Ontology-aware partitioning for knowledge graph identification [C ] // Proceedings the Workshop on Automated Knowledge Base Construction . 2013 : 19 - 24 .

BACH S H , BROECHELER M , HUANG B , et al . Hinge-loss markov random fields and probabilistic soft logic [J ] . Computer Science , 2017 , 18 ( 1 ): 1 - 67 .

MEILICKE C , CHEKOL M W , FINK M , et al . Reinforced anytime bottom up rule learning for knowledge graph completion [J ] . arXiv preprint,arXiv:2004.04412 , 2020 .

PEDRESCHI D , GIANNOTTI F , GUIDOTTI R , et al . Meaningful explanations of black box ai decision systems [C ] // Proceedings of the AAAI Conf on Artificial Intelligence . 2019 .

LAO N , COHEN W . Relational retrieval using a combination of path-constrained random walks [J ] . Machine Learning , 2010 , 81 ( 1 ): 53 - 67 .

LAO N , MITCHELL T , COHEN W . Random walk inference and learning in a large scale knowledge base [C ] // Proceedings of the 2011 Conf on Empirical Methods in Natural Language Processing . 2011 : 27 - 31 .

GARDNER M , TALUKDAR P , KRISHNAMURTHY J , et al . Incorporating vector space similarity in random walk inference over knowledge bases [C ] // Proceedings of the 2014 Conf on Empirical Methods in Natural Language Processing . 2014 : 397 - 406 .

GARDNER M , MITCHELL T . Efficient and expressive knowledge base completion using subgraph feature extraction [C ] // Proceedings of the 2015 Conf on Empirical Methods in Natural Language Processing . 2015 : 1488 - 1498 .

LIU Q , HAN M , JIANG L , et al . Two-tier random walk based relational inference algorithm [J ] . Chineses Journal of Computers , 2017 , 40 ( 6 ): 1275 - 1290 .

WEI Z , ZHAO J , LIU K . Mining inference formulas by goal-directed random walks [C ] // Proceedings of the 2016 Conf on Empirical Methods in Natural Language Processing . 2016 : 1379 - 1388 .

WANG Q , LIU J , LUO Y F , et al . Knowledge base completion via coupled path ranking [C ] // Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics . 2016 : 1308 - 1318 .

XIONG W H , HONG T , WANG W Y . DeepPath:a reinforcement learning method for knowledge graph reasoning [C ] // Proceedings of the 2017 Conf on Empirical Methods in Natural Language Processing . 2017 : 564 - 573 .

DAS R , DHULIAWALA S , ZAHEER M , et al . Go for a walk and arrive at the answer:reasoning over paths in knowledge bases using reinforcement learning [C ] // Proceedings of the 6th Int Conf on Learning Representations . 2018 .

GREFF K , SRIVASTAVA R K , KOUTNÍK J , , et al . LSTM:a search space odyssey [J ] . IEEE Trans on Neural Networks ＆Learning Systems , 2016 , 28 ( 10 ): 2222 - 2232 .

LIN X V , SOCHER R , XIONG C M . Multi- hop knowledge graph reasoning with reward shaping [C ] // Proceedings of the 2018 Conf on Empirical Methods in Natural Language Processing . 2018 : 3243 - 3253 .

SHEN Y , CHEN J , HUANG P S , et al . M-Walk:learning to walk over graphs using monte carlo tree search [C ] // Proceedings of the 32nd Int Conf on Neural Information Processing Systems . 2018 : 6786 - 6797 .

GODIN F , KUMAR A , MITTAL A . Using ternary rewards to reason over knowledge graphs with deep reinforcement learning [C ] // Proceedings of the 2019 Conf and Workshop on Neural Information Processing Systems . 2019 : 846 - 852 .

LEI D R , JIANG G G , GU X T , et al . Learning collaborative agents with rule guidance for knowledge graph reasoning [C ] // Proceedings of the 2020 Conf on Empirical Methods in Natural Language Processing . 2020 : 8541 - 8547 .

XIA Y , LAN M J , LUO J Y , et al . Iterative rule-guided reasoning over sparse knowledge graphs with deep reinforcement learning [C ] // Information Processing ＆ Management . 2022 :103040.

CHEN W H , XIONG W H , YAN X F , et al . Variational knowledge graph reasoning [C ] // Proceedings of the 2018 Conf of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies . 2018 : 1823 - 1832 .

KINGMA D P , WELLING M . Auto-encoding variational Bayes [C ] // Proceedings of the 2nd Int Conf on Learning Representations . 2014 : 1 - 14 .

LI Z X , JINX L , GUAN S P , et al . Path reasoning over knowledge graph:a multi-agent and reinforcement learning based method [C ] // Proceedings of the 2018 IEEE Int Conf on Data Mining Workshops . 2018 : 929 - 936 .

YU W T , MA X G , BAI L Y , et al . Path-based knowledge graph completion combining reinforcement learning with soft rules [C ] // Proceedings of the Int Conf on Natural Computation,Fuzzy Systems and Knowledge Discovery . 2019 : 139 - 146 .

WANG Q , HAO Y S , CAO J . ADRL:an attention-based deep reinforcement learning framework for knowledge graph reasoning [J ] . Knowledge-Based Systems , 2020 , 197 ( 7 ): 105910 .

HILDEBRANDT M , SERNA J A Q , MA Y P , et al . Reasoning on knowledge graphs with debate dynamics [C ] // Proceedings of the 34th AAAI Conf on Artificial Intelligence . 2020 : 4123 - 4131 .

BORDES A , USUNIER N , GARCIADURAN A , et al . Translating embeddings for modeling multi-relational data [C ] // Proceedings of the 26th Int Conf on Neural Information Processing Systems . 2013 : 2787 - 2795 .

WANG Z , ZHANG J W , FENG J L , et al . Knowledge graph embedding by translating on hyper planes [C ] // Proceedings of the 28th AAAI Conf on Artificial Intelligence . 2014 : 1112 - 1119 .

LIN Y K , LIU Z Y , SUN M S , et al . Learning entity and relation embeddings for knowledge graph completion [C ] // Proceedings of the 29th AAAI Conf on Artificial Intelligence . 2015 : 2181 - 2187 .

JI G , LIU K , HE S , et al . Knowledge graph completion with adaptive sparse transfer matrix [C ] // Proceedings of the 30th AAAI Conference on Artificial Intelligence . 2016 : 985 - 991 .

SUN Z Q , DENG Z H , NIE J Y , et al . RotatE:knowledge graph embedding by relational rotation in complex space [C ] // Proceedings of the 7th Int Conf on Learning Representations . 2019 .

ZHANG S , TAY Y , YAO L , et al . Quaternion knowledge graph embeddings [C ] // Proceedings of the 33rd Conference on Neural Information Processing Systems . 2019 : 1 - 14 .

SONG T W , LUO J , HUANG L . Rot-Pro:modeling transitivity by projection in knowledge graph embedding [J ] . Advances in Neural Information Processing Systems , 2021 ,34.

CAO Z S , XU Q Q , YANG Z Y et al . Dual quaternion knowledge graph embeddings [C ] // Proceedings of the AAAI Conference on Artificial Intelligence . 2021 : 6894 - 6902 .

LI M , JIA Y , WANG Y , et al . Hierarchy-based link prediction in knowledge graphs [C ] // Proceedings of the 25th International Conference Companion on World Wide Web . 2016 : 77 - 78 .

ZHANG Z , CAI J , ZHANG Y , et al . Learning hierarchy-aware knowledge graph embeddings for link prediction [C ] // Proceedings of the AAAI Conference on Artificial Intelligence . 2020 : 3065 - 3072 .

WANG S , FU K , SUN X , et al . Hierarchical-aware relation rotational knowledge graph embedding for link prediction [J ] . Neurocomputing , 2021 , 458 : 259 - 270 .

HU Z , HUANG P , DENG Y , et al . Entity hierarchy embedding [C ] // Proceedings of the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing . 2015 : 1292 - 1300 .

BALAZEVIC I , ALLEN C , HOSPEDALES T . Multi-relational poincaré graph embeddings [J ] . Advances in Neural Information Processing Systems , 2019 , 32 : 4463 - 4473 .

NICKEL M , TRESP V , KRIEGEL H-P . A three-way model for collective learning on multi-relational data [C ] // Proceedings of the Int Conf on Machine Learning . 2011 : 809 - 816 .

YANG B , YI W T , HE X , et al . Embedding entities and relations for learning and inference in knowledge bases [C ] // Proceedings of the 2015 Int Conf on Learning Representations . 2015 .

TROUILLON T , WELBL J , RIEDEL S , et al . Complex embeddings for simple link prediction [C ] // Proceedings of the Int Conf on Machine Learning . 2016 : 2071 - 2080 .

LIU H , WU Y , YANG Y . Analogical inference for multi-relational embeddings [C ] // Proceedings of the International Conference on Machine Learning . 2017 : 2168 - 2178 .

BALAŽEVIĆ I , ALLEN C , HOSPEDALES T M . Tucker:tensor factorization for knowledge graph completion [J ] . arXiv preprint arXiv:1901.09590 , 2019 .

SOCHER R , CHEN D , MANNING C D , et al . Reasoning with neural tensor networks for knowledge base completion [C ] // Proceedings of the Advances in Neural Information Processing Systems . 2013 : 926 - 934 .

BORDES A , GLOROT X , WESTON J , et al . A semantic matching energy function for learning with multi-relational data [J ] . Machine Learning , 2014 , 94 ( 2 ): 233 - 259 .

LIU Q , JIANG H , Evdokimov A , et al . Probabilistic reasoning via deep learning:neural association models [J ] . arXiv preprint arXiv:1603.07704 , 2016 .

DETTMERS T , MINERVINI P , STENETORP P , et al . Convolutional 2D knowledge graph embeddings [C ] // Proceedings of the 32nd AAAI Conference on Artificial Intelligence . 2018 : 1811 - 1818 .

VU T , NGUYEN T D , NGUYEN D Q , et al . A capsule network-based embedding model for knowledge graph completion and search personalization [C ] // Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies . 2019 : 2180 - 2189 .

VASHISHTH S , SANYAL S , NITIN V , et al . InteractE:improving convolution-based knowledge graph embeddings by increasing feature interactions [C ] // Proceedings of the AAAI Conference on Artificial Intelligence . 2020 : 3009 - 3016 .

YAO L , MAO C , LUO Y . KG-BERT:BERT for knowledge graph completion [J ] . arXiv preprint arXiv:1909.03193 , 2019 .

ZHAO Y , ZHOU H , XIE R B , et al . Incorporating global information in local attention for knowledge representation learning [C ] // Proceedings of the Findings of the Association for Computational Linguistics:ACL-IJCNLP 2021 . 2021 : 1341 - 1351 .

姚思雨 , 赵天哲 , 王瑞杰 , 等 . 规则引导的知识图谱联合嵌入方法 [J ] . 计算机研究与发展 , 2020 , 57 ( 12 ): 2514 - 2522 .

YAO S Y , ZHAO T Z , WANG R J , et al . Rule-guided joint embedding learning of knowledge graphs [J ] . Journal of Computer Research and Development , 2020 , 57 ( 12 ): 2514 - 2522 .

GUO S , WANG Q , WANG L H , et al . Jointly embedding knowledge graphs and logical rules [C ] // Proceedings of the 2016 Conf on Empirical Methods in Natural Language Processing . 2016 : 192 - 202 .

GUO S , WANG Q , WANG L H , et al . Knowledge graph embedding with iterative guidance from soft rules [C ] // Proceedings of the 32th AAAI Conf on Artificial Intelligence . 2018 : 4816 - 4823 .

WANG P W , DOU D J , WU F Z , et al . Logic rules powered knowledge graph embedding [J ] . arXiv preprint,arXiv:1903.03772 , 2019 .

ZHANG W , PAUDEL B , WANG L , et al . Iteratively learning embeddings and rules for knowledge graph reasoning [C ] // Proceedings of the World Wide Web Conf . 2019 : 2366 - 2377 .

CHENG K W , YANG Z Q , ZHANG M , et al . UniKER:a unified framework for combining embedding and definite horn rule reasoning for knowledge graph inference [C ] // Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing . 2021 : 9753 - 9771 .

NEELAKANTAN A , ROTH B , MCCALLUM A . Compositional vector space models for knowledge base completion [J ] . Computer Science , 2015 : 1 - 16 .

SHEN Y , HUANG P S , CHANG M W , et al . Traversing knowledge graph in vector space without symbolic space guidance [J ] . arXiv preprint,arXiv:1611.04642 , 2016 .

DAS R , NEELAKANTAN A , BELANGER D , et al . Chains of reasoning over entities,relations,and text using recurrent neural networks [C ] // Proceedings of the 15th Conf of the European Chapter of the Association for Computational Linguistics . 2017 : 132 - 141 .

WANG Z K , LI L J , ZENG D D . Attention-based multi-hop reasoning for knowledge graph [C ] // Proceedings of the 2018 IEEE Int Conf on Intelligence and Security Informatics . 2018 : 211 - 213 .

NIU G , ZHANG Y , LI B , et al . Rule-guided compositional representation learning on knowledge graphs [C ] // Proceedings of the AAAI Conference on Artificial Intelligence . 2020 : 2950 - 2958 .

QU M , TANG J . Probabilistic logic neural networks for reasoning [C ] // Proceedings of the Advances in Neural Information Processing Systems . 2019 : 7712 - 7722 .

ZHANG Y Y , CHEN X S , YANG Y , et al . Efficient probabilistic logic reasoning with graph neural networks [J ] . arXiv preprint,arXiv:2001.11850 , 2020 .

VARDHAN L V H , JIA G , KOK S . Probabilistic logic graph attention networks for reasoning [C ] // Proceedings of the World Wide Web Conf 2020 . 2020 : 669 - 673 .

COHEN W W . Tensorlog:a differentiable deductive database [J ] . arXiv preprint,arXiv:1605.06523 , 2020 .

EVANS R , GREFENSTETTE E . Learning explanatory rules from noisy data [J ] . Journal of Artificial Intelligence Research , 2018 , 61 ( 8 ): 1 - 64 .

YANG F , YANG Z , COHEN W W . Differentiable learning of logical rules for knowledge base reasoning [C ] // Proceedings of the Advances in Neural Information Processing Systems . 2017 : 2319 - 2328 .

WANG P , STEPANOVA D , DOMOKOS C , et al . Differentiable learning of numerical rules in knowledge graphs [C ] // Proceedings of the 8th Int Conf on Learning Representations . 2020 .

YAN Y , SONG L . Learn to explain efficiently via neural logic inductive learning [C ] // Proceedings of the 8th Int Conf on Learning Representations . 2020 .

WANG S , WEI X K , NOGUEIRA DOS SANTOS C N , et al . Mixed-curvature multi-relational graph neural network for knowledge graph completion [C ] // Proceedings of the Web Conference . 2021 : 1761 - 1771 .

TERU K K , DENIS E , HAMILTON W L . Inductive relation prediction by subgraph reasoning [J ] . arXiv preprint,arXiv:1911.06962 , 2019 .

DU Z , ZHOU C , DING M , et al . Cognitive knowledge graph reasoning for one-shot relational learning [J ] . IEEE Trans on Knowledge and Data Engineering , 2021 .

XU X R , FENG W , JIANG Y S , et al . Dynamically pruned message passing networks for large-scale knowledge graph reasoning [C ] // Proceedings of the 2020 Int Conf on Learning Representations . 2020 .

HO V T , STEPANOVA D , GAD-ELRAB M H , et al . Rule learning from knowledge graphs guided by embedding models [C ] // Proceedings of the 17th Int Semantic Web Conf . 2018 : 72 - 90 .

OMRAN P G , WANG K , WANG Z . Scalable rule learning via learning representation [C ] // Proceedings of the 27th Int Joint Conf on Artificial Intelligence . 2018 : 2149 - 2155 .

DONG H H , MAO J Y , LIN T , et al . Neural logic machines [C ] // Proceedings of the 7th Int Conf on Learning Reresentations . 2019 .

PAN Y , LIU J , ZHANG L , et al . Learning first-order rules with relational path contrast for inductive relation reasoning [J ] . arXiv preprint arXiv:2110.08810 , 2021 .

QU M , CHEN J K , XHONNEUX L P , et al . RNNLogic:learning logic rules for reasoning on knowledge graphs [C ] // Proceedings of the 2021 Int Conf on Learning Representations . 2021 .

XIA Y , ZHOU G , LUO J Y , et al . PFCA:an intelligent method of multidimensional user profile construction and application [C ] // Proceedings of the 2022 Int Conf on big data analytics . 2022 : 272 - 279 .

LYU X , CAO Y X , HOU L , et al . Is multi-hop reasoning really explainable? Towards benchmarking reasoning interpretability [C ] // Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing . 2021 : 8899 - 8911 .

Views

1121

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Network attack detection method based on knowledge graph and taint propagation

Data recommendation algorithm of network security event based on knowledge graph

Reversible data hiding algorithm in encrypted images based on prediction error and bitplane coding

Research on construction technology of artificial intelligence security knowledge graph

Survey of key management schemes for cluster networks

Related Author

ZHANG Liang

ZHOU Zhimo

ZOU Futai

HUANG Mingyi

Zeyu GU

Zihao LIU

Wei LIU

Xianwei ZHU

Related Institution

School of Cyber Science and Engineering, Shanghai Jiao Tong University

East Branch of State Grid Corporation of China

School of Computer and Electronic Information/School of Artificial Intelligence, Nanjing Normal University

School of Mathematical Science, Nanjing Normal University

School of Marxism, Xidian University, Xi′an

⁰