End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

研究问题

将图网络作为编码器,将Conv-TransE作为解码器,应用于知识图谱补全任务

背景动机

  • ConvE模型在做卷积之前对embedding实施了reshape操作,并且没有保留TransE系列模型的可翻译属性
  • ConvE模型没有把知识图谱的连通性纳入考虑

模型思想

提出了一种端到端的图结构敏感的卷积网络,编码器为WGCN,将节点结构、节点属性、关系类型作为输入;解码器为Conv-TransE,在ConvE的基础上可以保留实体到关系嵌入之间的翻译属性。

模型框架

  • 总体流程

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion
  • Weighted Graph Convolutional Layer(WGCN)

WGCN的主要思想是在聚合来自不同邻居节点的信息时,根据不同类型的关系赋予不同的自学习权重。

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

节点嵌入的更新公式如下

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

添加self_loop以保留节点自身信息

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

为了处理属性信息,论文将节点的属性也建模成了图中的节点,同时为了防止属性过多,对其进行了合并,例如只有性别作为属性节点,而没有单独的”男”或”女”节点。

  • Conv-TransE

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

这本质上其实是对实体和关系的嵌入做一维卷积之后加起来,相当于保留了可翻译属性,类似于TransE的思想。

最终得分函数为

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

; 实验部分

  • 链路预测实验

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion
  • 参数敏感性实验

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion
  • 节点度数实验

在度较低的节点下是SACN高于Conv-TransE的,因为邻居节点可以共享更多的信息;然而度较高的节点则效果不如单独的Conv-TransE

End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

评价

整体思想还是比较简单的,作者比较会讲故事,把卷积从多维改成二维都能说很多道理。

Original: https://blog.csdn.net/jining11/article/details/120309555
Author: 羊城迷鹿
Title: End-to-end Structure-Aware Convolutional Networks for Knowledge Base Completion

原创文章受到原创版权保护。转载请注明出处:https://www.johngo689.com/557948/

转载文章受原作者版权保护。转载请注明原作者出处!

(0)

大家都在看

亲爱的 Coder【最近整理,可免费获取】👉 最新必读书单  | 👏 面试题下载  | 🌎 免费的AI知识星球