ConvD: Attention Enhanced Dynamic Convolutional Embeddings for Knowledge Graph Completion
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909646357266432 |
|---|---|
| author | Guo, Wenbin Li, Zhao Wang, Xin Chen, Zirui Zhao, Jun Li, Jianxin Yuan, Ye |
| author_facet | Guo, Wenbin Li, Zhao Wang, Xin Chen, Zirui Zhao, Jun Li, Jianxin Yuan, Ye |
| contents | Knowledge graphs often suffer from incompleteness issues, which can be alleviated through information completion. However, current state-of-the-art deep knowledge convolutional embedding models rely on external convolution kernels and conventional convolution processes, which limits the feature interaction capability of the model. This paper introduces a novel dynamic convolutional embedding model, ConvD, which directly reshapes relation embeddings into multiple internal convolution kernels. This approach effectively enhances the feature interactions between relation embeddings and entity embeddings. Simultaneously, we incorporate a priori knowledge-optimized attention mechanism that assigns different contribution weight coefficients to the multiple relation convolution kernels in dynamic convolution, further boosting the expressive power of the model. Extensive experiments on various datasets show that our proposed model consistently outperforms the state-of-the-art baseline methods, with average improvements ranging from 3.28% to 14.69% across all model evaluation metrics, while the number of parameters is reduced by 50.66% to 85.40% compared to other state-of-the-art models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_07589 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | ConvD: Attention Enhanced Dynamic Convolutional Embeddings for Knowledge Graph Completion Guo, Wenbin Li, Zhao Wang, Xin Chen, Zirui Zhao, Jun Li, Jianxin Yuan, Ye Computation and Language Artificial Intelligence Knowledge graphs often suffer from incompleteness issues, which can be alleviated through information completion. However, current state-of-the-art deep knowledge convolutional embedding models rely on external convolution kernels and conventional convolution processes, which limits the feature interaction capability of the model. This paper introduces a novel dynamic convolutional embedding model, ConvD, which directly reshapes relation embeddings into multiple internal convolution kernels. This approach effectively enhances the feature interactions between relation embeddings and entity embeddings. Simultaneously, we incorporate a priori knowledge-optimized attention mechanism that assigns different contribution weight coefficients to the multiple relation convolution kernels in dynamic convolution, further boosting the expressive power of the model. Extensive experiments on various datasets show that our proposed model consistently outperforms the state-of-the-art baseline methods, with average improvements ranging from 3.28% to 14.69% across all model evaluation metrics, while the number of parameters is reduced by 50.66% to 85.40% compared to other state-of-the-art models. |
| title | ConvD: Attention Enhanced Dynamic Convolutional Embeddings for Knowledge Graph Completion |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2312.07589 |