A joint knowledge representation learning of sentence vectors weighting and primary neighbor constraints
摘要
Knowledge representation learning is to project entities and relations into low-dimensional vector spaces, and efficiently calculate entities, relations, and complex semantic associations between them. However, the translation models that fuse multi-source information fail to specially pay attention to the semantic information of important sentences in the textual descriptions of an entity, which lead to the low quality of embedded representation of textual descriptions, and fail to utilize the primary neighbor of the entity to further constrain the entity representation, resulting in the weak knowledge representation learning ability of the models. To address these issues, we propose a joint knowledge representation learning model of sentence vectors weighting and primary neighbor constraints called SW &NC-Joint. First, the weight distribution of the sentences is calculated according to the frequency of the neighbors in each sentence, and then the textual descriptions are represented by the sentence vectors weighting. Secondly, the concept of neighbor association degree is put forward, and the primary neighbor is filtered out for each entity according to the association degree. Finally, the weighted textual description information and triple structure information are jointly trained, the most crucial thing that the model is constrained by using the distance between the entity and its primary neighbor in the training process, so as to improve the representation learning ability of the model. The link prediction and triple classification experiments are carried out on FB15K and WN18 datasets. The experimental results demonstrate that our model significantly outperforms existing state-of-the-art text-enhanced knowledge representation learning model for link prediction and triple classification tasks.