In our paper Evaluating Language Models for Knowledge Base Completion we analyze the feasibility of Knowledge Base Completion by using Language Models. As a language model we use BERT and as a knowledge base we use Wikidata. We publish a new benchmark dataset WD-KNOWN along with the human evaluation of predictions for really missing facts, i.e. (subject,relation)-pairs non-existent in Wikidata.
easy-to-use code in progress
@inproceedings{veseli2023kbc,
title={Evaluating Language Models for Knowledge Base Completion},
author={Blerta Veseli, Simon Razniewski, Sneha Singhania, Gerhard Weikum},
booktitle={In: 20th Extended Semantic Web Conference (ESWC), 2023},
year={2023}
}