Multimodal Knowledge Graphs
MMKG is released under the BSD-3-Clause License (please read the LICENSE file for more details).
Numerical Data for FB15k, YAGO15k, and DBpedia15k
Numerical data for the entities in the FB15k, DBpedia15k, and Yago15k knowledge graphs. FB15k is a commonly used knowledge graph in the KB completion literature. Both FB15k and FB15k-237 can be used with the numerical data. The data set and one method for integrating numerical data into a joint machine learning model are described in the following paper (to be presented at UAI 2018).
We have created the Yago and DBpedia equivalents of FB15k and extracted numerical data for these data sets. You can find those files in the folders DB15K and YAGO15K.
Visual Data for FB15k, YAGO15k, and DBpedia15k
The second data set consists of a set of images associated with each of the entities in the FB15k, DBpedia15k, and Yago15k knowledge graphs. For now, we provide a list of URLs that can be downloaded with a script which also scales the images (thanks to https://github.com/jrieke). We also provide the links of the Freebase IDs to their image URLs. The paper describing the data set, possible visual queries, and a method for answering these queries are introduced in the following paper.
Download the image URLs for FB15k entities. NB: The Freebase ID is written m.xyz instead of /m/xyz
If you want to try out the crawler we used to retrieve the image URLs/data, you can download it here.
If you want to obtain the embeddings learned from a trained VGG16, you can download them FB15K, DB15K, YAGO15K. For example, the embedding for the DB15k entity http://dbpedia.org/resource/Bright_Star_(film), indexed by the identifier DBIMG00039, can be accessed:
import h5py import numpy as np filename = 'DB15K_ImageData.h5' f = h5py.File(filename, 'r') vgg_feats = f["DBIMG00039"]
Temporal Information for Yago15k, Wikidata, ICEWS14 and ICEWS05-15
Facts in Yago15k, Wikidata, ICEWS14 and ICEWS05-15 are enriched with temporal information. The data sets and a methodology for performing link prediction in temporal KGs with standard scoring functions are described in the following paper (to be presented at EMNLP 2018).
Learning Sequence Encoders for Temporal Knowledge Graph Completion.
sameAs Links between FB15k, YAGO15k, and DBpedia15k
If you use MMKB in your work, please cite one of the above papers. Thanks!