Conference paper
Inferring visual semantic similarity with deep learning and Wikidata: Introducing imagesim-353?
Aiming at multi-modal knowledge representation we construct a dataset with pairs of digital photos of objects. We manually score image pairs for semantic object similarity. A pre-trained ImageNet- based deep neural network predicts the objects and we use the output to estimate the similarity between two images.
With a linkage between the neural network and Wikidata, we augment the model and incorporate knowledge graph information into the similarity measure. We compare the machine-based predicted similarity with the human-based semantic similarity.
Language: | English |
---|---|
Year: | 2018 |
Pages: | 56-61 |
Proceedings: | 1st Workshop on Deep Learning for Knowledge Graphs and Semantic Technologies |
ISSN: | 16130073 |
Types: | Conference paper |
ORCIDs: | Nielsen, Finn Årup and Hansen, Lars Kai |