Abstract
We propose a novel framework named ViOCE that integrates ontology-based background knowledge in the form of n-ball concept embeddings into a neural network based vision architecture. The approach consists of two main components: (1) converting symbolic knowledge of an ontology into continuous space by learning n-ball embeddings that capture properties of subsumption and disjointness, (2) guiding the training and inference of a vision model using the learnt embeddings. We propose techniques to measure the quality of n-ball embeddings and evaluate ViOCE using the task of few-shot image classification, where it demonstrates superior performance in two standard benchmarks. We further introduce a metric to use background knowledge to measure the degree of incorrect predictions.
Original language | English |
---|---|
Title of host publication | 20th IEEE International Conference on Machine Learning and Applications (ICMLA) |
Pages | 292-297 |
DOIs | |
Publication status | Published - 25 Jan 2022 |
Event | 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA) - Pasadena, CA, USA Duration: 13 Dec 2021 → 16 Dec 2021 |
Conference
Conference | 2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA) |
---|---|
Period | 13/12/21 → 16/12/21 |