Towards Knowledge-aware Few-shot Learning with Ontology-based n-ball Concept Embeddings

Mirantha Jayathilaka, Tingting Mu, Uli Sattler

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We propose a novel framework named ViOCE that integrates ontology-based background knowledge in the form of n-ball concept embeddings into a neural network based vision architecture. The approach consists of two main components: (1) converting symbolic knowledge of an ontology into continuous space by learning n-ball embeddings that capture properties of subsumption and disjointness, (2) guiding the training and inference of a vision model using the learnt embeddings. We propose techniques to measure the quality of n-ball embeddings and evaluate ViOCE using the task of few-shot image classification, where it demonstrates superior performance in two standard benchmarks. We further introduce a metric to use background knowledge to measure the degree of incorrect predictions.
Original languageEnglish
Title of host publication20th IEEE International Conference on Machine Learning and Applications (ICMLA)
Pages292-297
DOIs
Publication statusPublished - 25 Jan 2022
Event2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA) - Pasadena, CA, USA
Duration: 13 Dec 202116 Dec 2021

Conference

Conference2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA)
Period13/12/2116/12/21

Fingerprint

Dive into the research topics of 'Towards Knowledge-aware Few-shot Learning with Ontology-based n-ball Concept Embeddings'. Together they form a unique fingerprint.

Cite this