TY - GEN
T1 - Few-Shot Learning in Diffusion Models for Generating Cerebral Aneurysm Geometries
AU - Deo, Yash
AU - Lin, Fengming
AU - Dou, Haoran
AU - Cheng, Nina
AU - Ravikumar, Nishant
AU - Frangi, Alejandro F.
AU - Lassila, Toni
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024/8/22
Y1 - 2024/8/22
N2 - The study of brain vessel pathologies is critical for the advancement o f neurovascular medicine, yet researchers often face significant hurdles due to the scarcity of imaging data for certain uncommon types of aneurysms. Generative deep learning models have been proposed to address the lack of high-quality labeled medical images - however, the shortage of data also presents a unique challenge in training generative models. To address this issue, our work explores the efficacy of training latent diffusion models (LDMs) with few-shot learning, enabling the generation of detailed vessel segmentations from as few as five images per class. By incorporating set-based vision transformers for class embeddings and leveraging signed distance functions (SDFs) as a novel form of conditioning, our method reduces the need for extensive datasets for training. Comparative studies with established generative models, including variational autoencoders (VAEs) and generative adversarial networks (GANs), highlight the robustness of our approach. Our model not only successfully generates high-quality segmentations of brain vessels with aneurysms but also significantly outperforms the standard generative models.
AB - The study of brain vessel pathologies is critical for the advancement o f neurovascular medicine, yet researchers often face significant hurdles due to the scarcity of imaging data for certain uncommon types of aneurysms. Generative deep learning models have been proposed to address the lack of high-quality labeled medical images - however, the shortage of data also presents a unique challenge in training generative models. To address this issue, our work explores the efficacy of training latent diffusion models (LDMs) with few-shot learning, enabling the generation of detailed vessel segmentations from as few as five images per class. By incorporating set-based vision transformers for class embeddings and leveraging signed distance functions (SDFs) as a novel form of conditioning, our method reduces the need for extensive datasets for training. Comparative studies with established generative models, including variational autoencoders (VAEs) and generative adversarial networks (GANs), highlight the robustness of our approach. Our model not only successfully generates high-quality segmentations of brain vessels with aneurysms but also significantly outperforms the standard generative models.
KW - Brain Vessel Synthesis
KW - Diffusion Models
KW - Image Synthesis
KW - Transformers
UR - http://www.scopus.com/inward/record.url?scp=85203379768&partnerID=8YFLogxK
U2 - 10.1109/ISBI56570.2024.10635313
DO - 10.1109/ISBI56570.2024.10635313
M3 - Conference contribution
AN - SCOPUS:85203379768
T3 - Proceedings - International Symposium on Biomedical Imaging
BT - IEEE International Symposium on Biomedical Imaging, ISBI 2024 - Conference Proceedings
PB - IEEE Computer Society
T2 - 21st IEEE International Symposium on Biomedical Imaging, ISBI 2024
Y2 - 27 May 2024 through 30 May 2024
ER -