Generalize ultrasound image segmentation via instant and plug play style transfer

Zhendong Liu, Xiaoqiong Huang, Xin Yang, Rui Gao, Rui Li, Yuanji Zhang, Yankai Huang, Guangquan Zhou, Yi Xiong, Alejandro F. Frangi, Dong Ni

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


Deep segmentation models that generalize to images with unknown appearance are important for real-world medical image analysis. Retraining models leads to high latency and complex pipelines, which are impractical in clinical settings. The situation becomes more severe for ultrasound image analysis because of their large appearance shifts. In this paper, we propose a novel method for robust segmentation under unknown appearance shifts. Our contribution is three-fold. First, we advance a one-stage plug-and-play solution by embedding hierarchical style transfer units into a segmentation architecture. Our solution can remove appearance shifts and perform segmentation simultaneously. Second, we adopt Dynamic Instance Normalization to conduct precise and dynamic style transfer in a learnable manner, rather than previously fixed style normalization. Third, our solution is fast and lightweight for routine clinical adoption. Given 400times 400 image input, our solution only needs an additional 0.2 ms and 1.92M FLOPs to handle appearance shifts compared to the baseline pipeline. Extensive experiments are conducted on a large dataset from three vendors demonstrate our proposed method enhances the robustness of deep segmentation models.

Original languageEnglish
Title of host publication2021 IEEE 18th International Symposium on Biomedical Imaging, ISBI 2021
PublisherIEEE Computer Society
Number of pages5
ISBN (Electronic)9781665412469
Publication statusPublished - 13 Apr 2021
Event18th IEEE International Symposium on Biomedical Imaging, ISBI 2021 - Nice, France
Duration: 13 Apr 202116 Apr 2021

Publication series

NameProceedings - International Symposium on Biomedical Imaging
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452


Conference18th IEEE International Symposium on Biomedical Imaging, ISBI 2021


  • Segmentation
  • Style transfer
  • Ultrasound


Dive into the research topics of 'Generalize ultrasound image segmentation via instant and plug play style transfer'. Together they form a unique fingerprint.

Cite this