A decision support system in precision medicine: contrastive multimodal learning for patient stratification

Qing Yin, Linda Zhong, Yunya Song, Liang Bai, Zhihua Wang, Chen Li, Yida Xu, Xian Yang

Research output: Contribution to journalArticlepeer-review

Abstract

Precision medicine aims to provide personalized healthcare for patients by stratifying them into subgroups based on their health conditions, enabling the development of tailored medical management. Various decision support systems (DSSs) are increasingly developed in this field, where the performance is limited to their capability of handling big amounts of heterogeneous and high-dimensional electronic health records (EHRs). In this paper, we focus on developing a deep learning model for patient stratification that can identify and explain patient subgroups from multimodal EHRs. The primary challenge is to effectively align and unify heterogeneous information from various modalities, which includes both unstructured and structured data. Here, we develop a Contrastive Multimodal learning model for EHR (ConMEHR) based on topic modelling. In ConMEHR, modality-level and topic-level contrastive learning (CL) mechanisms are adopted to obtain a unified representation space and diversify patient subgroups, respectively. The performance of ConMEHR will be evaluated on two real-world EHR datasets and the results show that our model outperforms other baseline methods.

Original languageEnglish
JournalAnnals of Operations Research
Early online date29 Aug 2023
DOIs
Publication statusE-pub ahead of print - 29 Aug 2023

Keywords

  • Application of EHRs in precision medicine
  • Deep learning model for patient stratification
  • Modelling unstructured and structured patient data
  • Multimodal contrastive learning

Fingerprint

Dive into the research topics of 'A decision support system in precision medicine: contrastive multimodal learning for patient stratification'. Together they form a unique fingerprint.

Cite this