An Ensemble of Neural Models for Nested Adverse Drug Events and Medication Extraction with Subwords

Objective: This paper describes an ensembling system to automatically extract adverse drug events (ADEs) and drug related entities from clinical narratives, which was developed for the 2018 n2c2 Shared Task Track 2.
Materials and Methods: We designed a neural model to tackle both nested (entities embedded in other entities) and polysemous entities (entities annotated with multiple semantic types) based on MIMIC III discharge summaries. To better represent rare and unknown words in entities, we further tokenised the MIMIC III dataset by splitting the words into finer-grained subwords. We finally combined all the models to boost the performance. Additionally, we implemented a featured-based CRF model and created an ensemble to combine its predictions with those of the neural model.
Results: Our method achieved 92.78% lenient micro F1-score with 95.99% lenient precision and 89.79% lenient recall, respectively. Experimental results showed that combining the predictions of either multiple models, or of a single model with different settings can improve performance.
Discussion: Analysis of the development set showed that our neural models can detect more informative text regions than feature-based CRF models. Furthermore, most entity types significantly benefit from subword representation, which also allows us to extract sparse entities especially nested entities.
Conclusion: The overall results have demonstrated that the ensemble method can accurately recognise entities, including nested and polysemous entities. Additionally, our method can recognise sparse entities, by reconsidering the clinical narratives at a finer-grained subword level, rather than at the word level.