Switching Contexts: Transportability Measures for NLP

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


This paper explores the topic of transportability, as a sub-area of generalisability. By proposing the utilisation of metrics based on well-established statistics, we are able to estimate the change in performance of NLP models in new contexts. Defining a new measure for transportability may allow for better estimation of NLP system performance in new domains, and is crucial when assessing the performance of NLP systems in new tasks and domains. Through several instances of increasing complexity, we demonstrate how lightweight domain similarity measures can be used as estimators for the transportability in NLP applications. The proposed transportability measures are evaluated in the context of Named Entity Recognition and Natural Language Inference tasks.
Original languageEnglish
Title of host publication14th International Conference on Computational Semantics (IWCS 2021)
Publication statusAccepted/In press - 16 Apr 2021
Event14th International Conference on Computational Semantics - University of Groningen, Groningen, Netherlands
Duration: 16 Jun 202118 Jun 2021


Conference14th International Conference on Computational Semantics
Abbreviated titleIWCS 2021


Dive into the research topics of 'Switching Contexts: Transportability Measures for NLP'. Together they form a unique fingerprint.

Cite this