Compressing Context to Enhance Inference Efficiency of Large Language Models

Yucheng Li, Bo Dong, Frank Guerin, Chenghua Lin

Research output: Chapter in Book/Conference proceeding › Conference contribution › peer-review

Original language	English
Title of host publication	Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP)
DOIs	https://doi.org/10.18653/v1/2023.emnlp-main.391
Publication status	Published - 2023

Access to Document

@inproceedings{b8e37d4dceb2469f871b2ecd9ecddf06,

title = "Compressing Context to Enhance Inference Efficiency of Large Language Models",

author = "Yucheng Li and Bo Dong and Frank Guerin and Chenghua Lin",

year = "2023",

doi = "10.18653/v1/2023.emnlp-main.391",

language = "English",

booktitle = "Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP)",

}

TY - GEN

T1 - Compressing Context to Enhance Inference Efficiency of Large Language Models

AU - Li, Yucheng

AU - Dong, Bo

AU - Guerin, Frank

AU - Lin, Chenghua

PY - 2023

Y1 - 2023

U2 - 10.18653/v1/2023.emnlp-main.391

DO - 10.18653/v1/2023.emnlp-main.391

M3 - Conference contribution

BT - Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP)

ER -