hf_text-generation-inference

mirror of https://github.com/huggingface/text-generation-inference.git

Author	SHA1	Message	Date
OlivierDehaene	c4bb5264ac	fix(server): decrease memory fragmentation (#557 )	2023-07-06 14:28:33 +02:00
OlivierDehaene	e74bd41e0f	feat(server): add paged attention to flash models (#516 ) Closes #478	2023-06-30 19:09:59 +02:00
OlivierDehaene	f000068944	feat(server): clear cache on error (#143 )	2023-03-28 11:29:35 +02:00
OlivierDehaene	3fef90d50f	feat(clients): Python client (#103 )	2023-03-07 18:52:22 +01:00