hf_text-generation-inference

mirror of https://github.com/huggingface/text-generation-inference.git

Author	SHA1	Message	Date
OlivierDehaene	31e2253ae7	feat(server): use latest flash attention commit (#543 ) @njhill FYI	2023-07-04 20:23:55 +02:00
OlivierDehaene	5ce89059f8	feat(server): pre-allocate past key values for flash causal LM (#412 )	2023-06-12 18:30:29 +02:00
OlivierDehaene	53ee09c0b0	fea(dockerfile): better layer caching (#159 )	2023-04-14 10:12:21 +02:00
OlivierDehaene	1883d8ecde	feat(docker): improve flash_attention caching (#160 )	2023-04-09 19:59:16 +02:00