hf_text-generation-inference

mirror of https://github.com/huggingface/text-generation-inference.git

Author	SHA1	Message	Date
OlivierDehaene	343437c7b5	feat(router): add device and dtype info (#215 )	2023-04-21 15:36:29 +02:00
OlivierDehaene	5fa8ae041c	feat(server): optimize decode for sane tokenizers (#170 )	2023-04-12 12:03:10 +02:00
OlivierDehaene	299217c95c	feat(server): add flash attention llama (#144 )	2023-04-11 16:38:22 +02:00
OlivierDehaene	3fef90d50f	feat(clients): Python client (#103 )	2023-03-07 18:52:22 +01:00