hf_text-generation-inference

mirror of https://github.com/huggingface/text-generation-inference.git

History

Nicolas Patry 136bcc8128 Keeping the benchmark somewhere (#2401 ) Co-authored-by: Daniël de Kok <me@danieldk.eu>		2024-08-12 15:22:02 +02:00
..
client	Add support for prefix caching to the v3 router (#2392 )	2024-08-12 14:59:17 +02:00
grpc-metadata	Rebase TRT-llm (#2331 )	2024-07-31 10:33:10 +02:00
trtllm	Rebase TRT-llm (#2331 )	2024-07-31 10:33:10 +02:00
v3	Keeping the benchmark somewhere (#2401 )	2024-08-12 15:22:02 +02:00