Vaibhav Srivastav 99b662f8c2 Improve the Consuming TGI + Streaming docs. (#2412) ... * Improve the Consuming TGI docs. * Fix erronous update to . * add info about Open AI client. * More updates. * Apply suggestions from code review Co-authored-by: Erik Kaunismäki <erik.kaum@gmail.com> * Suggestions from Lucain. * Update Gradio snippet. * Up. * Apply suggestions from code review Co-authored-by: Lucain <lucainp@gmail.com> * Update docs/source/basic_tutorials/consuming_tgi.md Co-authored-by: Lucain <lucainp@gmail.com> * Up. * Apply suggestions from code review Co-authored-by: Omar Sanseviero <osanseviero@gmail.com> * Up. * Up. * Doc review from Nico. * Doc review from Nico. x2 * Last nit --------- Co-authored-by: Erik Kaunismäki <erik.kaum@gmail.com> Co-authored-by: Lucain <lucainp@gmail.com> Co-authored-by: Omar Sanseviero <osanseviero@gmail.com>		2024-08-16 12:43:08 +02:00
..
flash_attention.md	chore: add pre-commit (#1569)	2024-02-16 11:58:58 +01:00
guidance.md	Add support for exl2 quantization	2024-05-30 11:28:05 +02:00
lora.md	feat: include local lora adapter loading docs (#2359)	2024-08-05 12:36:44 -04:00
paged_attention.md	Paged Attention Conceptual Guide (#901)	2023-09-08 14:18:42 +02:00
quantization.md	Using an enum for flash backens (paged/flashdecoding/flashinfer) (#2385)	2024-08-09 16:41:17 +02:00
safetensors.md	chore: add pre-commit (#1569)	2024-02-16 11:58:58 +01:00
speculation.md	feat: add train medusa head tutorial (#1934)	2024-05-23 11:34:18 +02:00
streaming.md	Improve the Consuming TGI + Streaming docs. (#2412)	2024-08-16 12:43:08 +02:00
tensor_parallelism.md	chore: add pre-commit (#1569)	2024-02-16 11:58:58 +01:00