Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
hf_text-generation-inference/docs/source/_toctree.yml

39 lines
1.1 KiB
YAML
Raw Normal View History

Setup for doc-builder and docs for TGI (#740) I added ToC for docs v1 & started setting up for doc-builder. cc @Narsil @osanseviero --------- Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> Co-authored-by: osanseviero <osanseviero@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>
2023-08-10 02:24:52 -06:00
- sections:
- local: index
title: Text Generation Inference
- local: quicktour
title: Quick Tour
- local: installation
title: Installation
- local: supported_models
title: Supported Models and Hardware
title: Getting started
- sections:
- local: basic_tutorials/consuming_tgi
title: Consuming TGI
- local: basic_tutorials/preparing_model
title: Preparing Model for Serving
- local: basic_tutorials/gated_model_access
title: Serving Private & Gated Models
Added CLI docs (#799) Added docs for CLI
2023-08-10 07:00:30 -06:00
- local: basic_tutorials/using_cli
title: Using TGI CLI
Automatic docs for TGI (#1045) I had to open this PR since I initially worked from my fork, and it requires a handful of work to trigger a new github action on my fork's specific branch (couldn't find a way, at least, despite trying all of them). --------- Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com>
2023-09-27 08:01:38 -06:00
- local: basic_tutorials/launcher
title: All TGI CLI options
Unsupported model serving docs (#906) Co-authored-by: Omar Sanseviero <osanseviero@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu> Co-authored-by: Pedro Cuenca <pedro@huggingface.co> Co-authored-by: OlivierDehaene <olivier@huggingface.co>
2023-09-12 07:55:14 -06:00
- local: basic_tutorials/non_core_models
title: Non-core Model Serving
Setup for doc-builder and docs for TGI (#740) I added ToC for docs v1 & started setting up for doc-builder. cc @Narsil @osanseviero --------- Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com> Co-authored-by: osanseviero <osanseviero@gmail.com> Co-authored-by: Mishig <mishig.davaadorj@coloradocollege.edu>
2023-08-10 02:24:52 -06:00
title: Tutorials
Add streaming guide (#858) Co-authored-by: Lucain <lucainp@gmail.com> Co-authored-by: Merve Noyan <merveenoyan@gmail.com>
2023-08-18 05:27:08 -06:00
- sections:
- local: conceptual/streaming
title: Streaming
Quantization docs (#911) Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com> Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
2023-09-12 07:52:46 -06:00
- local: conceptual/quantization
title: Quantization
Tensor Parallelism conceptual guide (#886) Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com> Co-authored-by: Omar Sanseviero <osanseviero@gmail.com> Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
2023-09-12 04:11:20 -06:00
- local: conceptual/tensor_parallelism
title: Tensor Parallelism
Paged Attention Conceptual Guide (#901)
2023-09-08 06:18:42 -06:00
- local: conceptual/paged_attention
title: PagedAttention
Safetensors conceptual guide (#905) IDK what else to add in this guide, I looked for relevant code in TGI codebase and saw that it's used in quantization as well (maybe I could add that?)
2023-09-07 08:22:06 -06:00
- local: conceptual/safetensors
title: Safetensors
docs: Flash Attention Conceptual Guide (#892) PR for conceptual guide on flash attention. I will add more info unless I'm told otherwise. --------- Co-authored-by: Nicolas Patry <patry.nicolas@protonmail.com> Co-authored-by: Omar Sanseviero <osanseviero@gmail.com>
2023-09-06 07:36:49 -06:00
- local: conceptual/flash_attention
title: Flash Attention
Add streaming guide (#858) Co-authored-by: Lucain <lucainp@gmail.com> Co-authored-by: Merve Noyan <merveenoyan@gmail.com>
2023-08-18 05:27:08 -06:00
title: Conceptual Guides