Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Fixed README ToC (#2196) 

Co-authored-by: Vinayak Kamath <Vinayak.Kamath@target.com>
This commit is contained in:
vinkamath 2024-07-09 02:22:08 -07:00 committed by GitHub
parent fe710af25f
commit f5ba9bfd52
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 14 additions and 13 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

27
README.md
View File

@ -20,19 +20,20 @@ to power Hugging Chat, the Inference API and Inference Endpoint.
## Table of contents ## Table of contents
- [Get Started](#get-started) - [Get Started](#get-started)
- [API Documentation](#api-documentation) - [Docker](#docker)
- [Using a private or gated model](#using-a-private-or-gated-model) - [API documentation](#api-documentation)
- [A note on Shared Memory](#a-note-on-shared-memory-shm) - [Using a private or gated model](#using-a-private-or-gated-model)
- [Distributed Tracing](#distributed-tracing) - [A note on Shared Memory (shm)](#a-note-on-shared-memory-shm)
- [Local Install](#local-install) - [Distributed Tracing](#distributed-tracing)
- [CUDA Kernels](#cuda-kernels) - [Architecture](#architecture)
- [Optimized architectures](#optimized-architectures) - [Local install](#local-install)
- [Run Mistral](#run-a-model) - [Optimized architectures](#optimized-architectures)
- [Run](#run) - [Run locally](#run-locally)
- [Quantization](#quantization) - [Run](#run)
- [Develop](#develop) - [Quantization](#quantization)
- [Testing](#testing) - [Develop](#develop)
- [Testing](#testing)
Text Generation Inference (TGI) is a toolkit for deploying and serving Large Language Models (LLMs). TGI enables high-performance text generation for the most popular open-source LLMs, including Llama, Falcon, StarCoder, BLOOM, GPT-NeoX, and [more](https://huggingface.co/docs/text-generation-inference/supported_models). TGI implements many features, such as: Text Generation Inference (TGI) is a toolkit for deploying and serving Large Language Models (LLMs). TGI enables high-performance text generation for the most popular open-source LLMs, including Llama, Falcon, StarCoder, BLOOM, GPT-NeoX, and [more](https://huggingface.co/docs/text-generation-inference/supported_models). TGI implements many features, such as: