Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Fix: docs typo (#2777) 

Fix: typo in model loading code

Fix typo in model loading code
This commit is contained in:
jp 2024-11-26 22:28:58 +09:00 committed by GitHub
parent 892a26e549
commit caff779dd4
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/source/supported_models.md
View File

@ -43,7 +43,7 @@ If the above list lacks the model you would like to serve, depending on the mode
```python ```python
# for causal LMs/text-generation models # for causal LMs/text-generation models
AutoModelForCausalLM.from_pretrained(<model>, device_map="auto")` AutoModelForCausalLM.from_pretrained(<model>, device_map="auto")
# or, for text-to-text generation models # or, for text-to-text generation models
AutoModelForSeq2SeqLM.from_pretrained(<model>, device_map="auto") AutoModelForSeq2SeqLM.from_pretrained(<model>, device_map="auto")
``` ```