This website requires JavaScript.
Explore
Gist
Help
Register
Sign In
Mirrors
/
hf_text-generation-inference
mirror of
https://github.com/huggingface/text-generation-inference.git
Watch
1
Star
0
Fork
You've already forked hf_text-generation-inference
0
Code
Issues
Packages
Projects
Releases
Wiki
Activity
fix-cudagraph-bug
hf_text-generation-inference
/
docs
/
source
/
installation_inferentia.md
183 B
Raw
Permalink
Blame
History
Using TGI with Inferentia
Check out this
guide
on how to serve models with TGI on Inferentia2.