Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
hf_text-generation-inference/docs/source/installation_inferentia.md

183 B
Raw Blame History

Using TGI with Inferentia

Check out this guide on how to serve models with TGI on Inferentia2.