This website requires JavaScript.
Explore
Gist
Help
Register
Sign In
Mirrors
/
hf_text-generation-inference
mirror of
https://github.com/huggingface/text-generation-inference.git
Watch
1
Star
0
Fork
You've already forked hf_text-generation-inference
0
Code
Issues
Packages
Projects
Releases
Wiki
Activity
fp8_rocm
hf_text-generation-inference
/
server
/
Makefile-flashinfer
3 lines
95 B
Plaintext
Raw
Permalink
Blame
History
install-flashinfer:
pip install flashinfer==0.1.6 -i https://flashinfer.ai/whl/cu124/torch2.4
Reference in New Issue
View Git Blame
Copy Permalink