7a48a84784
* Using an enum for flash backens (paged/flashdecoding/flashinfer) * Early exit on server too. * Clippy. * Fix clippy and fmt. |
||
---|---|---|
.. | ||
source | ||
README.md | ||
index.html | ||
openapi.json |
README.md
Documentation available at: https://huggingface.co/docs/text-generation-inference
Release
When making a release, please update the latest version in the documentation with:
export OLD_VERSION="2\.0\.3"
export NEW_VERSION="2\.0\.4"
find . -name '*.md' -exec sed -i -e "s/$OLD_VERSION/$NEW_VERSION/g" {} \;