nix: add default package (#2453)
The default package wraps the launcher and puts the server/router in the path. As a result, TGI can be started using something like: ``` nix run .# -- \ --model-id hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4 \ --port 8080 ```
This commit is contained in:
parent
358ceb67dd
commit
f3c5d7d92f
Loading…
Reference in New Issue