Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
hf_text-generation-inference/router
History
OlivierDehaene a963495315 add logic to queue 2023-04-26 13:40:20 +02:00
..
client feat(router): use number of tokens in batch as input for dynamic batching (#226) 2023-04-24 17:59:00 +02:00
grpc-metadata v0.5.0 (#168) 2023-04-11 20:32:18 +02:00
src add logic to queue 2023-04-26 13:40:20 +02:00
Cargo.toml v0.6.0 (#222) 2023-04-21 21:00:57 +02:00
build.rs feat(router): add git sha to info route (#208) 2023-04-19 21:36:59 +02:00