hf_text-generation-inference/router/client
OlivierDehaene ebc74d5666
feat(router): use number of tokens in batch as input for dynamic batching (#226)
Co-authored-by: Nick Hill <nickhill@us.ibm.com>
2023-04-24 17:59:00 +02:00
..
src feat(router): use number of tokens in batch as input for dynamic batching (#226) 2023-04-24 17:59:00 +02:00
Cargo.toml v0.6.0 (#222) 2023-04-21 21:00:57 +02:00
build.rs feat: add distributed tracing (#62) 2023-02-13 13:02:45 +01:00