OlivierDehaene ebc74d5666 feat(router): use number of tokens in batch as input for dynamic batching (#226) ... Co-authored-by: Nick Hill <nickhill@us.ibm.com>		2023-04-24 17:59:00 +02:00
..
generate.proto	feat(router): use number of tokens in batch as input for dynamic batching (#226)	2023-04-24 17:59:00 +02:00