0204946d26
* adding max_token_capacity_metric * added tgi to name of metric * Adding max capacity metric. * Add description for the metrics --------- Co-authored-by: Edwinhr716 <Edandres249@gmail.com> |
||
|---|---|---|
| .. | ||
| client | ||
| grpc-metadata | ||
| trtllm | ||
| v2 | ||
| v3 | ||