From ed6af32aeedd50bc146331ee5c094e34f13f56e2 Mon Sep 17 00:00:00 2001 From: Nicolas Patry Date: Thu, 1 Feb 2024 16:07:59 +0000 Subject: [PATCH] Monioring your deployements. --- README.md | 19 +++++++++++++++---- 1 file changed, 15 insertions(+), 4 deletions(-) diff --git a/README.md b/README.md index d7b13133..913b59aa 100644 --- a/README.md +++ b/README.md @@ -1,10 +1,21 @@
- - Making TGI deployment optimal - +
+ + Making TGI deployment optimal + -Production metrics + + Make TGI optimal + +
+ +
+ Production metrics + + Monitor TGI + +
# Text Generation Inference