Mirrors
/
hf_text-generation-inference
mirror of https://github.com/huggingface/text-generation-inference.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
hf_text-generation-inference/router/src
History
drbh 30395b09f4
fix: improve completions to send a final chunk with usage details (#2336) 
* fix: improve completions to send a final chunk with usage details

* fix: include finish reason string

* fix: remove dev debug trait and unneeded mut

* fix: update openapi schema
 		2024-08-12 17:26:11 +02:00
..
infer feat: validate template variables before apply and improve sliding wi… (#2403) 2024-08-12 10:58:40 -04:00
config.rs add gptj modeling in TGI #2366 (CI RUN) (#2372) 2024-08-07 21:32:37 -04:00
kserve.rs fix: simplify kserve endpoint and fix imports (#2119) 2024-06-25 19:30:10 -04:00
lib.rs fix: improve completions to send a final chunk with usage details (#2336) 2024-08-12 17:26:11 +02:00
logging.rs Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
main.rs.back Rebase TRT-llm (#2331) 2024-07-31 10:33:10 +02:00
server.rs fix: improve completions to send a final chunk with usage details (#2336) 2024-08-12 17:26:11 +02:00
usage_stats.rs refactor usage stats (#2339) 2024-07-31 16:29:07 +02:00
validation.rs feat: validate template variables before apply and improve sliding wi… (#2403) 2024-08-12 10:58:40 -04:00