local-llm-server/llm_server/routes
Cyberes bf648f605f implement streaming for hf-textgen 2023-08-29 17:56:12 -06:00
..
helpers caching 2023-08-23 12:40:13 -06:00
v1 implement streaming for hf-textgen 2023-08-29 17:56:12 -06:00
__init__.py show total output tokens on stats 2023-08-24 20:43:11 -06:00
cache.py add HF text-generation-inference backend 2023-08-29 13:46:41 -06:00
queue.py add HF text-generation-inference backend 2023-08-29 13:46:41 -06:00
stats.py update readme 2023-08-24 12:19:59 -06:00