local-llm-server/llm_server/routes/v1
Cyberes bf648f605f implement streaming for hf-textgen 2023-08-29 17:56:12 -06:00
..
__init__.py implement streaming for hf-textgen 2023-08-29 17:56:12 -06:00
generate.py remove old code 2023-08-29 15:57:28 -06:00
generate_stats.py implement streaming for hf-textgen 2023-08-29 17:56:12 -06:00
generate_stream.py implement streaming for hf-textgen 2023-08-29 17:56:12 -06:00
info.py do caching ourself on /model 2023-08-23 16:40:20 -06:00
proxy.py update home, update readme, calculate estimated wait based on database stats 2023-08-24 16:47:14 -06:00