local-llm-server/llm_server/llm
Cyberes 354ad8192d fix division by 0, prettify /stats json, add js var to home 2023-09-16 17:37:43 -06:00
..
oobabooga option to disable streaming, improve timeout on requests to backend, fix error handling. reduce duplicate code, misc other cleanup 2023-09-14 14:05:50 -06:00
vllm actually validate prompt length lol 2023-09-14 18:31:13 -06:00
__init__.py MVP 2023-08-21 21:28:52 -06:00
generator.py remove text-generation-inference backend 2023-09-12 13:09:47 -06:00
info.py option to disable streaming, improve timeout on requests to backend, fix error handling. reduce duplicate code, misc other cleanup 2023-09-14 14:05:50 -06:00
llm_backend.py fix division by 0, prettify /stats json, add js var to home 2023-09-16 17:37:43 -06:00