This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
local-llm-server/llm_server/llm
Cyberes cb99c3490e rewrite tokenizer, restructure validation 2023-09-24 13:02:30 -06:00
..
oobabooga rewrite tokenizer, restructure validation 2023-09-24 13:02:30 -06:00
vllm rewrite tokenizer, restructure validation 2023-09-24 13:02:30 -06:00
__init__.py rewrite tokenizer, restructure validation 2023-09-24 13:02:30 -06:00
generator.py remove text-generation-inference backend 2023-09-12 13:09:47 -06:00
info.py option to disable streaming, improve timeout on requests to backend, fix error handling. reduce duplicate code, misc other cleanup 2023-09-14 14:05:50 -06:00
llm_backend.py rewrite tokenizer, restructure validation 2023-09-24 13:02:30 -06:00