This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
local-llm-server/llm_server/routes
Cyberes 048e5a8060 fix API key handling 2023-09-26 22:49:53 -06:00
..
helpers fix API key handling 2023-09-26 22:49:53 -06:00
openai more work on openai endpoint 2023-09-26 22:09:11 -06:00
v1 fix API key handling 2023-09-26 22:49:53 -06:00
__init__.py show total output tokens on stats 2023-08-24 20:43:11 -06:00
auth.py more work on openai endpoint 2023-09-26 22:09:11 -06:00
cache.py more work on openai endpoint 2023-09-26 22:09:11 -06:00
ooba_request_handler.py update database, tokenizer handle null prompt, convert top_p to vllm on openai, actually validate prompt on streaming, 2023-09-25 22:32:48 -06:00
openai_request_handler.py more work on openai endpoint 2023-09-26 22:09:11 -06:00
queue.py don't count SYSTEM tokens for recent prompters, fix sql exclude for SYSTEM tokens 2023-09-25 13:00:39 -06:00
request_handler.py fix API key handling 2023-09-26 22:49:53 -06:00
server_error.py fix invalid param error, add manual model name 2023-09-12 10:30:45 -06:00
stats.py more work on openai endpoint 2023-09-26 22:09:11 -06:00