This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
local-llm-server/llm_server/routes/v1
Cyberes e1d3fca6d3 try to cancel inference if disconnected from client 2023-09-28 09:55:31 -06:00
..
__init__.py
generate.py
generate_stats.py
generate_stream.py try to cancel inference if disconnected from client 2023-09-28 09:55:31 -06:00
info.py
proxy.py