cyberes
/
local-llm-server
Archived
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
local-llm-server/llm_server/llm/oobabooga/ooba_backend.py

7 lines
113 B
Python
Raw Normal View History

actually we don't want to emulate openai
2023-09-12 01:04:11 -06:00
from ..llm_backend import LLMBackend
refactor generation route
2023-08-30 18:53:26 -06:00
add openai-compatible backend
2023-09-12 16:40:09 -06:00
class OobaboogaBackend(LLMBackend):
fix issues with queue and streaming
2023-10-15 20:45:01 -06:00
def __int__(self):
return