cyberes
/
local-llm-server
Archived
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
This repository has been archived on 2024-10-27. You can view files and clone it, but cannot push or open issues or pull requests.
local-llm-server/llm_server/llm/oobabooga/ooba_backend.py

7 lines
113 B
Python
Raw Permalink Normal View History

actually we don't want to emulate openai
2023-09-12 01:04:11 -06:00
from ..llm_backend import LLMBackend
refactor generation route
2023-08-30 18:53:26 -06:00
add openai-compatible backend
2023-09-12 16:40:09 -06:00
class OobaboogaBackend(LLMBackend):
Merge cluster to master (#3) Co-authored-by: Cyberes <cyberes@evulid.cc> Reviewed-on: https://git.evulid.cc/cyberes/local-llm-server/pulls/3
2023-10-27 19:19:22 -06:00
def __int__(self):
return