cyberes
/
local-llm-server
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
local-llm-server/llm_server/sock.py

9 lines
108 B
Python
Raw Normal View History

implement streaming for hf-textgen
2023-08-29 17:56:12 -06:00
from flask_sock import Sock
sock = Sock()
Merge cluster to master (#3) Co-authored-by: Cyberes <cyberes@evulid.cc> Reviewed-on: https://git.evulid.cc/cyberes/local-llm-server/pulls/3
2023-10-27 19:19:22 -06:00
def init_wssocket(app):
implement streaming for hf-textgen
2023-08-29 17:56:12 -06:00
global sock
sock.init_app(app)