This website requires JavaScript.
Explore
Gist
Help
Register
Sign In
cyberes
/
local-llm-server
Watch
1
Star
1
Fork
You've already forked local-llm-server
0
Code
Issues
Pull Requests
Packages
Projects
Releases
1
Wiki
Activity
27d36a7f0e
local-llm-server
/
llm_server
/
sock.py
9 lines
108 B
Python
Raw
Normal View
History
Unescape
Escape
implement streaming for hf-textgen
2023-08-29 17:56:12 -06:00
from
flask_sock
import
Sock
sock
=
Sock
(
)
Merge cluster to master (#3) Co-authored-by: Cyberes <cyberes@evulid.cc> Reviewed-on: https://git.evulid.cc/cyberes/local-llm-server/pulls/3
2023-10-27 19:19:22 -06:00
def
init_wssocket
(
app
)
:
implement streaming for hf-textgen
2023-08-29 17:56:12 -06:00
global
sock
sock
.
init_app
(
app
)