This website requires JavaScript.
Explore
Gist
Help
Register
Sign In
cyberes
/
local-llm-server
Archived
Watch
1
Star
1
Fork
You've already forked local-llm-server
0
Code
Issues
Pull Requests
Packages
Projects
Releases
1
Wiki
Activity
261
Commits
2
Branches
2
Tags
795
KiB
a5f31ca831
Commit Graph
4 Commits
Author
SHA1
Message
Date
Cyberes
e42f2b6819
fix negative queue on stats
2023-09-28 08:47:39 -06:00
Cyberes
ecdf819088
fix try/finally with continue, fix wrong subclass signature
2023-09-28 00:11:34 -06:00
Cyberes
e86a5182eb
redo background processes, reorganize server.py
2023-09-27 23:36:44 -06:00
Cyberes
e5fbc9545d
add ratelimiting to websocket streaming endpoint, fix queue not decrementing IP requests, add console printer
2023-09-27 21:15:54 -06:00