This website requires JavaScript.
Explore
Gist
Help
Register
Sign In
cyberes
/
local-llm-server
Watch
1
Star
1
Fork
You've already forked local-llm-server
0
Code
Issues
Pull Requests
Packages
Projects
Releases
1
Wiki
Activity
134
Commits
2
Branches
2
Tags
793
KiB
79b1e01b61
Commit Graph
4 Commits
Author
SHA1
Message
Date
Cyberes
1d9f40765e
remove text-generation-inference backend
2023-09-12 13:09:47 -06:00
Cyberes
4c9d543eab
implement vllm backend
2023-09-11 20:47:19 -06:00
Cyberes
0aa52863bc
forgot to start workers
2023-08-23 20:33:49 -06:00
Cyberes
6f8b70df54
add a queue system
2023-08-23 20:12:38 -06:00