This website requires JavaScript.
Explore
Gist
Help
Register
Sign In
cyberes
/
local-llm-server
Archived
Watch
1
Star
1
Fork
You've already forked local-llm-server
0
Code
Issues
Pull Requests
Packages
Projects
Releases
1
Wiki
Activity
260
Commits
2
Branches
2
Tags
795
KiB
bc74a3dc50
Commit Graph
4 Commits
Author
SHA1
Message
Date
Cyberes
aba2e5b9c0
don't use db pooling, add LLM-ST-Errors header to disable formatted errors
2023-09-26 23:59:22 -06:00
Cyberes
cb99c3490e
rewrite tokenizer, restructure validation
2023-09-24 13:02:30 -06:00
Cyberes
0530fa9870
getting sql error
2023-09-23 19:08:30 -06:00
Cyberes
03e3ec5490
port to mysql, use vllm tokenizer endpoint
2023-09-20 20:30:31 -06:00