This website requires JavaScript.
Explore
Gist
Help
Register
Sign In
cyberes
/
local-llm-server
Watch
1
Star
1
Fork
You've already forked local-llm-server
0
Code
Issues
Pull Requests
Packages
Projects
Releases
1
Wiki
Activity
191
Commits
2
Branches
2
Tags
793
KiB
e3c57d874a
Commit Graph
4 Commits
Author
SHA1
Message
Date
Cyberes
11e84db59c
update database, tokenizer handle null prompt, convert top_p to vllm on openai, actually validate prompt on streaming,
2023-09-25 22:32:48 -06:00
Cyberes
6459a1c91b
allow setting simultaneous IP limit per-token, fix token use tracker, fix tokens on streaming
2023-09-25 00:55:20 -06:00
Cyberes
8593198216
close mysql cursor
2023-09-20 21:19:26 -06:00
Cyberes
03e3ec5490
port to mysql, use vllm tokenizer endpoint
2023-09-20 20:30:31 -06:00