local-llm-server/llm_server/llm/vllm
Cyberes 4b3e0671c6 clean some stuff up, bump VLLM version 2024-01-10 15:01:26 -07:00
..
__init__.py port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00
generate.py Merge cluster to master (#3) 2023-10-27 19:19:22 -06:00
info.py Merge cluster to master (#3) 2023-10-27 19:19:22 -06:00
tokenize.py Merge cluster to master (#3) 2023-10-27 19:19:22 -06:00
vllm_backend.py clean some stuff up, bump VLLM version 2024-01-10 15:01:26 -07:00