 Cyberes
|
2ab2e6eed1
|
fix service file
|
2024-05-08 22:19:57 -06:00 |
|
Cyberes
|
20366fbd08
|
misc adjustments
|
2024-05-07 22:56:36 -06:00 |
|
Cyberes
|
fe23a2282f
|
refactor, add Llm-Disable-Openai header
|
2024-05-07 17:41:53 -06:00 |
|
Cyberes
|
5bd1044fad
|
openai error message cleanup
|
2024-05-07 17:07:34 -06:00 |
|
Cyberes
|
fd09c783d3
|
refactor a lot of things, major cleanup, use postgresql
|
2024-05-07 17:03:41 -06:00 |
|
Cyberes
|
ee9a0d4858
|
redo config
|
2024-05-07 12:20:53 -06:00 |
|
Cyberes
|
ff82add09e
|
redo database connection, add pooling, minor logging changes, other clean up
|
2024-05-07 09:48:51 -06:00 |
|
Cyberes
|
ab408c6c5b
|
ready for public release
|
2024-03-18 12:42:44 -06:00 |
|
Cyberes
|
e21be17d9b
|
update VLLM api server to upstream
|
2024-01-10 15:46:04 -07:00 |
|
Cyberes
|
6785079fea
|
adjust gunicorn logging and fix service
|
2024-01-10 15:35:29 -07:00 |
|
Cyberes
|
4b3e0671c6
|
clean some stuff up, bump VLLM version
|
2024-01-10 15:01:26 -07:00 |
|
Cyberes
|
0e7f04ab2d
|
fix gunicorn logging
|
2023-12-21 14:24:50 -07:00 |
|
Cyberes
|
27d36a7f0e
|
fix gunicorn warning
|
2023-12-21 13:25:16 -07:00 |
|
Cyberes
|
8cab76712f
|
update service
|
2023-12-21 13:22:47 -07:00 |
|
Cyberes
|
885b2d64f7
|
fix homepage incorrectly showing online when all backends are offline
|
2023-11-13 20:57:19 -07:00 |
|
Cyberes
|
009039dbd8
|
fix server exception
|
2023-10-30 14:42:50 -06:00 |
|
Cyberes
|
0059e7956c
|
Merge cluster to master (#3)
Co-authored-by: Cyberes <cyberes@evulid.cc>
Reviewed-on: #3
|
2023-10-27 19:19:22 -06:00 |
|
Cyberes
|
561820fb9e
|
pull torch version from github
|
2023-10-18 09:35:51 -06:00 |
|
Cyberes
|
ca40295e50
|
fix base vllm dockerfile
|
2023-10-18 09:24:39 -06:00 |
|
Cyberes
|
6f89ac83f3
|
Update 'other/vllm/Docker/Dockerfile.base'
|
2023-10-17 12:45:31 -06:00 |
|
Cyberes
|
a5f31ca831
|
docker: clean up
|
2023-10-15 17:14:14 -06:00 |
|
Cyberes
|
bc74a3dc50
|
docker: get working
|
2023-10-15 16:50:04 -06:00 |
|
Cyberes
|
407e991c52
|
docker: update supervisord
|
2023-10-15 16:15:25 -06:00 |
|
Cyberes
|
8c3937b4b5
|
docked: adjust
|
2023-10-15 16:09:48 -06:00 |
|
Cyberes
|
92ae8312af
|
docker: update build script
|
2023-10-15 16:06:36 -06:00 |
|
Cyberes
|
d68dd7127f
|
docker: revert
|
2023-10-15 16:05:14 -06:00 |
|
Cyberes
|
e650c4e891
|
docker: install jupiter notebook
|
2023-10-15 16:00:26 -06:00 |
|
Cyberes
|
cae8d8356b
|
docker: use jupiter notebook
|
2023-10-15 15:53:32 -06:00 |
|
Cyberes
|
949ddda649
|
docker: update
|
2023-10-15 15:45:25 -06:00 |
|
Cyberes
|
f58fa1a6f1
|
docker: git clone
|
2023-10-15 15:43:37 -06:00 |
|
Cyberes
|
d9d3e03f59
|
docker: split into base and runtime
|
2023-10-15 15:38:48 -06:00 |
|
Cyberes
|
ac5cf18784
|
docker: revert
|
2023-10-15 15:24:58 -06:00 |
|
Cyberes
|
521db377b4
|
docker: update readme
|
2023-10-15 14:57:14 -06:00 |
|
Cyberes
|
2d2d776fd7
|
docker: remove updater script
|
2023-10-15 14:55:32 -06:00 |
|
Cyberes
|
c56ad3c66a
|
docker: no need to install requirements
|
2023-10-15 14:53:05 -06:00 |
|
Cyberes
|
de37ab3771
|
docker: actualy do things
|
2023-10-15 14:51:41 -06:00 |
|
Cyberes
|
c222f96f24
|
docker: clean up
|
2023-10-15 14:50:04 -06:00 |
|
Cyberes
|
21ff182ec1
|
docker: ???
|
2023-10-15 12:37:45 -06:00 |
|
Cyberes
|
f849e17944
|
adjust docker caching
|
2023-10-15 12:16:12 -06:00 |
|
Cyberes
|
aba79bdcf7
|
docker: adjust expose
|
2023-10-15 12:15:18 -06:00 |
|
Cyberes
|
f2ab2a0e23
|
docker: adjust caching
|
2023-10-15 12:13:53 -06:00 |
|
Cyberes
|
5df955dae0
|
docker: fix??
|
2023-10-15 12:12:01 -06:00 |
|
Cyberes
|
d4b6d7ef82
|
docker: reverd
|
2023-10-15 12:03:16 -06:00 |
|
Cyberes
|
b1d73abfd8
|
docker: fix launch?
|
2023-10-15 10:43:35 -06:00 |
|
Cyberes
|
448ebcbe8d
|
docker: install pytorch 11.8
|
2023-10-14 20:41:40 -06:00 |
|
Cyberes
|
076501a784
|
adjust vllm docker
|
2023-10-09 18:18:29 -06:00 |
|
Cyberes
|
782678de5f
|
Update 'other/vllm/Docker/Dockerfile'
|
2023-10-01 02:09:37 -06:00 |
|
Cyberes
|
23cb4df7db
|
Update 'other/vllm/Docker/Dockerfile'
|
2023-10-01 02:08:16 -06:00 |
|
Cyberes
|
ac43cb0f5a
|
Update 'other/vllm/Docker/README.md'
|
2023-09-30 22:41:11 -06:00 |
|
Cyberes
|
fdbc3feae4
|
Update 'other/vllm/Docker/start-container.sh'
|
2023-09-30 22:19:04 -06:00 |