Commit Graph

284 Commits

Author SHA1 Message Date
Cyberes 3494106355 Update README.md 2024-10-27 12:14:57 -06:00
Cyberes b13fda722a archive project 2024-10-27 12:13:26 -06:00
Cyberes 9a1d41a9b7 get functional again 2024-07-07 15:05:35 -06:00
Cyberes 2ab2e6eed1 fix service file 2024-05-08 22:19:57 -06:00
Cyberes 20366fbd08 misc adjustments 2024-05-07 22:56:36 -06:00
Cyberes fe23a2282f refactor, add Llm-Disable-Openai header 2024-05-07 17:41:53 -06:00
Cyberes 5bd1044fad openai error message cleanup 2024-05-07 17:07:34 -06:00
Cyberes fd09c783d3 refactor a lot of things, major cleanup, use postgresql 2024-05-07 17:03:41 -06:00
Cyberes ee9a0d4858 redo config 2024-05-07 12:20:53 -06:00
Cyberes ff82add09e redo database connection, add pooling, minor logging changes, other clean up 2024-05-07 09:48:51 -06:00
Cyberes ab408c6c5b ready for public release 2024-03-18 12:42:44 -06:00
Cyberes e21be17d9b update VLLM api server to upstream 2024-01-10 15:46:04 -07:00
Cyberes 6785079fea adjust gunicorn logging and fix service 2024-01-10 15:35:29 -07:00
Cyberes 4b3e0671c6 clean some stuff up, bump VLLM version 2024-01-10 15:01:26 -07:00
Cyberes 0e7f04ab2d fix gunicorn logging 2023-12-21 14:24:50 -07:00
Cyberes 27d36a7f0e fix gunicorn warning 2023-12-21 13:25:16 -07:00
Cyberes 8cab76712f update service 2023-12-21 13:22:47 -07:00
Cyberes 885b2d64f7 fix homepage incorrectly showing online when all backends are offline 2023-11-13 20:57:19 -07:00
Cyberes 009039dbd8 fix server exception 2023-10-30 14:42:50 -06:00
Cyberes 0059e7956c Merge cluster to master (#3)
Co-authored-by: Cyberes <cyberes@evulid.cc>
Reviewed-on: #3
2023-10-27 19:19:22 -06:00
Cyberes 561820fb9e pull torch version from github 2023-10-18 09:35:51 -06:00
Cyberes ca40295e50 fix base vllm dockerfile 2023-10-18 09:24:39 -06:00
Cyberes 6f89ac83f3 Update 'other/vllm/Docker/Dockerfile.base' 2023-10-17 12:45:31 -06:00
Cyberes a5f31ca831 docker: clean up 2023-10-15 17:14:14 -06:00
Cyberes bc74a3dc50 docker: get working 2023-10-15 16:50:04 -06:00
Cyberes 407e991c52 docker: update supervisord 2023-10-15 16:15:25 -06:00
Cyberes 8c3937b4b5 docked: adjust 2023-10-15 16:09:48 -06:00
Cyberes 92ae8312af docker: update build script 2023-10-15 16:06:36 -06:00
Cyberes d68dd7127f docker: revert 2023-10-15 16:05:14 -06:00
Cyberes e650c4e891 docker: install jupiter notebook 2023-10-15 16:00:26 -06:00
Cyberes cae8d8356b docker: use jupiter notebook 2023-10-15 15:53:32 -06:00
Cyberes 949ddda649 docker: update 2023-10-15 15:45:25 -06:00
Cyberes f58fa1a6f1 docker: git clone 2023-10-15 15:43:37 -06:00
Cyberes d9d3e03f59 docker: split into base and runtime 2023-10-15 15:38:48 -06:00
Cyberes ac5cf18784 docker: revert 2023-10-15 15:24:58 -06:00
Cyberes 521db377b4 docker: update readme 2023-10-15 14:57:14 -06:00
Cyberes 2d2d776fd7 docker: remove updater script 2023-10-15 14:55:32 -06:00
Cyberes c56ad3c66a docker: no need to install requirements 2023-10-15 14:53:05 -06:00
Cyberes de37ab3771 docker: actualy do things 2023-10-15 14:51:41 -06:00
Cyberes c222f96f24 docker: clean up 2023-10-15 14:50:04 -06:00
Cyberes 21ff182ec1 docker: ??? 2023-10-15 12:37:45 -06:00
Cyberes f849e17944 adjust docker caching 2023-10-15 12:16:12 -06:00
Cyberes aba79bdcf7 docker: adjust expose 2023-10-15 12:15:18 -06:00
Cyberes f2ab2a0e23 docker: adjust caching 2023-10-15 12:13:53 -06:00
Cyberes 5df955dae0 docker: fix?? 2023-10-15 12:12:01 -06:00
Cyberes d4b6d7ef82 docker: reverd 2023-10-15 12:03:16 -06:00
Cyberes b1d73abfd8 docker: fix launch? 2023-10-15 10:43:35 -06:00
Cyberes 448ebcbe8d docker: install pytorch 11.8 2023-10-14 20:41:40 -06:00
Cyberes 076501a784 adjust vllm docker 2023-10-09 18:18:29 -06:00
Cyberes 782678de5f Update 'other/vllm/Docker/Dockerfile' 2023-10-01 02:09:37 -06:00