Commit Graph

58 Commits

Author SHA1 Message Date
Cyberes 21ff182ec1 docker: ??? 2023-10-15 12:37:45 -06:00
Cyberes f849e17944 adjust docker caching 2023-10-15 12:16:12 -06:00
Cyberes aba79bdcf7 docker: adjust expose 2023-10-15 12:15:18 -06:00
Cyberes f2ab2a0e23 docker: adjust caching 2023-10-15 12:13:53 -06:00
Cyberes 5df955dae0 docker: fix?? 2023-10-15 12:12:01 -06:00
Cyberes d4b6d7ef82 docker: reverd 2023-10-15 12:03:16 -06:00
Cyberes b1d73abfd8 docker: fix launch? 2023-10-15 10:43:35 -06:00
Cyberes 448ebcbe8d docker: install pytorch 11.8 2023-10-14 20:41:40 -06:00
Cyberes 076501a784 adjust vllm docker 2023-10-09 18:18:29 -06:00
Cyberes 782678de5f Update 'other/vllm/Docker/Dockerfile' 2023-10-01 02:09:37 -06:00
Cyberes 23cb4df7db Update 'other/vllm/Docker/Dockerfile' 2023-10-01 02:08:16 -06:00
Cyberes ac43cb0f5a Update 'other/vllm/Docker/README.md' 2023-09-30 22:41:11 -06:00
Cyberes fdbc3feae4 Update 'other/vllm/Docker/start-container.sh' 2023-09-30 22:19:04 -06:00
Cyberes 3e651e64d2 Update 'other/vllm/Docker/start-container.sh' 2023-09-30 19:24:20 -06:00
Cyberes 428123e9f1 Update 'other/vllm/Docker/start-container.sh' 2023-09-30 19:11:26 -06:00
Cyberes ee83608a52 Update 'other/vllm/Docker/start-container.sh' 2023-09-30 19:10:10 -06:00
Cyberes 79fef7bc5a Update 'other/vllm/Docker/Dockerfile' 2023-09-30 19:04:31 -06:00
Cyberes c65b722211 Update 'other/vllm/Docker/DOCKER.md' 2023-09-30 13:32:46 -06:00
Cyberes d3f529ca8b Upload files to 'other/vllm/Docker' 2023-09-30 13:25:10 -06:00
Cyberes c047df0dc0 Update 'other/vllm/Docker/start-container.sh' 2023-09-30 13:24:47 -06:00
Cyberes d8ac9dc042 Update 'other/vllm/Docker/supervisord.conf' 2023-09-30 13:00:01 -06:00
Cyberes 2e998344d6 Update 'other/vllm/vllm_api_server.py' 2023-09-29 22:36:03 -06:00
Cyberes c888f5c789 update docker 2023-09-29 22:28:38 -06:00
Cyberes 89e9f42663 remove secrets from dockerfile, use /storage instead 2023-09-28 17:02:45 -06:00
Cyberes 3a538d649a fix docker typo lol 2023-09-28 00:02:41 -06:00
Cyberes abef9eba7d adjust dockerfile paths 2023-09-27 17:50:55 -06:00
Cyberes 1874e6f7c4 fix docker logging 2023-09-27 17:00:46 -06:00
Cyberes ffb7af8f3c rename docker service 2023-09-27 16:58:49 -06:00
Cyberes 3b0ec723a5 fix docker 2023-09-27 16:57:14 -06:00
Cyberes 74f16afa67 update dockerfile 2023-09-27 16:12:36 -06:00
Cyberes eade509947 improve dockerfile 2023-09-27 14:59:33 -06:00
Cyberes 957a6cd092 fix error handling 2023-09-27 14:36:49 -06:00
Cyberes 90bb68115f asdjust docker 2023-09-27 00:04:37 -06:00
Cyberes 7456bbe085 adjust docker 2023-09-26 23:23:54 -06:00
Cyberes d9bbcc42e6 more work on openai endpoint 2023-09-26 22:09:11 -06:00
Cyberes 9e6624e779 modify dockerfile for paperspace 2023-09-26 21:45:13 -06:00
Cyberes e3c57d874a add vllm dockerfile 2023-09-26 14:48:34 -06:00
Cyberes 135bd743bb fix homepage slowness, fix incorrect 24 hr prompters, fix redis wrapper, 2023-09-25 17:20:21 -06:00
Cyberes 2678102153 handle error while streaming 2023-09-24 13:27:27 -06:00
Cyberes cb99c3490e rewrite tokenizer, restructure validation 2023-09-24 13:02:30 -06:00
Cyberes 76a1428ba0 implement streaming for vllm 2023-09-23 17:57:23 -06:00
Cyberes 03e3ec5490 port to mysql, use vllm tokenizer endpoint 2023-09-20 20:30:31 -06:00
Cyberes 354ad8192d fix division by 0, prettify /stats json, add js var to home 2023-09-16 17:37:43 -06:00
Cyberes 8f4f17166e adjust 2023-09-14 14:36:22 -06:00
Cyberes 79b1e01b61 option to disable streaming, improve timeout on requests to backend, fix error handling. reduce duplicate code, misc other cleanup 2023-09-14 14:05:50 -06:00
Cyberes c45e68a8c8 adjust requests timeout, add service file 2023-09-14 01:32:49 -06:00
Cyberes 12e894032e show the openai system prompt 2023-09-13 20:25:56 -06:00
Cyberes bcedd2ab3d adjust logging, add more vllm stuff 2023-09-13 11:22:33 -06:00
Cyberes 40ac84aa9a actually we don't want to emulate openai 2023-09-12 01:04:11 -06:00
Cyberes c14cc51f09 get working with ooba again, give up on dockerfile 2023-09-11 09:51:01 -06:00