Commit Graph

Select branches

Hide Pull Requests

cluster

master

#3

v0.9

vllm-gptq-b633191

Mono Color

• 3494106355 Update README.md master Cyberes 2024-10-27 12:14:57 -0600
• b13fda722a archive project Cyberes 2024-10-27 12:13:26 -0600
• 9a1d41a9b7 get functional again Cyberes 2024-07-07 15:05:35 -0600
• 2ab2e6eed1 fix service file Cyberes 2024-05-08 22:19:57 -0600
• 20366fbd08 misc adjustments Cyberes 2024-05-07 22:56:36 -0600
• fe23a2282f refactor, add Llm-Disable-Openai header Cyberes 2024-05-07 17:41:53 -0600
• 5bd1044fad openai error message cleanup Cyberes 2024-05-07 17:07:34 -0600
• fd09c783d3 refactor a lot of things, major cleanup, use postgresql Cyberes 2024-05-07 17:03:41 -0600
• ee9a0d4858 redo config Cyberes 2024-05-07 12:20:53 -0600
• ff82add09e redo database connection, add pooling, minor logging changes, other clean up Cyberes 2024-05-07 09:48:51 -0600
• ab408c6c5b ready for public release v0.9 Cyberes 2024-03-18 12:42:44 -0600
• e21be17d9b update VLLM api server to upstream Cyberes 2024-01-10 15:46:04 -0700
• 6785079fea adjust gunicorn logging and fix service Cyberes 2024-01-10 15:35:29 -0700
• 4b3e0671c6 clean some stuff up, bump VLLM version Cyberes 2024-01-10 15:01:26 -0700
• 0e7f04ab2d fix gunicorn logging Cyberes 2023-12-21 14:24:50 -0700
• 27d36a7f0e fix gunicorn warning Cyberes 2023-12-21 13:25:16 -0700
• 8cab76712f update service Cyberes 2023-12-21 13:22:47 -0700
• 885b2d64f7 fix homepage incorrectly showing online when all backends are offline Cyberes 2023-11-13 20:57:19 -0700
• 009039dbd8 fix server exception Cyberes 2023-10-30 14:42:50 -0600
• 0059e7956c Merge cluster to master (#3) Cyberes 2023-10-27 19:19:22 -0600
• ee44371fdf Merge branch 'master' into cluster #3 cluster Cyberes 2023-10-27 19:05:27 -0600
• 28c250385d add todo Cyberes 2023-10-27 19:00:49 -0600
• 563630547a add robots.txt Cyberes 2023-10-23 17:32:33 -0600
• b4e01e129d fix when all offline Cyberes 2023-10-23 17:28:59 -0600
• 96ba48affc make sure to regen stats on startup Cyberes 2023-10-23 17:26:15 -0600
• 177dabd209 Give some time for the background threads to get themselves ready to go Cyberes 2023-10-23 17:25:38 -0600
• 0771c2325c fix inference workers quitting when a backend is offline, start adding logging, improve tokenizer error handling Cyberes 2023-10-23 17:24:20 -0600
• 3cf73fec9b fix a few exceptions when all backends go offline Cyberes 2023-10-23 15:22:57 -0600
• d43f110a14 fix redis cycle and add no reset to daemon Cyberes 2023-10-22 12:19:20 -0600
• e236e93a79 clean up a bit Cyberes 2023-10-20 18:26:41 -0600
• f39e976b34 dameon printer: Calculate the queue size the same way it's done on the stats Cyberes 2023-10-20 17:41:47 -0600
• 1a15232400 tests: make sure all prompts are the same Cyberes 2023-10-20 17:35:21 -0600
• 763139c949 fix keyerror Cyberes 2023-10-20 14:02:30 -0600
• e838f591aa fix keyerror? Cyberes 2023-10-20 14:00:24 -0600
• 0abd4b94fb track down keyerror Cyberes 2023-10-20 13:57:20 -0600
• 4f5b2dbecb add tests Cyberes 2023-10-20 12:14:34 -0600
• 6e74ce7c28 fix old code in completions Cyberes 2023-10-19 17:59:27 -0600
• 561820fb9e pull torch version from github Cyberes 2023-10-18 09:35:51 -0600
• ca40295e50 fix base vllm dockerfile Cyberes 2023-10-18 09:24:39 -0600
• b9566e9db7 docs and stuff Cyberes 2023-10-18 09:23:54 -0600
• 56a2ca464b change print Cyberes 2023-10-18 09:12:30 -0600
• 50377eca22 track lag on get_ip_request_count() Cyberes 2023-10-18 09:09:22 -0600
• 92e4ecd8a1 refer to queue for tracking IP count rather than seperate value Cyberes 2023-10-18 09:03:10 -0600
• 6f89ac83f3 Update 'other/vllm/Docker/Dockerfile.base' Cyberes 2023-10-17 12:45:31 -0600
• be03569165 use backend handler to build parameters when sending test prompt Cyberes 2023-10-17 12:42:48 -0600
• 90adffaec8 test Cyberes 2023-10-17 12:32:41 -0600
• 4c2c164ce1 test Cyberes 2023-10-17 12:29:12 -0600
• 2fed87d340 remove timed-out items from queue Cyberes 2023-10-17 11:46:39 -0600
• 7998cfca87 cleanup Cyberes 2023-10-16 23:47:34 -0600
• 2ed0e01db6 background thread Cyberes 2023-10-16 23:44:11 -0600
• 6f65791795 adjust Cyberes 2023-10-16 23:40:07 -0600
• 9e3cbc9d2e fix streaming slowdown? Cyberes 2023-10-16 23:36:25 -0600
• c3c053e071 test Cyberes 2023-10-16 23:29:17 -0600
• 70cf6843e5 update requiorements Cyberes 2023-10-16 23:12:41 -0600
• 806e522d16 don't pickle streaming Cyberes 2023-10-16 18:35:10 -0600
• 81baf9616f revert Cyberes 2023-10-16 18:16:19 -0600
• 21755450a3 test Cyberes 2023-10-16 18:10:21 -0600
• 1e68e10b62 fix GeneratorExit Cyberes 2023-10-16 18:04:49 -0600
• 20047fa0e4 2000 chunk size Cyberes 2023-10-16 18:01:17 -0600
• 19a193b792 increase tokenization chunk size Cyberes 2023-10-16 17:59:21 -0600
• f421436048 add nginx config Cyberes 2023-10-16 17:43:37 -0600
• 2c7773cc4f get streaming working again Cyberes 2023-10-16 16:22:52 -0600
• 151b3e4769 begin streaming rewrite Cyberes 2023-10-16 00:18:05 -0600
• 24aab3cd93 fix streaming disabled Cyberes 2023-10-15 20:59:11 -0600
• 381bdb950f remove debug print Cyberes 2023-10-15 20:46:32 -0600
• 31ab4188f1 fix issues with queue and streaming Cyberes 2023-10-15 20:45:01 -0600
• 3ec9b2347f fix wrong datatype Cyberes 2023-10-15 17:24:18 -0600
• a5f31ca831 docker: clean up Cyberes 2023-10-15 17:14:14 -0600
• bc74a3dc50 docker: get working Cyberes 2023-10-15 16:50:04 -0600
• 407e991c52 docker: update supervisord Cyberes 2023-10-15 16:15:25 -0600
• 8c3937b4b5 docked: adjust Cyberes 2023-10-15 16:09:48 -0600
• 92ae8312af docker: update build script Cyberes 2023-10-15 16:06:36 -0600
• d68dd7127f docker: revert Cyberes 2023-10-15 16:05:14 -0600
• e650c4e891 docker: install jupiter notebook Cyberes 2023-10-15 16:00:26 -0600
• cae8d8356b docker: use jupiter notebook Cyberes 2023-10-15 15:53:32 -0600
• 949ddda649 docker: update Cyberes 2023-10-15 15:45:25 -0600
• f58fa1a6f1 docker: git clone Cyberes 2023-10-15 15:43:37 -0600
• d9d3e03f59 docker: split into base and runtime Cyberes 2023-10-15 15:38:48 -0600
• ac5cf18784 docker: revert Cyberes 2023-10-15 15:24:58 -0600
• b3f0c4b28f remove debug print Cyberes 2023-10-15 15:14:32 -0600
• 83f3ba8919 trying to fix workers still processing after backend goes offline Cyberes 2023-10-15 15:11:37 -0600
• 521db377b4 docker: update readme Cyberes 2023-10-15 14:57:14 -0600
• 2d2d776fd7 docker: remove updater script Cyberes 2023-10-15 14:55:32 -0600
• c56ad3c66a docker: no need to install requirements Cyberes 2023-10-15 14:53:05 -0600
• de37ab3771 docker: actualy do things Cyberes 2023-10-15 14:51:41 -0600
• c222f96f24 docker: clean up Cyberes 2023-10-15 14:50:04 -0600
• 21ff182ec1 docker: ??? Cyberes 2023-10-15 12:37:45 -0600
• f849e17944 adjust docker caching Cyberes 2023-10-15 12:16:12 -0600
• aba79bdcf7 docker: adjust expose Cyberes 2023-10-15 12:15:18 -0600
• f2ab2a0e23 docker: adjust caching Cyberes 2023-10-15 12:13:53 -0600
• 5df955dae0 docker: fix?? Cyberes 2023-10-15 12:12:01 -0600
• d4b6d7ef82 docker: reverd Cyberes 2023-10-15 12:03:16 -0600
• b1d73abfd8 docker: fix launch? Cyberes 2023-10-15 10:43:35 -0600
• 448ebcbe8d docker: install pytorch 11.8 Cyberes 2023-10-14 20:41:40 -0600
• ca7044bc90 update gradio chat Cyberes 2023-10-11 18:49:31 -0600
• 4e3985e156 fix wrong status code on openai streaming Cyberes 2023-10-11 18:17:02 -0600
• 74cf8f309b clean up Cyberes 2023-10-11 18:04:15 -0600
• 169e216a38 add background thread to gradio Cyberes 2023-10-11 12:56:04 -0600
• 69b8c1e35c fix openai confusion Cyberes 2023-10-11 12:50:20 -0600
• 1d1c45dc1a add length penalty param to vllm Cyberes 2023-10-11 12:22:50 -0600