Commit Graph

352 Commits

Author SHA1 Message Date
Cyberes 81baf9616f revert 2023-10-16 18:16:19 -06:00
Cyberes 21755450a3 test 2023-10-16 18:10:21 -06:00
Cyberes 1e68e10b62 fix GeneratorExit 2023-10-16 18:04:49 -06:00
Cyberes 20047fa0e4 2000 chunk size 2023-10-16 18:01:17 -06:00
Cyberes 19a193b792 increase tokenization chunk size 2023-10-16 17:59:21 -06:00
Cyberes f421436048 add nginx config 2023-10-16 17:43:37 -06:00
Cyberes 2c7773cc4f get streaming working again 2023-10-16 16:22:52 -06:00
Cyberes 151b3e4769 begin streaming rewrite 2023-10-16 00:18:05 -06:00
Cyberes 24aab3cd93 fix streaming disabled 2023-10-15 20:59:11 -06:00
Cyberes 381bdb950f remove debug print 2023-10-15 20:46:32 -06:00
Cyberes 31ab4188f1 fix issues with queue and streaming 2023-10-15 20:45:01 -06:00
Cyberes 3ec9b2347f fix wrong datatype 2023-10-15 17:24:18 -06:00
Cyberes b3f0c4b28f remove debug print 2023-10-15 15:14:32 -06:00
Cyberes 83f3ba8919 trying to fix workers still processing after backend goes offline 2023-10-15 15:11:37 -06:00
Cyberes ca7044bc90 update gradio chat 2023-10-11 18:49:31 -06:00
Cyberes 4e3985e156 fix wrong status code on openai streaming 2023-10-11 18:17:02 -06:00
Cyberes 74cf8f309b clean up 2023-10-11 18:04:15 -06:00
Cyberes 169e216a38 add background thread to gradio 2023-10-11 12:56:04 -06:00
Cyberes 69b8c1e35c fix openai confusion 2023-10-11 12:50:20 -06:00
Cyberes 1d1c45dc1a add length penalty param to vllm 2023-10-11 12:22:50 -06:00
Cyberes 78114771b0 fix oai exception 2023-10-11 09:20:00 -06:00
Cyberes 7286e38cb0 t 2023-10-11 09:10:32 -06:00
Cyberes f4e5b5275d test 2023-10-11 09:09:41 -06:00
Cyberes 18e37a72ae add model selection to openai endpoint 2023-10-09 23:51:26 -06:00
Cyberes 5f7bf4faca misc changes 2023-10-09 18:12:12 -06:00
Cyberes ae4d4e5ca9 fix exception 2023-10-09 10:31:35 -06:00
Cyberes 467e1893ea fix issue with null data on openai 2023-10-08 19:36:12 -06:00
Cyberes 3e5feb9c97 fix stat 2023-10-05 21:43:49 -06:00
Cyberes e8964fcfd2 fix the queue?? 2023-10-05 21:37:18 -06:00
Cyberes ea61766838 fix 2023-10-05 20:19:57 -06:00
Cyberes da20d1807b actually wait again 2023-10-05 20:17:42 -06:00
Cyberes e9f6fdf65e fix streaming? 2023-10-05 20:14:28 -06:00
Cyberes 67173f30dd t 2023-10-05 19:35:12 -06:00
Cyberes 8df667bc0a t 2023-10-05 19:25:08 -06:00
Cyberes c4cc7bbaa0 f 2023-10-05 19:13:43 -06:00
Cyberes 0bef14ea55 t 2023-10-05 19:11:59 -06:00
Cyberes 5540112607 t 2023-10-05 19:09:25 -06:00
Cyberes 9befda5acb c 2023-10-05 19:05:41 -06:00
Cyberes 50992116f5 fix 2023-10-05 18:59:19 -06:00
Cyberes 96dd62478f fix 2023-10-05 18:53:19 -06:00
Cyberes a37b12a221 t 2023-10-05 18:51:56 -06:00
Cyberes 46d44f95ac t 2023-10-05 18:50:10 -06:00
Cyberes 817c454c89 t 2023-10-05 18:48:07 -06:00
Cyberes 9b819573e8 fix import error 2023-10-05 18:39:31 -06:00
Cyberes e07e31df0a fix 2023-10-05 18:37:50 -06:00
Cyberes 0718f10eb9 t 2023-10-05 18:36:02 -06:00
Cyberes fb8bc05b4c t 2023-10-05 18:30:54 -06:00
Cyberes 6be1e9acd3 t 2023-10-05 18:16:17 -06:00
Cyberes 10eb6269b7 t 2023-10-05 18:15:02 -06:00
Cyberes 64d7a9edbb fix 2023-10-05 18:09:24 -06:00