 Cyberes
|
151b3e4769
|
begin streaming rewrite
|
2023-10-16 00:18:05 -06:00 |
|
Cyberes
|
24aab3cd93
|
fix streaming disabled
|
2023-10-15 20:59:11 -06:00 |
|
Cyberes
|
381bdb950f
|
remove debug print
|
2023-10-15 20:46:32 -06:00 |
|
Cyberes
|
31ab4188f1
|
fix issues with queue and streaming
|
2023-10-15 20:45:01 -06:00 |
|
Cyberes
|
3ec9b2347f
|
fix wrong datatype
|
2023-10-15 17:24:18 -06:00 |
|
Cyberes
|
b3f0c4b28f
|
remove debug print
|
2023-10-15 15:14:32 -06:00 |
|
Cyberes
|
83f3ba8919
|
trying to fix workers still processing after backend goes offline
|
2023-10-15 15:11:37 -06:00 |
|
Cyberes
|
4e3985e156
|
fix wrong status code on openai streaming
|
2023-10-11 18:17:02 -06:00 |
|
Cyberes
|
74cf8f309b
|
clean up
|
2023-10-11 18:04:15 -06:00 |
|
Cyberes
|
69b8c1e35c
|
fix openai confusion
|
2023-10-11 12:50:20 -06:00 |
|
Cyberes
|
1d1c45dc1a
|
add length penalty param to vllm
|
2023-10-11 12:22:50 -06:00 |
|
Cyberes
|
78114771b0
|
fix oai exception
|
2023-10-11 09:20:00 -06:00 |
|
Cyberes
|
f4e5b5275d
|
test
|
2023-10-11 09:09:41 -06:00 |
|
Cyberes
|
18e37a72ae
|
add model selection to openai endpoint
|
2023-10-09 23:51:26 -06:00 |
|
Cyberes
|
5f7bf4faca
|
misc changes
|
2023-10-09 18:12:12 -06:00 |
|
Cyberes
|
ae4d4e5ca9
|
fix exception
|
2023-10-09 10:31:35 -06:00 |
|
Cyberes
|
467e1893ea
|
fix issue with null data on openai
|
2023-10-08 19:36:12 -06:00 |
|
Cyberes
|
3e5feb9c97
|
fix stat
|
2023-10-05 21:43:49 -06:00 |
|
Cyberes
|
e8964fcfd2
|
fix the queue??
|
2023-10-05 21:37:18 -06:00 |
|
Cyberes
|
ea61766838
|
fix
|
2023-10-05 20:19:57 -06:00 |
|
Cyberes
|
da20d1807b
|
actually wait again
|
2023-10-05 20:17:42 -06:00 |
|
Cyberes
|
e9f6fdf65e
|
fix streaming?
|
2023-10-05 20:14:28 -06:00 |
|
Cyberes
|
67173f30dd
|
t
|
2023-10-05 19:35:12 -06:00 |
|
Cyberes
|
8df667bc0a
|
t
|
2023-10-05 19:25:08 -06:00 |
|
Cyberes
|
c4cc7bbaa0
|
f
|
2023-10-05 19:13:43 -06:00 |
|
Cyberes
|
0bef14ea55
|
t
|
2023-10-05 19:11:59 -06:00 |
|
Cyberes
|
5540112607
|
t
|
2023-10-05 19:09:25 -06:00 |
|
Cyberes
|
9befda5acb
|
c
|
2023-10-05 19:05:41 -06:00 |
|
Cyberes
|
50992116f5
|
fix
|
2023-10-05 18:59:19 -06:00 |
|
Cyberes
|
96dd62478f
|
fix
|
2023-10-05 18:53:19 -06:00 |
|
Cyberes
|
a37b12a221
|
t
|
2023-10-05 18:51:56 -06:00 |
|
Cyberes
|
46d44f95ac
|
t
|
2023-10-05 18:50:10 -06:00 |
|
Cyberes
|
817c454c89
|
t
|
2023-10-05 18:48:07 -06:00 |
|
Cyberes
|
9b819573e8
|
fix import error
|
2023-10-05 18:39:31 -06:00 |
|
Cyberes
|
e07e31df0a
|
fix
|
2023-10-05 18:37:50 -06:00 |
|
Cyberes
|
0718f10eb9
|
t
|
2023-10-05 18:36:02 -06:00 |
|
Cyberes
|
fb8bc05b4c
|
t
|
2023-10-05 18:30:54 -06:00 |
|
Cyberes
|
6be1e9acd3
|
t
|
2023-10-05 18:16:17 -06:00 |
|
Cyberes
|
10eb6269b7
|
t
|
2023-10-05 18:15:02 -06:00 |
|
Cyberes
|
5a61bdccd4
|
f
|
2023-10-05 18:07:59 -06:00 |
|
Cyberes
|
3d0a5cf0a2
|
t
|
2023-10-05 18:06:36 -06:00 |
|
Cyberes
|
a229b4d6c5
|
c
|
2023-10-05 18:04:29 -06:00 |
|
Cyberes
|
a53790ee37
|
fix???
|
2023-10-05 18:01:08 -06:00 |
|
Cyberes
|
84c1ed8737
|
t
|
2023-10-05 17:58:23 -06:00 |
|
Cyberes
|
979a945466
|
t
|
2023-10-05 17:55:44 -06:00 |
|
Cyberes
|
19e62be3e8
|
t
|
2023-10-05 17:41:01 -06:00 |
|
Cyberes
|
27e461c76b
|
test
|
2023-10-05 17:00:35 -06:00 |
|
Cyberes
|
08df52a4fd
|
fix exception when not valid model
|
2023-10-05 12:28:00 -06:00 |
|
Cyberes
|
acf409abfc
|
fix background logger, add gradio chat example
|
2023-10-04 19:24:47 -06:00 |
|
Cyberes
|
1670594908
|
fix import error
|
2023-10-04 16:29:19 -06:00 |