 Cyberes
|
92e4ecd8a1
|
refer to queue for tracking IP count rather than seperate value
|
2023-10-18 09:03:10 -06:00 |
|
Cyberes
|
be03569165
|
use backend handler to build parameters when sending test prompt
|
2023-10-17 12:42:48 -06:00 |
|
Cyberes
|
90adffaec8
|
test
|
2023-10-17 12:32:41 -06:00 |
|
Cyberes
|
2fed87d340
|
remove timed-out items from queue
|
2023-10-17 11:46:39 -06:00 |
|
Cyberes
|
7998cfca87
|
cleanup
|
2023-10-16 23:47:34 -06:00 |
|
Cyberes
|
2ed0e01db6
|
background thread
|
2023-10-16 23:44:11 -06:00 |
|
Cyberes
|
6f65791795
|
adjust
|
2023-10-16 23:40:07 -06:00 |
|
Cyberes
|
9e3cbc9d2e
|
fix streaming slowdown?
|
2023-10-16 23:36:25 -06:00 |
|
Cyberes
|
c3c053e071
|
test
|
2023-10-16 23:29:17 -06:00 |
|
Cyberes
|
806e522d16
|
don't pickle streaming
|
2023-10-16 18:35:10 -06:00 |
|
Cyberes
|
2c7773cc4f
|
get streaming working again
|
2023-10-16 16:22:52 -06:00 |
|
Cyberes
|
151b3e4769
|
begin streaming rewrite
|
2023-10-16 00:18:05 -06:00 |
|
Cyberes
|
24aab3cd93
|
fix streaming disabled
|
2023-10-15 20:59:11 -06:00 |
|
Cyberes
|
381bdb950f
|
remove debug print
|
2023-10-15 20:46:32 -06:00 |
|
Cyberes
|
31ab4188f1
|
fix issues with queue and streaming
|
2023-10-15 20:45:01 -06:00 |
|
Cyberes
|
3ec9b2347f
|
fix wrong datatype
|
2023-10-15 17:24:18 -06:00 |
|
Cyberes
|
83f3ba8919
|
trying to fix workers still processing after backend goes offline
|
2023-10-15 15:11:37 -06:00 |
|
Cyberes
|
74cf8f309b
|
clean up
|
2023-10-11 18:04:15 -06:00 |
|
Cyberes
|
78114771b0
|
fix oai exception
|
2023-10-11 09:20:00 -06:00 |
|
Cyberes
|
f4e5b5275d
|
test
|
2023-10-11 09:09:41 -06:00 |
|
Cyberes
|
e8964fcfd2
|
fix the queue??
|
2023-10-05 21:37:18 -06:00 |
|
Cyberes
|
ea61766838
|
fix
|
2023-10-05 20:19:57 -06:00 |
|
Cyberes
|
da20d1807b
|
actually wait again
|
2023-10-05 20:17:42 -06:00 |
|
Cyberes
|
e9f6fdf65e
|
fix streaming?
|
2023-10-05 20:14:28 -06:00 |
|
Cyberes
|
8df667bc0a
|
t
|
2023-10-05 19:25:08 -06:00 |
|
Cyberes
|
c4cc7bbaa0
|
f
|
2023-10-05 19:13:43 -06:00 |
|
Cyberes
|
0bef14ea55
|
t
|
2023-10-05 19:11:59 -06:00 |
|
Cyberes
|
5540112607
|
t
|
2023-10-05 19:09:25 -06:00 |
|
Cyberes
|
9befda5acb
|
c
|
2023-10-05 19:05:41 -06:00 |
|
Cyberes
|
817c454c89
|
t
|
2023-10-05 18:48:07 -06:00 |
|
Cyberes
|
fb8bc05b4c
|
t
|
2023-10-05 18:30:54 -06:00 |
|
Cyberes
|
6be1e9acd3
|
t
|
2023-10-05 18:16:17 -06:00 |
|
Cyberes
|
10eb6269b7
|
t
|
2023-10-05 18:15:02 -06:00 |
|
Cyberes
|
27e461c76b
|
test
|
2023-10-05 17:00:35 -06:00 |
|
Cyberes
|
08df52a4fd
|
fix exception when not valid model
|
2023-10-05 12:28:00 -06:00 |
|
Cyberes
|
acf409abfc
|
fix background logger, add gradio chat example
|
2023-10-04 19:24:47 -06:00 |
|
Cyberes
|
1670594908
|
fix import error
|
2023-10-04 16:29:19 -06:00 |
|
Cyberes
|
95d781725e
|
t
|
2023-10-04 12:42:18 -06:00 |
|
Cyberes
|
f88e2362c5
|
remove some debug prints
|
2023-10-03 20:01:28 -06:00 |
|
Cyberes
|
32ad97e57c
|
do default model rather than default backend, adjust moderation endpoint logic and add timeout, exclude system tokens from recent proompters, calculate number of moderators from endpoint concurrent gens, adjust homepage
|
2023-10-03 13:40:08 -06:00 |
|
Cyberes
|
ca1baa4870
|
test
|
2023-10-03 00:15:16 -06:00 |
|
Cyberes
|
70126acdf2
|
test
|
2023-10-03 00:12:13 -06:00 |
|
Cyberes
|
94141b8ecf
|
fix processing not being decremented on streaming, fix confusion over queue, adjust stop sequences
|
2023-10-02 20:53:08 -06:00 |
|
Cyberes
|
4f226ae38e
|
handle requests to offline backends
|
2023-10-02 11:11:48 -06:00 |
|
Cyberes
|
f7e9687527
|
finish openai endpoints
|
2023-10-01 16:04:53 -06:00 |
|
Cyberes
|
25ec56a5ef
|
get streaming working, remove /v2/
|
2023-10-01 00:20:00 -06:00 |
|
Cyberes
|
b10d22ca0d
|
cache the home page in the background
|
2023-09-30 23:03:42 -06:00 |
|
Cyberes
|
e0f86d053a
|
reorganize to api v2
|
2023-09-30 19:42:41 -06:00 |
|
Cyberes
|
114f36e709
|
functional
|
2023-09-30 19:41:50 -06:00 |
|
Cyberes
|
624ca74ce5
|
mvp
|
2023-09-29 00:09:44 -06:00 |