 Cyberes
|
ee44371fdf
|
Merge branch 'master' into cluster
|
2023-10-27 19:05:27 -06:00 |
|
Cyberes
|
e236e93a79
|
clean up a bit
|
2023-10-20 18:26:41 -06:00 |
|
Cyberes
|
1a15232400
|
tests: make sure all prompts are the same
|
2023-10-20 17:35:21 -06:00 |
|
Cyberes
|
4f5b2dbecb
|
add tests
|
2023-10-20 12:14:34 -06:00 |
|
Cyberes
|
f421436048
|
add nginx config
|
2023-10-16 17:43:37 -06:00 |
|
Cyberes
|
2c7773cc4f
|
get streaming working again
|
2023-10-16 16:22:52 -06:00 |
|
Cyberes
|
ca7044bc90
|
update gradio chat
|
2023-10-11 18:49:31 -06:00 |
|
Cyberes
|
74cf8f309b
|
clean up
|
2023-10-11 18:04:15 -06:00 |
|
Cyberes
|
169e216a38
|
add background thread to gradio
|
2023-10-11 12:56:04 -06:00 |
|
Cyberes
|
f4e5b5275d
|
test
|
2023-10-11 09:09:41 -06:00 |
|
Cyberes
|
5f7bf4faca
|
misc changes
|
2023-10-09 18:12:12 -06:00 |
|
Cyberes
|
acf409abfc
|
fix background logger, add gradio chat example
|
2023-10-04 19:24:47 -06:00 |
|
Cyberes
|
94141b8ecf
|
fix processing not being decremented on streaming, fix confusion over queue, adjust stop sequences
|
2023-10-02 20:53:08 -06:00 |
|
Cyberes
|
114f36e709
|
functional
|
2023-09-30 19:41:50 -06:00 |
|
Cyberes
|
624ca74ce5
|
mvp
|
2023-09-29 00:09:44 -06:00 |
|
Cyberes
|
89e9f42663
|
remove secrets from dockerfile, use /storage instead
|
2023-09-28 17:02:45 -06:00 |
|
Cyberes
|
3a538d649a
|
fix docker typo lol
|
2023-09-28 00:02:41 -06:00 |
|
Cyberes
|
abef9eba7d
|
adjust dockerfile paths
|
2023-09-27 17:50:55 -06:00 |
|
Cyberes
|
1874e6f7c4
|
fix docker logging
|
2023-09-27 17:00:46 -06:00 |
|
Cyberes
|
ffb7af8f3c
|
rename docker service
|
2023-09-27 16:58:49 -06:00 |
|
Cyberes
|
3b0ec723a5
|
fix docker
|
2023-09-27 16:57:14 -06:00 |
|
Cyberes
|
74f16afa67
|
update dockerfile
|
2023-09-27 16:12:36 -06:00 |
|
Cyberes
|
eade509947
|
improve dockerfile
|
2023-09-27 14:59:33 -06:00 |
|
Cyberes
|
957a6cd092
|
fix error handling
|
2023-09-27 14:36:49 -06:00 |
|
Cyberes
|
90bb68115f
|
asdjust docker
|
2023-09-27 00:04:37 -06:00 |
|
Cyberes
|
7456bbe085
|
adjust docker
|
2023-09-26 23:23:54 -06:00 |
|
Cyberes
|
d9bbcc42e6
|
more work on openai endpoint
|
2023-09-26 22:09:11 -06:00 |
|
Cyberes
|
9e6624e779
|
modify dockerfile for paperspace
|
2023-09-26 21:45:13 -06:00 |
|
Cyberes
|
e3c57d874a
|
add vllm dockerfile
|
2023-09-26 14:48:34 -06:00 |
|
Cyberes
|
135bd743bb
|
fix homepage slowness, fix incorrect 24 hr prompters, fix redis wrapper,
|
2023-09-25 17:20:21 -06:00 |
|
Cyberes
|
2678102153
|
handle error while streaming
|
2023-09-24 13:27:27 -06:00 |
|
Cyberes
|
cb99c3490e
|
rewrite tokenizer, restructure validation
|
2023-09-24 13:02:30 -06:00 |
|
Cyberes
|
76a1428ba0
|
implement streaming for vllm
|
2023-09-23 17:57:23 -06:00 |
|
Cyberes
|
03e3ec5490
|
port to mysql, use vllm tokenizer endpoint
|
2023-09-20 20:30:31 -06:00 |
|
Cyberes
|
354ad8192d
|
fix division by 0, prettify /stats json, add js var to home
|
2023-09-16 17:37:43 -06:00 |
|
Cyberes
|
8f4f17166e
|
adjust
|
2023-09-14 14:36:22 -06:00 |
|
Cyberes
|
79b1e01b61
|
option to disable streaming, improve timeout on requests to backend, fix error handling. reduce duplicate code, misc other cleanup
|
2023-09-14 14:05:50 -06:00 |
|
Cyberes
|
c45e68a8c8
|
adjust requests timeout, add service file
|
2023-09-14 01:32:49 -06:00 |
|
Cyberes
|
12e894032e
|
show the openai system prompt
|
2023-09-13 20:25:56 -06:00 |
|
Cyberes
|
bcedd2ab3d
|
adjust logging, add more vllm stuff
|
2023-09-13 11:22:33 -06:00 |
|
Cyberes
|
40ac84aa9a
|
actually we don't want to emulate openai
|
2023-09-12 01:04:11 -06:00 |
|
Cyberes
|
c14cc51f09
|
get working with ooba again, give up on dockerfile
|
2023-09-11 09:51:01 -06:00 |
|
Cyberes
|
4c49aa525a
|
still working on dockerfile
|
2023-09-10 18:11:25 -06:00 |
|
Cyberes
|
170c912d71
|
reorganize dockerfile
|
2023-09-06 23:32:43 -06:00 |
|
Cyberes
|
f213b9a3ae
|
cuda nn
|
2023-09-06 22:27:48 -06:00 |
|
Cyberes
|
b2b6cdabaa
|
still working on dockerfile
|
2023-09-06 12:01:32 -06:00 |
|
Cyberes
|
cc1db8a0ba
|
more docker stuff
|
2023-09-04 20:15:45 -06:00 |
|
Cyberes
|
a98d7edeb7
|
add docker file
|
2023-08-31 15:59:45 -06:00 |
|
Cyberes
|
33190e3cfe
|
fix stats for real
|
2023-08-23 01:14:19 -06:00 |
|
Cyberes
|
cb2ba1455d
|
add systemctl service
|
2023-08-21 23:25:53 -06:00 |