OlivierDehaene
|
895c5f1562
|
feat(server): only compute prefill logprobs when asked (#406)
Close #288
|
2023-06-02 17:12:30 +02:00 |
|
OlivierDehaene
|
951930fbff
|
feat(benchmarker): add summary tables (#368)
|
2023-05-25 13:38:36 +02:00 |
|
OlivierDehaene
|
218c9adaa5
|
feat: decrease IPC proto size (#367)
Closes #307 #308
|
2023-05-24 19:19:57 +02:00 |
|
OlivierDehaene
|
e250282213
|
feat(docker): add benchmarking tool to docker image (#298)
|
2023-05-09 13:19:31 +02:00 |
|
OlivierDehaene
|
0e9d249b79
|
feat(benchmark): add support for private tokenizers (#262)
|
2023-04-29 12:17:30 +02:00 |
|
OlivierDehaene
|
7de8a377b0
|
fix(benchmarking): fix benchmarking tool
|
2023-04-26 00:54:27 +02:00 |
|
OlivierDehaene
|
6ded76a4ae
|
v0.6.0 (#222)
|
2023-04-21 21:00:57 +02:00 |
|
OlivierDehaene
|
5fa8ae041c
|
feat(server): optimize decode for sane tokenizers (#170)
|
2023-04-12 12:03:10 +02:00 |
|
OlivierDehaene
|
9987960062
|
feat(router): make router input validation optional (#164)
|
2023-04-09 20:22:27 +02:00 |
|
OlivierDehaene
|
fef1a1c381
|
v0.4.3 (#152)
|
2023-03-30 17:28:14 +02:00 |
|
OlivierDehaene
|
84722f3e33
|
v0.4.2 (#151)
|
2023-03-30 17:10:01 +02:00 |
|
OlivierDehaene
|
610bb1f978
|
feat(benchmark): tui based benchmarking tool (#149)
|
2023-03-30 15:26:27 +02:00 |