khanon
|
aa5380d2ef
|
Rework OpenAIKeyChecker to remove usage tracking and test all keys for liveness (khanon/oai-reverse-proxy!29)
|
2023-07-21 04:00:12 +00:00 |
nai-degen
|
cbf9f16108
|
removes clamp on quota display to better show glitched keys
|
2023-07-19 23:34:09 -05:00 |
breathingmanually
|
576423d1f8
|
Fix JSON parse exception when Claude finishes streaming (khanon/oai-reverse-proxy!25)
|
2023-07-20 01:57:50 +00:00 |
nai-degen
|
c31540e54e
|
bumps deps to address npm audit advisories
|
2023-07-19 11:52:58 -05:00 |
Xrystallized
|
120b7da340
|
Include non /v1 url in check (khanon/oai-reverse-proxy!27)
|
2023-07-19 16:00:29 +00:00 |
nai-degen
|
d7a4829d13
|
handles keys which have been banned (but not revoked) by openai
|
2023-07-19 10:28:38 -05:00 |
nai-degen
|
c749e2d57d
|
adjusts claude rate limit handling to retry more aggressively
|
2023-07-19 01:58:44 -05:00 |
nai-degen
|
efa1b03570
|
uses claude-v1 by default as anthropic seems to be turning off v1.2
|
2023-07-19 01:48:57 -05:00 |
goanon016
|
f6f13f7955
|
Fix cell size error in sheets (khanon/oai-reverse-proxy!26)
|
2023-07-16 08:35:42 +00:00 |
khanon
|
7478112077
|
fixes embarrassing auth oversight
|
2023-07-16 07:31:44 +00:00 |
nai-degen
|
aee382c84e
|
adds claude-2 to supported models
|
2023-07-11 09:14:46 -05:00 |
nai-degen
|
32605fff53
|
fixes infopage regression when CHECK_KEYS=false
|
2023-07-08 15:29:43 -05:00 |
nai-degen
|
71882b18ae
|
adds feature to prevent GPT-4 model selection (default off)
|
2023-07-06 16:09:30 -05:00 |
nai-degen
|
561c063d90
|
assumes keys are GPT-4 by default since it's now GA
|
2023-07-06 15:07:01 -05:00 |
nai-degen
|
2a7efc8d42
|
cleans up minor
pm audit items
|
2023-07-06 07:26:52 -05:00 |
nai-degen
|
327e860967
|
fixes wrong/misleading error msg when no Turbo keys available
|
2023-07-04 11:49:12 -05:00 |
nai-degen
|
6598b4df0d
|
requests old version of Anthropic API due to breaking SSE changes
|
2023-06-24 14:50:48 -05:00 |
nai-degen
|
6a7f64b037
|
adds missed change from origin header adjustment
|
2023-06-24 14:25:30 -05:00 |
nai-degen
|
c8b3238398
|
reorganizes origin header middleware
|
2023-06-24 14:25:01 -05:00 |
nai-degen
|
602931bf7f
|
removes origin/referer headers from proxied request
|
2023-06-23 00:08:09 -05:00 |
nai-degen
|
db034a51b3
|
prevents crash on startup when git is not installed
|
2023-06-21 01:24:41 -05:00 |
khanon
|
43359779e7
|
Implements more robust anti-zoomer functionality (khanon/oai-reverse-proxy!24)
|
2023-06-14 04:05:51 +00:00 |
nai-degen
|
c0ac69df27
|
adjusts default origin block
|
2023-06-13 21:18:31 -05:00 |
nai-degen
|
3a2a6e96fd
|
adds new OpenAI June 2023 models
|
2023-06-13 16:24:34 -05:00 |
khanon
|
96cf4a0e2d
|
Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23)
|
2023-06-09 07:16:40 +00:00 |
khanon
|
4f2a12ef14
|
Show per-model queues and keys on info page (khanon/oai-reverse-proxy!22)
|
2023-06-08 18:50:04 +00:00 |
khanon
|
120040c028
|
Separate `MAX_OUTPUT_TOKENS` config for OpenAI/Claude (khanon/oai-reverse-proxy!21)
|
2023-06-08 00:58:57 +00:00 |
nai-degen
|
a6a0c21f7d
|
makes gatekeeper compatible with sillytavern claude impl
|
2023-06-06 20:53:50 -05:00 |
nai-degen
|
ace32c7e6e
|
fix for huggingface not sending x-forwarded-host anymore
|
2023-06-06 20:47:45 -05:00 |
khanon
|
7b5e612921
|
Workaround for Anthropic requiring some prompts to start with `Human:` (khanon/oai-reverse-proxy!20)
|
2023-06-05 21:55:59 +00:00 |
khanon
|
cd754bd601
|
Allow overriding default Claude model selection (khanon/oai-reverse-proxy!19)
|
2023-06-05 03:12:34 +00:00 |
nai-degen
|
e6a8c548c2
|
reduces max log batch size to account for claude 100k prompts
|
2023-06-04 12:42:12 -05:00 |
nai-degen
|
176eef34db
|
makes log queue backoff on errors rather than stop
|
2023-06-04 12:40:57 -05:00 |
nai-degen
|
38ff0e3f3b
|
fixes prompt logging for streamed Claude requests
|
2023-06-04 12:16:29 -05:00 |
khanon
|
dae1262f7a
|
Refactor request middleware (khanon/oai-reverse-proxy!18)
|
2023-06-02 04:03:16 +00:00 |
nai-degen
|
a26979f7bc
|
returns static model list instead of proxying
|
2023-06-01 20:17:09 -05:00 |
nai-degen
|
a6c6e4c694
|
allows KeyPool.available to be scoped per-service
|
2023-06-01 08:31:41 -05:00 |
nai-degen
|
b7fa65d9f9
|
fixes dumb /v1/models bug affecting sillytavern again
|
2023-05-31 13:53:24 -05:00 |
nai-degen
|
f621031ec1
|
fixes circluar dependency that broke tsc but not esbuild
|
2023-05-30 04:01:03 -05:00 |
khanon
|
6723cbf662
|
Anthropic endpoint improvements (khanon/oai-reverse-proxy!16)
|
2023-05-30 03:13:17 +00:00 |
nai-degen
|
2c8c81e6dd
|
notes kobold endpoint as being deprecated
|
2023-05-29 19:43:43 -05:00 |
nai-degen
|
30bdc7cd5e
|
shitty quick fix for tavern+openai not working properly
|
2023-05-29 13:23:38 -05:00 |
nai-degen
|
f102f02a65
|
adds stop sequences for better UJB/group chat behavior on claude
|
2023-05-29 13:07:15 -05:00 |
nai-degen
|
304893e13d
|
uses claude v1.2 instead of v1.1
|
2023-05-29 12:39:45 -05:00 |
nai-degen
|
dc43183353
|
adds anthropic endpoint to info page
|
2023-05-29 12:21:39 -05:00 |
nai-degen
|
d7ddbeea54
|
shortens backoff on claude rate limit
|
2023-05-29 12:16:46 -05:00 |
khanon
|
2d93463247
|
Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15)
|
2023-05-29 17:08:08 +00:00 |
nai-degen
|
03aaa6daad
|
wraps SSE error responses in code block backticks
|
2023-05-23 12:28:06 -05:00 |
nai-degen
|
13b6a3d7b8
|
adds header to improve nginx compatibility
|
2023-05-23 11:57:14 -05:00 |
nai-degen
|
03616f4bbc
|
increases wait time estimation window to 5min
|
2023-05-23 11:26:40 -05:00 |