Commit Graph

469 Commits

Author SHA1 Message Date
khanon aa5380d2ef Rework OpenAIKeyChecker to remove usage tracking and test all keys for liveness (khanon/oai-reverse-proxy!29) 2023-07-21 04:00:12 +00:00
nai-degen cbf9f16108 removes clamp on quota display to better show glitched keys 2023-07-19 23:34:09 -05:00
breathingmanually 576423d1f8 Fix JSON parse exception when Claude finishes streaming (khanon/oai-reverse-proxy!25) 2023-07-20 01:57:50 +00:00
nai-degen c31540e54e bumps deps to address npm audit advisories 2023-07-19 11:52:58 -05:00
Xrystallized 120b7da340 Include non /v1 url in check (khanon/oai-reverse-proxy!27) 2023-07-19 16:00:29 +00:00
nai-degen d7a4829d13 handles keys which have been banned (but not revoked) by openai 2023-07-19 10:28:38 -05:00
nai-degen c749e2d57d adjusts claude rate limit handling to retry more aggressively 2023-07-19 01:58:44 -05:00
nai-degen efa1b03570 uses claude-v1 by default as anthropic seems to be turning off v1.2 2023-07-19 01:48:57 -05:00
goanon016 f6f13f7955 Fix cell size error in sheets (khanon/oai-reverse-proxy!26) 2023-07-16 08:35:42 +00:00
khanon 7478112077 fixes embarrassing auth oversight 2023-07-16 07:31:44 +00:00
nai-degen aee382c84e adds claude-2 to supported models 2023-07-11 09:14:46 -05:00
nai-degen 32605fff53 fixes infopage regression when CHECK_KEYS=false 2023-07-08 15:29:43 -05:00
nai-degen 71882b18ae adds feature to prevent GPT-4 model selection (default off) 2023-07-06 16:09:30 -05:00
nai-degen 561c063d90 assumes keys are GPT-4 by default since it's now GA 2023-07-06 15:07:01 -05:00
nai-degen 2a7efc8d42 cleans up minor
pm audit items
2023-07-06 07:26:52 -05:00
nai-degen 327e860967 fixes wrong/misleading error msg when no Turbo keys available 2023-07-04 11:49:12 -05:00
nai-degen 6598b4df0d requests old version of Anthropic API due to breaking SSE changes 2023-06-24 14:50:48 -05:00
nai-degen 6a7f64b037 adds missed change from origin header adjustment 2023-06-24 14:25:30 -05:00
nai-degen c8b3238398 reorganizes origin header middleware 2023-06-24 14:25:01 -05:00
nai-degen 602931bf7f removes origin/referer headers from proxied request 2023-06-23 00:08:09 -05:00
nai-degen db034a51b3 prevents crash on startup when git is not installed 2023-06-21 01:24:41 -05:00
khanon 43359779e7 Implements more robust anti-zoomer functionality (khanon/oai-reverse-proxy!24) 2023-06-14 04:05:51 +00:00
nai-degen c0ac69df27 adjusts default origin block 2023-06-13 21:18:31 -05:00
nai-degen 3a2a6e96fd adds new OpenAI June 2023 models 2023-06-13 16:24:34 -05:00
khanon 96cf4a0e2d Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23) 2023-06-09 07:16:40 +00:00
khanon 4f2a12ef14 Show per-model queues and keys on info page (khanon/oai-reverse-proxy!22) 2023-06-08 18:50:04 +00:00
khanon 120040c028 Separate `MAX_OUTPUT_TOKENS` config for OpenAI/Claude (khanon/oai-reverse-proxy!21) 2023-06-08 00:58:57 +00:00
nai-degen a6a0c21f7d makes gatekeeper compatible with sillytavern claude impl 2023-06-06 20:53:50 -05:00
nai-degen ace32c7e6e fix for huggingface not sending x-forwarded-host anymore 2023-06-06 20:47:45 -05:00
khanon 7b5e612921 Workaround for Anthropic requiring some prompts to start with `Human:` (khanon/oai-reverse-proxy!20) 2023-06-05 21:55:59 +00:00
khanon cd754bd601 Allow overriding default Claude model selection (khanon/oai-reverse-proxy!19) 2023-06-05 03:12:34 +00:00
nai-degen e6a8c548c2 reduces max log batch size to account for claude 100k prompts 2023-06-04 12:42:12 -05:00
nai-degen 176eef34db makes log queue backoff on errors rather than stop 2023-06-04 12:40:57 -05:00
nai-degen 38ff0e3f3b fixes prompt logging for streamed Claude requests 2023-06-04 12:16:29 -05:00
khanon dae1262f7a Refactor request middleware (khanon/oai-reverse-proxy!18) 2023-06-02 04:03:16 +00:00
nai-degen a26979f7bc returns static model list instead of proxying 2023-06-01 20:17:09 -05:00
nai-degen a6c6e4c694 allows KeyPool.available to be scoped per-service 2023-06-01 08:31:41 -05:00
nai-degen b7fa65d9f9 fixes dumb /v1/models bug affecting sillytavern again 2023-05-31 13:53:24 -05:00
nai-degen f621031ec1 fixes circluar dependency that broke tsc but not esbuild 2023-05-30 04:01:03 -05:00
khanon 6723cbf662 Anthropic endpoint improvements (khanon/oai-reverse-proxy!16) 2023-05-30 03:13:17 +00:00
nai-degen 2c8c81e6dd notes kobold endpoint as being deprecated 2023-05-29 19:43:43 -05:00
nai-degen 30bdc7cd5e shitty quick fix for tavern+openai not working properly 2023-05-29 13:23:38 -05:00
nai-degen f102f02a65 adds stop sequences for better UJB/group chat behavior on claude 2023-05-29 13:07:15 -05:00
nai-degen 304893e13d uses claude v1.2 instead of v1.1 2023-05-29 12:39:45 -05:00
nai-degen dc43183353 adds anthropic endpoint to info page 2023-05-29 12:21:39 -05:00
nai-degen d7ddbeea54 shortens backoff on claude rate limit 2023-05-29 12:16:46 -05:00
khanon 2d93463247 Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15) 2023-05-29 17:08:08 +00:00
nai-degen 03aaa6daad wraps SSE error responses in code block backticks 2023-05-23 12:28:06 -05:00
nai-degen 13b6a3d7b8 adds header to improve nginx compatibility 2023-05-23 11:57:14 -05:00
nai-degen 03616f4bbc increases wait time estimation window to 5min 2023-05-23 11:26:40 -05:00