Commit Graph

150 Commits

Author SHA1 Message Date
nai-degen 602931bf7f removes origin/referer headers from proxied request 2023-06-23 00:08:09 -05:00
nai-degen db034a51b3 prevents crash on startup when git is not installed 2023-06-21 01:24:41 -05:00
khanon 43359779e7 Implements more robust anti-zoomer functionality (khanon/oai-reverse-proxy!24) 2023-06-14 04:05:51 +00:00
nai-degen c0ac69df27 adjusts default origin block 2023-06-13 21:18:31 -05:00
nai-degen 3a2a6e96fd adds new OpenAI June 2023 models 2023-06-13 16:24:34 -05:00
khanon 96cf4a0e2d Automatically add Anthropic "\n\nHuman:" preamble when necessary (khanon/oai-reverse-proxy!23) 2023-06-09 07:16:40 +00:00
khanon 4f2a12ef14 Show per-model queues and keys on info page (khanon/oai-reverse-proxy!22) 2023-06-08 18:50:04 +00:00
khanon 120040c028 Separate `MAX_OUTPUT_TOKENS` config for OpenAI/Claude (khanon/oai-reverse-proxy!21) 2023-06-08 00:58:57 +00:00
nai-degen a6a0c21f7d makes gatekeeper compatible with sillytavern claude impl 2023-06-06 20:53:50 -05:00
nai-degen ace32c7e6e fix for huggingface not sending x-forwarded-host anymore 2023-06-06 20:47:45 -05:00
khanon 7b5e612921 Workaround for Anthropic requiring some prompts to start with `Human:` (khanon/oai-reverse-proxy!20) 2023-06-05 21:55:59 +00:00
khanon cd754bd601 Allow overriding default Claude model selection (khanon/oai-reverse-proxy!19) 2023-06-05 03:12:34 +00:00
nai-degen e6a8c548c2 reduces max log batch size to account for claude 100k prompts 2023-06-04 12:42:12 -05:00
nai-degen 176eef34db makes log queue backoff on errors rather than stop 2023-06-04 12:40:57 -05:00
nai-degen 38ff0e3f3b fixes prompt logging for streamed Claude requests 2023-06-04 12:16:29 -05:00
khanon dae1262f7a Refactor request middleware (khanon/oai-reverse-proxy!18) 2023-06-02 04:03:16 +00:00
nai-degen a26979f7bc returns static model list instead of proxying 2023-06-01 20:17:09 -05:00
nai-degen a6c6e4c694 allows KeyPool.available to be scoped per-service 2023-06-01 08:31:41 -05:00
nai-degen b7fa65d9f9 fixes dumb /v1/models bug affecting sillytavern again 2023-05-31 13:53:24 -05:00
nai-degen f621031ec1 fixes circluar dependency that broke tsc but not esbuild 2023-05-30 04:01:03 -05:00
khanon 6723cbf662 Anthropic endpoint improvements (khanon/oai-reverse-proxy!16) 2023-05-30 03:13:17 +00:00
nai-degen 2c8c81e6dd notes kobold endpoint as being deprecated 2023-05-29 19:43:43 -05:00
nai-degen 30bdc7cd5e shitty quick fix for tavern+openai not working properly 2023-05-29 13:23:38 -05:00
nai-degen f102f02a65 adds stop sequences for better UJB/group chat behavior on claude 2023-05-29 13:07:15 -05:00
nai-degen 304893e13d uses claude v1.2 instead of v1.1 2023-05-29 12:39:45 -05:00
nai-degen dc43183353 adds anthropic endpoint to info page 2023-05-29 12:21:39 -05:00
nai-degen d7ddbeea54 shortens backoff on claude rate limit 2023-05-29 12:16:46 -05:00
khanon 2d93463247 Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15) 2023-05-29 17:08:08 +00:00
nai-degen 03aaa6daad wraps SSE error responses in code block backticks 2023-05-23 12:28:06 -05:00
nai-degen 13b6a3d7b8 adds header to improve nginx compatibility 2023-05-23 11:57:14 -05:00
nai-degen 03616f4bbc increases wait time estimation window to 5min 2023-05-23 11:26:40 -05:00
nai-degen 01eee61e8b checks the request content-type instead... 2023-05-22 21:14:58 -05:00
nai-degen e3603a60e9 follow-up to Accept header adjustment 2023-05-22 21:02:11 -05:00
nai-degen b24894d98f fixes origin block response to account for clients sending bad headers 2023-05-22 20:29:49 -05:00
nai-degen 26a6e4cadb increases wait time calculation window 2023-05-22 19:33:03 -05:00
nai-degen a61fa04fbf Implements origin/referrer block (khanon/oai-reverse-proxy!13) 2023-05-22 21:08:20 +00:00
yukianon a3620db591 Implement Test Generation for Trial Keys (khanon/oai-reverse-proxy!12) 2023-05-20 19:10:21 +00:00
nai-degen fe305bee98 shows more detailed build info 2023-05-19 20:53:13 -05:00
nai-degen 5be848d0d1 removes Render queue note as Tavern bug is now fixed 2023-05-19 09:34:56 -05:00
nai-degen 2bad644772 Prefer user tokens as rate-limit/queue keys when available (khanon/oai-reverse-proxy!10) 2023-05-19 04:33:20 +00:00
nai-degen dfd8f0cc97 fixes missing closing bracket in infopage html 2023-05-16 15:42:49 -05:00
nai-degen 27caf1ff06 adds temporary disclaimer about streaming issues on Render 2023-05-16 01:19:13 -05:00
nai-degen 1f113b9150 updates render docs 2023-05-15 17:05:12 -05:00
nai-degen b4d8ebca4e adds noindex tag to infopage 2023-05-15 17:05:04 -05:00
nai-degen ec4e7a3671 Add docs and support for Render.com deployments (khanon/oai-reverse-proxy!9) 2023-05-15 21:47:30 +00:00
nai-degen 7f202dc9ef cleans up configs shown on info page 2023-05-14 15:45:30 -05:00
nai-degen 3f46d132f7 disables per-user IP limit by default 2023-05-14 14:46:14 -05:00
nai-degen 9ff7381f31 exempts 'special' user role from auto-ban 2023-05-14 14:37:50 -05:00
nai-degen 6eb121ac66 disables keys shared between too many IP addresses 2023-05-14 14:30:32 -05:00
nai-degen 285186d70e fixes keys being lost if not used at least once 2023-05-14 13:32:41 -05:00