Commit Graph

133 Commits

Author SHA1 Message Date
nai-degen a6c6e4c694 allows KeyPool.available to be scoped per-service 2023-06-01 08:31:41 -05:00
nai-degen b7fa65d9f9 fixes dumb /v1/models bug affecting sillytavern again 2023-05-31 13:53:24 -05:00
nai-degen f621031ec1 fixes circluar dependency that broke tsc but not esbuild 2023-05-30 04:01:03 -05:00
khanon 6723cbf662 Anthropic endpoint improvements (khanon/oai-reverse-proxy!16) 2023-05-30 03:13:17 +00:00
nai-degen 2c8c81e6dd notes kobold endpoint as being deprecated 2023-05-29 19:43:43 -05:00
nai-degen 30bdc7cd5e shitty quick fix for tavern+openai not working properly 2023-05-29 13:23:38 -05:00
nai-degen f102f02a65 adds stop sequences for better UJB/group chat behavior on claude 2023-05-29 13:07:15 -05:00
nai-degen 304893e13d uses claude v1.2 instead of v1.1 2023-05-29 12:39:45 -05:00
nai-degen dc43183353 adds anthropic endpoint to info page 2023-05-29 12:21:39 -05:00
nai-degen d7ddbeea54 shortens backoff on claude rate limit 2023-05-29 12:16:46 -05:00
khanon 2d93463247 Implement support for Anthropic keys and Claude API (khanon/oai-reverse-proxy!15) 2023-05-29 17:08:08 +00:00
nai-degen 03aaa6daad wraps SSE error responses in code block backticks 2023-05-23 12:28:06 -05:00
nai-degen 13b6a3d7b8 adds header to improve nginx compatibility 2023-05-23 11:57:14 -05:00
nai-degen 03616f4bbc increases wait time estimation window to 5min 2023-05-23 11:26:40 -05:00
nai-degen 01eee61e8b checks the request content-type instead... 2023-05-22 21:14:58 -05:00
nai-degen e3603a60e9 follow-up to Accept header adjustment 2023-05-22 21:02:11 -05:00
nai-degen b24894d98f fixes origin block response to account for clients sending bad headers 2023-05-22 20:29:49 -05:00
nai-degen 26a6e4cadb increases wait time calculation window 2023-05-22 19:33:03 -05:00
nai-degen a61fa04fbf Implements origin/referrer block (khanon/oai-reverse-proxy!13) 2023-05-22 21:08:20 +00:00
yukianon a3620db591 Implement Test Generation for Trial Keys (khanon/oai-reverse-proxy!12) 2023-05-20 19:10:21 +00:00
nai-degen fe305bee98 shows more detailed build info 2023-05-19 20:53:13 -05:00
nai-degen 5be848d0d1 removes Render queue note as Tavern bug is now fixed 2023-05-19 09:34:56 -05:00
nai-degen 2bad644772 Prefer user tokens as rate-limit/queue keys when available (khanon/oai-reverse-proxy!10) 2023-05-19 04:33:20 +00:00
nai-degen dfd8f0cc97 fixes missing closing bracket in infopage html 2023-05-16 15:42:49 -05:00
nai-degen 27caf1ff06 adds temporary disclaimer about streaming issues on Render 2023-05-16 01:19:13 -05:00
nai-degen 1f113b9150 updates render docs 2023-05-15 17:05:12 -05:00
nai-degen b4d8ebca4e adds noindex tag to infopage 2023-05-15 17:05:04 -05:00
nai-degen ec4e7a3671 Add docs and support for Render.com deployments (khanon/oai-reverse-proxy!9) 2023-05-15 21:47:30 +00:00
nai-degen 7f202dc9ef cleans up configs shown on info page 2023-05-14 15:45:30 -05:00
nai-degen 3f46d132f7 disables per-user IP limit by default 2023-05-14 14:46:14 -05:00
nai-degen 9ff7381f31 exempts 'special' user role from auto-ban 2023-05-14 14:37:50 -05:00
nai-degen 6eb121ac66 disables keys shared between too many IP addresses 2023-05-14 14:30:32 -05:00
nai-degen 285186d70e fixes keys being lost if not used at least once 2023-05-14 13:32:41 -05:00
nai-degen f1ac64fa12 Implement user persistence via Firebase (khanon/oai-reverse-proxy!8) 2023-05-14 04:26:08 +00:00
nai-degen 7126fb6c6c adds unhandled promise rejection listener just in case 2023-05-13 13:37:42 -05:00
nai-degen a7514e594d displays wait times more prominently on infopage 2023-05-13 13:33:05 -05:00
nai-degen 546b28cca6 increases wait time calc window to 90sec 2023-05-13 13:32:37 -05:00
nai-degen 977247d7a2 User authentication (khanon/oai-reverse-proxy!7) 2023-05-13 00:58:15 +00:00
nai-degen 5238aff378 reverts default quotaDisplay to partial; removes rejectSampleRate 2023-05-11 20:35:28 -05:00
nai-degen 7382bdc92e cleans up ratelimit table more frequently to smooth proompters display 2023-05-11 11:50:44 -05:00
nai-degen 09184079af reduces wait time window from 2min to 1min 2023-05-11 11:45:15 -05:00
nai-degen 8ff43aef1a disables kobold endpoint when queueing is enabled 2023-05-10 11:44:03 -05:00
nai-degen e03f3d48dd Implements request queueing (khanon/oai-reverse-proxy!6) 2023-05-09 23:11:57 +00:00
nai-degen e9e9f1f8b6 corrects openai incorrectly referred to as 'downstream' 2023-05-06 10:07:09 -05:00
nai-degen e541a7b892 forgot string.replace doesn't actually mutate the string 2023-05-06 09:55:59 -05:00
nai-degen 119c2f827a fixes org-ID redaction on errors which don't include one 2023-05-06 09:51:18 -05:00
gronon e0529197cd Prevent leaking OpenAI organization-ids in error responses (khanon/oai-reverse-proxy!5) 2023-05-06 12:22:05 +00:00
nai-degen 432023f875 cycles out keys which have been disabled 2023-05-05 09:50:43 -05:00
nai-degen 77bcbc7954 fixes bad pino redaction syntax 2023-05-04 16:43:26 -05:00
nai-degen 4dc9c649d8 fixes server blowing up when a streaming request drops out 2023-05-04 16:37:16 -05:00