Commit Graph

267 Commits

Author SHA1 Message Date
nai-degen b24894d98f fixes origin block response to account for clients sending bad headers 2023-05-22 20:29:49 -05:00
nai-degen 26a6e4cadb increases wait time calculation window 2023-05-22 19:33:03 -05:00
nai-degen a61fa04fbf Implements origin/referrer block (khanon/oai-reverse-proxy!13) 2023-05-22 21:08:20 +00:00
yukianon a3620db591 Implement Test Generation for Trial Keys (khanon/oai-reverse-proxy!12) 2023-05-20 19:10:21 +00:00
nai-degen fe305bee98 shows more detailed build info 2023-05-19 20:53:13 -05:00
nai-degen 5be848d0d1 removes Render queue note as Tavern bug is now fixed 2023-05-19 09:34:56 -05:00
nai-degen 2bad644772 Prefer user tokens as rate-limit/queue keys when available (khanon/oai-reverse-proxy!10) 2023-05-19 04:33:20 +00:00
nai-degen dfd8f0cc97 fixes missing closing bracket in infopage html 2023-05-16 15:42:49 -05:00
nai-degen 27caf1ff06 adds temporary disclaimer about streaming issues on Render 2023-05-16 01:19:13 -05:00
nai-degen 1f113b9150 updates render docs 2023-05-15 17:05:12 -05:00
nai-degen b4d8ebca4e adds noindex tag to infopage 2023-05-15 17:05:04 -05:00
nai-degen ec4e7a3671 Add docs and support for Render.com deployments (khanon/oai-reverse-proxy!9) 2023-05-15 21:47:30 +00:00
nai-degen 7f202dc9ef cleans up configs shown on info page 2023-05-14 15:45:30 -05:00
nai-degen 3f46d132f7 disables per-user IP limit by default 2023-05-14 14:46:14 -05:00
nai-degen 9ff7381f31 exempts 'special' user role from auto-ban 2023-05-14 14:37:50 -05:00
nai-degen 6eb121ac66 disables keys shared between too many IP addresses 2023-05-14 14:30:32 -05:00
nai-degen 285186d70e fixes keys being lost if not used at least once 2023-05-14 13:32:41 -05:00
nai-degen f1ac64fa12 Implement user persistence via Firebase (khanon/oai-reverse-proxy!8) 2023-05-14 04:26:08 +00:00
nai-degen 7126fb6c6c adds unhandled promise rejection listener just in case 2023-05-13 13:37:42 -05:00
nai-degen a7514e594d displays wait times more prominently on infopage 2023-05-13 13:33:05 -05:00
nai-degen 546b28cca6 increases wait time calc window to 90sec 2023-05-13 13:32:37 -05:00
nai-degen 977247d7a2 User authentication (khanon/oai-reverse-proxy!7) 2023-05-13 00:58:15 +00:00
nai-degen 5238aff378 reverts default quotaDisplay to partial; removes rejectSampleRate 2023-05-11 20:35:28 -05:00
nai-degen 7382bdc92e cleans up ratelimit table more frequently to smooth proompters display 2023-05-11 11:50:44 -05:00
nai-degen 09184079af reduces wait time window from 2min to 1min 2023-05-11 11:45:15 -05:00
nai-degen 8ff43aef1a disables kobold endpoint when queueing is enabled 2023-05-10 11:44:03 -05:00
nai-degen e03f3d48dd Implements request queueing (khanon/oai-reverse-proxy!6) 2023-05-09 23:11:57 +00:00
nai-degen e9e9f1f8b6 corrects openai incorrectly referred to as 'downstream' 2023-05-06 10:07:09 -05:00
nai-degen e541a7b892 forgot string.replace doesn't actually mutate the string 2023-05-06 09:55:59 -05:00
nai-degen 119c2f827a fixes org-ID redaction on errors which don't include one 2023-05-06 09:51:18 -05:00
gronon e0529197cd Prevent leaking OpenAI organization-ids in error responses (khanon/oai-reverse-proxy!5) 2023-05-06 12:22:05 +00:00
nai-degen 432023f875 cycles out keys which have been disabled 2023-05-05 09:50:43 -05:00
nai-degen 77bcbc7954 fixes bad pino redaction syntax 2023-05-04 16:43:26 -05:00
nai-degen 4dc9c649d8 fixes server blowing up when a streaming request drops out 2023-05-04 16:37:16 -05:00
nai-degen be1e672e68 prevents revealing x-forwarded-for ip addresses in HTTP logs 2023-05-04 16:31:40 -05:00
nai-degen 1fc0138e65 prevents revealing api keys in logs during startup crash 2023-05-04 16:29:36 -05:00
nai-degen 94720b51e7 fixes post-startup checks 2023-05-01 18:35:35 -05:00
nai-degen 40eac590af checks multiple keys at once during startup 2023-05-01 18:31:04 -05:00
nai-degen b1a331bde0 reduces keychecker delay, really not necessary to wait so long in between each key 2023-05-01 18:16:12 -05:00
nai-degen 176a37928d Implement support for streamed OpenAI responses (khanon/oai-reverse-proxy!4) 2023-05-01 22:01:47 +00:00
nai-degen 2b783e0f2b improves model_not_found error message 2023-04-30 22:01:45 -07:00
nai-degen 16b5ccb977 disables key downgrade feature to prevent abuse 2023-04-30 21:30:42 -07:00
nai-degen 1d69078514 displays huggingface metadata on infopage if present 2023-04-17 14:19:58 -07:00
nai-degen 9afa4570ec adds repo link to prompt logging notice 2023-04-15 01:11:00 -07:00
nai-degen e4495798ee omits undefined values from listConfig 2023-04-15 00:44:52 -07:00
nai-degen 5c885eaa1a removes duplicate keys which cause keychecker to get stuck 2023-04-14 21:13:24 -07:00
nai-degen 673f6f6185 actually fixes prompt logger path detection 2023-04-14 20:54:55 -07:00
nai-degen 717788b9b0 fixes key checker getting stuck in infinte loop 2023-04-14 20:51:05 -07:00
nai-degen 5e046b9060 fixes bug introduced in previous commit which prevented logging 2023-04-14 20:19:26 -07:00
nai-degen 34ed165a6f fixes issue with attempting to log non-completion endpoints 2023-04-14 20:10:14 -07:00