Commit Graph

93 Commits

Author SHA1 Message Date
nai-degen 09184079af reduces wait time window from 2min to 1min 2023-05-11 11:45:15 -05:00
nai-degen 8ff43aef1a disables kobold endpoint when queueing is enabled 2023-05-10 11:44:03 -05:00
nai-degen e03f3d48dd Implements request queueing (khanon/oai-reverse-proxy!6) 2023-05-09 23:11:57 +00:00
nai-degen e9e9f1f8b6 corrects openai incorrectly referred to as 'downstream' 2023-05-06 10:07:09 -05:00
nai-degen e541a7b892 forgot string.replace doesn't actually mutate the string 2023-05-06 09:55:59 -05:00
nai-degen 119c2f827a fixes org-ID redaction on errors which don't include one 2023-05-06 09:51:18 -05:00
gronon e0529197cd Prevent leaking OpenAI organization-ids in error responses (khanon/oai-reverse-proxy!5) 2023-05-06 12:22:05 +00:00
nai-degen 432023f875 cycles out keys which have been disabled 2023-05-05 09:50:43 -05:00
nai-degen 77bcbc7954 fixes bad pino redaction syntax 2023-05-04 16:43:26 -05:00
nai-degen 4dc9c649d8 fixes server blowing up when a streaming request drops out 2023-05-04 16:37:16 -05:00
nai-degen be1e672e68 prevents revealing x-forwarded-for ip addresses in HTTP logs 2023-05-04 16:31:40 -05:00
nai-degen 1fc0138e65 prevents revealing api keys in logs during startup crash 2023-05-04 16:29:36 -05:00
nai-degen 94720b51e7 fixes post-startup checks 2023-05-01 18:35:35 -05:00
nai-degen 40eac590af checks multiple keys at once during startup 2023-05-01 18:31:04 -05:00
nai-degen b1a331bde0 reduces keychecker delay, really not necessary to wait so long in between each key 2023-05-01 18:16:12 -05:00
nai-degen 176a37928d Implement support for streamed OpenAI responses (khanon/oai-reverse-proxy!4) 2023-05-01 22:01:47 +00:00
nai-degen 2b783e0f2b improves model_not_found error message 2023-04-30 22:01:45 -07:00
nai-degen 16b5ccb977 disables key downgrade feature to prevent abuse 2023-04-30 21:30:42 -07:00
nai-degen 1d69078514 displays huggingface metadata on infopage if present 2023-04-17 14:19:58 -07:00
nai-degen 9afa4570ec adds repo link to prompt logging notice 2023-04-15 01:11:00 -07:00
nai-degen e4495798ee omits undefined values from listConfig 2023-04-15 00:44:52 -07:00
nai-degen 5c885eaa1a removes duplicate keys which cause keychecker to get stuck 2023-04-14 21:13:24 -07:00
nai-degen 673f6f6185 actually fixes prompt logger path detection 2023-04-14 20:54:55 -07:00
nai-degen 717788b9b0 fixes key checker getting stuck in infinte loop 2023-04-14 20:51:05 -07:00
nai-degen 5e046b9060 fixes bug introduced in previous commit which prevented logging 2023-04-14 20:19:26 -07:00
nai-degen 34ed165a6f fixes issue with attempting to log non-completion endpoints 2023-04-14 20:10:14 -07:00
nai-degen 0f60fa9407 updates logging README to warn about Google retardation 2023-04-14 19:09:41 -07:00
nai-degen fc3043dad0 Implements prompt logging via Google Sheets (khanon/oai-reverse-proxy!1) 2023-04-15 01:21:04 +00:00
nai-degen a767044850 Refactor onProxyRes handlers to use middleware stack (khanon/oai-reverse-proxy!2) 2023-04-14 15:29:11 +00:00
nai-degen 6cf529b405 updates huggingface docs with new repo url 2023-04-11 16:02:41 -07:00
nai-degen a98665f013 reverts disabling keys which have gone above hardlimit, just let the API do that 2023-04-11 12:10:58 -07:00
nai-degen bbcc76266f improves downstream API error handling 2023-04-11 05:01:35 -07:00
nai-degen a8340b0dd4 redacts bearer tokens from logs 2023-04-11 03:39:24 -07:00
nai-degen 65c5cfeef2 fixes quota checking not counting the current day 2023-04-11 03:28:50 -07:00
nai-degen 920612f1ce rewrites urls to deal with client idiosyncrasies 2023-04-11 03:20:19 -07:00
nai-degen 44f667976a simplifies infopage and updates README 2023-04-11 03:19:05 -07:00
nai-degen 15ed8e7c25 adds TODOs so I don't forget 2023-04-10 20:02:48 -07:00
nai-degen f3a13129f9 fixes dead keys being 'revived' by a queued check 2023-04-10 19:57:32 -07:00
nai-degen 885487a61d fixes kobold key selection, I think 2023-04-10 19:50:42 -07:00
nai-degen f37a2fa7fa temporarily disable gpt-4 for kobold as it is broken 2023-04-10 04:56:04 -07:00
nai-degen f0afc8c420 fixes kobold endpoint not actually being rate-limited 2023-04-10 06:42:12 -05:00
nai-degen 6b47c1cdc5 improves quota display 2023-04-10 04:16:14 -07:00
nai-degen 4200d8203d redacts cookies in logs; fix sha on infopage 2023-04-10 03:39:13 -07:00
nai-degen 2a4dfe2501 Merge branch 'main' of https://github.com/nai-degen/oai-reverse-proxy 2023-04-10 03:11:36 -07:00
nai-degen 1238ee77c9 adds SHA to infopage 2023-04-10 03:11:26 -07:00
nai-degen 75e004d2b1 tries to handle exhausted trials a bit better 2023-04-10 03:11:14 -07:00
nai-degen 111fb1a7c5 improves service info page 2023-04-10 04:44:38 -05:00
nai-degen de5833e1e5 unfucks quota checking for real this time 2023-04-10 02:42:56 -07:00
nai-degen ca7f57f493 improves key checker 2023-04-10 01:49:52 -07:00
nai-degen 91cba67650 fixes kobold content-encoding 2023-04-10 00:53:27 -07:00