Commit Graph

212 Commits

Author SHA1 Message Date
nai-degen 2c0a659b2d adds token consumption stats to infopage 2023-08-30 20:40:40 -05:00
nai-degen bed275a195 partial refactor/optimization of infopage 2023-08-30 19:25:17 -05:00
nai-degen 7cab0a5c52 fixes tsc issue breaking build 2023-08-30 14:31:47 -05:00
nai-degen 27a1181752 adds optional token quota limits for gpt4-32k 2023-08-30 13:57:10 -05:00
nai-degen 85aeeb2c05 adds unique openaiOrgs to infopage 2023-08-30 12:42:28 -05:00
nai-degen 8d557c844e adds a bunch more logging to keychecker 2023-08-30 12:30:41 -05:00
nai-degen 0a52ec478f maybe fixes keychecker bricking on disabled org keys 2023-08-30 12:30:16 -05:00
nai-degen e462ad585e improves keychecker stability with rate-limited trial keys 2023-08-30 08:33:00 -05:00
khanon 4d781e1720 Add GPT-4-32k support (khanon/oai-reverse-proxy!39) 2023-08-29 22:56:54 +00:00
nai-degen 3c56103de0 adds optional user_token nicknames 2023-08-29 14:20:28 -05:00
nai-degen bb78a399eb fixes organization key issue (via Drago/oai-reverse-proxy@714292ed) 2023-08-29 04:13:12 -05:00
nai-degen 09416c0b90 automatically rechecks keys on the 1st of every month 2023-08-29 04:08:50 -05:00
nai-degen abb30d3608 admin ui improvements; adds Force Recheck feature 2023-08-29 04:08:45 -05:00
khanon 6833736392 Clone keys assigned to multiple organizations (khanon/oai-reverse-proxy!38) 2023-08-28 21:11:49 +00:00
nai-degen 7c9c3a640c minor cleanup for user quota docs/examples 2023-08-28 14:51:28 -05:00
khanon cb780e85da Per-user token quotas and automatic quota refreshing (khanon/oai-reverse-proxy!37) 2023-08-28 19:33:14 +00:00
nai-degen 785b1f69f3 implements new local risu validation (via @kwaroran) 2023-08-28 05:28:58 -05:00
nai-degen c05bfefba4 fixes incorrectly applied doubleCsrf to REST routes 2023-08-10 15:54:01 -05:00
nai-degen 9b184ab245 removes QUOTA_DISPLAY_MODE config as OpenAI no longer supports it 2023-08-09 18:29:38 -05:00
nai-degen 6bb67281d9 removes QUEUE_MODE config (now always enabled) 2023-08-09 18:29:34 -05:00
nai-degen 5d3fb6af3a removes IP redaction from pino 2023-08-09 18:29:29 -05:00
khanon 268165e2be Add CSRF protection to server-rendered views (khanon/oai-reverse-proxy!34) 2023-08-09 23:11:26 +00:00
nai-degen 6f4e581bf2 fixes forgotten http=true on admin cookie 2023-08-09 11:01:30 -05:00
nai-degen 358339d48b fixes issue with Claude <EOT> token disallowed 2023-08-08 17:43:12 -05:00
nai-degen c8d8e2e58f avoids instantiating new Claude tiktoken on every call 2023-08-08 17:38:03 -05:00
nai-degen d1d83b41fa uses accurate Claude tokenization 2023-08-08 17:29:36 -05:00
nai-degen 81ceee7897 adds pagination info below user table 2023-08-05 23:49:14 -05:00
nai-degen dc32e41ab5 updates user management docs 2023-08-05 23:48:33 -05:00
nai-degen 21ee00f057 fixes issue with IP count sorting 2023-08-05 23:26:15 -05:00
nai-degen 97a2b6b479 fixes build issue with missing EJS templates 2023-08-05 23:01:58 -05:00
nai-degen 61d90f3f3a fixes admin ui sort during pagination 2023-08-05 21:16:44 -05:00
khanon bb230469b2 Admin user management UI (khanon/oai-reverse-proxy!32) 2023-08-06 00:58:33 +00:00
nai-degen 125bbe6441 fixes issue with writeErrorResponse 2023-08-04 13:49:11 -05:00
nai-degen d29c304d5a increases tokenizer failsafe to 500000 characters 2023-07-27 15:21:06 -05:00
nai-degen addfa7c57b restores trial key detection via workaround 2023-07-24 14:07:02 -05:00
nai-degen e5b4c7bc9e removes key limit/trial status from infopage 2023-07-24 13:14:44 -05:00
nai-degen 51503dec14 disables key checker, mostly 2023-07-24 13:11:45 -05:00
nai-degen 00346360af fixes turbo-16k incompatibility 2023-07-23 20:13:38 -05:00
nai-degen e2bd8a6b86 extracts Risu auth into new middleware so queue can use it too 2023-07-22 13:48:02 -05:00
nai-degen b8534dafae reduces default MAX_OUTPUT_TOKENS_ANTHROPIC 2023-07-21 19:18:21 -05:00
khanon 56a4902599 Add tokenizers and configurable context size limits (khanon/oai-reverse-proxy!28) 2023-07-22 00:11:32 +00:00
khanon 7634afeea4 Implement rate limit for risuai.xyz (khanon/oai-reverse-proxy!31) 2023-07-21 21:48:07 +00:00
nai-degen 77c2309b52 correctly flags trial keys during startup even if over quota 2023-07-20 23:06:37 -05:00
khanon aa5380d2ef Rework OpenAIKeyChecker to remove usage tracking and test all keys for liveness (khanon/oai-reverse-proxy!29) 2023-07-21 04:00:12 +00:00
nai-degen cbf9f16108 removes clamp on quota display to better show glitched keys 2023-07-19 23:34:09 -05:00
breathingmanually 576423d1f8 Fix JSON parse exception when Claude finishes streaming (khanon/oai-reverse-proxy!25) 2023-07-20 01:57:50 +00:00
nai-degen c31540e54e bumps deps to address npm audit advisories 2023-07-19 11:52:58 -05:00
Xrystallized 120b7da340 Include non /v1 url in check (khanon/oai-reverse-proxy!27) 2023-07-19 16:00:29 +00:00
nai-degen d7a4829d13 handles keys which have been banned (but not revoked) by openai 2023-07-19 10:28:38 -05:00
nai-degen c749e2d57d adjusts claude rate limit handling to retry more aggressively 2023-07-19 01:58:44 -05:00