Mirrors
/
oai-reverse-proxy
mirror of https://gitgud.io/khanon/oai-reverse-proxy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 9445110727 adds gpt-4-turbo stable main nai-degen 2024-04-09 16:31:42 -0500
  • 34a673a80a adds option to disable multimodal prompts nai-degen 2024-03-23 14:30:08 -0500
  • 8cb960e174 fixes incorrect model assignment when requesting Haiku from AWS nai-degen 2024-03-21 23:21:27 -0500
  • 32fea30c91 handles Anthropic keys which cannot support multimodal requests nai-degen 2024-03-20 00:03:10 -0500
  • 3f9fd25004 exempt 'special' token type from context size limits nai-degen 2024-03-19 11:14:51 -0500
  • e068edcf48 adds Anthropic key tier detection and trial key display nai-degen 2024-03-18 15:20:34 -0500
  • 2098948b7a reduces Anthropic keychecker frequency nai-degen 2024-03-18 15:19:41 -0500
  • 7705ee58a0 minor cleanup of error-generator.ts nai-degen 2024-03-18 15:18:18 -0500
  • 7c64d9209e minor refactoring of response middleware handlers nai-degen 2024-03-17 22:20:39 -0500
  • af74e3debb Merge branch 'count-streaming-tokens' into 'main' twinkletoes 2024-03-17 17:09:40 +0000
  • 59107af3d6 minor fixes for google sheets backend for anthropic-chat nai-degen 2024-03-17 12:08:11 -0500
  • 24a3487b3c Merge branch 'api-support-refactor' into 'main' khanon 2024-03-16 21:16:02 +0000
  • 435280fa04 fixes missing system prompt on AWS anthropic-chat schema nai-degen 2024-03-16 16:00:59 -0500
  • 84acc429d7 wip api-support-refactor nai-degen 2024-03-16 00:04:27 -0500
  • 834707339b Properly count tokens when streaming twinkletoes 2024-03-15 02:39:37 +0000
  • d9117bf08e fixes AWS debug log nai-degen 2024-03-14 21:34:07 -0500
  • 57d9791270 fixes uncounted tokens when Response stream is prematurely closed nai-degen 2024-03-14 21:32:20 -0500
  • 367ac3d075 adds ?debug=true query param to have proxy respond with transformed prompt nai-degen 2024-03-14 08:16:38 -0500
  • 276a1a1d44 small fix for recurring AWS logging check nai-degen 2024-03-13 20:53:21 -0500
  • 6cf029112e adds Anthropic's SOTA Haiku model; misc code cleanup nai-degen 2024-03-13 20:47:57 -0500
  • 4b86802eb2 adds separate model detection for gpt-4-32k-0314 nai-degen 2024-03-10 19:16:11 -0500
  • 7f431de98e sets cache-control on static user images nai-degen 2024-03-10 15:50:40 -0500
  • e0bf10626e removes .reverse() from image history to avoid thumbnails shifting as users browse nai-degen 2024-03-10 15:12:20 -0500
  • eb55f30414 adds input prompt to imagehistory nai-degen 2024-03-10 15:08:44 -0500
  • e1fb53b461 pretty-prints dall-e image metadata JSON download nai-degen 2024-03-10 15:04:44 -0500
  • 7610369c6d adds dall-e full history page and metadata downloader nai-degen 2024-03-10 14:53:11 -0500
  • 37f17ded60 removes OpenAI max_tokens default as that isn't aligned with the real API nai-degen 2024-03-10 12:32:15 -0500
  • 96b6ea9568 adds azure-image endpoint to service info; hides unavailable endpoints nai-degen 2024-03-09 13:25:50 -0600
  • cec39328a2 adds azure dall-e support nai-degen 2024-03-09 13:03:50 -0600
  • cab346787c fixes regression in anthropic text > anthropic chat api translation nai-degen 2024-03-08 21:16:25 -0600
  • fab404b232 refactors api transformers and adds oai->anthropic chat api translation nai-degen 2024-03-08 20:59:19 -0600
  • 8d84f289b2 fixes issue with mistral-large model family not being detected nai-degen 2024-03-08 17:07:25 -0600
  • 9ce10b4f6a shows more helpful errors when users' prefills are invalid during AWS streaming nai-degen 2024-03-07 13:28:23 -0600
  • 96756d32f3 fixes handling of DALL-E content_policy_violation errors nai-degen 2024-03-07 12:56:35 -0600
  • 1fb3eac154 maybe shows clearer AWS ValidationExceptions when users have bad prefills nai-degen 2024-03-06 05:12:47 -0600
  • 8f46bd4397 handles 'this organization is disabled' error from anthropic nai-degen 2024-03-06 00:42:10 -0600
  • ddf34685df adds Claude 3 Vision support nai-degen 2024-03-05 18:34:10 -0600
  • ea3aae5da6 allows selecting compat model via endpoint name and makes errors less confusing nai-degen 2024-03-05 05:13:17 -0600
  • 055d650c5d fixes legacy compat endpoint nai-degen 2024-03-05 01:38:39 -0600
  • 2643dfea61 improves aws sonnet key detection and no keys available error messaging nai-degen 2024-03-05 00:18:48 -0600
  • 434445797a fixes bad handleCompatibilityRequest middleware fallthrough nai-degen 2024-03-04 23:53:13 -0600
  • 03c5c473e1 improves error handling for sillytavern nai-degen 2024-03-04 22:54:21 -0600
  • 068e7a834f fixes AWS legacy models for non-streaming requests nai-degen 2024-03-04 21:22:43 -0600
  • 736803ad92 enables opus by default nai-degen 2024-03-04 21:11:32 -0600
  • 6b22d17c50 fixes claude-opus token usage being attributed to regular claude nai-degen 2024-03-04 17:03:02 -0600
  • 51ffca480a adds AWS Claude Chat Completions and Claude 3 Sonnet support nai-degen 2024-03-04 16:25:06 -0600
  • 802d847cc6 enables Claude opus by default nai-degen 2024-03-04 16:21:40 -0600
  • 90ddcac55b makes claude3 compat model customizable via environment variable nai-degen 2024-03-04 14:17:29 -0600
  • 36923686f6 shows claude-opus key count on service info page nai-degen 2024-03-04 14:12:38 -0600
  • 1edc93dc72 adds claude-opus model family nai-degen 2024-03-04 14:08:59 -0600
  • f6c124c1d3 fixes issue with preamble-required claude keys and anthropic chat nai-degen 2024-03-04 14:00:25 -0600
  • 90a053d0e0 detects and removes over-quota claude keys from keypool nai-degen 2024-03-04 13:42:05 -0600
  • db318ec237 Implement Anthropic Chat Completions endpoint and Claude 3 (khanon/oai-reverse-proxy!64) khanon 2024-03-04 19:06:46 +0000
  • b90abbda88 spoofs response for SillyTavern test messages nai-degen 2024-02-28 15:57:18 -0600
  • 93cee1db9b removes claude v1 from AWS keychecker as it has been retired nai-degen 2024-02-27 15:52:09 -0600
  • bd15728743 uses explicitly set keyprovider rather than inferring via requested model nai-degen 2024-02-27 10:56:40 -0600
  • 627559b729 updates mistral modelids nai-degen 2024-02-26 23:55:03 -0600
  • 428e103323 allows customizing the /proxy endpoint prefix nai-degen 2024-02-26 18:20:34 -0600
  • fd742fc0cb Merge remote-tracking branch 'origin/main' nai-degen 2024-02-26 18:12:23 -0600
  • 5e19e2756a adds mistral-large model family, untested nai-degen 2024-02-26 18:12:08 -0600
  • 2817c3abc4 Merge branch 'combined-endpoint' into 'main' khanon 2024-02-20 10:58:31 +0000
  • d3f7c675e3 add pricing for Azure GPT counterparts and update Claude pricing (khanon/oai-reverse-proxy!65) devvnull 2024-02-20 03:53:26 +0000
  • 59bda40bbc handles google streaming json response format variation nai-degen 2024-02-19 00:12:09 -0600
  • 68d829bceb adds Claude over-quota detection nai-degen 2024-02-17 15:56:22 -0600
  • 9c03290a3d detects anthropic copyright prefill pozzing nai-degen 2024-02-16 10:22:45 -0600
  • 3498584a1f removes forceModel on Google AI endpoint nai-degen 2024-02-15 11:41:34 -0600
  • 21d61da62b increases max image payload size for gpt4v nai-degen 2024-02-12 21:58:46 -0600
  • 35dc0f4826 fixes 'Premature close' caused by fucked up AWS unmarshaller errors nai-degen 2024-02-10 14:47:14 -0600
  • a2ae9f32db handles OpenAI organization check failures due to missing API scopes nai-degen 2024-02-09 00:18:21 -0600
  • 0ce4582f3b Improve "\n\nHuman" prefix requirement detection for Anthropic (khanon/oai-reverse-proxy!63) devvnull 2024-02-08 16:28:11 +0000
  • bbee056114 fixes Force Key Recheck admin function for azure/aws nai-degen 2024-02-07 19:54:40 -0600
  • ecc804887b uses EventStreamMarshaller from AWS SDK to hopefully handle split messages nai-degen 2024-02-05 19:56:41 -0600
  • a8fd3c7240 fixes AWS Claude throttlingException handling nai-degen 2024-02-04 20:48:20 -0600
  • 40240601f5 refactors SSEStreamAdapter to fix leaking decoder streams nai-degen 2024-02-04 18:38:06 -0600
  • 98cea2da02 replaces eventstream lib to (hopefully) fix interrupted AWS streams nai-degen 2024-02-04 17:18:28 -0600
  • c88f47d0ed fixes middleware order breaking /proxy endpoint nai-degen 2024-02-04 16:21:44 -0600
  • 43106d9c7f tracks Risu userid rather than IP address on usertokens nai-degen 2024-02-04 14:14:36 -0600
  • fe429a7610 adds SERVICE_INFO_PASSWORD to gate infopage behind a password nai-degen 2024-02-04 14:04:46 -0600
  • 6f7abf0220 wip combined-endpoint nai-degen 2024-02-04 13:31:27 -0600
  • 235510e588 fixes incorrect AWS Claude 2.1 max context limit nai-degen 2024-02-01 20:40:15 -0600
  • 7eb6eb90ad moves api schema validators from transform-outbound-payload into shared nai-degen 2024-01-29 19:38:22 -0600
  • 924db33f7e attempts to auto-convert Mistral prompts for its more strict rules nai-degen 2024-01-28 17:42:23 -0600
  • 3f2f30e605 updates gpt4-v tokenizer for previous Risu change nai-degen 2024-01-27 13:35:46 -0600
  • c9791acd85 makes gpt4-v input validation less strict to accomodate Risu nai-degen 2024-01-27 13:24:11 -0600
  • e871b8ecf1 removes logprobs default value since it breaks gpt-4-vision nai-degen 2024-01-27 12:19:24 -0600
  • 37ca98ad30 adds dark mode (infopage only currently) nai-degen 2024-01-25 16:24:11 -0600
  • e6dc4475e6 fixes max context size for nu-gpt4-turbo nai-degen 2024-01-25 14:07:42 -0600
  • 5e646b1c86 adds gpt-4-0125-preview and gpt-4-turbo-preview alias nai-degen 2024-01-25 13:27:03 -0600
  • 6f626e623e fixes OAI trial keys bricking the dall-e queue nai-degen 2024-01-25 01:47:51 -0600
  • 02a54bf4e3 fixes azure openai logprobs (actually tested this time) nai-degen 2024-01-25 01:17:18 -0600
  • 79b2e5b6fd adds very basic support for OpenAI function calling nai-degen 2024-01-24 16:42:26 -0600
  • 935a633325 fixes typo in Azure logprob adjustment nai-degen 2024-01-24 16:03:26 -0600
  • 4a4b60ebcd handles Azure deviation from OpenAI spec on logprobs param nai-degen 2024-01-24 16:01:19 -0600
  • ad465be363 fixes logprobs schema validation for turbo instruct endpoint nai-degen 2024-01-24 14:31:10 -0600
  • c7a351baa8 adds support for requesting logprobs from OpenAI Chat Completions API nai-degen 2024-01-24 11:46:09 -0600
  • ba8b052b17 adds bindAddress to omitted config keys nai-degen 2024-01-17 02:31:30 -0600
  • e813cd9d22 default claude 2.1 instead of 1.3 in openai compat endpoint since 1.3 is not accessible on all keys nai-degen 2024-01-17 02:36:21 -0600
  • 4c2a2c1e6c improves handle-streamed-response comments/docs [skip-ci] nai-degen 2024-01-17 11:23:08 -0600
  • f1d927fa62 updates README with building/forking info [skip-ci] nai-degen 2024-01-15 11:46:05 -0600
  • ad6e5224e3 allows binding to loopback interface via app config instead of only docker nai-degen 2024-01-15 11:32:26 -0600