nai-degen
|
fab404b232
|
refactors api transformers and adds oai->anthropic chat api translation
|
2024-03-08 20:59:19 -06:00 |
|
nai-degen
|
8d84f289b2
|
fixes issue with mistral-large model family not being detected
|
2024-03-08 17:07:25 -06:00 |
|
nai-degen
|
9ce10b4f6a
|
shows more helpful errors when users' prefills are invalid during AWS streaming
|
2024-03-07 13:28:23 -06:00 |
|
nai-degen
|
96756d32f3
|
fixes handling of DALL-E content_policy_violation errors
|
2024-03-07 12:56:35 -06:00 |
|
nai-degen
|
1fb3eac154
|
maybe shows clearer AWS ValidationExceptions when users have bad prefills
|
2024-03-06 05:12:47 -06:00 |
|
nai-degen
|
8f46bd4397
|
handles 'this organization is disabled' error from anthropic
|
2024-03-06 00:42:10 -06:00 |
|
nai-degen
|
ddf34685df
|
adds Claude 3 Vision support
|
2024-03-05 18:34:10 -06:00 |
|
nai-degen
|
ea3aae5da6
|
allows selecting compat model via endpoint name and makes errors less confusing
|
2024-03-05 05:13:22 -06:00 |
|
nai-degen
|
055d650c5d
|
fixes legacy compat endpoint
|
2024-03-05 01:38:39 -06:00 |
|
nai-degen
|
2643dfea61
|
improves aws sonnet key detection and no keys available error messaging
|
2024-03-05 01:04:08 -06:00 |
|
nai-degen
|
434445797a
|
fixes bad handleCompatibilityRequest middleware fallthrough
|
2024-03-04 23:53:13 -06:00 |
|
nai-degen
|
03c5c473e1
|
improves error handling for sillytavern
|
2024-03-04 22:59:32 -06:00 |
|
nai-degen
|
068e7a834f
|
fixes AWS legacy models for non-streaming requests
|
2024-03-04 21:22:43 -06:00 |
|
nai-degen
|
736803ad92
|
enables opus by default
|
2024-03-04 21:11:32 -06:00 |
|
nai-degen
|
6b22d17c50
|
fixes claude-opus token usage being attributed to regular claude
|
2024-03-04 17:03:02 -06:00 |
|
nai-degen
|
51ffca480a
|
adds AWS Claude Chat Completions and Claude 3 Sonnet support
|
2024-03-04 16:25:06 -06:00 |
|
nai-degen
|
802d847cc6
|
enables Claude opus by default
|
2024-03-04 16:21:40 -06:00 |
|
nai-degen
|
90ddcac55b
|
makes claude3 compat model customizable via environment variable
|
2024-03-04 14:21:55 -06:00 |
|
nai-degen
|
36923686f6
|
shows claude-opus key count on service info page
|
2024-03-04 14:12:38 -06:00 |
|
nai-degen
|
1edc93dc72
|
adds claude-opus model family
|
2024-03-04 14:08:59 -06:00 |
|
nai-degen
|
f6c124c1d3
|
fixes issue with preamble-required claude keys and anthropic chat
|
2024-03-04 14:00:25 -06:00 |
|
nai-degen
|
90a053d0e0
|
detects and removes over-quota claude keys from keypool
|
2024-03-04 13:42:29 -06:00 |
|
khanon
|
db318ec237
|
Implement Anthropic Chat Completions endpoint and Claude 3 (khanon/oai-reverse-proxy!64)
|
2024-03-04 19:06:46 +00:00 |
|
nai-degen
|
b90abbda88
|
spoofs response for SillyTavern test messages
|
2024-02-28 15:57:18 -06:00 |
|
nai-degen
|
93cee1db9b
|
removes claude v1 from AWS keychecker as it has been retired
|
2024-02-27 15:52:09 -06:00 |
|
nai-degen
|
bd15728743
|
uses explicitly set keyprovider rather than inferring via requested model
|
2024-02-27 10:56:50 -06:00 |
|
nai-degen
|
627559b729
|
updates mistral modelids
|
2024-02-26 23:55:03 -06:00 |
|
nai-degen
|
428e103323
|
allows customizing the /proxy endpoint prefix
|
2024-02-26 18:20:34 -06:00 |
|
nai-degen
|
fd742fc0cb
|
Merge remote-tracking branch 'origin/main'
|
2024-02-26 18:12:23 -06:00 |
|
nai-degen
|
5e19e2756a
|
adds mistral-large model family, untested
|
2024-02-26 18:12:08 -06:00 |
|
devvnull
|
d3f7c675e3
|
add pricing for Azure GPT counterparts and update Claude pricing (khanon/oai-reverse-proxy!65)
|
2024-02-20 03:53:26 +00:00 |
|
nai-degen
|
59bda40bbc
|
handles google streaming json response format variation
|
2024-02-19 00:12:09 -06:00 |
|
nai-degen
|
68d829bceb
|
adds Claude over-quota detection
|
2024-02-17 15:56:22 -06:00 |
|
nai-degen
|
9c03290a3d
|
detects anthropic copyright prefill pozzing
|
2024-02-16 10:22:45 -06:00 |
|
nai-degen
|
3498584a1f
|
removes forceModel on Google AI endpoint
|
2024-02-15 11:41:34 -06:00 |
|
nai-degen
|
21d61da62b
|
increases max image payload size for gpt4v
|
2024-02-12 21:59:48 -06:00 |
|
nai-degen
|
35dc0f4826
|
fixes 'Premature close' caused by fucked up AWS unmarshaller errors
|
2024-02-10 14:47:14 -06:00 |
|
nai-degen
|
a2ae9f32db
|
handles OpenAI organization check failures due to missing API scopes
|
2024-02-09 10:10:22 -06:00 |
|
devvnull
|
0ce4582f3b
|
Improve "\n\nHuman" prefix requirement detection for Anthropic (khanon/oai-reverse-proxy!63)
|
2024-02-08 16:28:11 +00:00 |
|
nai-degen
|
bbee056114
|
fixes Force Key Recheck admin function for azure/aws
|
2024-02-07 19:54:40 -06:00 |
|
nai-degen
|
ecc804887b
|
uses EventStreamMarshaller from AWS SDK to hopefully handle split messages
|
2024-02-05 19:56:41 -06:00 |
|
nai-degen
|
a8fd3c7240
|
fixes AWS Claude throttlingException handling
|
2024-02-04 20:48:20 -06:00 |
|
nai-degen
|
40240601f5
|
refactors SSEStreamAdapter to fix leaking decoder streams
|
2024-02-04 18:38:06 -06:00 |
|
nai-degen
|
98cea2da02
|
replaces eventstream lib to (hopefully) fix interrupted AWS streams
|
2024-02-04 17:18:28 -06:00 |
|
nai-degen
|
c88f47d0ed
|
fixes middleware order breaking /proxy endpoint
|
2024-02-04 16:21:44 -06:00 |
|
nai-degen
|
43106d9c7f
|
tracks Risu userid rather than IP address on usertokens
|
2024-02-04 14:14:36 -06:00 |
|
nai-degen
|
fe429a7610
|
adds SERVICE_INFO_PASSWORD to gate infopage behind a password
|
2024-02-04 14:04:46 -06:00 |
|
nai-degen
|
235510e588
|
fixes incorrect AWS Claude 2.1 max context limit
|
2024-02-01 20:40:15 -06:00 |
|
nai-degen
|
7eb6eb90ad
|
moves api schema validators from transform-outbound-payload into shared
|
2024-01-29 19:38:22 -06:00 |
|
nai-degen
|
924db33f7e
|
attempts to auto-convert Mistral prompts for its more strict rules
|
2024-01-28 17:42:23 -06:00 |