nai-degen
|
a27163a629
|
adds option to not disable keys when reaching IP limit
|
2023-11-06 10:15:57 -06:00 |
|
nai-degen
|
5a8fb3aff6
|
adds USE_INSECURE_COOKIES for hosts without SSL support
|
2023-11-03 15:25:06 -05:00 |
|
nai-degen
|
51dd0c71ba
|
removes unused import in openai proxy
|
2023-10-24 13:17:46 -05:00 |
|
nai-degen
|
89e1ed46d5
|
re-signs AWS requests on every attempt to fix fucked up queueing
|
2023-10-24 13:10:50 -05:00 |
|
nai-degen
|
26dc79c8f1
|
fixes broken AWS rate limit backoff
|
2023-10-24 09:19:46 -05:00 |
|
nai-degen
|
89e9b67f3f
|
fixes AWS mid-stream rate limits not actually marking key as rate-limited
|
2023-10-23 22:47:29 -05:00 |
|
nai-degen
|
52ec2ec265
|
fixes blank AWS responses due to reqs sometimes using wrong handler
|
2023-10-23 22:23:06 -05:00 |
|
nai-degen
|
8bd2f749c1
|
reduces logging severity of prompt validation errors
|
2023-10-23 20:30:27 -05:00 |
|
khanon
|
ff27ca3780
|
Update info-page.ts
|
2023-10-20 00:33:57 +00:00 |
|
nai-degen
|
41a463d2c8
|
possibly fix issue with AWS keychecker due to amazon API change
|
2023-10-16 12:17:02 -05:00 |
|
nai-degen
|
3f7e50f87e
|
follow-up 'fixes empty AWS streaming responses when under heavy load'
|
2023-10-15 00:06:38 -05:00 |
|
nai-degen
|
f6cfc6e882
|
fixes empty AWS streaming responses when under heavy load
|
2023-10-15 00:05:36 -05:00 |
|
nai-degen
|
af4d8dae40
|
changes default AMZ_HOST to bedrock-runtime.region.amazonaws.com
|
2023-10-12 15:39:06 -05:00 |
|
nai-degen
|
725fd6e6f1
|
deprioritizes queued Agnai.chat requests and limits concurrency to five across all shared IPs
|
2023-10-09 12:36:54 -05:00 |
|
nai-degen
|
c87484f1ff
|
adds AWS console screenshot to docs
|
2023-10-07 21:33:53 -05:00 |
|
nai-degen
|
15a2cb5a26
|
another docs correction
|
2023-10-07 21:10:18 -05:00 |
|
nai-degen
|
c8182cea17
|
docs correction
|
2023-10-07 21:08:40 -05:00 |
|
nai-degen
|
b06d48e1f8
|
adds better AWS docs
|
2023-10-07 20:58:04 -05:00 |
|
khanon
|
140bdea14e
|
Implement AWS KeyChecker and auto-disable AWS logged keys (khanon/oai-reverse-proxy!47)
|
2023-10-08 01:17:09 +00:00 |
|
nai-degen
|
12f78fa1f2
|
exempts 'special' role from rate limiting
|
2023-10-06 20:29:28 -05:00 |
|
nai-degen
|
daf6a123d5
|
adjusts Agnai.chat and RisuAI rate limiting
|
2023-10-04 09:39:59 -05:00 |
|
nai-degen
|
4e05b01e90
|
improves AWS .env.example and config.ts docs
|
2023-10-03 20:29:49 -05:00 |
|
nai-degen
|
5033d00444
|
improves clarity of errors sent back to streaming clients
|
2023-10-03 19:45:15 -05:00 |
|
nai-degen
|
ba0b20617e
|
ensures AWS always uses anthropic-version 2023-06-01 parser
|
2023-10-03 19:43:30 -05:00 |
|
nai-degen
|
4a5fd91da3
|
address npm audit; adds zod-error package
|
2023-10-03 19:05:46 -05:00 |
|
khanon
|
ecf897e685
|
Refactor handleStreamingResponse to make it less shit (khanon/oai-reverse-proxy!46)
|
2023-10-03 06:14:19 +00:00 |
|
nai-degen
|
6a3d753f0d
|
fixes anthropic keychecker for some keys
|
2023-10-02 20:32:07 -05:00 |
|
khanon
|
0bf2f5c123
|
fixes typo in .env.example
|
2023-10-02 20:39:30 +00:00 |
|
nai-degen
|
ede274c117
|
disables AWS key on AccessDeniedException
|
2023-10-02 11:18:08 -05:00 |
|
nai-degen
|
d2267beb18
|
adds aws-claude token cost
|
2023-10-02 09:43:26 -05:00 |
|
nai-degen
|
0837c89a42
|
fixes incorrect context size limit for aws claude v1
|
2023-10-02 03:53:04 -05:00 |
|
nai-degen
|
f67560a17b
|
refactors proxy routing
|
2023-10-01 12:12:28 -05:00 |
|
nai-degen
|
e13361a323
|
removes dead koboldai code
|
2023-10-01 11:27:11 -05:00 |
|
khanon
|
fa4bf468d2
|
Implement AWS Bedrock support (khanon/oai-reverse-proxy!45)
|
2023-10-01 01:40:18 +00:00 |
|
nai-degen
|
7e681a7bef
|
strips OAI request parameters when translating to Claude format
|
2023-09-29 03:01:39 -05:00 |
|
nai-degen
|
1b0106a1ea
|
strips reverse proxy originating IP headers
|
2023-09-29 03:00:55 -05:00 |
|
nai-degen
|
f5521aa6c3
|
prevents selecting trial keys for embeddings requests due to rate limits
|
2023-09-26 01:26:07 -05:00 |
|
nai-degen
|
f8b480f4c2
|
adds support for proxying text-embedding-ada-002 requests
|
2023-09-26 00:58:38 -05:00 |
|
khanon
|
1f35fe1ae1
|
updates huggingface docs to clarify gatekeeper
|
2023-09-24 11:00:25 +00:00 |
|
khanon
|
35b44e1c6b
|
fixes issue with OpenAIV1ChatCompletionSchema and PaLM compat
|
2023-09-24 10:48:56 +00:00 |
|
nai-degen
|
075e415343
|
makes incoming model name validation less strict for PaLM endpoint
|
2023-09-20 23:55:53 -05:00 |
|
nai-degen
|
ec4f7e845b
|
triggers automatic OAI key recheck three times a day
|
2023-09-19 21:43:16 -05:00 |
|
nai-degen
|
8923bb76a0
|
adds turbo-instruct endpoint to info page
|
2023-09-19 21:10:29 -05:00 |
|
khanon
|
35a6c393ed
|
Add support for Google PaLM and OpenAI Turbo Instruct (khanon/oai-reverse-proxy!44)
|
2023-09-19 23:13:08 +00:00 |
|
nai-degen
|
ef554f8e06
|
fixes user edit modal for null values
|
2023-09-18 23:42:08 -05:00 |
|
nai-degen
|
624973fc82
|
adds admin note
|
2023-09-18 23:35:29 -05:00 |
|
nai-degen
|
c6453638e9
|
makes max IP limit configurable per-user
|
2023-09-18 23:16:06 -05:00 |
|
nai-degen
|
40e71435f0
|
partially redacts IP address on token lookup page
|
2023-09-17 17:53:29 -05:00 |
|
nai-degen
|
5e57dbb8f1
|
attempts to improve compatibility with BetterGPT frontend
|
2023-09-16 11:04:40 -05:00 |
|
khanon
|
201f71a989
|
corrects typo in anthropic key liveness test payload
|
2023-09-15 16:50:35 +00:00 |