nai-degen
|
fdd824f0e4
|
adds azure rate limit auto-retry
|
2023-12-04 01:24:33 -06:00 |
|
khanon
|
fbdea30264
|
Azure OpenAI suport (khanon/oai-reverse-proxy!48)
|
2023-12-04 04:21:18 +00:00 |
|
nai-degen
|
cd1b9d0e0c
|
don't print google api key to container logs on error
|
2023-12-01 11:23:56 -06:00 |
|
nai-degen
|
9e61d9029f
|
adds claude-2.1 (untested)
|
2023-11-21 11:32:43 -06:00 |
|
nai-degen
|
f95e24afbb
|
fixes incorrect max model size for gpt4-v
|
2023-11-19 02:23:41 -06:00 |
|
khanon
|
f29049f993
|
Support for GPT-4-Vision (khanon/oai-reverse-proxy!54)
|
2023-11-19 05:06:21 +00:00 |
|
nai-degen
|
7f2f324e26
|
fixes render dockerfile and dalle3 model detection
|
2023-11-18 12:27:14 -06:00 |
|
nai-degen
|
dc61291933
|
adds temporary keychecker var to treat dall-e-2 the same as dall-e-3
|
2023-11-17 20:24:36 -06:00 |
|
nai-degen
|
6c02e9b265
|
don't enqueue requests which fail stream check
|
2023-11-17 14:36:47 -06:00 |
|
nai-degen
|
e018672968
|
re-adds keychecker info to STATIC_INFO_PAGE
|
2023-11-16 02:16:24 -06:00 |
|
nai-degen
|
bfd7e23124
|
encodes queue payload
|
2023-11-16 01:19:01 -06:00 |
|
khanon
|
6aa6bebf08
|
Scale SSE heartbeat size with traffic (khanon/oai-reverse-proxy!53)
|
2023-11-16 05:45:35 +00:00 |
|
nai-degen
|
6acdf35914
|
removes length from stalled request error message
|
2023-11-15 17:18:51 -06:00 |
|
nai-degen
|
3de79873e9
|
adds STATIC_SERVICE_INFO config
|
2023-11-15 17:12:07 -06:00 |
|
nai-degen
|
3aca9e90f0
|
fixes rate limiter always using IMAGE_MODEL_RATE_LIMIT
|
2023-11-15 13:07:58 -06:00 |
|
nai-degen
|
5fabe1d1f8
|
uses exponential moving average for wait time calculation
|
2023-11-14 01:36:11 -06:00 |
|
nai-degen
|
4a68c14477
|
further increases OpenAI rate limit backoff
|
2023-11-14 01:28:28 -06:00 |
|
khanon
|
20c064394a
|
OpenAI DALL-E Image Generation (khanon/oai-reverse-proxy!52)
|
2023-11-14 05:41:19 +00:00 |
|
nai-degen
|
3ea23760c3
|
adjusts prompt logging to truncate huge prompts from the end
|
2023-11-11 20:14:32 -06:00 |
|
nai-degen
|
5db07404f2
|
fixes infopage crash when check_keys is disabled
|
2023-11-10 22:41:57 -06:00 |
|
nai-degen
|
c453a5f2ad
|
logs usertoken lookup attempts
|
2023-11-10 22:41:36 -06:00 |
|
nai-degen
|
c7a095d345
|
removes debug log
|
2023-11-09 16:25:57 -06:00 |
|
nai-degen
|
e9110611fa
|
adds REJECT_PHRASES configuration setting
|
2023-11-09 16:24:49 -06:00 |
|
nai-degen
|
79e1fe09e4
|
fixes multiple enumeration on infopage
|
2023-11-08 12:02:23 -06:00 |
|
dllt98
|
08b2196bfb
|
Update .env.example to include MAX_CONTEXT_TOKENS_OPENAI (khanon/oai-reverse-proxy!50)
|
2023-11-08 02:50:19 +00:00 |
|
nai-degen
|
350d6542cf
|
fixes stats for non-openai models
|
2023-11-06 22:41:48 -06:00 |
|
nai-degen
|
c9c24f86bb
|
improvements to infopage key categorization
|
2023-11-06 22:13:34 -06:00 |
|
nai-degen
|
b6f8f15a1f
|
tries to prevent per-day rate limited keys from bricking the queue
|
2023-11-06 21:16:36 -06:00 |
|
nai-degen
|
5467136c1a
|
adds gpt4-turbo to userschema; updates docs
|
2023-11-06 16:35:35 -06:00 |
|
nai-degen
|
0d5dfeccf8
|
adds gpt4-turbo model family and support for gpt-4-1106-preview model
|
2023-11-06 15:29:43 -06:00 |
|
nai-degen
|
b615ffa433
|
fixes issue with local development cookies
|
2023-11-06 10:28:27 -06:00 |
|
nai-degen
|
a27163a629
|
adds option to not disable keys when reaching IP limit
|
2023-11-06 10:15:57 -06:00 |
|
nai-degen
|
5a8fb3aff6
|
adds USE_INSECURE_COOKIES for hosts without SSL support
|
2023-11-03 15:25:06 -05:00 |
|
nai-degen
|
51dd0c71ba
|
removes unused import in openai proxy
|
2023-10-24 13:17:46 -05:00 |
|
nai-degen
|
89e1ed46d5
|
re-signs AWS requests on every attempt to fix fucked up queueing
|
2023-10-24 13:10:50 -05:00 |
|
nai-degen
|
26dc79c8f1
|
fixes broken AWS rate limit backoff
|
2023-10-24 09:19:46 -05:00 |
|
nai-degen
|
89e9b67f3f
|
fixes AWS mid-stream rate limits not actually marking key as rate-limited
|
2023-10-23 22:47:29 -05:00 |
|
nai-degen
|
52ec2ec265
|
fixes blank AWS responses due to reqs sometimes using wrong handler
|
2023-10-23 22:23:06 -05:00 |
|
nai-degen
|
8bd2f749c1
|
reduces logging severity of prompt validation errors
|
2023-10-23 20:30:27 -05:00 |
|
khanon
|
ff27ca3780
|
Update info-page.ts
|
2023-10-20 00:33:57 +00:00 |
|
nai-degen
|
41a463d2c8
|
possibly fix issue with AWS keychecker due to amazon API change
|
2023-10-16 12:17:02 -05:00 |
|
nai-degen
|
3f7e50f87e
|
follow-up 'fixes empty AWS streaming responses when under heavy load'
|
2023-10-15 00:06:38 -05:00 |
|
nai-degen
|
f6cfc6e882
|
fixes empty AWS streaming responses when under heavy load
|
2023-10-15 00:05:36 -05:00 |
|
nai-degen
|
af4d8dae40
|
changes default AMZ_HOST to bedrock-runtime.region.amazonaws.com
|
2023-10-12 15:39:06 -05:00 |
|
nai-degen
|
725fd6e6f1
|
deprioritizes queued Agnai.chat requests and limits concurrency to five across all shared IPs
|
2023-10-09 12:36:54 -05:00 |
|
nai-degen
|
c87484f1ff
|
adds AWS console screenshot to docs
|
2023-10-07 21:33:53 -05:00 |
|
nai-degen
|
15a2cb5a26
|
another docs correction
|
2023-10-07 21:10:18 -05:00 |
|
nai-degen
|
c8182cea17
|
docs correction
|
2023-10-07 21:08:40 -05:00 |
|
nai-degen
|
b06d48e1f8
|
adds better AWS docs
|
2023-10-07 20:58:04 -05:00 |
|
khanon
|
140bdea14e
|
Implement AWS KeyChecker and auto-disable AWS logged keys (khanon/oai-reverse-proxy!47)
|
2023-10-08 01:17:09 +00:00 |