Reverse proxy server for various LLM APIs. Features translation between API formats, user management, anti-abuse, API key rotation, DALL-E support, and optional prompt/response logging.
Go to file
nai-degen 518a5b125d updates docs again 2023-04-09 20:39:35 -05:00
docker refines huggingface instructions 2023-04-09 20:34:22 -05:00
docs updates docs again 2023-04-09 20:39:35 -05:00
src correctly decompresses gzip/deflate payloads 2023-04-09 02:30:59 -05:00
.env.example updates .env.example again 2023-04-08 22:00:45 -05:00
.gitattributes initial commit 2023-04-08 01:54:44 -05:00
.gitignore loads keys on startup 2023-04-08 06:02:59 -05:00
.replit adds preliminary replit support 2023-04-09 18:55:24 -05:00
.replit.nix adds preliminary replit support 2023-04-09 18:55:24 -05:00
README.md updates README 2023-04-09 20:21:28 -05:00
package-lock.json correctly decompresses gzip/deflate payloads 2023-04-09 02:30:59 -05:00
package.json adds preliminary replit support 2023-04-09 18:55:24 -05:00
tsconfig.json implements basic key rotation 2023-04-08 05:32:24 -05:00

README.md

title emoji colorFrom colorTo sdk pinned
oai-reverse-proxy 🔁 green purple docker false

OAI Reverse Proxy Server

Simple reverse proxy server for the OpenAI API.

What is this?

If you have an API key you want to share with a friend, you can use this to keep your key safe while still allowing them to generate text with the API.

Why?

OpenAI keys have full account permissions. They can revoke themselves, generate new keys, modify spend quotas, etc. You absolutely should not share them.

If you still want to share access to your key, you can put it behind this proxy to ensure it can't be used to do anything but generate text. You can also set a separate key on the proxy to gatekeep access.

How to use

Since this is a server, you'll need to deploy it somewhere. A few options are available:

See here for instructions on deploying to a Huggingface Space.

Deploy to Repl.it (WIP)

Still working on this. It's a bit more technical than the Huggingface option; you can give it a shot by clicking on the button below.

Run on Repl.it

You'll need to set your secrets in Replit similar to the Huggingface instructions above. Currently .env files don't work properly so it only uses the default configuration.