Reverse proxy server for various LLM APIs. Features translation between API formats, user management, anti-abuse, API key rotation, DALL-E support, and optional prompt/response logging.

Go to file

nai-degen 1ba72582da updates .env.example again		2023-04-08 22:00:45 -05:00
src	adds variable filter sampling rate	2023-04-08 21:57:51 -05:00
.env.example	updates .env.example again	2023-04-08 22:00:45 -05:00
.gitattributes	initial commit	2023-04-08 01:54:44 -05:00
.gitignore	loads keys on startup	2023-04-08 06:02:59 -05:00
Dockerfile	project scaffolding	2023-04-08 02:34:21 -05:00
README.md	fixes incorrect Service Info URLs	2023-04-08 09:31:04 -05:00
package-lock.json	updates docs	2023-04-08 08:50:03 -05:00
package.json	updates docs	2023-04-08 08:50:03 -05:00
tsconfig.json	implements basic key rotation	2023-04-08 05:32:24 -05:00

README.md

title	emoji	colorFrom	colorTo	sdk	pinned
oai-reverse-proxy	🔁	green	purple	docker	false

OAI Reverse Proxy Server

Simple reverse proxy server for the OpenAI API.

What is this?

If you have an API key you want to share with a friend, you can use this to keep your key safe while still allowing them to generate text with the API.

Why?

OpenAI keys have full account permissions. They can revoke themselves, generate new keys, modify spend quotas, etc. You absolutely should not share them.

If you still want to share access to your key, you can put it behind this proxy to ensure it can't be used to do anything but generate text. You can also set a separate key on the proxy to gatekeep access.

How to use

1. Get an API key

Go to OpenAI and sign up for an account.

2. Clone this Huggingface repository to your account

Go to Huggingface and sign up for an account.
Once logged in, click on the + button in the top right corner and select Duplicate this Space.

3. Set your OpenAI API key as a secret

Click the Settings button in the top right corner of your repository.
Scroll down to the Repository Secrets section and click New Secret.

Enter OPENAI_KEY as the name and your OpenAI API key as the value.

Do not paste the key into server.js! That file is public and anyone can see it. Leave it alone; it will load the key from the secret you just created.

4. Deploy the server

Your server should automatically deploy when you add the secret, but if not you can select Factory Reset from that same Settings menu.

The Service Info section below should show the URL for your server. You can share this with anyone to safely give them access to your OpenAI API key.
Your friend doesn't need any OpenAI API key of their own, they just need your link.
However, if you want to protect access to the server, you can add another secret called PROXY_KEY. This key will need to be passed in the Authentication header of every request to the server, just like an OpenAI API key.

Note: The keys section in the serverinfo screen may not correctly identify keys as trial/paid/GPT-4 unless you use the more advanced configuration described in .env.example.