Mirrors
/
oai-reverse-proxy
mirror of https://gitgud.io/khanon/oai-reverse-proxy.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

adds support for requesting logprobs from OpenAI Chat Completions API

This commit is contained in:
nai-degen 2024-01-24 11:46:09 -06:00
parent ba8b052b17
commit c7a351baa8
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
src/proxy/middleware/request/preprocessors/transform-outbound-payload.ts
View File

@ -87,6 +87,8 @@ export const OpenAIV1ChatCompletionSchema = z
logit_bias: z.any().optional(), logit_bias: z.any().optional(),
user: z.string().max(500).optional(), user: z.string().max(500).optional(),
seed: z.number().int().optional(), seed: z.number().int().optional(),
logprobs: z.boolean().optional().default(false),
top_logprobs: z.number().int().optional(),
}) })
.strip(); .strip();