cyberes
/
local-llm-server
Archived
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity

fix sending error messages when streaming

This commit is contained in:
Cyberes 2023-09-25 17:37:58 -06:00
parent 7ce60079d7
commit 8184e24bff
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
llm_server/routes/v1/generate_stream.py
View File

@ -54,7 +54,7 @@ def stream(ws):
ws.send(json.dumps({ ws.send(json.dumps({
'event': 'text_stream', 'event': 'text_stream',
'message_num': message_num, 'message_num': message_num,
'text': invalid_response 'text': invalid_response[0].json['results'][0]['text']
})) }))
else: else:
input_prompt = request_json_body['prompt'] input_prompt = request_json_body['prompt']