cyberes
/
local-llm-server
Archived
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity

Merge cluster to master #3

Merged
cyberes merged 163 commits from cluster into master 2023-10-27 19:19:22 -06:00
Conversation 0 Commits 163 Files Changed 91 +1
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files
Showing only changes of commit 6dc3529190 - Show all commits

1
llm_server/routes/v1/generate_stats.py
View File

@ -54,6 +54,7 @@ def generate_stats(regen: bool = False):
'anthropicKeys': '∞', 'anthropicKeys': '∞',
}, },
'backends': {}, 'backends': {},
'online': len(model_choices) > 0
} }
# TODO: have get_model_choices() return all the info so we don't have to loop over the backends ourself # TODO: have get_model_choices() return all the info so we don't have to loop over the backends ourself