cyberes
/
local-llm-server
1
1
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
local-llm-server/llm_server/routes/__init__.py

2 lines
81 B
Python
Raw Normal View History

show total output tokens on stats
2023-08-24 20:43:11 -06:00
# TODO: move the inference API to /api/infer/ and the stats api to /api/v1/stats