{{ analytics_tracking_code|safe }}

{{ llm_middleware_name }}

Current Model: {{ current_model }}

Client API URL: {{ client_api }}

Streaming API URL: {{ ws_client_api }}

Estimated Wait Time: {{ estimated_wait }}

{{ info_html|safe }}

Instructions:
  1. Set your API type to {{ mode_name }}
  2. Enter {{ client_api }} in the {{ api_input_textbox }} textbox.
  3. Enter {{ ws_client_api }} in the {{ streaming_input_textbox }} textbox.
  4. If using a token, check the Mancer AI checkbox and enter your token in the Mancer API key textbox.
  5. Click Connect to test the connection.
  6. Open your preset config and set Context Size to {{ context_size }}.
  7. Follow this guide to get set up: rentry.org/freellamas
{{ extra_info|safe }}

{{ stats_json|safe }}
git.evulid.cc/cyberes/local-llm-server