{{ analytics_tracking_code|safe }}

{{ llm_middleware_name }}

Current Model: {{ current_model }}

Estimated Wait Time: {{ estimated_wait }}


Client API URL: {{ client_api }}

Streaming API URL: {{ ws_client_api if enable_streaming else 'Disabled' }}

OpenAI-Compatible API URL: {{ openai_client_api }}

{% if info_html|length > 1 %}
{{ info_html|safe }} {% endif %}

Instructions:
  1. Set your API type to {{ mode_name }}
  2. Enter {{ client_api }} in the {{ api_input_textbox }} textbox.
    3. {% if enable_streaming %}
  3. Enter {{ ws_client_api }} in the {{ streaming_input_textbox }} textbox.
    4. {% endif %}
  4. If you have a token, check the Mancer AI checkbox and enter your token in the Mancer API key textbox.
  5. Click Connect to test the connection.
  6. Open your preset config and set Context Size to {{ context_size }}.
  7. Follow this guide to get set up: rentry.org/freellamas
{% if openai_client_api != 'disabled' and expose_openai_system_prompt %}
OpenAI-Compatible API

The OpenAI-compatible API adds a system prompt to set the AI's behavior to a "helpful assistant". You can view this prompt here.

{% endif %}
{{ extra_info|safe }}

{{ stats_json|safe }}
git.evulid.cc/cyberes/local-llm-server