For the complete documentation index, see llms.txt. This page is also available as Markdown.

SillyTavern

Connect SillyTavern to TensorX and chat with AI using a feature-rich, self-hosted frontend β€” powered by open-source models.


Overview

SillyTavern is an open-source LLM frontend for power users, with 24K+ GitHub stars and one of the largest communities in the AI chat space. It supports OpenAI-compatible APIs, making it easy to connect to TensorX for a self-hosted, privacy-first chat experience.


Prerequisites


Installation

Open http://localhost:8000 in your browser.


Configuration

Step 1: Open API Settings

  1. Click the plug icon (API Connections) in the top menu

  2. Select Chat Completion as the API type

  3. Select Custom (OpenAI-compatible) as the Chat Completion Source

Step 2: Configure TensorX

Setting
Value

Custom Endpoint (Base URL)

https://api.tensorx.ai/v1

API Key

Your TensorX API key

Step 3: Set Your Model

In the model field, type the model name directly:

Model
Use Case

z-ai/glm-5.1 ⭐

General use, coding, reasoning

deepseek/deepseek-chat-v3.1

Balanced chat

deepseek/deepseek-r1-0528

Complex reasoning

minimax/minimax-m2.5

Function calling

moonshotai/kimi-k2.5

Vision, long context

Step 4: Test Connection

Click Connect and send a test message to verify everything works.


Use Case
Model
Why

General chat ⭐

z-ai/glm-5.1

Versatile, great reasoning

Creative writing

deepseek/deepseek-chat-v3.1

Balanced and natural

Long conversations

moonshotai/kimi-k2.5

Large context window

Deep reasoning

deepseek/deepseek-r1-0528

Complex analysis

Fast responses

minimax/minimax-m2

Quick and cost-effective


Optimizing Settings

Context Size

Set the context size in SillyTavern to match your model:

  • GLM-5.1: 203000

  • Kimi K2.5: 262000

  • DeepSeek: 164000

Response Length

Adjust Max Response Length based on your use case:

  • Chat: 1024–2048 tokens

  • Creative writing: 4096–8192 tokens

  • Analysis: 8192–16384 tokens


Troubleshooting

Connection Failed

  1. Verify the endpoint is exactly https://api.tensorx.ai/v1

  2. Check your API key is correct

  3. Ensure you selected Custom (OpenAI-compatible) not plain OpenAI

Empty or Short Responses

Increase the Max Response Length in the generation settings.

Model Not Found

Type the full model name (e.g., z-ai/glm-5.1) β€” SillyTavern may not auto-discover models from custom endpoints.


See Also

Last updated

Was this helpful?