AnythingLLM

Connect AnythingLLM to TensorX and chat with your documents using any of our models.

What is AnythingLLM?

AnythingLLM is an all-in-one AI application that lets you chat with your documents, use AI agents, and manage multiple workspaces. It supports many LLM providers including OpenAI-compatible APIs like TensorX.

Why AnythingLLM + TensorX?

📁 Document chat - Upload PDFs, docs, and more to chat with your content
🤖 AI Agents - Build custom agents that can browse the web and use tools
👥 Multi-user - Support for teams with permissions (Docker version)
🔌 Embeddable - Create chat widgets for your website
🖥️ Desktop & Docker - Run locally or self-host

Prerequisites

AnythingLLM installed (Desktop or Docker)
A TensorX API key (sign up here)

Configuration

AnythingLLM supports TensorX through the OpenAI (Generic) provider.

Step 1: Open LLM Settings

Launch AnythingLLM
Click the Settings gear icon
Navigate to LLM settings

Step 2: Select OpenAI (Generic)

In the LLM provider dropdown, select OpenAI (Generic)
Configure the following settings:

Field

Value

Base URL

https://api.tensorx.ai/v1

API Key

Your TensorX API key

Model Name

deepseek/deepseek-chat-v3.1

Max Tokens

4096 (or your preferred limit)

Click Save Changes

Important: The Base URL must include /v1 at the end.

Docker Deployment

Deploy AnythingLLM with TensorX pre-configured:

docker run -d \
  --name anythingllm \
  -p 3001:3001 \
  -v anythingllm-data:/app/server/storage \
  -e LLM_PROVIDER=generic-openai \
  -e GENERIC_OPEN_AI_BASE_PATH=https://api.tensorx.ai/v1 \
  -e GENERIC_OPEN_AI_API_KEY=your-tensorx-api-key \
  -e GENERIC_OPEN_AI_MODEL_PREF=deepseek/deepseek-chat-v3.1 \
  mintplexlabs/anythingllm

Then open http://localhost:3001 in your browser.

Docker Compose

version: '3.8'

services:
  anythingllm:
    image: mintplexlabs/anythingllm
    container_name: anythingllm
    ports:
      - "3001:3001"
    environment:
      - LLM_PROVIDER=generic-openai
      - GENERIC_OPEN_AI_BASE_PATH=https://api.tensorx.ai/v1
      - GENERIC_OPEN_AI_API_KEY=your-tensorx-api-key
      - GENERIC_OPEN_AI_MODEL_PREF=deepseek/deepseek-chat-v3.1
      - GENERIC_OPEN_AI_MAX_TOKENS=4096
    volumes:
      - anythingllm-data:/app/server/storage

volumes:
  anythingllm-data:

Deploy with:

docker compose up -d

Recommended Models

Use Case

Model

Notes

General chat

deepseek/deepseek-chat-v3.1

Fast, great for everyday use

Complex reasoning

deepseek/deepseek-r1-0528

Best for analysis and research

Coding assistance

z-ai/glm-5.1

Excellent for code-related tasks

Vision tasks

moonshotai/kimi-k2.5

Image understanding

Long documents

meta-llama/llama-4-maverick

Long document processing

Fast responses

meta-llama/llama-3.3-70b-instruct

Quick, cost-effective

Workspace Configuration

You can set different models per workspace:

Open a workspace
Click the Settings icon for that workspace
Under Chat Settings, select Workspace LLM
Choose OpenAI (Generic) and configure with a different TensorX model

This allows you to use different models for different use cases within the same AnythingLLM instance.

Features with TensorX

📁 Document Upload

Upload and chat with various document types:

PDFs
Word documents (.docx)
Text files
Web pages (via URL)
And more

🤖 AI Agents

Create custom agents that can:

Browse the web
Execute code
Use custom tools
Access your documents

💬 Workspaces

Organize your documents into separate workspaces, each with its own:

Document collection
Chat history
Model settings

Create embeddable chat widgets for your website (Docker version only).

Environment Variables

For Docker deployments, these environment variables configure TensorX:

Variable

Value

Description

LLM_PROVIDER

generic-openai

Use OpenAI-compatible provider

GENERIC_OPEN_AI_BASE_PATH

https://api.tensorx.ai/v1

TensorX API endpoint

GENERIC_OPEN_AI_API_KEY

Your API key

TensorX API key

GENERIC_OPEN_AI_MODEL_PREF

Model name

Default model to use

GENERIC_OPEN_AI_MAX_TOKENS

4096

Max tokens per response

Troubleshooting

"Invalid API Key" Error

Verify your API key is correct
Check that the key has available credits
Test your key:

curl https://api.tensorx.ai/v1/models \
  -H "Authorization: Bearer YOUR_API_KEY"

"Model Not Found" Error

Verify the model name is correct (e.g., deepseek/deepseek-chat-v3.1)
Check available models at tensorx.ai/models

Connection Errors

Ensure Base URL is https://api.tensorx.ai/v1 (with /v1)
Check your internet connection
Verify no firewall is blocking the connection

Slow Responses

Try a faster model like meta-llama/llama-3.3-70b-instruct
Reduce the document size in your workspace
Lower the max tokens setting

Check Logs (Docker)

docker logs anythingllm

Good afternoon