---
title: AnythingLLM | RunAPI
description: Install AnythingLLM, configure its Generic OpenAI provider for RunAPI,
  choose model limits, and verify a workspace chat.
url: https://runapi.ai/docs/resources/application-practices/anythingllm.md
canonical: https://runapi.ai/docs/resources/application-practices/anythingllm
locale: en
---

> HTML version: https://runapi.ai/docs/resources/application-practices/anythingllm
> Site index for agents: https://runapi.ai/llms.txt

# AnythingLLM

AnythingLLM exposes a developer-focused **OpenAI (generic)** provider
for compatible Chat Completions services. Before starting, create a
standard RunAPI API key in the [Authentication
Guide](https://runapi.ai/docs/guides/authentication.md) and choose a model from the [Model
Catalog](https://runapi.ai/models).

## Install AnythingLLM

Install the desktop or self-hosted edition using the [official
AnythingLLM installation guide][1]. Open AnythingLLM and finish its
initial setup before changing the LLM provider.



[1]: https://docs.anythingllm.com/installation-desktop/overview

## Configure OpenAI (generic)

1.  Open **Settings → LLM Preference** and select **OpenAI (generic)**.
2.  Enter `https://runapi.ai/v1` as the **Base URL**. Do not append
    `/chat/completions`; AnythingLLM adds the operation path.
3.  Enter your RunAPI API key.
4.  Choose the exact RunAPI identifier under **Selected Model**. If the
    model list is empty, type the identifier from the [Model
    Catalog](https://runapi.ai/models).
5.  Set **Model context window** and **Max Tokens** to values supported
    by that model, then save the provider.

AnythingLLM uses **Model context window** to budget system instructions,
history, and user input. It sends **Max Tokens** as `max_tokens`, so
these values must follow the selected model rather than a universal
example.

## Verify the connection

Create or open a workspace, start a chat, and send `Reply with the word
connected.` A text reply confirms that the workspace is using the saved
RunAPI provider and Selected Model.

## Troubleshoot

* **No models are listed:** verify the Base URL is exactly
  `https://runapi.ai/v1`, then enter a current model identifier
  manually.
* **The request is rejected for length:** reduce workspace history or
  correct **Model context window** and **Max Tokens** using the selected
  model's current limits.
* **Authentication fails:** update the API key in **OpenAI (generic)**
  with a valid standard key from the [Authentication
  Guide](https://runapi.ai/docs/guides/authentication.md).
* **Another model answers the workspace:** reopen **LLM Preference**,
  confirm **OpenAI (generic)** is active, and save the intended
  **Selected Model** again.

For the shared protocol behavior, use the [LLM API
Quickstart](https://runapi.ai/docs/guides/llm-api/quickstart.md). For request and response
fields, use the [Chat Completions API
Reference](https://runapi.ai/docs/api/openai/chat-completions.md).

---

## More from RunAPI

- [Home](https://runapi.ai/.md)
- [Models](https://runapi.ai/models.md)
- [AI Video API Comparison](https://runapi.ai/ai-video-api-comparison.md)
- [OpenClaw Integration](https://runapi.ai/openclaw.md)
- [Best API for OpenClaw](https://runapi.ai/best-api-for-openclaw.md)
- [OpenClaw Image Generation](https://runapi.ai/openclaw-image-generation.md)
- [Hermes Agent Integration](https://runapi.ai/hermes-agent.md)
- [Pricing](https://runapi.ai/pricing.md)
- [Claude API Pricing](https://runapi.ai/claude-api-pricing.md)
- [ChatGPT API Pricing](https://runapi.ai/chatgpt-api-pricing.md)
- [OpenAI API Pricing](https://runapi.ai/openai-api-pricing.md)
- [Gemini API Pricing](https://runapi.ai/gemini-api-pricing.md)
- [Claude Code Pricing](https://runapi.ai/claude-code-pricing.md)
- [Claude Code API](https://runapi.ai/claude-code-api.md)
- [Claude Code vs Cursor](https://runapi.ai/claude-code-vs-cursor.md)
- [Claude Max vs API](https://runapi.ai/claude-max-vs-api.md)
- [Requesty Alternative](https://runapi.ai/requesty-alternative.md)
- [Docs](https://runapi.ai/docs/guides)
- [SDK](https://runapi.ai/sdk.md)
- [Skills](https://runapi.ai/skills.md)
- [MCP Server](https://runapi.ai/mcp.md)
- [CLI](https://runapi.ai/cli.md)
- [Feedback](https://runapi.ai/)
- [Contact](mailto:support@runapi.ai)
- [Terms](https://runapi.ai/terms.md)
- [Privacy](https://runapi.ai/privacy.md)
- [Site index for agents](https://runapi.ai/llms.txt)

Contact: contact@runapi.ai

## Structured data

```json
[
  {
    "@context": "https://schema.org",
    "inLanguage": "en",
    "@type": "WebSite",
    "name": "RunAPI",
    "url": "https://runapi.ai/",
    "potentialAction": {
      "@type": "SearchAction",
      "target": {
        "@type": "EntryPoint",
        "urlTemplate": "https://runapi.ai/models?q={search_term_string}"
      },
      "query-input": "required name=search_term_string"
    }
  },
  {
    "@context": "https://schema.org",
    "inLanguage": "en",
    "@type": "Organization",
    "name": "RunAPI",
    "url": "https://runapi.ai/",
    "logo": {
      "@type": "ImageObject",
      "url": "https://runapi.ai/icon.svg"
    },
    "sameAs": [
      "https://github.com/runapi-ai"
    ]
  },
  {
    "@context": "https://schema.org",
    "inLanguage": "en",
    "@type": "TechArticle",
    "headline": "AnythingLLM",
    "description": "Install AnythingLLM, configure its Generic OpenAI provider for RunAPI, choose model limits, and verify a workspace chat.",
    "url": "https://runapi.ai/docs/resources/application-practices/anythingllm",
    "mainEntityOfPage": "https://runapi.ai/docs/resources/application-practices/anythingllm"
  }
]
```