From 15dba8d0803c8d2c5a3fd8c556f7e550385482e9 Mon Sep 17 00:00:00 2001 From: Xubin Ren <52506698+Re-bin@users.noreply.github.com> Date: Tue, 19 May 2026 22:15:09 +0800 Subject: [PATCH] Polish local provider docs --- README.md | 2 +- docs/configuration.md | 18 ++++++++++++++---- 2 files changed, 15 insertions(+), 5 deletions(-) diff --git a/README.md b/README.md index c025f67fe..b5e4b02c0 100644 --- a/README.md +++ b/README.md @@ -212,7 +212,7 @@ nanobot agent - Want different LLM providers, web search, MCP, security settings, or more config options? See [Configuration](./docs/configuration.md) -- Want to run locally? Use Atomic Chat, Ollama, LM Studio, OpenVINO Model Server, vLLM, or any OpenAI-compatible local server. See [Configuration](./docs/configuration.md) +- Want to run locally? Use [Atomic Chat](./docs/configuration.md#atomic-chat-local), [vLLM](./docs/configuration.md#vllm-local-openai-compatible), [Ollama](./docs/configuration.md#ollama-local), and [others](./docs/configuration.md#local-providers). - Want to run nanobot in chat apps like Telegram, Discord, WeChat or Feishu? See [Chat Apps](./docs/chat-apps.md) - Want Docker or Linux service deployment? See [Deployment](./docs/deployment.md) diff --git a/docs/configuration.md b/docs/configuration.md index bc06588dc..fed07ff2d 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -541,6 +541,8 @@ Some OpenAI-compatible gateways expose request-body extensions such as vLLM guid + +
Ollama (local) @@ -606,12 +608,19 @@ ollama run llama3.2
+
Atomic Chat (local) -[Atomic Chat](https://atomic.chat/) is a local-first desktop app that exposes an **OpenAI-compatible** HTTP API (default `http://localhost:1337/v1`). Start Atomic Chat and enable the local API server, then point nanobot at it. +[Atomic Chat](https://atomic.chat/) is a local-first desktop app that exposes an **OpenAI-compatible** HTTP API (default `http://localhost:1337/v1`). Use it when you want to run nanobot against a model on your own machine instead of a hosted API provider. -**1. Add to config** (partial — merge into `~/.nanobot/config.json`): +**1. Start Atomic Chat** + +- Install [Atomic Chat](https://atomic.chat/) on your machine. +- Open Atomic Chat, download a model, and keep the app running. The local API is enabled by default. +- Copy the model ID exposed by the local API. For example, the model ID for `Qwen 3 32B` might be `qwen3-32b`. + +**2. Add to config** (partial — merge into `~/.nanobot/config.json`): ```json { @@ -624,13 +633,13 @@ ollama run llama3.2 "agents": { "defaults": { "provider": "atomic_chat", - "model": "your-model-id-from-atomic-chat" + "model": "qwen3-32b" } } } ``` -> **Note:** Set `apiKey` to `null` if your Atomic Chat server does not require a key. If it does, set `apiKey` (or the `ATOMIC_CHAT_API_KEY` environment variable) to the value Atomic Chat expects. The `model` string must match the model id Atomic Chat exposes on its OpenAI-compatible endpoint. +> **Note:** Replace `qwen3-32b` with the model ID from Atomic Chat. Set `apiKey` to `null` if your Atomic Chat server does not require a key. If it does, set `apiKey` (or the `ATOMIC_CHAT_API_KEY` environment variable) to the value Atomic Chat expects. > `provider: "auto"` also works when `providers.atomic_chat.apiBase` is configured, but setting `"provider": "atomic_chat"` is the clearest option. @@ -711,6 +720,7 @@ docker run -d \ > See the [official OVMS docs](https://docs.openvino.ai/2026/model-server/ovms_docs_llm_quickstart.html) for more details.
+
vLLM (local / OpenAI-compatible)