OpenAI-Compatible API

nanobot can expose a minimal OpenAI-compatible endpoint for local integrations:

pip install "nanobot-ai[api]"
nanobot serve

By default, the API binds to 127.0.0.1:8900. You can change this in config.json.

Behavior

Session isolation: pass "session_id" in the request body to isolate conversations; omit for a shared default session (api:default)
Single-message input: each request must contain exactly one user message
Fixed model: omit model, or pass the same model shown by /v1/models
Streaming: set stream=true to receive Server-Sent Events (text/event-stream) with OpenAI-compatible delta chunks, terminated by data: [DONE]; omit or set stream=false for a single JSON response
File uploads: supports images, PDF, Word (.docx), Excel (.xlsx), PowerPoint (.pptx) via JSON base64 or multipart/form-data (max 10MB per file)
API requests run in the synthetic api channel, so the message tool does not automatically deliver to Telegram/Discord/etc. To proactively send to another chat, call message with an explicit channel and chat_id for an enabled channel.

Example tool call for cross-channel delivery from an API session:

{
  "content": "Build finished successfully.",
  "channel": "telegram",
  "chat_id": "123456789"
}

If channel points to a channel that is not enabled in your config, nanobot will queue the outbound event but no platform delivery will occur.

Endpoints

GET /health
GET /v1/models
POST /v1/chat/completions

curl

curl http://127.0.0.1:8900/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "messages": [{"role": "user", "content": "hi"}],
    "session_id": "my-session"
  }'

File Upload (JSON base64)

Send images inline using the OpenAI multimodal content format:

curl http://127.0.0.1:8900/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "messages": [{"role": "user", "content": [
      {"type": "text", "text": "Describe this image"},
      {"type": "image_url", "image_url": {"url": "data:image/png;base64,iVBOR..."}}
    ]}]
  }'

File Upload (multipart/form-data)

Upload any supported file type (images, PDF, Word, Excel, PPT) via multipart:

# Single file
curl http://127.0.0.1:8900/v1/chat/completions \
  -F "message=Summarize this report" \
  -F "files=@report.docx"

# Multiple files with session isolation
curl http://127.0.0.1:8900/v1/chat/completions \
  -F "message=Compare these files" \
  -F "files=@chart.png" \
  -F "files=@data.xlsx" \
  -F "session_id=my-session"

Supported file types:

Images: PNG, JPEG, GIF, WebP (sent to AI as base64 for vision analysis)
Documents: PDF, Word (.docx), Excel (.xlsx), PowerPoint (.pptx) (text extracted and sent to AI)
Text: TXT, Markdown, CSV, JSON, etc. (read directly)

Python (`requests`)

import requests

resp = requests.post(
    "http://127.0.0.1:8900/v1/chat/completions",
    json={
        "messages": [{"role": "user", "content": "hi"}],
        "session_id": "my-session",  # optional: isolate conversation
    },
    timeout=120,
)
resp.raise_for_status()
print(resp.json()["choices"][0]["message"]["content"])

Python (`openai`)

from openai import OpenAI

client = OpenAI(
    base_url="http://127.0.0.1:8900/v1",
    api_key="dummy",
)

resp = client.chat.completions.create(
    model="MiniMax-M2.7",
    messages=[{"role": "user", "content": "hi"}],
    extra_body={"session_id": "my-session"},  # optional: isolate conversation
)
print(resp.choices[0].message.content)

3.6 KiB Raw Blame History