From 278ef2277699ffcf78696a99613d598dcdf6c60d Mon Sep 17 00:00:00 2001 From: Xubin Ren Date: Tue, 28 Apr 2026 07:37:58 +0000 Subject: [PATCH] docs(config): document provider extra body Show how to configure OpenAI-compatible request body extensions such as sampling and chat template parameters. Made-with: Cursor --- docs/configuration.md | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/docs/configuration.md b/docs/configuration.md index 513a35ebd..c919db067 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -208,6 +208,25 @@ Connects directly to any OpenAI-compatible endpoint — llama.cpp, Together AI, > > In short: **chat-completions-compatible endpoint → `custom`**; **Responses-compatible endpoint → `azure_openai`**. +Some OpenAI-compatible gateways expose request-body extensions such as vLLM guided decoding or local sampling controls. Put those under `extraBody`; nanobot merges them into the chat-completions request body after its provider defaults: + +```json +{ + "providers": { + "custom": { + "apiKey": "your-api-key", + "apiBase": "https://api.your-provider.com/v1", + "extraBody": { + "repetition_penalty": 1.15, + "chat_template_kwargs": { + "enable_thinking": false + } + } + } + } +} +``` +