mirror/nanobot
1
0
Fork 0
mirror of https://github.com/HKUDS/nanobot.git synced 2026-05-01 23:35:52 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(providers): make max_tokens and max_completion_tokens mutually exclusive (#2491)

Browse Source 
* fix(providers): make max_tokens and max_completion_tokens mutually exclusive

* docs: document supports_max_completion_tokens ProviderSpec option
This commit is contained in:
Flo 2026-03-27 13:10:04 +03:00 committed by GitHub
parent 9aa2116e24
commit d96b0b7833
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
3 changed files with 9 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
README.md
View File

@ -110,6 +110,8 @@
- [🌐 Agent Social Network](#-agent-social-network) - [🌐 Agent Social Network](#-agent-social-network)
- [⚙️ Configuration](#️-configuration) - [⚙️ Configuration](#️-configuration)
- [Providers](#providers) - [Providers](#providers)
- [Channel Settings](#channel-settings)
- [Retry Behavior](#retry-behavior)
- [Web Search](#web-search) - [Web Search](#web-search)
- [MCP (Model Context Protocol)](#mcp-model-context-protocol) - [MCP (Model Context Protocol)](#mcp-model-context-protocol)
- [Security](#security) - [Security](#security)
@ -1248,6 +1250,7 @@ That's it! Environment variables, model routing, config matching, and `nanobot s
| `detect_by_key_prefix` | Detect gateway by API key prefix | `"sk-or-"` | | `detect_by_key_prefix` | Detect gateway by API key prefix | `"sk-or-"` |
| `detect_by_base_keyword` | Detect gateway by API base URL | `"openrouter"` | | `detect_by_base_keyword` | Detect gateway by API base URL | `"openrouter"` |
| `strip_model_prefix` | Strip provider prefix before sending to gateway | `True` (for AiHubMix) | | `strip_model_prefix` | Strip provider prefix before sending to gateway | `True` (for AiHubMix) |
| `supports_max_completion_tokens` | Use `max_completion_tokens` instead of `max_tokens`; required for providers that reject both being set simultaneously (e.g. VolcEngine) | `True` |
</details> </details>

7
nanobot/providers/openai_compat_provider.py
View File

@ -229,11 +229,14 @@ class OpenAICompatProvider(LLMProvider):
kwargs: dict[str, Any] = { kwargs: dict[str, Any] = {
"model": model_name, "model": model_name,
"messages": self._sanitize_messages(self._sanitize_empty_content(messages)), "messages": self._sanitize_messages(self._sanitize_empty_content(messages)),
"max_tokens": max(1, max_tokens),
"max_completion_tokens": max(1, max_tokens),
"temperature": temperature, "temperature": temperature,
} }
if spec and getattr(spec, "supports_max_completion_tokens", False):
kwargs["max_completion_tokens"] = max(1, max_tokens)
else:
kwargs["max_tokens"] = max(1, max_tokens)
if spec: if spec:
model_lower = model_name.lower() model_lower = model_name.lower()
for pattern, overrides in spec.model_overrides: for pattern, overrides in spec.model_overrides:

1
nanobot/providers/registry.py
View File

@ -49,6 +49,7 @@ class ProviderSpec:
# gateway behavior # gateway behavior
strip_model_prefix: bool = False # strip "provider/" before sending to gateway strip_model_prefix: bool = False # strip "provider/" before sending to gateway
supports_max_completion_tokens: bool = False
# per-model param overrides, e.g. (("kimi-k2.5", {"temperature": 1.0}),) # per-model param overrides, e.g. (("kimi-k2.5", {"temperature": 1.0}),)
model_overrides: tuple[tuple[str, dict[str, Any]], ...] = () model_overrides: tuple[tuple[str, dict[str, Any]], ...] = ()