mirror/nanobot
1
0
Fork 0
mirror of https://github.com/HKUDS/nanobot.git synced 2026-05-20 16:42:25 +00:00
Code Issues Packages Projects Releases Wiki Activity

fix(api): remove enable_compression to restore real SSE streaming

Browse Source 
The HTTP compression buffer in aiohttp held all SSE chunks until
the stream ended, making streaming appear batched instead of
incremental. SSE payloads are small and frequent, so compression
provides negligible benefit while breaking real-time delivery.
This commit is contained in:
zhonghongwei 2026-05-07 10:26:51 +08:00 committed by Xubin Ren
parent 536c456e5e
commit 6a3069514c
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
nanobot/api/server.py
View File

@ -239,7 +239,6 @@ async def handle_chat_completions(request: web.Request) -> web.Response:
resp.content_type = "text/event-stream" resp.content_type = "text/event-stream"
resp.headers["Cache-Control"] = "no-cache" resp.headers["Cache-Control"] = "no-cache"
resp.headers["Connection"] = "keep-alive" resp.headers["Connection"] = "keep-alive"
resp.enable_compression()
await resp.prepare(request) await resp.prepare(request)
chunk_id = f"chatcmpl-{uuid.uuid4().hex[:12]}" chunk_id = f"chatcmpl-{uuid.uuid4().hex[:12]}"