95160a304d
feat(tools): add model-agnostic computer use (computer_use + browser tools)
...
Adds two opt-in agent tools for controlling a computer:
- computer_use: pixel-based (screenshot + mouse/keyboard) via a desktop
(pyautogui) or browser (playwright) backend.
- browser: DOM/accessibility-based web automation (act by element ref),
reliable across ANY tool-calling model, not just vision/CU-trained ones.
Core enabler in the runner: a tool may return image content blocks, which
are split out and delivered to the model as a follow-up user message
(_split_tool_result_media), so screenshots reach any vision provider
(e.g. via OpenRouter/openai-compat) without provider-specific code.
Both tools are OFF by default (tools.computerUse.enable / tools.browser.enable),
are not exposed to subagents, and the browser tool supports an allowed_domains
allowlist. Heavy deps (pyautogui/pillow/playwright) are an optional [computer-use] extra.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com >
2026-08-09 01:12:13 +09:00
Xubin Ren
af52fbcbc4
fix(webui): emphasize temporary chat expiry
2026-08-08 23:20:59 +08:00
Xubin Ren
92eb91338a
fix(webui): label temporary chat guidance
2026-08-08 23:20:59 +08:00
Xubin Ren
c410ea444c
fix(agent): stop session-owned exec processes
2026-08-08 23:20:59 +08:00
chengyongru and Xubin Ren
8e04f12720
fix(webui): name temporary chats from first message
2026-08-08 23:20:59 +08:00
chengyongru and Xubin Ren
516ae11c33
fix(webui): simplify temporary chat closing
2026-08-08 23:20:59 +08:00
chengyongru and Xubin Ren
656e0d606b
fix(webui): tighten temporary chat close action
2026-08-08 23:20:59 +08:00
chengyongru and Xubin Ren
75e333a3c5
fix(webui): derive temporary chats from session policy
2026-08-08 23:20:59 +08:00
chengyongru and Xubin Ren
a5bc3bfbb9
fix(webui): complete temporary chat mode
2026-08-08 23:20:59 +08:00
Xubin Ren
c9a6145878
feat(webui): add temporary chat mode
2026-08-08 23:20:59 +08:00
chengyongru and chengyongru
113e8d67ad
refactor: remove verified dead code
2026-08-08 21:10:34 +08:00
chengyongru and GitHub
4e063f5695
fix(webui): prevent image hover clipping ( #5294 )
2026-08-08 18:05:00 +08:00
chengyongru and chengyongru
bd8d3ad5b6
fix(channels): preserve global progress defaults
2026-08-07 17:19:14 +08:00
chengyongru and GitHub
332c159b93
fix(weixin): harden protocol delivery, streaming, and login ( #5263 )
2026-08-07 16:53:31 +08:00
chengyongru and chengyongru
edb3b7e446
fix(webui): preserve newly created topic route
2026-08-07 16:10:01 +08:00
chengyongru and chengyongru
cdb2a474f9
refactor(webui): remove legacy session messages route
2026-08-07 15:16:57 +08:00
chengyongru and GitHub
ff6deda178
fix: modernize dependency recovery guidance ( #5282 )
2026-08-07 13:58:13 +08:00
chengyongru and chengyongru
02a002a0e6
fix(webui): preserve activity text rendering
2026-08-07 13:04:42 +08:00
Xubin Ren
3836c32874
fix(webui): scope preset editor to one row
2026-08-07 12:42:37 +08:00
Xubin Ren
3fc69b2922
style(webui): inset expanded preset editor
2026-08-07 12:42:37 +08:00
Xubin Ren
eb5d7e1a32
style(webui): distinguish expanded preset editor
2026-08-07 12:42:37 +08:00
Xubin Ren
b77e1133cb
fix(webui): preserve preset deletion workflow
2026-08-07 12:42:37 +08:00
Xubin Ren
1b12fbae39
fix(webui): explain disabled preset deletion
2026-08-07 12:42:37 +08:00
Xubin Ren
6f2512ce9a
style(webui): retain model preset colors
2026-08-07 12:42:37 +08:00
Xubin Ren
c8bc4d8510
fix(webui): make active model presets deletable
2026-08-07 12:42:37 +08:00
Xubin Ren
e971e81b6c
refactor(webui): expand model preset editor inline
2026-08-07 12:42:37 +08:00
Xubin Ren
ada07aa799
feat(webui): add responsive model preset detail pane
2026-08-07 12:42:37 +08:00
chengyongru and chengyongru
2c7943a133
fix(memory): archive short idle sessions for Dream
2026-08-07 11:45:49 +08:00
chengyongru and chengyongru
8dfce4c162
fix(session): require user anchor for delivery retention
2026-08-07 10:53:55 +08:00
ziuus and chengyongru
60282d1588
fix(session): preserve proactive channel delivery during session retention trimming
2026-08-07 10:53:55 +08:00
Xubin Ren
c2fd41b44d
fix(webui): persist large sidebar ordering state
2026-08-06 19:11:05 +08:00
Xubin Ren
1d290614c9
fix(webui): align composer mention metrics
2026-08-06 19:11:05 +08:00
Xubin Ren
9af6bb91c7
fix(webui): preserve session drag contracts
2026-08-06 19:11:05 +08:00
Xubin Ren
f44a766f98
feat(webui): preview dragged session mentions
2026-08-06 19:11:05 +08:00
Xubin Ren
9cf6cf0639
feat(webui): persist manual session ordering
2026-08-06 19:11:05 +08:00
Xubin Ren
2c8e63446f
feat(webui): drag sessions into composer mentions
2026-08-06 19:11:05 +08:00
Orrin Witt and GitHub
5c4c2cb819
fix(matrix): send non-empty POST body on room join for Continuwuity compatibility ( #5248 )
2026-08-06 18:29:57 +08:00
chengyongru and chengyongru
223b911e7e
fix(webui): tighten interactive motion
2026-08-06 18:28:45 +08:00
chengyongru and GitHub
a95fd0ee82
perf(webui): reduce cold-start payload ( #5262 )
2026-08-06 13:24:34 +08:00
chengyongru and GitHub
67805f5db8
feat: add provider-native request switches ( #5254 )
2026-08-05 18:26:39 +08:00
chengyongru and GitHub
5a1ab44baa
fix(whatsapp): detect outbound media content before dispatch ( #5203 )
2026-08-05 15:44:23 +08:00
chengyongru and GitHub
9098ffd38f
refactor(webui): improve visual consistency ( #5249 )
2026-08-05 13:24:45 +08:00
chengyongru and chengyongru
a54d5d14cb
fix(webui): feather clipped activity edges
2026-08-05 11:10:46 +08:00
chengyongru and GitHub
6e9ae5bd05
refactor(session): remove request-scoped access grants ( #5238 )
2026-08-05 10:18:46 +08:00
Xubin Ren and chengyongru
858f6d96a6
fix(mattermost): preserve thread policy compatibility
2026-08-05 09:31:55 +08:00
Kenneth Zhao and chengyongru
cd4c1d0f6e
feat(mattermost): separate group policy for threads vs channels
2026-08-05 09:31:55 +08:00
Xubin Ren
be5af019b9
fix(wecom): sanitize fallback media filename
2026-08-04 22:04:21 +08:00
santhreal and Xubin Ren
98507ae4fe
fix(wecom): fallback to default filename when sanitize strips to empty
2026-08-04 22:04:21 +08:00
concertypin and Xubin Ren
cb2f9d0bbd
fix(webui): configure public websocket URL
2026-08-04 21:53:16 +08:00
concertypin and Xubin Ren
e318e21cad
fix(webui): require proxy-generated auth assertions
2026-08-04 21:53:16 +08:00
chengyongruandXubin Ren
chengyongruandchengyongru
ziuusandchengyongru
Orrin WittandGitHub
Kenneth Zhaoandchengyongru
santhrealandXubin Ren
concertypinandXubin Ren