chengyongru 0e754d2591 feat(multimodal): re-implement audio/video support on main ...

Re-implements PR #2908's generalized multimodal support on the
post-FSM main branch:

- Audio input: detects WAV/MP3/OGG/FLAC via magic bytes, sends
  input_audio blocks to compatible providers, falls back to
  [audio: path] placeholder when unsupported.
- Video input: sends video_url data-URI blocks to compatible
  providers, falls back to [video: path] placeholder.
- InputLimitsConfig: count limits (images/audios/videos) and byte
  limits per media type.
- AgentDefaults: pattern-matched vision_models, audio_models,
  video_models with supports_*() helpers.
- Provider retry: strips all media types (image_url, input_audio,
  video_url) on non-transient errors and retries once.
- Feishu: extracts media tags from post messages.
- Anthropic & OpenAI Responses converters handle audio/video.

Tests: 17 new multimodal tests + existing suite passes.

2026-05-20 11:47:01 +08:00

..

test_ant_ling_provider.py

feat(providers): add Ant Ling support

2026-05-18 22:13:52 +08:00

test_anthropic_long_request_fallback.py

test(provider): tidy Anthropic fallback imports

2026-05-01 23:59:24 +08:00

test_anthropic_merge_consecutive.py

fix(anthropic): also enforce leading-user + empty-array recovery

2026-04-21 01:32:32 +08:00

test_anthropic_stream_idle.py

feat(webui): stream live file edit events

2026-05-18 22:01:33 +08:00

test_anthropic_thinking.py

test(providers): cover reasoning_effort="none" and gemma auto-routing

2026-04-29 15:41:11 +08:00

test_anthropic_tool_result.py

test(anthropic): pin tool_result image_url conversion regression

2026-04-22 22:10:53 +08:00

test_azure_openai_provider.py

test(providers): cover reasoning_effort="none" and gemma auto-routing

2026-04-29 15:41:11 +08:00

test_bedrock_provider.py

fix(provider): preserve Bedrock tool config for history

2026-05-12 20:59:01 +08:00

test_cached_tokens.py

fix(providers): normalize anthropic cached token usage

2026-04-02 12:51:45 +08:00

test_custom_provider.py

fix(provider): preserve static error helper compatibility

2026-04-13 09:37:31 +08:00

test_enforce_role_alternation.py

refactor(agent): tighten comments, extract constant, strengthen edge case test

2026-04-17 16:20:53 +08:00

test_extra_body_config.py

feat(providers): add extra_body config for OpenAI-compatible endpoints

2026-04-28 15:56:13 +08:00

test_github_copilot_routing.py

test(providers): add regression tests for GitHub Copilot /responses routing

2026-04-22 06:53:37 +00:00

test_image_generation.py

feat(image-generation): add StepFun provider support and StepPlan docs

2026-05-20 00:08:38 +08:00

test_litellm_kwargs.py

feat(webui): stream live file edit events

2026-05-18 22:01:33 +08:00

test_llm_response.py

feat(webui): stream live file edit events

2026-05-18 22:01:33 +08:00

test_local_endpoint_detection.py

fix(providers): tighten local endpoint detection

2026-04-26 16:14:24 +08:00

test_longcat_provider.py

fix(provider): correct LongCat OpenAI base URL

2026-05-02 01:52:04 +08:00

test_minimax_anthropic_provider.py

docs(providers): explain MiniMax thinking endpoint

2026-04-16 01:00:45 +08:00

test_mistral_provider.py

refactor: replace litellm with native openai + anthropic SDKs

2026-03-25 01:58:48 +08:00

test_openai_codex_provider.py

fix(ci): update live file edit test expectations

2026-05-18 22:01:33 +08:00

test_openai_compat_timeout.py

fix(provider): bound OpenAI-compatible request timeouts

2026-04-27 17:47:31 +08:00

test_openai_responses.py

feat(webui): stream live file edit events

2026-05-18 22:01:33 +08:00

test_prompt_cache_markers.py

fix(cache): stabilize tool ordering and cache markers for MCP

2026-04-01 17:07:22 +00:00

test_provider_error_metadata.py

refactor: remove dead _error_response wrapper in Anthropic provider

2026-04-06 08:35:02 +00:00

test_provider_retry_after_hints.py

fix: robust Retry-After extraction across provider backends

2026-04-02 18:39:24 +00:00

test_provider_retry.py

feat(multimodal): re-implement audio/video support on main

2026-05-20 11:47:01 +08:00

test_provider_sdk_retry_defaults.py

fix(providers): disable Azure SDK retries by default

2026-04-04 12:36:45 +08:00

test_providers_init.py

add native Bedrock Converse provider

2026-05-01 18:52:03 +08:00

test_reasoning_content.py

test(providers): cover reasoning_content extraction in OpenAI compat provider

2026-04-04 02:09:57 +08:00

test_responses_circuit_breaker.py

fix: normalize responses circuit breaker keys

2026-04-19 20:16:25 +08:00

test_skywork_provider.py

feat(providers): add Skywork provider support

2026-05-20 02:20:44 +08:00

test_stepfun_reasoning.py

fix(provider): gate reasoning-to-content fallback behind spec flag

2026-04-26 20:11:08 +08:00

test_transcription.py

fix(transcription): address review nits on PR #3253

2026-05-06 15:52:29 +08:00

test_xiaomi_mimo_thinking.py

fix(providers): wire MiMo thinking control on gateway providers (#3845)

2026-05-16 20:46:34 +08:00