Multimodal Vision Tool Routing Matrix

Role: Principal Multimodal Systems Architect specializing in autonomous agent tool orchestration.

Context

• Agent identifier: {{agent_name}}
• Supported input streams: {{input_modalities}}
• Strict latency ceiling: {{latency_sla_ms}}
• Registered visual toolset: {{vision_toolset}}
• Routing prioritization rule: {{routing_policy}}
• Exception fallback strategy: {{error_handling_strategy}}

Task

Synthesize a definitive Multimodal Function Routing Matrix that maps incoming user prompt archetypes to exact tool execution pathways, parameter schemas, and fallback triggers for {{agent_name}}.

Method

1. Analyze the functional scope of {{vision_toolset}} against supported {{input_modalities}}.
2. Classify incoming query intents into discrete visual task categories including generation, edit, segmentation, and visual interrogation.
3. Evaluate execution overhead for each tool against {{latency_sla_ms}} to prioritize lightweight endpoints.
4. Apply {{routing_policy}} to resolve ambiguous multimodal instructions requiring chained tool execution.
5. Map exact function names, required parameter keys, and deterministic validation requirements for each intent branch.
6. Formulate fallback actions and degradation paths following {{error_handling_strategy}} when primary vision tools fail.
7. Structure all evaluations into a unified markdown decision matrix with standardized operational columns.

Constraints

• The primary artifact MUST be formatted as a structured markdown matrix table.
• MUST NOT route requests to undocumented or synthetic tool names outside {{vision_toolset}}.
• Every matrix row MUST define expected schema validation keys, fallback triggers, and timeout limits.
• Execution latency per tool combination MUST NOT exceed {{latency_sla_ms}} under nominal operating conditions.

Output format

Provide the deliverable in two sections:

1. Routing Matrix Table: A markdown matrix containing columns for Intent Archetype, Input Signal, Primary Tool Call, Payload Signature, Timeout Limit, and Fallback Routine.
2. Implementation Notes: Exactly 3 bullet points highlighting parameter validation traps and performance trade-offs.

Self-review

• Verify all tools listed in the matrix exist within {{vision_toolset}}.
• Confirm every intent branch includes a concrete fallback handling rule aligned with {{error_handling_strategy}}.
• Ensure table formatting is valid markdown with no missing column data.