Closed-Loop Vision Agent Prompt Mutation and Repair Matrix

Role: Senior Vision-Language Evaluator and Automated Workflow Reliability Lead.

Context

• Critique Agent Engine: {{critique_agent_engine}}
• Image Generation Tool: {{image_generation_tool}}
• Target Defect Categories: {{defect_taxonomy}}
• Prompt Modification Operators: {{mutation_operators}}
• Max Correction Budget: {{max_iteration_budget}}
• Quality Acceptance Threshold: {{acceptance_threshold}}

Task

Develop an actionable prompt mutation and parameter repair matrix that enables an autonomous vision-critique agent to diagnose generation flaws and execute targeted prompt modifications across self-correcting tool-calling loops.

Method

1. Classify image generation flaws categorized in {{defect_taxonomy}} into prompt-addressable root causes.
2. Define visual verification probes for {{critique_agent_engine}} to reliably isolate artifacts.
3. Establish syntax modifications using {{mutation_operators}} (token weighting, keyword deletion, semantic substitution).
4. Formulate precise negative prompt counter-measures for each error category.
5. Determine parameter adjustments (CFG reduction, sampler change, seed reset) for {{image_generation_tool}}.
6. Structure step-by-step repair recipes that do not overwrite intact stylistic components of the original prompt.
7. Establish iteration stopping rules based on {{max_iteration_budget}} and {{acceptance_threshold}}.

Constraints

• MUST specify the exact regex or token replacement rule for each identified visual artifact.
• MUST NOT recommend total prompt rewrites; repairs must be localized and deterministic.
• Parameter adjustments MUST remain within valid limits for {{image_generation_tool}}.
• Negative counter-measures MUST NOT contain mutually contradictory tokens that collapse image saturation or detail.

Output format

1. Vision Critique Evaluation Framework

Metric definition and scoring rubric for {{acceptance_threshold}} (max 100 words).

2. Autonomous Prompt Repair Matrix

A markdown table with the following mandatory columns: | Defect Code | Visual Defect Description | Critique Detection Signature | Prompt Token Mutation Rule | Negative Prompt Injection | Parameter Adjustment | Confidence Escalation Action | (Provide exactly 6 distinct defect mitigation rows covering composition, anatomy, text/lettering, texture, lighting, and semantic drift).

3. Termination & Escalation Logic

Deterministic decision tree in markdown list format detailing behavior when {{max_iteration_budget}} is reached.

Self-review

• Are the prompt mutation rules directly executable by an automated script or agent tool?
• Does the matrix address all failure types listed in {{defect_taxonomy}}?
• Are parameter shifts calibrated specifically to the constraints of {{image_generation_tool}}?