Enterprise Image Model Fidelity and Prompt Adherence Audit

Role: Staff Multimodal AI Researcher and Quality Benchmarking Lead

Context

• Enterprise Client: {{enterprise_client}}
• Evaluated Models: {{evaluated_models}}
• Core Subject Domains: {{core_subject_domains}}
• Prompt Complexity Tiers: {{prompt_complexity_tiers}}
• Fidelity Evaluation Criteria: {{fidelity_criteria}}
• Artifact Risk Threshold: {{artifact_risk_threshold}}

Task

Generate an in-depth benchmark audit report evaluating prompt following accuracy, spatial relation coherence, and artifact prevalence across {{evaluated_models}} for {{enterprise_client}} within {{core_subject_domains}}.

Method

1. Define prompt test suites stratified across {{prompt_complexity_tiers}} (simple, multi-subject, relational, and contextual).
2. Establish scoring rubrics for text alignment based on {{fidelity_criteria}}, measuring text-to-image semantic translation.
3. Measure multi-subject spatial positioning accuracy, counting attribute bleeding and relational placement failures.
4. Audit anatomical and geometric integrity against {{artifact_risk_threshold}} across repeated seed batches.
5. Evaluate text rendering capabilities and typographic coherence across models when explicit lettering is requested.
6. Compare prompt latency, token degradation thresholds, and cross-attention weight behavior across {{evaluated_models}}.
7. Synthesize findings into actionable deployment recommendations for commercial asset pipelines.

Constraints

• MUST provide quantitative benchmark scoring rubrics (scale of 1-10) with explicit qualitative criteria for each level.
• MUST evaluate specific failure modes including color contamination, limb distortion, and background hallucination.
• MUST NOT recommend models that exceed the specified {{artifact_risk_threshold}} without mitigation steps.
• Analysis MUST compare model performance directly across identical prompt strings in {{core_subject_domains}}.

Output format

Deliver the audit as a formal technical evaluation report with the following structure:

Executive Summary & Risk Assessment

Benchmark Methodology & Prompt Stratification

Comparative Model Scorecards (Detailed Analysis of {{evaluated_models}})

Subject Domain Analysis (Coverage of {{core_subject_domains}})

Artifact Prevalence & Failure Mode Matrix

Production Deployment Roadmap

Total report length should span 1,400 to 2,000 words.

Self-review

1. Verify that comparative scoring tables assess all models listed in {{evaluated_models}} equitably.
2. Ensure failure modes are explicitly detailed with concrete prompt examples demonstrating breakdown.
3. Check that deployment recommendations address the constraints defined in {{artifact_risk_threshold}}.