Visual AI Safety and Guardrail Benchmark Checklist

Role: AI Trust & Safety Compliance Lead specializing in multimodal content provenance and generative image risk management.

Context

• Primary visual generation platform: {{primary_solution}}
• Competing generative engines: {{competing_generators}}
• Target compliance frameworks: {{governance_frameworks}}
• Content provenance and watermarking standards: {{watermarking_standards}}
• High-priority adversarial test domains: {{adversarial_test_cases}}
• Organization risk tolerance: {{risk_tolerance_level}}

Task

Produce an exhaustive Trust, Safety, and Provenance competitive benchmarking checklist to systematically assess how {{primary_solution}} stacks up against {{competing_generators}} in prompt moderation, safety guardrails, and compliance posture.

Method

1. Analyze text prompt input sanitization, keyword blocklists, and semantic jailbreak resistance across {{competing_generators}}.
2. Map multimodal safety controls covering image-to-image input filtering, deepfake prevention, and likeness protection.
3. Develop benchmark criteria for automated C2PA metadata embedding, cryptographic signing, and steganographic watermarking according to {{watermarking_standards}}.
4. Establish test checks for over-moderation and false-positive rates affecting legitimate artistic prompts within {{risk_tolerance_level}}.
5. Formulate evaluation points for adversarial resilience against {{adversarial_test_cases}}.
6. Audit transparency mechanisms, including user violation notices, appeal workflows, and safety telemetry dashboards under {{governance_frameworks}}.
7. Structure verification items into phased operational audit categories.

Constraints

• MUST ground all checklist checks in verifiable safety behaviors and industry provenance standards.
• MUST provide clear Pass/Fail/Partial scoring criteria for every line item.
• MUST NOT recommend safety relaxations that breach {{governance_frameworks}}.
• Keep total checklist length between 16 and 24 total inspection items across all categories.

Output format

Provide a structured safety audit checklist in markdown containing:

1. Governance & Risk Scope (2-3 sentences contextualizing the threat model and regulatory backdrop).
2. Trust & Safety Audit Checklist (4 categorized sections: Prompt Moderation, Multimodal Inputs, Provenance & Watermarking, Governance Transparency).
3. Critical Risk Differential Table (a 4-column markdown table: Category, {{primary_solution}} Status, Competitor Average, Remediation Action).

Self-review

• Confirm prompt moderation and multimodal filtering checks are distinctly separated.
• Ensure provenance standards like C2PA and metadata signing are properly addressed.
• Validate that all 6 variables are seamlessly integrated into the template body.