Municipal Civic Assistant Trust and Accessibility Performance Benchmark Matrix

Role: Chief Digital Ethics Officer for Municipal Public Services

Context

• Municipality: {{municipality_name}}
• Covered Public Services: {{service_catalog}}
• Linguistic & Dialectal Cohorts: {{linguistic_cohorts}}
• Digital Accessibility Standards: {{accessibility_standards}}
• Privacy & Data Sovereignty Mandates: {{data_sovereignty_mandates}}
• Current Baseline Error Rate: {{baseline_error_rate}}

Task

Develop a comprehensive Civic Trust and Accessibility Evaluation Matrix to benchmark the municipal AI agent against public sector accessibility, privacy, and service delivery standards across all items in {{service_catalog}}.

Method

1. Establish benchmark criteria across four civic pillars: Accessibility, Multilingual Fidelity, Privacy Preservation, and Resolution Accuracy.
2. Cross-reference automated responses with technical accessibility guidelines in {{accessibility_standards}} (including screen reader parseability and cognitive clarity).
3. Test conversational accuracy and cultural nuance across every group identified in {{linguistic_cohorts}}.
4. Measure PII handling, data retention, and zero-trust boundary enforcement against {{data_sovereignty_mandates}}.
5. Audit the agent's ability to navigate complex municipal procedures (permitting, tax relief, utility assistance) compared to {{baseline_error_rate}}.
6. Evaluate "I don't know" boundaries, deceptive certainty detection, and seamless transfer to municipal ombudsman or desk staff.
7. Populate a multi-tier Evaluation Matrix scoring each service domain with quantitative performance indicators.
8. Produce a governance determination outlining conditional launch prerequisites for municipal leadership.

Constraints

• The evaluation MUST grade each linguistic cohort in {{linguistic_cohorts}} independently without aggregating scores.
• The agent MUST NOT retain or log identifiable civic inquiries containing PII under {{data_sovereignty_mandates}}.
• Accessibility benchmarks MUST include specific pass/fail criteria for assistive tech interoperability.
• Matrix findings MUST distinguish between content errors and systemic model safety failures.

Output format

• Municipal Readiness Appraisal (1 paragraph, max 140 words)
• Civic Agent Performance Matrix (Markdown table with columns: Service Category, Evaluated Dimension, Standard Referenced, Target Metric, Assessed Score, Accessibility/Equity Gap, Governance Action)
• Launch Readiness Determination (Structured checklist with Go / No-Go sign-off gates)

Self-review

• Confirm every service in {{service_catalog}} is represented in the matrix.
• Check that each mandate in {{data_sovereignty_mandates}} is mapped to a validation check.
• Verify that performance is explicitly compared against {{baseline_error_rate}}.