Microservice Latency Degradation and Trace Attribution Reporting Framework
Standardize how engineering teams report microservice latency spikes, isolate trace bottlenecks, and document SLA breaches.
Use this template when microservice tail latencies breach operational thresholds and cross-functional engineering teams need a standardized reporting framework to pinpoint root spans and quantify upstream service degradation.
Role: Principal Site Reliability Engineer and Distributed Tracing Architect.
Context
- Target service mesh: {{service_mesh_name}}
- Service level objective baseline: {{target_slo_threshold}}
- Telemetry observation window: {{incident_timeframe}}
- Upstream caller dependencies: {{upstream_dependencies}}
- Observability data provider: {{tracing_telemetry_source}}
- Impacted HTTP/gRPC endpoints: {{impacted_endpoints}}
Task
Develop a structured latency degradation and trace attribution reporting framework that standardizes how engineering squads synthesize distributed trace anomalies, isolate span bottlenecks, and report upstream SLA breaches.
Method
- Parse span duration distributions from {{tracing_telemetry_source}} across the specified {{incident_timeframe}}.
- Identify tail latency percentiles (p95, p99) exceeding {{target_slo_threshold}} across {{impacted_endpoints}}.
- Correlate upstream caller dependencies in {{upstream_dependencies}} with downstream database and RPC wait times.
- Classify latency anomalies into network transit delays, thread starvation, lock contention, or payload serialization overhead.
- Establish a standardized scoring schema to rank endpoints by business criticality and latency degradation severity within {{service_mesh_name}}.
- Define trace-based evidence requirements including sample trace IDs, span graphs, and flame chart references.
- Construct reproducible triage workflows for on-call engineers to translate telemetry spikes into actionable remediation tickets.
Constraints
- MUST isolate parent span versus child span overhead explicitly in all reporting dimensions.
- MUST NOT recommend infrastructure scaling before evaluating software lock contention and query efficiency.
- All recommendations MUST cite quantitative telemetry thresholds derived from {{target_slo_threshold}}.
- Limit reporting tiers to three standardized severity categories: Critical, Degraded, and Nominal.
Output format
- Executive Telemetry Overview (max 150 words).
- Span Attribution & Bottleneck Taxonomy (markdown table with 4 columns: Endpoint, Span Component, Latency Contribution %, Root Mechanism).
- Standardized Diagnostic Workflow (ordered 4-step triage sequence).
- Remediation Reporting Template (structured schema for engineering tickets).
Self-review
- Ensure all references to {{service_mesh_name}} and {{tracing_telemetry_source}} are integrated logically into the telemetry tiers.
- Verify that the four-column table schema matches the exact requirements in the output format.
- Confirm no speculative root causes are asserted without trace validation constraints.
Explicit role, a named task, and discrete steps the model can follow.
Background, inputs and variables the model needs before it starts.
Hard boundaries — what the model must and must not do.
A named, field-level shape for the response.
Ordered work items that force analysis before an answer.
Length and structure that travel across frontier models.
Signal density — instruction weight without padding.
Documented variables so the scaffold adapts to new inputs.
Quality bar, assumptions and behaviour when inputs are thin.
How much real usage the template has behind it.