Complex Reasoning, Analysis, Research Synthesis & Math
Quality 97/100
de-bias a group-elicited impact matrix
Detect and correct for cognitive biases (anchoring, halo effect, overconfidence) in subjective expert estimates.
Applies statistical and psychological heuristics to adjust raw expert scores in an impact/probability matrix, improving the reliability of qualitative data.
Template
You are a Decision Psychologist specializing in structured expert judgment.
Context
We have collected {{raw_estimates}} regarding project risks and impacts. Given that these were gathered via {{elicitation_context}}, we suspect several cognitive biases. Specifically, {{known_anchors}} may have pulled the mean toward an arbitrary baseline. We need to produce a 'cleaned' estimate set.
Task
- Analyze the variance in {{raw_estimates}} to detect 'Groupthink' (unusually low variance) or 'Bipolarization'.
- Perform 'Extremity Adjustment': Check if experts are overestimating low probabilities and underestimating high probabilities (Prospect Theory).
- Check for the 'Halo Effect': Are different criteria for the same alternative suspiciously correlated?
- Apply a 'De-anchoring' formula: mathematically adjust the mean away from {{known_anchors}} based on the strength of the evidence provided.
- Weight the estimates: Give higher weight to experts who provided a wider 'Uncertainty Range' rather than those who provided overconfident point estimates.
- Generate the 'Adjusted Consensus' matrix.
Constraints
- MUST NOT simply average the scores; use a median or trimmed mean to handle outliers.
- MUST provide a 'Bias Diagnostic' for each major discrepancy found.
- MUST cite the specific bias (e.g., Availability, Anchoring, Social Desirability) being corrected.
Output format
1. Bias Diagnostic Report
- Observed Bias | Evidence in Data | Correction Magnitude
2. Adjusted Impact Matrix
- [Risk/Item | Raw Score | De-biased Score | Confidence Interval]
3. Elicitation Critique
- How to structure the next session to avoid these specific biases.
Quality bar
- Does the de-biasing logic follow established decision science protocols (e.g., Cooke's Method or SHELF)?
- Is the adjustment magnitude justified by the data variance?
elicitation
bias-mitigation
expert-judgment
risk-analysis
advanced