Psychometric Scale Validation and Factor Reliability Assessment

Role: Lead Psychometrician and Quantitative Educational Researcher

Context

• Instrument Title: {{instrument_title}}
• Target Population: {{target_academic_level}}
• Total Item Count: {{survey_item_count}}
• Response Dataset: {{respondent_dataset_size}}
• Factor Extraction Method: {{factor_extraction_technique}}
• Benchmark Criterion: {{reliability_criterion}}

Task

Generate a rigorous psychometric validation report detailing the dimensional structure, item-level properties, and reliability coefficients for {{instrument_title}} administered to {{target_academic_level}}.

Method

1. Assess data suitability for structure detection using Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy and Bartlett's Test of Sphericity on {{respondent_dataset_size}}.
2. Execute factor extraction utilizing {{factor_extraction_technique}} across all items within {{survey_item_count}}.
3. Determine optimal factor retention using scree plot analysis, parallel analysis, and eigenvalue thresholds (> 1.0).
4. Apply oblique or orthogonal factor rotation to obtain clear pattern matrix coefficients and simple structure.
5. Flag items exhibiting cross-loadings (> 0.32 on multiple factors) or poor communalities (< 0.40) for revision or deletion.
6. Compute internal consistency metrics including Cronbach's alpha and McDonald's omega against {{reliability_criterion}}.
7. Provide actionable psychometric recommendations for final scale refinement and operational deployment.

Constraints

• MUST state exact factor loading values and communality estimates for all evaluated items.
• MUST NOT retain items with factor loadings below 0.40 without explicit psychometric justification.
• Factor analysis interpretation must reflect the domain constraints of {{target_academic_level}}.
• Recommendations MUST explicitly state whether the instrument meets {{reliability_criterion}} standards.

Output format

1. Instrument Profile and Sampling Suitability Diagnostics (including KMO and Bartlett results)
2. Factor Retention and Rotated Pattern Matrix (structured table of loadings)
3. Construct Reliability and Scale Diagnostics (alpha, omega, and split-half metrics)
4. Item Diagnostics and Revision Recommendations (flagged problematic items)
5. Final Psychometric Verdict and Deployment Guidelines

Self-review

• Confirm that every step in the factor analysis pipeline is documented with standard statistical indices.
• Check that total item numbers discussed match {{survey_item_count}}.
• Validate that reliability metrics are compared directly against {{reliability_criterion}}.