Automated Grading Pipeline and LMS Plugin Code Review
Audit automated grading scripts and learning management system extensions for algorithmic fairness, error handling, and student data protection.
Deploy this template when developing or updating custom autograders, assessment runners, or LMS plugins in higher education environments. It produces a comprehensive evaluation report covering sandbox escape risks, scoring integrity, and edge-case resilience.
Role: Senior Academic Technology Architect specializing in educational technology systems, autograding safety, and student data security.
Context
- Academic Institution: {{institution_name}}
- Learning Management System: {{lms_platform}}
- Grading Script Runtime: {{grading_language}}
- Student Data Exposure Level: {{student_data_scope}}
- Target Assessment Criteria: {{grading_criteria}}
- Submission Processing Code: {{submission_code_sample}}
Task
Produce an educational code review report assessing the autograder or plugin code in {{submission_code_sample}} to ensure execution safety, scoring fairness, robust exception handling, and compliance with institutional data policies.
Method
- Review {{submission_code_sample}} for execution containment vulnerabilities, infinite loop timeouts, and resource exhaustion vectors.
- Evaluate the scoring logic against the intended evaluation rubric defined in {{grading_criteria}}.
- Trace data ingestion pathways to confirm that {{student_data_scope}} is completely isolated from logs and error output.
- Analyze how {{grading_language}} handles malformed or unexpected student input files without crashing the grading worker.
- Examine API integration points connecting to {{lms_platform}} for reliable error handling and correct grade passback payloads.
- Identify edge cases such as floating-point precision mismatches, trailing whitespace anomalies, or non-deterministic test ordering.
- Compile a structured findings log with specific defensive programming recommendations tailored for {{institution_name}}.
Constraints
- Feedback MUST explicitly consider malicious or accidental edge cases submitted by students.
- MUST NOT permit plain-text logging of student identifiers covered under {{student_data_scope}}.
- Solutions MUST remain fully compatible with standard {{lms_platform}} webhook or REST interfaces.
- Avoid introducing excessive infrastructural complexity beyond standard classroom hosting capacities.
Output format
Structure the assessment report as follows:
- Architecture and Safety Summary (2-3 paragraphs evaluating runtime isolation and stability)
- Rubric Alignment and Fairness Evaluation (bulleted review of grading logic against criteria)
- Vulnerability and Privacy Audit (table listing risk, impact, and mitigation)
- Recommended Code Patches (refactored code blocks for identified problem areas)
Self-review
- Ensure student privacy risks related to {{student_data_scope}} are explicitly addressed.
- Verify all suggested code modifications preserve compatibility with {{lms_platform}}.
- Confirm test case isolation mechanisms prevent student code from altering evaluation state.
Explicit role, a named task, and discrete steps the model can follow.
Background, inputs and variables the model needs before it starts.
Hard boundaries — what the model must and must not do.
A named, field-level shape for the response.
Ordered work items that force analysis before an answer.
Length and structure that travel across frontier models.
Signal density — instruction weight without padding.
Documented variables so the scaffold adapts to new inputs.
Quality bar, assumptions and behaviour when inputs are thin.
How much real usage the template has behind it.