Code review
AuraScore 79/100

Scientific Computing Pipeline Reproducibility Audit Plan

Generate a phased plan to review and verify academic research code for computational reproducibility and data integrity.

Use this template when preparing research software for peer review or public release. It establishes a step-by-step code review plan focused on deterministic execution, data lineage, and dependency tracking.

Template

Role: Principal Research Software Engineer specializing in computational reproducibility and open science.

Context

  • Institution: {{research_institution}}
  • Domain: {{scientific_discipline}}
  • Codebase: {{target_repository}}
  • Execution Environment: {{compute_environment}}
  • Data Standard: {{data_provenance_standard}}
  • Target Milestone: {{publication_deadline}}

Task

Design a structured reproducibility code review plan that guides peer reviewers and lab members through auditing scientific algorithms, fixed random seeds, package dependencies, and raw data transformations in {{target_repository}} prior to {{publication_deadline}}.

Method

  1. Establish baseline environment isolation requirements tailored to {{compute_environment}}.
  2. Outline source code inspection checkpoints for deterministic random seed management and floating-point stability.
  3. Formulate verification criteria for data input pipelines against {{data_provenance_standard}}.
  4. Define script modularity and unit test coverage requirements for core numerical routines.
  5. Design an artifact verification protocol covering configuration files, lockfiles, and container recipes.
  6. Schedule staged review milestones mapping directly to {{publication_deadline}}.
  7. Detail failure-triage procedures when benchmark outputs deviate from expected figures.

Constraints

  • Focus strictly on technical reproducibility, computational correctness, and code hygiene.
  • MUST include explicit validation checkpoints for deterministic random states and hardcoded file paths.
  • MUST NOT require proprietary third-party commercial review tooling unavailable in open academic environments.
  • Limit recommendations to pragmatic steps achievable by academic researchers.
  • Reference {{scientific_discipline}} domain norms for code documentation.

Output format

Provide the review plan using these exact sections:

  1. Executive Audit Charter (1 paragraph summarizing objectives and scope)
  2. Environment & Dependency Review Matrix (bulleted audit criteria)
  3. Numerical Correctness & Provenance Protocol (numbered review steps)
  4. Staged Timeline & Deliverable Schedule (phased breakdown leading to {{publication_deadline}})

Self-review

  • Confirm all 6 variables are referenced naturally in the text.
  • Verify that the plan explicitly addresses computational reproducibility in {{compute_environment}}.
  • Ensure the format adheres to the four designated output sections without omitted parts.
AuraScore breakdown
79/100Provisional
Instruction clarity15/15 · Strong

Explicit role, a named task, and discrete steps the model can follow.

Context architecture12/12 · Strong

Background, inputs and variables the model needs before it starts.

Constraint engineering8/12 · Adequate

Hard boundaries — what the model must and must not do.

Output specification6/14 · Thin

A named, field-level shape for the response.

Reasoning structure10/10 · Strong

Ordered work items that force analysis before an answer.

Model compatibility10/10 · Strong

Length and structure that travel across frontier models.

Token efficiency7/10 · Adequate

Signal density — instruction weight without padding.

Reusability7/7 · Strong

Documented variables so the scaffold adapts to new inputs.

Robustness3/5 · Adequate

Quality bar, assumptions and behaviour when inputs are thin.

Observed performance1/5 · Thin

How much real usage the template has behind it.

developers
developers-code-review
education-research
research-software
code-review
reproducibility