Scientific Computing Pipeline Reproducibility Audit Plan
Generate a phased plan to review and verify academic research code for computational reproducibility and data integrity.
Use this template when preparing research software for peer review or public release. It establishes a step-by-step code review plan focused on deterministic execution, data lineage, and dependency tracking.
Role: Principal Research Software Engineer specializing in computational reproducibility and open science.
Context
- Institution: {{research_institution}}
- Domain: {{scientific_discipline}}
- Codebase: {{target_repository}}
- Execution Environment: {{compute_environment}}
- Data Standard: {{data_provenance_standard}}
- Target Milestone: {{publication_deadline}}
Task
Design a structured reproducibility code review plan that guides peer reviewers and lab members through auditing scientific algorithms, fixed random seeds, package dependencies, and raw data transformations in {{target_repository}} prior to {{publication_deadline}}.
Method
- Establish baseline environment isolation requirements tailored to {{compute_environment}}.
- Outline source code inspection checkpoints for deterministic random seed management and floating-point stability.
- Formulate verification criteria for data input pipelines against {{data_provenance_standard}}.
- Define script modularity and unit test coverage requirements for core numerical routines.
- Design an artifact verification protocol covering configuration files, lockfiles, and container recipes.
- Schedule staged review milestones mapping directly to {{publication_deadline}}.
- Detail failure-triage procedures when benchmark outputs deviate from expected figures.
Constraints
- Focus strictly on technical reproducibility, computational correctness, and code hygiene.
- MUST include explicit validation checkpoints for deterministic random states and hardcoded file paths.
- MUST NOT require proprietary third-party commercial review tooling unavailable in open academic environments.
- Limit recommendations to pragmatic steps achievable by academic researchers.
- Reference {{scientific_discipline}} domain norms for code documentation.
Output format
Provide the review plan using these exact sections:
- Executive Audit Charter (1 paragraph summarizing objectives and scope)
- Environment & Dependency Review Matrix (bulleted audit criteria)
- Numerical Correctness & Provenance Protocol (numbered review steps)
- Staged Timeline & Deliverable Schedule (phased breakdown leading to {{publication_deadline}})
Self-review
- Confirm all 6 variables are referenced naturally in the text.
- Verify that the plan explicitly addresses computational reproducibility in {{compute_environment}}.
- Ensure the format adheres to the four designated output sections without omitted parts.
Explicit role, a named task, and discrete steps the model can follow.
Background, inputs and variables the model needs before it starts.
Hard boundaries — what the model must and must not do.
A named, field-level shape for the response.
Ordered work items that force analysis before an answer.
Length and structure that travel across frontier models.
Signal density — instruction weight without padding.
Documented variables so the scaffold adapts to new inputs.
Quality bar, assumptions and behaviour when inputs are thin.
How much real usage the template has behind it.