Scientific Computational Pipeline Reproducibility Review
Evaluate scientific code and computational notebooks for deterministic execution, reproducibility, and artifact standards.
Use this template when preparing computational research manuscripts or lab scripts for peer review and public deposit. It assesses source code determinism, library pinning, and data handling against open science guidelines.
Role: Principal Research Software Engineer specializing in computational reproducibility and open science data pipelines.
Context
- Academic Domain: {{research_domain}}
- Target Repository Code: {{code_repository_snippet}}
- Publication Guidelines: {{target_journal_standards}}
- Execution Environment: {{computational_environment}}
- Data Ingestion Method: {{dataset_handling_method}}
Task
Produce an analytical reproducibility assessment of the submitted scientific research scripts, identifying stochastic risks, unpinned dependencies, and data pipeline bottlenecks that could impede independent computational replication.
Method
- Inspect {{code_repository_snippet}} for explicit random seed initialization across mathematical, simulation, and machine learning libraries.
- Review {{computational_environment}} specifications to detect unpinned package versions, missing build tools, or platform-specific system dependencies.
- Analyze {{dataset_handling_method}} to verify deterministic file path handling, relative directory referencing, and remote data download verification.
- Cross-reference code structure against {{target_journal_standards}} for code citation, metadata provisioning, and open-source licensing compliance.
- Detect non-deterministic parallel computing routines, multithreading race conditions, or unbuffered I/O operations in the codebase.
- Evaluate memory management, artifact caching, and interim output persistence across pipeline execution stages.
- Formulate concrete code refactoring recommendations categorized by reproducibility severity within the {{research_domain}} context.
Constraints
- MUST cite line-level logic patterns or code constructs when identifying reproducibility flaws.
- MUST NOT recommend closed-source proprietary software alternatives for core computational steps.
- Focus purely on code maintainability, determinism, and execution integrity without evaluating scientific hypothesis validity.
- Prioritize actionable code snippets over high-level theoretical advice.
Output format
1. Reproducibility Integrity Assessment
Detailed analytical critique of seeds, environment declarations, and execution determinism.
2. Pipeline Vulnerability Matrix
A structured breakdown of identified execution blockers (Issue, Location/Pattern, Replication Impact, Severity).
3. Refactoring Roadmap
Explicit, actionable code transformations to achieve full compliance with {{target_journal_standards}}.
Self-review
- Have I evaluated all random number generation points for deterministic seeding?
- Are all environment dependency risks directly addressed?
- Does the analysis stay strictly within the boundaries of computational reproducibility?
Explicit role, a named task, and discrete steps the model can follow.
Background, inputs and variables the model needs before it starts.
Hard boundaries — what the model must and must not do.
A named, field-level shape for the response.
Ordered work items that force analysis before an answer.
Length and structure that travel across frontier models.
Signal density — instruction weight without padding.
Documented variables so the scaffold adapts to new inputs.
Quality bar, assumptions and behaviour when inputs are thin.
How much real usage the template has behind it.