Code review
AuraScore 77/100

Scientific Computational Pipeline Reproducibility Review

Evaluate scientific code and computational notebooks for deterministic execution, reproducibility, and artifact standards.

Use this template when preparing computational research manuscripts or lab scripts for peer review and public deposit. It assesses source code determinism, library pinning, and data handling against open science guidelines.

Template

Role: Principal Research Software Engineer specializing in computational reproducibility and open science data pipelines.

Context

  • Academic Domain: {{research_domain}}
  • Target Repository Code: {{code_repository_snippet}}
  • Publication Guidelines: {{target_journal_standards}}
  • Execution Environment: {{computational_environment}}
  • Data Ingestion Method: {{dataset_handling_method}}

Task

Produce an analytical reproducibility assessment of the submitted scientific research scripts, identifying stochastic risks, unpinned dependencies, and data pipeline bottlenecks that could impede independent computational replication.

Method

  1. Inspect {{code_repository_snippet}} for explicit random seed initialization across mathematical, simulation, and machine learning libraries.
  2. Review {{computational_environment}} specifications to detect unpinned package versions, missing build tools, or platform-specific system dependencies.
  3. Analyze {{dataset_handling_method}} to verify deterministic file path handling, relative directory referencing, and remote data download verification.
  4. Cross-reference code structure against {{target_journal_standards}} for code citation, metadata provisioning, and open-source licensing compliance.
  5. Detect non-deterministic parallel computing routines, multithreading race conditions, or unbuffered I/O operations in the codebase.
  6. Evaluate memory management, artifact caching, and interim output persistence across pipeline execution stages.
  7. Formulate concrete code refactoring recommendations categorized by reproducibility severity within the {{research_domain}} context.

Constraints

  • MUST cite line-level logic patterns or code constructs when identifying reproducibility flaws.
  • MUST NOT recommend closed-source proprietary software alternatives for core computational steps.
  • Focus purely on code maintainability, determinism, and execution integrity without evaluating scientific hypothesis validity.
  • Prioritize actionable code snippets over high-level theoretical advice.

Output format

1. Reproducibility Integrity Assessment

Detailed analytical critique of seeds, environment declarations, and execution determinism.

2. Pipeline Vulnerability Matrix

A structured breakdown of identified execution blockers (Issue, Location/Pattern, Replication Impact, Severity).

3. Refactoring Roadmap

Explicit, actionable code transformations to achieve full compliance with {{target_journal_standards}}.

Self-review

  • Have I evaluated all random number generation points for deterministic seeding?
  • Are all environment dependency risks directly addressed?
  • Does the analysis stay strictly within the boundaries of computational reproducibility?
AuraScore breakdown
77/100Provisional
Instruction clarity15/15 · Strong

Explicit role, a named task, and discrete steps the model can follow.

Context architecture12/12 · Strong

Background, inputs and variables the model needs before it starts.

Constraint engineering8/12 · Adequate

Hard boundaries — what the model must and must not do.

Output specification6/14 · Thin

A named, field-level shape for the response.

Reasoning structure10/10 · Strong

Ordered work items that force analysis before an answer.

Model compatibility10/10 · Strong

Length and structure that travel across frontier models.

Token efficiency5/10 · Thin

Signal density — instruction weight without padding.

Reusability7/7 · Strong

Documented variables so the scaffold adapts to new inputs.

Robustness3/5 · Adequate

Quality bar, assumptions and behaviour when inputs are thin.

Observed performance1/5 · Thin

How much real usage the template has behind it.

developers
developers-code-review
education-research
reproducibility
research-software
code-review