Automated Source Code Vulnerability Detection Literature Assessment
Analyzes peer-reviewed research on static analysis, graph neural networks, and formal methods for automated vulnerability detection.
Use this template to review and compare automated vulnerability discovery approaches before designing or procuring SAST tooling for large-scale enterprise repositories.
Role: Head of Application Security Research and Formal Verification Specialist
Context
- Target vulnerability classes: {{vulnerability_classes}}
- Primary codebase language and framework ecosystem: {{source_language_ecosystem}}
- Technical analysis paradigms to evaluate: {{analysis_mechanisms}}
- Benchmark datasets referenced in literature: {{benchmark_datasets}}
- Operational false positive tolerance: {{false_positive_threshold}}
- Pipeline runtime and latency budget: {{ci_cd_latency_budget}}
Task
Conduct a rigorous literature analysis synthesizing academic research on automated vulnerability detection to determine the most effective detection paradigm for {{vulnerability_classes}} in {{source_language_ecosystem}}.
Method
- Review the state-of-the-art literature combining AST parsing, control-flow/data-flow analysis, and neural representations.
- Evaluate how graph-based models (e.g., Code Property Graphs, GNNs) identify complex cross-function data flows for {{vulnerability_classes}}.
- Assess the validity and bias of reported results against {{benchmark_datasets}}, filtering out dataset contamination or synthetic testbed artifacts.
- Analyze precision, recall, and real-world applicability relative to {{false_positive_threshold}}.
- Compare classical symbolic execution and taint analysis with modern LLM-driven vulnerability classification.
- Evaluate computational scalability, memory footprint, and analysis duration against {{ci_cd_latency_budget}}.
- Document how state-of-the-art approaches handle language-specific quirks, dynamic dispatch, and reflection in {{source_language_ecosystem}}.
- Formulate a comparative viability score for hybrid static-analysis and machine-learning architectures.
Constraints
- MUST highlight data leakage and synthetic dataset limitations in academic machine learning benchmarks.
- MUST NOT recommend techniques with computational complexity exceeding {{ci_cd_latency_budget}} in CI/CD integration.
- Differentiate inter-procedural taint tracking from intra-procedural pattern matching.
- Provide concrete examples of vulnerabilities missed by purely lexical or token-based analysis.
Output format
- Paradigm Taxonomy & Literature Matrix (table comparing 5-6 approaches: Technique, Precision/Recall, Latency, False Positive Rate)
- Deep Dive: Graph Representation vs. Deep Learning Approaches (max 450 words)
- Benchmark Validity and Dataset Leakage Critique (max 350 words)
- Language-Specific Coverage Analysis for {{source_language_ecosystem}} (max 300 words)
- Strategic Architecture Recommendations for CI/CD Integration
Self-review
- Does the literature review address detection of zero-day/novel variants within {{vulnerability_classes}}?
- Are the false positive rates documented from realistic, open-source/enterprise software studies?
- Does the analysis evaluate execution overhead within {{ci_cd_latency_budget}}?
Explicit role, a named task, and discrete steps the model can follow.
Background, inputs and variables the model needs before it starts.
Hard boundaries — what the model must and must not do.
A named, field-level shape for the response.
Ordered work items that force analysis before an answer.
Length and structure that travel across frontier models.
Signal density — instruction weight without padding.
Documented variables so the scaffold adapts to new inputs.
Quality bar, assumptions and behaviour when inputs are thin.
How much real usage the template has behind it.