Cloud VFX Render Farm Worker Bursting Pipeline Spec

Role: Lead Visual Effects Pipeline Architect with extensive background in OpenCue, cloud infrastructure, and DCC integration.

Context

• Studio Name: {{studio_name}}
• Primary DCC Suite: {{primary_dcc_tools}}
• Cloud Infrastructure Provider: {{hybrid_cloud_provider}}
• Asset Storage Protocol: {{asset_storage_protocol}}
• Hourly Burst Budget Ceiling: {{max_burst_budget_hourly}}
• Priority Queue Tiers: {{priority_scheduling_tiers}}

Task

Produce a technical engineering specification for {{studio_name}} that defines the continuous integration, testing, and burst deployment pipeline for {{primary_dcc_tools}} render nodes running on {{hybrid_cloud_provider}} without exceeding {{max_burst_budget_hourly}}.

Method

1. Specify the base image pipeline for building and testing customized {{primary_dcc_tools}} headless rendering containers.
2. Design warm-pool provisioning and autoscaling algorithms aligned with {{priority_scheduling_tiers}}.
3. Integrate {{asset_storage_protocol}} mount caching and pre-population mechanisms to minimize cold-start render lag.
4. Define spot/preemptible instance lifecycle hooks and graceful task checkpointing procedures on {{hybrid_cloud_provider}}.
5. Construct budget monitoring middleware to halt node provisioning before surpassing {{max_burst_budget_hourly}}.
6. Formulate synthetic render test stages within CI to validate frame fidelity and color space accuracy.
7. Detail IAM least-privilege policies and network isolation boundaries between production render tasks.

Constraints

• MUST prevent any cloud compute scaling that breaches {{max_burst_budget_hourly}}.
• MUST NOT permit untracked local asset writes; all outputs must sync through {{asset_storage_protocol}}.
• Node bootstrap time from trigger to frame compute must stay under 180 seconds.
• Render farm worker images must pass automated color transform verification before deployment.

Output format

Deliver the technical specification in the following format:

1. Worker Image CI Build & Validation Workflow (step-by-step description, max 250 words)
2. Autoscaling & Cost Guardrail State Machine (text-based state logic or structured list)
3. Storage Mount & IOPS Optimization Strategy (max 200 words)
4. Fault Handling & Node Eviction Runbook (table with Trigger, Worker Action, Queue Impact)

Self-review

• Confirm that the autoscaling logic explicitly incorporates all {{priority_scheduling_tiers}}.
• Verify storage caching handles the throughput demands of {{asset_storage_protocol}}.
• Ensure budget enforcement mechanisms guarantee adherence to {{max_burst_budget_hourly}}.