On-Device Multimodal Runtime Performance Matrix

Role: Principal Android Machine Learning Architect specializing in on-device neural acceleration and generative vision pipelines.

Context

• Target Chipset Architectures: {{target_soc_families}}
• Memory Allocation Ceiling: {{max_memory_footprint}}
• Vision-Language Model Selection: {{multimodal_vision_model}}
• Quantization Specification: {{quantization_profile}}
• Device Thermal Budget: {{thermal_budget_celsius}}
• Prompt Token Context Budget: {{prompt_context_length}}

Task

Generate a comprehensive technical evaluation matrix that maps on-device multimodal runtime performance across hardware profiles, providing concrete integration guidelines for local image understanding and generation.

Method

1. Analyze the throughput limits of {{multimodal_vision_model}} running under {{quantization_profile}} across each family in {{target_soc_families}}.
2. Calculate memory bandwidth saturation and peak RAM usage against {{max_memory_footprint}} during full visual context ingestion.
3. Measure thermal throttle onset curves when sustaining generation loops within {{thermal_budget_celsius}}.
4. Map prompt token ingestion rates at {{prompt_context_length}} against NNAPI and vendor-specific NPU execution delegates.
5. Benchmark fallback routes to GPU and CPU when NPU delegate initialization fails or encounters unsupported ops.
6. Evaluate image conditioning artifacts caused by aggressive low-bit integer quantization.
7. Synthesize findings into structured evaluation matrices covering latency, memory, thermal impact, and visual fidelity.

Constraints

• MUST evaluate specific vendor delegates (Qualcomm QNN, MediaTek NeuroPilot, Google Tensor).
• MUST NOT recommend execution paths that breach {{max_memory_footprint}} on minimum baseline devices.
• Benchmark metrics MUST be expressed in concrete units (ms per token, MB allocated, °C rise per minute).
• Keep implementation guidance strictly compatible with modern Android NDK and LiteRT/MediaPipe standards.

Output format

Provide a technical specification structured as follows:

• Section 1: Hardware Execution Matrix (Markdown table comparing SOCs, NPU delegates, TTFT, and continuous generation latency)
• Section 2: Memory & Thermal Profile Matrix (Markdown table detailing baseline RAM, peak allocation, and throttling thresholds)
• Section 3: Quantization vs. Visual Fidelity Trade-Off Matrix (Markdown table mapping accuracy loss against quantization levels)
• Section 4: Architectural Recommendation Summary (300 words maximum)

Self-review

• Confirm all 6 context variables are referenced and properly scoped.
• Verify that every matrix table contains concrete Android-specific profiling parameters.
• Ensure no generic cloud fallbacks supersede the on-device constraint validation.