Qualcomm AI Engine Direct - [GenAI Pipeline] PR3: Pipeline Orchestrator

[qti-horodnic]

Summary

This PR adds the pipeline orchestrator (GenAIPipeline) that wires together all the components from PRs 1 and 2. It assembles stages from EngineProxy, builds InputConfig objects from OutputConfig results, executes stages sequentially with timing, and returns InferenceOutputConfig. No existing files are modified.

What's included

Pipeline orchestrator:

• GenAIPipeline: main orchestrator class with:

  • _STRATEGY_REGISTRY: maps (stage_name, engine_type) → (StageClass, StrategyClass) for extensibility
  • from_proxy(): factory method that resolves stages from EngineProxy
  • invoke(): executes model_preparation → quantization → compilation → inference
  • Private _run_* methods: each builds an InputConfig, calls the stage, returns the OutputConfig
  • Structured logging with [GenAIPipeline] StageName started/completed in X.Xs format per LLD Section 5.2

• executorch_model_preparation_strategy.py: ExecuTorch model preparation strategy stub (implementation in a subsequent PR)

Unit tests (13 tests):

• from_proxy(): creates all stages, skip stages, default engines
• from_proxy() error paths: unsupported engine for each stage
• invoke(): full pipeline with mock strategies, compile-only, no stages
• Data wiring: quantization receives soc_model, compilation receives backend_type, inference receives prompt

PR Review Checklist

• All new classes follow single responsibility (one class per file) - Yes.
• All dependencies are injected via constructor with sensible defaults - Yes.
• All external calls are behind injectable interfaces - Yes (via strategy pattern).
• Unit tests cover every public method - Yes.
• No existing files are modified (Phase 1 constraint) - Yes (only __init__.py updated to add GenAIPipeline export).
• Docstrings on all public classes and methods - Yes.
• Type annotations on all function signatures - Yes.
• Logging follows the strategy in the LLD - Yes ([GenAIPipeline] prefix, timing).

Related PRs

• PR 1: Core data model, engine routing & exceptions: Qualcomm AI Engine Direct - [GenAI Pipeline] PR1: Core Data Model, Engine Routing & Exceptions #20409
• PR 2: Strategy interfaces & stage wrappers: Qualcomm AI Engine Direct - [GenAI Pipeline] PR2: Strategy Interfaces & Stage Wrappers #20795.
• PR 3: Pipeline orchestrator: this pr.
• PR 4: Adapter interfaces & default implementations: pending.
• PR 5: Model preparation & quantization strategies: pending
• PR 6: Compilation & inference strategy implementations: pending.
• PR 7: Integration & E2E tests: pending.

Test plan

python -m pytest \
  backends/qualcomm/genai_pipeline/tests/test_genai_pipeline.py \
  -v

All 13 unit-tests passed.

Test Coverage

Command to run:

coverage run --rcfile=backends/qualcomm/.coveragerc \
  -m pytest \
    backends/qualcomm/genai_pipeline/tests/test_genai_pipeline.py \
  -v

coverage report --rcfile=backends/qualcomm/.coveragerc \
  --include="backends/qualcomm/genai_pipeline/genai_pipeline.py"

Result:

Name                                                 Stmts   Miss Branch BrPart  Cover   Missing
------------------------------------------------------------------------------------------------
backends/qualcomm/genai_pipeline/genai_pipeline.py      98      7     12      1    93%   184-195
------------------------------------------------------------------------------------------------
TOTAL                                                   98      7     12      1    93%

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/21149

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• Unrelated MacOS MPS test jobs time out (30 min) due to stale cpp_extension lock file poisoning self-hosted runners

⚠️ 12 Awaiting Approval

As of commit e3bdc68 with merge base 53551c1 ():

AWAITING APPROVAL - The following workflows need approval before CI can run:

• Build documentation (gh)
• Build Presets (gh)
• Lint (gh)
• periodic (gh)
• pull (gh)
• Test ARM Backend (gh)
• Test CoreML Backend (gh)
• Test QNN Backend (gh)
• Test QNN Windows MSVC build (gh)
• Test Vulkan Backend (gh)
• Test WebGPU Backend (gh)
• Test XNNPACK Backend (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[qti-horodnic]

@pytorchbot label "release notes: qualcomm"