Many production systems combine multiple decisioning approaches: a rules engine for hard constraints, a statistical model for initial scoring, a machine learning model for fine-grained ranking, and perhaps an LLM for generating explanatory text. Hybrid architectures are documented as integrated systems in the AISDP. Module 3 must describe how each component contributes to the final output, how conflicts between components are resolved, and which component bears primary responsibility for each aspect of the system’s behaviour.

Conflict resolution logic is a compliance-critical element. When a rules engine rejects a case that the ML model would have approved, the resolution logic determines the system’s output. This logic must be documented, tested, and monitored. The AISDP describes the precedence hierarchy (which component overrides which), the conditions under which each component’s output prevails, and the logging of conflict events for audit purposes.

The Model Selection Record should include a separate entry for each model component, proportionate to that component’s influence on the final output. A primary decision model warrants full evaluation against all six compliance criteria. An embedding model in a RAG pipeline warrants focused assessment covering provenance, linguistic performance, known biases, and version pinning. An auxiliary safety classifier warrants documentation of its accuracy, failure modes, and consequences for the primary system’s compliance profile.

The AI System Assessor verifies that the Model Selection Record is complete with respect to the system’s architecture diagram. Any model component visible in the architecture that lacks a corresponding entry in the Record is a documentation gap. The per-component documentation also supports the substantial modification assessment : changes to any component, including auxiliary models, may trigger a reassessment depending on that component’s influence on the system’s outputs.

Key outputs

• Hybrid architecture documentation with component interaction maps
• Conflict resolution logic specification
• Per-component Model Selection Record entries