Limited-Visibility Deployments — Synthetic Monitoring Synthetic monitoring is the mechanism entirely within the provider’s control. Sentinel test suites submit known inputs to the deployed system at defined intervals and verify the outputs. This detects functional degradation, silent model changes (if the deployer has modified the system), and availability problems without requiring any deployer cooperation. Synthetic monitoring cannot detect distributional drift in the real-world input population (sentinel inputs are fixed), but it provides a baseline behavioural check. The test cases span the system’s intended use cases and include edge cases relevant to the risk register. The sentinel suite results are compared against the baseline established at deployment. For limited-visibility deployments, the PMM plan documents which monitoring mechanisms are used (telemetry, callbacks, synthetic), the coverage each provides, the residual monitoring gaps, and the mitigations for those gaps. Where full PMM visibility cannot be achieved, the AISDP documents the limitation and the compensating controls. Key outputs
- Sentinel test suites submitted at defined intervals
- Functional degradation and silent change detection
- No deployer cooperation required
- Residual gaps documented with compensating controls