Five Monitoring Dimensions Summary Performance (accuracy metrics, ground truth handling, disaggregated and temporal analysis; ). Fairness (selection rate ratios, equalised odds, intersectional computation, missing demographic data strategies; ). Data drift (input drift PSI/KS/JS, concept drift, per-feature drift; ). Operational health (availability, latency, error rates, resource utilisation, dependency health; ). Human oversight (override rates, review times, escalation monitoring, automation bias detection, operator wellbeing; ). Key outputs
- Five dimensions with cross-references to detailed articles
- Per-dimension key metrics identified
Three Severity Tiers Summary Informational: metric shifted within tolerance band; logged, reviewed at next scheduled meeting; no immediate action. Warning: breached warning threshold; Technical SME review within five working days; root cause analysis initiated; auto-escalation after five days if unresolved. Critical: breached compliance threshold or fundamental rights concern; immediate investigation; AI Governance Lead notified within 24 hours; break-glass considered; serious incident reporting assessed. Key outputs
- Three tiers with response timeframes
- Auto-escalation for unresolved warnings
- Critical tier links to serious incident reporting
Serious Incident Reporting Timelines Summary Two days from awareness: widespread fundamental rights infringement or serious irreversible critical infrastructure disruption. Ten days from awareness: death or suspected causal link to death. Fifteen days from awareness: all other serious incidents meeting Article 3(49). Initial incomplete reports permitted with supplementary follow-up (Article 73(5)). See for detailed treatment. Key outputs
- 2/10/15-day tiered reporting timelines
- “Awareness” includes causal link establishment
- Initial incomplete report permitted
Feedback Loop Metrics Summary Four meta-metrics: time from PMM finding to decision, time from decision to completed fix, share of findings resulting in system change versus accepted within tolerance, and share of fixes successfully resolving the originating finding. Reported quarterly at PMM review. Sustained deterioration triggers process review. See for detailed treatment. Key outputs
- Four feedback loop meta-metrics
- Quarterly reporting cadence
- Deterioration triggers process review