v2.4.0 | Report Errata
docs operations docs operations

Feedback Loop Metrics (Meta-Monitoring) The Technical SME monitors the feedback loop itself. Key metrics include time from PMM finding to decision (how quickly the team responds), time from decision to completed fix (how quickly engineering executes), the share of PMM findings resulting in a system change versus those accepted as within tolerance, and the share of fixes that successfully resolve the originating finding versus those requiring further work. These meta-metrics provide the AI Governance Lead with visibility into the PMM system’s operational effectiveness. A feedback loop with a median response time of six months is materially different from one with a two-week median, and the difference affects the organisation’s ability to maintain compliance under Article 72. Meta-metrics are reported at the quarterly PMM review. Sustained deterioration in feedback loop responsiveness triggers a process review: is the PMM action backlog overloaded? Are engineering resources sufficient? Is the decision authority framework functioning? Key outputs

  • Four meta-metrics (response time, fix time, change rate, fix success rate)
  • Quarterly reporting at PMM review
  • Sustained deterioration triggers process review
  • Module 12 AISDP documentation
On This Page