Bias Evaluation Reports consolidate the complete fairness assessment chain: pre-training analysis and post-training evaluation. They present the end-to-end bias story for the system, from data examination through model evaluation to fairness concept prioritisation.

The pre-training section includes the distributional analysis, label bias assessment, proxy variable detection, and intersectional analysis. The post-training section includes the five fairness metrics (selection rate ratio, equalised odds, predictive parity, calibration within groups, counterfactual fairness), the threshold compliance status for each metric, and the fairness concept prioritisation decision.

The report also includes the bias mitigation section: which techniques were applied, their measured effectiveness, the residual bias after mitigation, and the compensating controls. The report concludes with the AI Governance Lead’s acceptance of any residual bias risk.

This artefact is the central fairness evidence document for AISDP Modules 4 and 5. It is reviewed during conformity assessment and should be retrievable if a competent authority or notified body requests evidence of the organisation’s fairness practices.

Key outputs

• Bias Evaluation Report (combined pre-training and post-training)
• Mitigation effectiveness assessment
• AI Governance Lead residual risk acceptance