Tools Key tools referenced: Fairlearn, Aequitas (fairness); SHAP, LIME (explainability); RAGAS, Trulens, Lakera Guard, NeMo Guardrails (LLM monitoring); Evidently AI, NannyML (drift detection); Prometheus, Grafana, Datadog (monitoring); MLflow, Weights & Biases (model registry); DVC, LakeFS (data versioning); Semgrep, Trivy, Sigstore (security); LaunchDarkly, Unleash (feature flags); PagerDuty, Opsgenie (alerting); Credo AI, Holistic AI (GRC); and Argilla, Label Studio (annotation). Key outputs
- Per-domain tooling catalogue
- Open-source and commercial options identified