
Contents
- What changed between 2024 and 2026
- What an AI risk management framework covers
- Step 1: identify your AI risks
- Step 2: assess and rank by impact
- Step 3: put controls on the high-risk systems
- Step 4: governance and compliance
- Step 5: monitoring and incident response
- An AI risk register you can start with
- Frequently asked questions
An AI risk management framework is the set of steps you use to find, rank, control and monitor the risks of AI systems that influence business decisions. The practical version has five steps: inventory your AI, rank each use case by impact, put controls on the high-risk ones, assign governance, and monitor with a tested incident plan.
This guide is for CIOs, risk owners and SAP programme leads who already have AI in finance, HR or procurement, or are about to. It maps each step to the NIST AI RMF and the EU AI Act, and gives you a risk register template to start with.
Automated decisions fail fast. In 2012, Knight Capital deployed faulty trading software and, according to the US SEC, lost more than $460 million in 45 minutes because nobody could stop the system in time. That was not machine learning. It was an automated decision system with no effective monitoring and no kill switch, which is exactly the gap many AI deployments have today.
The principles below still hold. Three external changes alter what you plan around.
NIST added a generative AI profile. The NIST AI Risk Management Framework (AI RMF 1.0, January 2023) is built on four functions: Govern, Map, Measure, Manage. In July 2024 NIST published the Generative AI Profile (NIST AI 600-1), covering risks such as confabulation, prompt injection, data privacy and intellectual property. If you run Joule, Microsoft Copilot or your own generative AI agents on enterprise data, reference it in your risk register. NIST says the core framework is being revised; there is no version 1.1 yet.
The EU AI Act timetable moved. The Act entered into force on 1 August 2024. Prohibited practices and AI literacy duties applied from 2 February 2025, and general-purpose AI obligations from 2 August 2025. Most remaining rules and enforcement apply from 2 August 2026. After the Digital Omnibus amendments adopted in 2026, the rules for high-risk systems listed in Annex III (hiring, credit scoring, access to essential services and similar) apply from 2 December 2027, and high-risk AI inside regulated products from 2 August 2028. The Commission's implementation timeline is the place to check. Fines reach €35 million or 7% of worldwide turnover for prohibited practices, and €15 million or 3% for most other breaches.
The extra time is not a reason to wait. Technical documentation, data governance, human oversight and post-market monitoring take longer to build than most teams expect.
ISO/IEC 42001 gave AI governance a certifiable standard. Published in December 2023, it does for AI management what ISO 27001 did for information security. ISO/IEC 23894 (2023) adds guidance specifically on AI risk management. In my view, any company selling AI-enabled software into regulated buyers should expect 42001 to appear in procurement questionnaires.
For Gulf organisations, the UAE's Charter for the Development and Use of AI (2024) and Saudi Arabia's SDAIA AI Ethics Principles are not binding law in the way the EU Act is, but regulators and public-sector buyers already ask how you meet them.
A proper framework runs across the model lifecycle, from design through deployment into daily operation.
| Component | What it covers | Key actions |
|---|---|---|
| Governance structure | Oversight and decision rights | Set up an AI risk committee; name an owner per system |
| Risk identification | Technical, ethical and regulatory risks | Risk workshops, threat modelling, scenario analysis |
| Compliance alignment | EU AI Act, GDPR, ISO 42001, local rules | Map each use case to the rules that apply |
| Bias and fairness | Discriminatory outcomes | Bias testing, fairness audits, impact by group |
| Explainability | Decisions people can understand | Explainability methods, model documentation |
| Security and privacy | Model and data protection | Encrypt training data; adversarial testing |
| Continuous monitoring | Behaviour after deployment | KPIs, anomaly detection, human review loops |
| Incident response | Malfunctions and ethical breaches | Escalation paths, rollback and recovery plans |
Most frameworks fail because they sit outside the project flow. AI governance has to live inside the operating model, alongside audit and change control. Otherwise issues surface late, when they are harder and more expensive to fix.
- IdentifyInventory every AI system
- RankBy likelihood and impact
- ControlStrictest on high-risk systems
- GovernA named owner per model
- MonitorAlerts and a tested incident plan
Review monthly for critical systems, quarterly for the rest
Start with an inventory. For each AI system, answer three questions. What data does it process? What decisions does it influence? What is the worst outcome if it gets something wrong?
The common risk categories:
- Bias and fairness. Models trained on historical data inherit its biases. If five years of hiring decisions skewed toward certain profiles, the model will repeat that. Amazon scrapped an AI recruiting tool after finding it downgraded CVs that included the word "women's", as Reuters reported in 2018. That was predictable. A basic bias audit before deployment would have caught it.
- Security. AI systems that touch payments, HR records or contracts are targets. Data poisoning, prompt injection and model theft are real attack paths.
- Compliance. GDPR, the EU AI Act, ISO 42001, HIPAA and local rules can all apply at once. Regulators increasingly want to see the method behind an AI decision, not just the output.
- Operational drift. A model trained in Q1 can behave differently by Q3 as data patterns shift. Nobody notices until a customer complains or an audit finds it.
Not all risks are equal. Rank by likelihood and business impact.
- Critical: AI influencing financial approvals, employment decisions or access control. These need the strictest controls, human oversight and full documentation.
- Moderate: AI that recommends while a human makes the final call. Lighter controls, but audit logging still applies.
- Low: internal tools with limited scope and little effect on people. Basic monitoring and periodic review.
Use the EU AI Act categories as a cross-check. Hiring, credit and access to essential services are explicitly high-risk.
Bias. Use representative training data. Audit outcomes by demographic group on a regular schedule. Keep humans in the loop for decisions about individuals: hiring, lending, access. Investigate acceptance-rate differences between groups.
Security. Encrypt training data and model outputs. Restrict who can change models. Test whether crafted inputs can manipulate behaviour. Watch for unusual access patterns.
Operational continuity. Define what normal looks like for each system, then set alert thresholds. When a metric moves (fraud blocking rate, hiring acceptance ratio, supplier approval pattern), you want an alert, not a month-end surprise. And make sure someone can switch the system off quickly.
Governance for AI needs three things.
- Named ownership. One person answers for each model's outputs. A committee without a chair is no one.
- Audit trails. Every AI-influenced decision needs a traceable record: the data used, the output, and when and by whom it was reviewed.
- Regulatory alignment. Check each system against ISO 42001, the NIST AI RMF, the EU AI Act and GDPR or your regional equivalent. Re-check when the rules change, as the EU dates just did.
If you are building this inside an SAP programme, my guide to AI governance in SAP implementations covers where the controls sit in S/4HANA and SuccessFactors.
AI bias can go undetected for months. Security breaches happen in seconds. I've worked with companies that only realised AI was failing after customers started complaining or regulators started investigating.
Tools that are widely used in enterprise environments:
| Tool | Primary focus |
|---|---|
| Fiddler AI | Model monitoring, explainability, bias detection |
| IBM watsonx.governance (includes Watson OpenScale) | Model governance, bias and drift monitoring, documentation |
| Microsoft Responsible AI dashboard (Azure Machine Learning) | Fairness, error analysis, data imbalance |
| Arthur | Performance, drift and fairness monitoring |
| Amazon SageMaker Clarify | Bias detection in training and inference |
When something goes wrong, teams that improvise make it worse. Define the escalation path before the incident: who gets the call, what authority they have to pause or roll back the model, and what you tell customers if their data was affected.
I've seen companies assume their AI is running fine, only to scramble when a silent error snowballs into a crisis. A written incident plan, tested and not just filed, is the difference.
One row per AI system. Review it monthly for critical systems and quarterly for the rest.
| Field | What to record | Example |
|---|---|---|
| System and owner | Name, business owner, technical owner | Invoice auto-approval model; AP manager; data science lead |
| Decision influenced | What it decides or recommends | Approves invoices under a threshold without review |
| Data used | Sources, personal data, sensitive fields | Vendor master, invoice lines, payment history |
| Risk tier | Critical / moderate / low; EU AI Act category if relevant | Moderate; not Annex III |
| Main risks | Bias, security, compliance, drift | Drift as vendor mix changes; fraud through manipulated invoices |
| Controls | Tests, human review, thresholds, kill switch | Weekly sample review; value cap; alert on approval-rate change |
| Monitoring metric | What you watch and the alert level | Auto-approval rate outside its normal band |
| Incident contact | Who can pause it, and how fast | AP manager, within an agreed response time |
| Last reviewed | Date and reviewer | Monthly, by the AI risk committee |
For the governance structure that owns this register, see my AI governance framework guide. If you want an outside review of your register before a regulator or auditor asks for it, that is part of my AI governance advisory work.
What is an AI risk management framework?
A structured process for identifying, assessing and managing the risks that arise when AI systems influence business decisions. It covers the model lifecycle and includes controls for bias, security, compliance and operational drift.
In SAP environments it applies to models used in procurement (supplier scoring), HR (candidate screening), finance (invoice approval) and supply chain (demand forecasting). These systems affect people, money and compliance.
What is the NIST AI Risk Management Framework?
A voluntary framework from the US National Institute of Standards and Technology, published as AI RMF 1.0 in January 2023 and built on four functions:
- Govern: policies, accountability and culture
- Map: context, intended use and potential impacts
- Measure: testing for bias, robustness, explainability and security
- Manage: prioritising and treating risks, and monitoring
In July 2024 NIST added the Generative AI Profile (NIST AI 600-1), which is the most useful US reference for governing assistants such as Joule and Copilot.
When do the EU AI Act high-risk rules apply?
After the 2026 Digital Omnibus amendments, the rules for high-risk systems listed in Annex III (such as hiring, credit scoring and access to essential services) apply from 2 December 2027. High-risk AI embedded in products covered by EU product safety law follows on 2 August 2028. Prohibitions and general-purpose AI rules already apply.
What are the biggest risks in enterprise AI?
- Bias and discrimination: skewed historical data produces skewed outputs
- Security: data poisoning, prompt injection and model theft
- Compliance: GDPR, the EU AI Act, ISO 42001 and sector rules
- Operational drift: accuracy degrades as data patterns change
- Lack of explainability: a decision you cannot explain is hard to defend to a regulator, a customer or internal audit
What should an AI incident response plan cover?
Four things, defined before the incident:
- Escalation path: who is told first, who can pause or roll back the model, who speaks to customers
- Containment: how to isolate the system without breaking downstream processes
- Customer communication: what you tell affected people and when
- Post-incident review: root cause, retrain or roll back, and updated controls
Test the plan with a tabletop exercise at least once a year.
Next step
Running an ERP programme right now?
If this article touched on a programme you are live in right now, a 30-minute conversation usually gets further than another week of internal analysis.




