What to study for each CAIA-001 domain
Foundations of AI and Machine Learning
Covers supervised and unsupervised learning, overfitting, classification and regression, features and labels, holdout validation, precision and recall, computer vision, natural language processing, neural networks, and training data quality.
Key skills
supervised learning, unsupervised learning, overfitting, classification, regression, features and labels, recall, neural networks
AI Governance and Regulatory Compliance
Covers auditing accountability and ownership, approval evidence, risk-based audit focus, compliance mapping, policy frameworks as audit criteria, reassessment after regulatory change, oversight records, vendor change control, and AI system registers.
Key skills
governance audit, approval evidence, compliance mapping, audit criteria, system register, change control, oversight records
AI Risk Management and Ethical Auditing
Covers risk context and harm analysis, fairness and disparate impact testing, likelihood and impact rating, risk register completeness, hallucination risk, override effectiveness, authorised risk acceptance, and incident follow-up.
Key skills
risk auditing, fairness testing, disparate impact, risk register, hallucination risk, risk acceptance, ethical escalation
AI System Evaluation and Model Auditing
Covers independent performance verification, holdout re-testing and overfitting signals, representative evaluation data, per-class and subgroup metrics, robustness testing, version control, baseline benchmarking, and handling scope limitations.
Key skills
model evaluation, holdout testing, per-class metrics, robustness testing, subgroup analysis, version control, benchmarking
AI Security and Privacy
Covers prompt injection, model and data extraction attacks, privacy risks of external AI services, data poisoning, least-privilege access and logging, minimisation, output filtering, credential protection, retention, and adversarial examples.
Key skills
prompt injection, extraction attacks, data poisoning, access control, minimisation, output filtering, retention, adversarial examples
Reporting, Continuous Monitoring, and Best Practices
Covers audit finding structure, recommendations with owners and dates, monitoring thresholds and escalation, continuous monitoring versus point-in-time audit, follow-up of overdue actions, leadership reporting, decommissioning, and auditor independence.
Key skills
audit reporting, recommendations, monitoring thresholds, escalation, follow-up, leadership reporting, independence, decommissioning