Explore Tasks
Prepare a model or AI system release decision with evaluation evidence, monitoring and rollback
The model or AI system owner receives a release decision record with fitness or evaluation evidence against the agreed bar, a monitoring plan and rollback, and records approval or rejection.
2jobs do it
6jobs help with it
22skills it needs
- Machine Learning Engineer
- AI Engineer
- Data Scientist
- Lead Data Scientist
- Lead AI & ML Engineer
- AI Product Manager
- Group Product Manager
- AI Governance Lead
Does itHelps with it
- Reading and tracing unfamiliar code
- Reviewing human- and AI-generated code changes for correctness and risk
- Sampling and reviewing a team's work against standards
- Diagnosing misleading data visualisations
- Verifying reports and dashboards before and after release
- Verifying AI-assisted outputs against sources
- Disclosing AI contribution to professional work
- Testing competing explanations with discriminating evidence
- Independently checking analytical conclusions and claims
- Escalating unresolved risks with evidence and clear ownership
- Giving specific developmental feedback on data and AI work
- Judging the materiality of defects and deficiencies for the intended use
- Gating releases on evidence with rollback ready
- Setting and reviewing action thresholds for scores and model predictions
- Bounding and securing AI systems' tool and data access
- Designing and running evaluations of AI systems
- Analysing error patterns and failure modes in models and AI systems
- Training reproducible machine learning models
- Evaluating ML generalisation and fitness
- Monitoring model fitness and drift
- Assessing data-driven fairness and bias
- Setting and applying a release and rollback bar for models and AI systems
Paths that teach the skills it needs
Skill Path
Data Literacy for Business Decisions
Judge whether a business claim from a table, KPI, chart or dashboard really holds up.
- Modules
- 5 open
- Practice data
- Raket Parts
Skill Path
Diagnostic Investigation and Root Cause Analysis
Resolve contradictory evidence and find, verify and prevent the causes of business and data anomalies.
- Modules
- 5 open
- Practice data
- Raket Parts
Skill Path
Data Visualisation and Dashboard Design
Design honest, accessible charts and decision-useful dashboards and verify them before release.
- Modules
- 5 open
- Practice data
- Raket Parts
Coming soonMachine Learning: from Data to Validated Models and DecisionsApplied AI at Work