AI and machine learning

Model drift

  • AI and machine learning

Definition

When a model gets worse over time because the world it was trained on has changed.

Example

A model trained on last year's purchasing patterns begins performing worse as customer behaviour changes.

See how it works

  1. Record baseline performance
  2. Monitor inputs and outcomes
  3. Investigate performance changes
  4. Review, update or retrain as justified

Check your understanding

Common mistake: Every performance decline is not necessarily model drift; data defects or system changes may also be responsible.

What should be monitored besides model predictions?

Show explanation

Input distributions, relevant outcomes, quality of incoming data and performance against an agreed baseline.

For your role

Choose your role to see what this term means in your work.

Why it matters

Where it is used

Any model left running for months without being checked.