AI and machine learning

Inference cost

  • AI and machine learning

Definition

The ongoing cost of actually running a trained model to produce predictions, as opposed to the cost of training it.

For your role

Choose your role to see what this term means in your work.