Data engineering and IT

ETL

  • Data engineering and IT

Definition

Short for extract, transform, load: taking data from source systems, cleaning and reshaping it, and loading it into a destination such as a data warehouse.

Example

ILLUSTRATION based on Raket Parts B.V. data. Raket's systems exchange 1,243 interface batches in the practice data. An ETL job would extract each day's batch, transform it (drop the 4 refused duplicate replays, convert currencies, standardise dates) and load the result into the warehouse tables.

Raket Parts B.V. is a fictional company created for Insyt.

For your role

Choose your role to see what this term means in your work.

Why it matters

Analysis is only as good as the data arriving in the warehouse; ETL is where it is cleaned and made consistent.

Where it is used

Data integration and warehouse loading. Used by data engineers, analytics engineers and BI developers.