Data quality and governance

Deduplication

  • Data quality and governance

Definition

Finding records that describe the same real thing more than once and keeping only one, using rules about which fields must match.

Example

Raket Parts B.V. received 979 supplier invoices. One was a duplicate: supplier X-SUP-015 sent invoice 015-377440 for €12,278.75 twice, and the second copy was rejected. Matching on supplier and supplier invoice number, not on the internal reference, is what catches it.

Raket Parts B.V. is a fictional company created for Insyt.

For your role

Choose your role to see what this term means in your work.

Why it matters

Duplicates inflate totals, cause double payments and annoy customers who get two of everything.

Where it is used

Data cleaning, accounts payable controls, CRM clean-ups and migrations. Used by data analysts, data engineers, accounts payable teams and CRM administrators.