🛡️Data Profiling
Also known as Data Profile, Column Profiling
Counting what is really in a table: blanks, values and ranges. It comes before checks.
Think of it like
It is like a check-up at the doctor. First you get the facts, then you decide.
Example
Jack profiles a new customer table of 10,000 rows. 312 emails are blank, and one fake email shows up 240 times. He writes two quality checks from what he found.
Why it matters
Checks written without a profile guess at the data. A profile shows the real problems worth a check.
Definition
Example code
sql
SELECT COUNT(*), COUNT(email), COUNT(DISTINCT email)
FROM customers;
-- 10000 | 9688 | 9410Common mistake
Key takeaways
- 1Measure first. Count before you judge.
- 2Every column. Blanks, values, ranges and top values.
- 3Feeds the checks. Each surprise becomes a quality rule.