Skip to content
BENIBIX Learn

Feature Scaling vs Database Normalization

People hear normalization and think of one idea, and there are two. In machine learning, it means scaling number columns to a similar range. In databases, it means splitting tables so each fact is stored once. One changes the numbers. The other changes the table layout.

AI📈 Machine Learning

Feature Scaling

Puts number columns on one range. Then big numbers do not drown out small ones.

Feature scaling puts number columns on a similar range before training. One column might be age, from 0 to 100. Another might be income, up to 200,000. Without scaling, the big numbers can drown out the small ones. Min-max scaling squeezes each column to 0 to 1. Standardization shifts it so the average is 0 and most values sit near it.

Example
Emma's model reads age and income. After scaling, both run from 0 to 1. Her k-nearest neighbors model stops ignoring age.
Why it matters
Models that measure distance or use gradient descent learn badly without it. Tree models do not need it.
Full entry
Development🗃️ Databases

Database Normalization

Setting up a database so each fact is kept in one place.

Normalization means each fact is kept in just one place in a database. Instead of copying a customer's city into every order, you keep it in the customers table and link to it. That way, a change happens once and nothing gets out of step. The rules come in steps called normal forms, such as first, second and third. Most apps aim for third normal form.

Example
Jack's orders table copied each buyer's address. When Lucy moved, half her orders showed the old one. Moving addresses to the customers table fixed it.
Why it matters
Copied data drifts apart. When there is just one copy, it cannot.
Full entry

In one line

Feature Scaling
Puts number columns on one range. Then big numbers do not drown out small ones.
Database Normalization
Setting up a database so each fact is kept in one place.

These live in different corners of the glossary (AI and Development), which is exactly why they get confused.