Change Data Capture vs Incremental Load
People think asking a table for rows with a newer time is CDC. That is an incremental load. It asks the table on a timer and only sees rows as they are now. CDC reads the database's change log, so it catches every change, deletes too, within seconds.
Change Data Capture (CDC)
It copies each change in a database right as it is made.
Change data capture copies each change in a database as it happens. It reads the database's own change log. Every insert, update and delete is written there. Each change becomes an event that is sent on to other systems. So a warehouse or a search index stays in step within seconds. The source database barely notices.
Incremental Load
Copy only what is new since last time. Do not copy it all again.
An incremental load copies only the rows that are new or changed since the last run. It keeps a mark of how far it got, often the latest updated time or the highest ID. The next run asks only for rows past that mark. A full load copies the whole table each time instead. Incremental loads are far faster on big tables.
In one line
- Change Data Capture (CDC)
- It copies each change in a database right as it is made.
- Incremental Load
- Copy only what is new since last time. Do not copy it all again.