Temporal DWH whitepaper

CDC (Change Data Capture) solutions let us see every little change that happens on a database. It is possible to turn a CDC change register into a set of temporal tables that can be pushed through ETL to form a fully temporal data warehouse, where any change in the source is represented in the output tables (like facts or dimensions). In this paper we shortly describe our approach to temporal data warehousing and show how can the data from CDC can efficiently be extracted, transformed and loaded into the serving layer tables.

Temporal DWH whitepaper

CDC (Change Data Capture) solutions let us see every little change that happens on a database.
It is possible to turn a CDC change register into a set of temporal tables that can be pushed through ETL to form a fully temporal data warehouse, where any change in the source is represented in the output tables (like facts or dimensions). In this paper we shortly describe our approach to temporal data warehousing and show how can the data from CDC can efficiently be extracted, transformed and loaded into the serving layer tables.

Dadrico Github repository

In our public code repository you can find a couple of custom SAS Data Integration Studio transformations that you can use in your ETL projects. Among them there are some basic operations on temporal tables (join, group by, last) that are handy when dealing with tables with any type of timelines. There are also some non-temporal ones available, like hierarchy search, which can be used to effortlessly extract information from a parent-child relation tables. Enjoy!

CONTACT

Dadrico B.V.

+31 683 774 907

info@dadrico.com

CONTACT

Dadrico B.V.

+31 683 774 907

info@dadrico.com

CONTACT

Dadrico B.V.

+31 683 774 907

info@dadrico.com