ETL Pipelines using SSIS
Extracting Customer Data into Stagging
Stagging to Loading Customer Dimension Control Flow
FudgeFlix Customer Loading into Customer Dimension
FudgeMart Customer Loading into Customer Dimension
Project information
For this project, SSIS is used to create the data flow. Data is extracted from OLTP data sources into the staging environment. Next, SSIS packages are designed to transform
data into the desired warehouse schema and loaded into their respective Dimension or Fact tables. Storing of historical data was achieved by implementing Slowly Changing Dimensions on the desired columns.
Tools used in this project to perform the required task were: SQL Query generator, Derived Columns, Lookup Transformation, et cetera.