ETL Pipelines using SSIS

Project information

  • Category: SQL, ETL & Data Warehouse
  • GitHub:

For this project, SSIS is used to create the data flow. Data is extracted from OLTP data sources into the staging environment. Next, SSIS packages are designed to transform data into the desired warehouse schema and loaded into their respective Dimension or Fact tables. Storing of historical data was achieved by implementing Slowly Changing Dimensions on the desired columns.

Tools used in this project to perform the required task were: SQL Query generator, Derived Columns, Lookup Transformation, et cetera.