Metadata Driven Pipelines (Full Load): The Fabric Modern Data Platform


To solve a complex business problem, one needs to break the process into smaller solvable steps. Today, we are going revisit the Modern Data Platform for Fabric Warehouse. Our first problem to solve is a full data load pattern from a relational database management system (RDBMS) into the Fabric Warehouse. The solution creates the framework that will be used in the next few articles. How can we use data pipelines to land full copies of data into raw zone tables?

Business Problem

Our manager has asked us to create data pipelines to copy tables from the Adventure Works LT database