Apache Spark

Empowering Lakehouse Users – Data Engineering with Fabric

Microsoft Fabric allows the developers to create delta tables in the Lakehouse. However, the automation of copying, updating, […]

 dans Sites anglophones  étiqueté Apache Spark / CSV files / data engineering / Data Wrangler Extension / DELETE / Empowering Users / Full Load Code / INSERT / John F. Miner III / Learn / Microsoft Fabric / Microsoft Fabric (Azure Synapse, Data Engineering, etc.) / One Lake Explorer / Parquet files / Strong File Format / Update / VS Code / Weak File Format par

Combining Silver Tables into a Model – Data Engineering with ...

Data Presentation Layer Microsoft Fabric allows the developer to create delta tables in the lake house. The bronze […]

 dans Sites anglophones  étiqueté Adventure Works Schema / Aggregate / Apache Spark / Combine / data engineering / Data Factory / Data Warehouses / External SQL Tools / Full Load Code / Gold Layer / John F. Miner III / Learn / Meta Data Driven Design / Microsoft Fabric / SQL Analyhtics Endpoint / Uncategorized par

Metadata Driven Pipelines – Data Engineering with Fabric

What is a metadata driven pipeline? Wikipedia defines metadata as “data that provides information about other data.” As […]

 dans Sites anglophones  étiqueté Apache Spark / Bronze / CSV files / data engineering / Data Factory / Full Load Code / John F. Miner III / Learn / Meta Data Driven Design / Microsoft Fabric / Microsoft Fabric (Azure Synapse, Data Engineering, etc.) / Quality Zones / Raw / Silver par