Ingesting Data from Google Drive to Azure Data Lake Gen2 ...
The post Ingesting Data from Google Drive to Azure Data Lake Gen2 using Azure Data Factory appeared first […]
ETL/SSIS/Azure Data Factory
The Art of Data Ingestion – Part 1
Data movement is a fundamental piece of a data engineer’s duties, and recently I’ve been thinking about the […]
Assert Transformations in Azure Data Factory
Introduction I was recently working on a data pipeline project where I had to check data quality for […]
Azure Data Factory Interview Questions and Answers
Azure Data Factory is an Important tool for Azure Data engineers and organizations to fulfill their data transfer […]
The Script Activity in Azure Data Factory
Introduction Azure Data Factory recently introduced a new activity, called the Script activity. We can use the Script […]
Understanding the Mapping Data Flow Activity in Azure Data Factory
Azure Data Factory is used for ELT (Extract, Load, Transform) operations in Azure. We do have multiple activities […]
An Introduction to Flowlets in Azure Data Factory
Introduction Flowlets is a new feature of Mapping data flows introduced in Azure Data Factory and Azure Synapse […]
Understanding Azure Data Factory Pricing
Introduction In this article, we will discuss the pricing of the Azure data factory data pipeline. It will […]
Working with Get Metadata Activity in Azure Data Factory
Introduction While working in Azure Data Factory, sometimes we need to retrieve metadata information, like the file name, […]
Importing a CSV into SQL Server Shouldn’t Be This Hard
Like many of you, I recently had to import some data in a CSV (comma-separated file) into SQL […]
Migrating SSIS packages to Azure – Lift and Shift using ...
Unlike an on premises SQL Server, Integration Services (SSIS) works very differently on Azure. If there are requirements […]
Microsoft Azure ADF – Dynamic Pipelines
Azure Data Factory (ADF) is a cloud based data integration service that allows you to create data-driven workflows […]
How to Resolve Merge Conflicts in Git for SSIS Projects
The post How to Resolve Merge Conflicts in Git for SSIS Projects appeared first on SQLServerCentral.
Migrate the SSIS Catalog in Just a Few Clicks
From SQL Server 2012 onwards, Microsoft introduced a new deployment model in SSIS, called the project deployment model. […]
Getting Informative SQL Agent Notifications from Failed SSIS Packages
Introduction The SSISDB database (a.k.a. the Integration Services catalog) was introduced back in SQL Server 2012 as a […]
How to simulate Case statement in Azure Data Factory (ADF) ...
This post will describe how you use a CASE statement in Azure Data Factory (ADF). If you are […]
Incremental Data Loading using Azure Data Factory
Introduction In my last article, Loading data in Azure Synapse Analytics using Azure Data Factory, I discussed the step-by-step […]
Downloading a CSV File from an API Using Azure Data ...
Azure Data Factory has two different connectors that can copy data from APIs. Originally, there was only the […]