Using ADF to Upload Disparate CSV Files into Azure MySQL

In this article our objective is to showcase how to leverage Azure Data Factory (ADF) and a custom script to upload data in Azure MySQL database when we have CSV files with different schemas.

As there is no straightforward way to upload data directly using ADF for this given scenario, it will actually help to understand how a custom activity will help. We will use this activity to handle various tasks that cannot be accomplished directly in ADF.


There are the files coming from multiple vendors with different column names and orders. Those files need to be loaded in