While working on a pipeline in Azure Data Factory (ADF), sometimes we need to combine records from multiple source files and put them together into an output file. In this article, we will discuss steps to merge multiple files.
We will use three files in the data lake storage folder: File1.csv,File2.csv and File3.csv. Each file has a similar structure, with these columns:
SALESORDERNUMBER ISEXPORTSALE REATEDDATE ISSELECTED SALESORDERSTATUS CURRENCYCODE DELIVERYADDRESSCITY DELIVERYADDRESSCOUNTRYREGIONID DELIVERYADDRESSSTATEID.
We will use these files as sources for the merging process. You can see these files in my container below.
Let’s see the content of the