Assert Transformations in Azure Data Factory


Introduction

I was recently working on a data pipeline project where I had to check data quality for the source data stream. Azure Data Factory provides Assert transformation to perform data quality and data validation checks. You can add expressions that validate to meet data quality. You can also check for duplicate values.

Pipeline development

I used the below sample sales data which is available in the SQL table. This table has multiple columns including customer address details like City, State, and Country. Now our job is to check whether the country field has values ‘Japan’:

Let’s go to