Managing Failed Pipeline Runs in Azure Data Factory
The post Managing Failed Pipeline Runs in Azure Data Factory appeared first on SQLServerCentral.
Query Exercise: Who’s Changing the Table?
For this week’s Query Exercise, your challenge is to find out who keeps messing up the rows in the Users table. Take any size version of the Stack Overflow database, and the Users table looks like this: People are complaining that from time to ti …
It’s Time For Our Annual Anniversary Sale!
I first registered BrentOzar.com way back in May 2001. Over the years, some things in databases have changed a lot, but some things still remain the same. Every year, people get handed applications and databases, and they’re told, “The back …
Metadata Driven Pipelines – Data Engineering with Fabric
What is a metadata driven pipeline? Wikipedia defines metadata as “data that provides information about other data.” As a developer, we can create a non-parameterized pipeline and/or notebook to solve a business problem. However, if we must solve the s …
PySpark Secrets to use with Fabric
PySpark is a powerful language for data manipulation and it’s full of tricks. Let’s discover some of them. Control the Type of a NULL column If you are creating a pysspark dataframe, but one of the columns contains only null values (None), …
Join Me at the PASS Data Community Summit in November!
On November 4 in Seattle, I’m presenting a new pre-conference workshop! Tuning T-SQL for SQL Server 2019 and 2022 You’ve been working with SQL Server for a few years, and you’re comfortable writing queries and reading execution plans. …