Dynamic Partitioning and a Simple Incremental Load
Let’s consider a simple statement for partitioning and save a table in a lakehouse: df.write.mode(« overwrite »).format(« delta »).partitionBy(« Year », »Month », »Day »).save(« Tables/ » + table_name) Let’s consider we load the data daily, with all th …
Who’s Hiring in the Microsoft Data Platform Community? April 2024 Edition
Is your company hiring for a database position as of April 2024? Do you wanna work with the kinds of people who read this blog? Let’s set up some rapid networking here. If your company is hiring, leave a comment. The rules: Your comment must incl …
Use Fabric Data Factory to Load Data From a CSV File in Azure Blob Storage to Azure SQL DB
The post Use Fabric Data Factory to Load Data From a CSV File in Azure Blob Storage to Azure SQL DB appeared first on SQLServerCentral.
Building MongoDB Aggregations in MongoDB Compass
This article is part of Robert Sheldon’s continuing series on Mongo DB. To see all of the items in the series, click here. In the previous article in this series, I demonstrated how to build and run an aggregate statement in MongoDB Shell. An aggregate …
Announcing Fundamentals Week, May 6-10
You’ve attended some of my free online streams, read my blog posts, and you use the First Responder Kit. You enjoy my laid-back, humorous approach to sharing what I’ve learned over the years. You love live classes. You’ve tried watchi …
Tomorrow’s the Big Day: Free Live Webcasts!
No fooling here. Tomorrow, I’m teaching my very favorite class live online, for free, two different ways – one with all slides, and one with all demos. Whatever way you like to learn, I’ve got you covered. So, what’s the subject …
Custom Statistics Distributions in SQL Server 2022
Statistics are important for the query processing engine in SQL Server to run efficiently. The type of execution plan that is created often depends on the optimizer knowing the distribution of data in a column. This is why so many of us have maintenanc …
Choosing Between SSIS vs ADF: What You Need to Know
The post Choosing Between SSIS vs ADF: What You Need to Know appeared first on SQLServerCentral.
SQL Logic
In this article, I will discuss the history and thinking behind several types of logic that are typically associated with writing relational database code. Because of how relational databases implement NULLs, it definitely can make some processes more …
Check Azure SQL DB Space Used
A couple of days ago I was doing some cleaning on some Azure SQL DBs and shrinking some files to lower the bill. To check my progress I needed to check the size before/after the task in an easy way for multiple Azure SQL DBs. Check Azure SQL DB storage …
[Video] Office Hours: 25 Answers in 10 Minutes
It’s time for a speed round, a rapid-fire tour of your top-voted questions from https://pollgab.com/room/brento: Here’s what we discussed: 00:00 Start 00:17 SteveTV: Hi Brent! Are there solutions for managing SQL Agent jobs that obviate the …
[Video] Office Hours: The Long One
You posted a lot of great questions at https://pollgab.com/room/brento and I spent almost an hour covering these: Here’s what we covered: 00:00 Start 02:05 Kulstad: I’m using Ola Hallengren’s maintenance scripts for my db maintenance …
Managing Files and Folders with Python – Data Engineering with Fabric
What is a data lake? It is just a bunch of files organized by folders. Keeping these files organized prevents your data lake from becoming a data swamp. Today, we are going to learn about a Python library that can help you. Business Problem Our manager …
A First Look at SSMS 20
Recently Microsoft released SQL Server Management Studio (SSMS) v20.0, which is a major release of the primary tool that many of us use to work with SQL Server. Over the last few years, the tools team at Microsoft has worked to separate the tools from …
What is Eventstream in Microsoft Fabric? – Part 1
The post What is Eventstream in Microsoft Fabric? – Part 1 appeared first on SQLServerCentral.