Azure Synapse on Cathrine Wilhelmsen

Participating in the Microsoft Fabric AMA (Ask Me Anything) hosted by MDPUG Norway

Mon, 19 Jun 2023 12:00:00 +0200

On Wednesday, June 21st, 2023, I will be participating in the Microsoft Fabric AMA (Ask Me Anything) hosted by Microsoft Data Platform User Group Norway.

Microsoft Fabric was launched in public preview in May. It was called the greatest invention since SQL Server and promises to simplify analytics for everyone. Microsoft used Build, one of its flagship events, to launch Microsoft Fabric to much fanfare - and surrounded by lots of hype. But is the hype real?

Solving FizzBuzz using SQL

Wed, 07 Sep 2022 11:20:00 +0200

This week, my coworkers and I were given a fun challenge. Using any tool or language, solve FizzBuzz! 🤓 Then present and explain the solution to the rest of the team. This was a fun challenge because our team is a mix of junior-to-senior developers and data professionals, working with everything from SQL to Python to C# to DAX to PowerShell. Those who had never solved FizzBuzz before got the chance to do so, while those who had already solved it got the chance to try again using a different tool or language.

Ingest and Explore LEGO Datasets using Pipelines and Serverless SQL in Azure Synapse Analytics

Tue, 12 Apr 2022 17:00:00 +0200

In the April session of the Azure Synapse Analytics and Microsoft MVP series, I got to show one of my favorite demos: ingesting and exploring LEGO datasets! 🤓 In just a few minutes, I grab a compressed file from the web, decompress it, store it as a Parquet file in my data lake, and run SQL queries on it using Serverless SQL. It really is that simple:

If you want to try this demo yourself, you can follow the detailed steps below. Have fun! 😃

Failed to Subscribe / Failed to Activate Storage Event Trigger After Publishing in Azure Synapse Analytics

Wed, 15 Dec 2021 16:00:00 +0100

I ran into an issue today while trying to publish a storage event trigger in Azure Synapse Analytics. After publishing, I got error messages that said “failed to subscribe” and “failed to activate”. The storage event trigger had been published, but it wouldn’t start. Help! 😱

(Skip to how I fixed the failed to subscribe / failed to activate errors 👇🏻)

The Error Messages

The error messages hinted at access control or permission issues:

Connecting to HubSpot from Azure Synapse Analytics or Azure Data Factory

Tue, 14 Dec 2021 20:30:00 +0100

I spent a couple of hours today figuring out how to connect to HubSpot from Azure Synapse Analytics. Since it wasn’t straightforward for me, I decided to blog about how I did it. Hopefully, this post can help one or two others (or future me!) save some time 😊

The HubSpot Linked Service

The Azure Synapse Analytics (or Azure Data Factory) linked service connects to HubSpot using a Client ID, Client Secret, Access Token, and Refresh Token:

How do we get these values from HubSpot?

The overall process is to:

Create a private app in HubSpot to get the Client ID and Client Secret
Authorize the private app and get authorization code
Exchange authorization code for Access Token and Refresh Token
Create linked service in Azure Synapse Analytics or Azure Data Factory

Let’s dig into the details! 🤓

Training Day at SQLBits 2022: Data Integration using Azure Data Factory or Azure Synapse Analytics

Wed, 08 Dec 2021 14:50:00 +0100

Are you new to Azure Data Factory or Azure Synapse Analytics? Maybe you’re an expert SSIS developer wondering how to take that first step into Azure? Do you feel a little overwhelmed by all the possible ways you can move and transform data these days? Join me at the ExCeL London on Tuesday, March 8th, 2022! I will be delivering a training day at SQLBits 2022 called Beginner’s Guide to Data Integration using Azure Data Factory or Azure Synapse Analytics 🥳

My goal is to help kickstart your journey as an Azure Data Engineer, and for all of us to have a great and safe day of learning and networking. SQLBits are taking covid safety seriously by requiring proof of vaccination / tests, wearing masks, and ensuring proper spacing between seats. I will be there in-person and hope you will be able to join us too!

(Oh, and if you want to get the most out of your week at SQLBits? Check out Paul Andrew’s training day on Wednesday called Azure Data Integration Pipelines - Advanced Design and Delivery 🤓)

Ask the Experts: Data Integration in Azure Synapse Analytics (at Data Toboggan 2021)

Wed, 02 Jun 2021 11:55:33 +0200

On Saturday, June 12th, 2021, I will be moderating an Ask the Experts session at Data Toboggan! This is a free event focusing on Azure Synapse Analytics. There are over twenty sessions and lightning talks scheduled, covering topics such as architecture, performance, tools, data integration, machine learning and much more.

If you have any questions about Data Integration in Azure Synapse Analytics (or Azure Data Factory), join us! You don’t want to miss this session 🤓

Speaking at Global Azure Norway 2021

Mon, 12 Apr 2021 10:20:24 +0200

On Friday, April 16th, 2021, I will be speaking at Global Azure Norway! Global Azure is a virtual 3-day event where communities from around the world organize live streams that are open for everyone to join. All the live streams add up to one global event with more than 500 speakers and sessions, so you should be able to find something interesting 🤓

I will be presenting my session called Pipeline and Data Flows: Introduction to Data Integration in Azure Synapse Analytics. Do you want to learn about something else? You can find all the worldwide sessions on the Global Azure website, or the local sessions on the Global Azure Norway website.

Speaking at Data Toboggan 2021

Mon, 25 Jan 2021 10:55:35 +0100

On Saturday, January 30th, 2021, I will be speaking at the first Data Toboggan event! This is a free event focusing on Azure Synapse Analytics. There are 14 sessions scheduled in 12 hours, covering topics such as data integration, machine learning, data warehousing, data governance, and more. Join us 🤓

I will be presenting a session called Pipelines and Data Flows: Introduction to Data Integration in Azure Synapse Analytics.