Sending Azure Cost Management to Azure Data Explorer/Fabric KQL DB

This post has been republished via RSS; it originally appeared at: Microsoft Tech Community - Latest Blogs - .

Understanding your Azure Spend is one of the most important things you do as an Azure customer. Azure Cost Management is built into the platform to provide you insights. But we live in a world of data and looking at the Azure Cost Management data in a silo may not meet your organization's needs. In those situations, we can solve that need by putting your Cost Management data into an analytical platform like Azure Data Explorer or Microsoft Fabric KQL Database. Here we can bring in or join additional data that's useful, run ad-hoc queries and build visualization tying it all together.

 

Using the below repository, you'll be able to utilize Azure Cost Management exports to setup an automated process that ingests the cost data into ADX or Fabric KQL Database.

 

Components

The system consists of an Azure Data Explorer cluster, an Azure Data Factory, and a Storage Account.

 

An admin using AzCLI or Azure Cost Management automatic export pushes usage data in to blob containers in the storage account. Azure Data Factory automatically loads new data into Azure Data Explorer as it arrives in the blob containers via an Event Grid trigger.

 

Architecture

 

dataflow.png

Installation

There are two methods to deploy this architecture.

  1. Click to implement this using AzCLI (automatic):
 

Start.jpg

  1. Click to implement this using a guided walkthrough (manual):
 

Start.jpg

Sample Results

Power BI Report

 

PBIReport.png

 

For more information about dealing with duplicates or updating records review click here!

Leave a Reply

Your email address will not be published. Required fields are marked *

*

This site uses Akismet to reduce spam. Learn how your comment data is processed.