Just Shipped: Use Azure Data Factory command activity to run Azure Data Explorer control commands

This post has been republished via RSS; it originally appeared at: Azure Data Explorer articles.

Azure Data Factory (ADF) is a cloud-based data integration service that allows you to perform a combination of activities on the data. Use ADF to create data-driven workflows for orchestrating and automating data movement and data transformation. The Azure Data Explorer Command activity in Azure Data Factory enables you to run Azure Data Explorer control commands within an ADF workflow. This article teaches you how to create a pipeline with a lookup activity and ForEach activity containing an Azure Data Explorer command activity.

Control commands are requests to Kusto to process and potentially modify data or metadata. For example, the following control command creates a new Kusto table with two columns, Level and Text:

 

 

.create table Logs (Level:string, Text:string)

 

 

 

adx-command-activity.png

The command activity has the following limits:

  • Size limit: 1 MB response size
  • Time limit: 20 minutes (default), 1 hour (maximum).
  • If needed, you can append a query to the result using AdminThenQuery, to reduce resulting size/time.

 

For more information regarding how to use ADX command read:  Use Azure Data Factory to run Azure Data Explorer Command 

 

Learn more about Azure Data Explorer (Kusto):

  1. Azure Data Explorer
  2. Documentation
  3. Course – Basics of KQL
  4. Query explorer
  5. Azure Portal
  6. User Voice
  7. Cost Estimator
  8. ADX End to End Lab

Join us to share questions, thoughts, or ideas about Azure Data Explorer (Kusto) and receive answers from the diverse and knowledgeable Azure Data Explorer community.

 

Azure Data Explorer product team

“Join the conversation on the Azure Data Explorer community”.

REMEMBER: these articles are REPUBLISHED. Your best bet to get a reply is to follow the link at the top of the post to the ORIGINAL post! BUT you're more than welcome to start discussions here:

This site uses Akismet to reduce spam. Learn how your comment data is processed.