Azure SQL Database to ADF connectivity using Azure Private Endpoint

This post has been republished via RSS; it originally appeared at: New blog articles in Microsoft Tech Community.

Recently, I came across a question where a user wanted to test Private endpoint connectivity from Azure Data Factory ( ADF) to Azure SQL Database. The Azure SQL server has Deny Public network access.

YoBelwal_26-1653216956433.png

For this task, I created Data Factory and using Azure Self Hosted Integration runtime tested the desired connectivity. Below are the steps I followed. I started with creating an Azure Data Factory.

 

  • In the global search, search for Data factories.

YoBelwal_27-1653216956443.png

  • Click on Create

YoBelwal_28-1653216956449.png

  • Provide the required details

YoBelwal_29-1653216956459.png

  • For the test, select Configure Git later and select review + create.
  • Once Data Factory is created then go to the created resource and in the overview, blade select Open Azure Data Factory Studio. This will open a new webpage.

YoBelwal_30-1653216956470.png

  • In the newly opened weblink, go to Integration runtime and click on New
    YoBelwal_31-1653216956486.png

     

  • For the demo I selected integration runtime setup as Azure, Self-Hosted IR

YoBelwal_32-1653216956495.png

 

  • Click continue and provide the required details

    YoBelwal_33-1653216956506.png

     

  • In the next tab, enable the Virtual network option.

    YoBelwal_34-1653216956514.png

     



  • In the data flow tab, you can select your desired setup or leave it to default settings.
  • Click on Create.
  • Once Integration Runtime is created, you can see it’s status in Integration Runtimes blade

YoBelwal_35-1653216956527.png

 

  • Now, go to Managed Private Endpoint blade and click on New.

YoBelwal_36-1653216956543.png

 

  • Select Azure SQL Database.

YoBelwal_37-1653216956556.png

 

  • Provide the details of your Azure SQL Server for which you want to create private communication between ADF and Azure Database and click Create.

    YoBelwal_38-1653216956567.png

     

 

  •  You can see the provisioning state of the Managed Private Endpoint, it needs to be succeeded 

YoBelwal_39-1653216956588.png

 

 

  • Now, let’s create a Linked service. Go to Linked Services and then select New

    YoBelwal_40-1653216956611.png

     

  • Search for Azure SQL Database and click on Continue

    YoBelwal_41-1653216956628.png

     

 

  • Provide the required details, but make sure you are providing the correct integration runtime details (the one we created in step 6).

YoBelwal_42-1653216956637.png

 

  • To test connectivity, click on Test connection.

    YoBelwal_43-1653216956642.png

     



  • Once the test is successful, click on Create. You can check the status in Linked Services blade.

YoBelwal_44-1653216956653.png

 

  • Now, let’s go to Portal.azure.com and in global search, search for Private endpoints

YoBelwal_45-1653216956667.png

 

  • Go to pending connections tab and approve the pending Private link connection ( which we have just created)
    YoBelwal_46-1653216956680.png

     

  • Once it is approved, then to validate if you can fetch the data from ADF you can create a dataset. For this go to ADF weblink and then go to Author, then to dataset.

YoBelwal_47-1653216956687.png

 

  • Search for Azure SQL Database

    YoBelwal_48-1653216956693.png

     




  • In the properties tab provide the required details, make sure to provide the correct linked service. Once it is selected click Ok.

    YoBelwal_49-1653216956697.png

     



  • Now, in the connection tab, select the required table name and then click on Preview data option to see the data.

    YoBelwal_50-1653216956705.png

     

YoBelwal_51-1653216956711.png

 

Leave a Reply

Your email address will not be published. Required fields are marked *

*

This site uses Akismet to reduce spam. Learn how your comment data is processed.