This post has been republished via RSS; it originally appeared at: Healthcare and Life Sciences Blog articles.
This blog has been co-authored by Samantha Brown, Pallavi Reddy and Ksheerja Batra
Microsoft’s Health and Life Sciences customers use our enterprise-ready and secure health data platform to solve a multitude of real world problems in healthcare and digitally transform their organization. While working with large amounts of organizational data, customers often run into the need to make data across siloed systems more interoperable. Customers have been asking for an easier way to construct their own custom ETL (extract, transform, and load) pipelines to integrate all their data and ultimately unlock business insights through analytics.
We knew that we needed to make this process easier for our customers, and we are proud to have now released several templates within the Azure Data Factory (ADF) template gallery. Azure Data Factory is a fully managed, serverless data integration service that comes with more than 90 built-in connectors. And yes, Data Factory is now in Microsoft Fabric, an all-in-one analytics solution for enterprises.
Azure Health Data and AI Templates
To allow customers to get started quickly with Azure Health Data Services and Azure AI services, we published several predefined and totally customizable templates in the ADF gallery. Today, when you search in the Azure Data Factory Gallery View, you will find several published templates, pictured below:
Get Started with Convert Data
One of our new templates allows you to transform HL7v2 data to Fast Healthcare Interoperability Resources (FHIR®) R4 and persist transformed results within an Azure Data Lake Storage (ADLS) Gen2 account. One of the most common scenarios that we hear about from customers is wanting to convert their source HL7v2 data into the FHIR R4 format, without having to create client apps to invoke the convert operation. We created a template that allows you to reduce your manual overhead and do just that!
Search for HLv2 in the Template gallery, select the “Transform HL7V2 health data to FHIR R4 format and write to ADLS Gen2” tile and then click Continue.
Once you select “Use this template", it will import a set of pipelines as shown below. Each of these are categorized under Extract, Load, Transform and Pipelines.
You can now make any modifications to the pipelines to fit your scenario. If you do not intend to persist the result in a destination ADLS Gen2 storage account, for example, you can modify the pipeline to remove that step altogether. The purpose of this template is to help you get started, cut down on development time, and be able to customize it to your unique use case.
We now have five different templates available for you to use in the Azure Data Factory Template Gallery. This will lessen the burden on customers when it comes to creating their own ETL pipeline from scratch, allow for seamless data integration, and ultimately will improve developer productivity through a more intuitive user interface.
If you would like to learn more details about any of the following topics mentioned in this blog, please see official Azure documentation below:
- Azure Health Data Services
- Azure Data Factory
- Azure Data Factory Templates
- $Convert-data FHIR Operation
- Troubleshoot $convert-data - Azure Health Data Services | Microsoft Learn
- Transform HL7v2 to FHIR R4
FHIR® is the registered trademark of HL7 and is used with the permission of HL7