Validate CSV files before ingestion in Microsoft Fabric Data Factory Pipelines

A very common task for Microsoft Fabric, Azure Data Factory and Synapse Analytics Pipelines is to receive unstructured files, land them in an Azure Data Lake (ADLS Gen2) and load them into structured tables. This often leads to a very common issue with… Continue reading Validate CSV files before ingestion in Microsoft Fabric Data Factory Pipelines

Always Encrypted vs Always Encrypted with secure enclaves

Introduction
Encryption is a vital technique for protecting sensitive data from unauthorized access or modification. SQL Server and Azure SQL Database offer two encryption technologies that allow you to encrypt data in use: Always Encrypted and Always … Continue reading Always Encrypted vs Always Encrypted with secure enclaves

AI-as-a-Service: Architecting GenAI Application Governance with Azure API Management and Fabric

The past year has seen explosive growth for Azure OpenAI and large language models in general. With models reliant on a token-based approach for processing requests, ensuring prompt engineering is being done correctly, tracking what models and api’s ar… Continue reading AI-as-a-Service: Architecting GenAI Application Governance with Azure API Management and Fabric

Deployment rules for Notebooks: Enhancing Efficiency with Microsoft Fabric.

Introduction. Fabric Notebooks, an integral component of the Microsoft Fabric ecosystem, offer a powerful platform for interactive data exploration, analysis, and collaboration. Designed to enhance productivity and streamline workflows, Fabric Not… Continue reading Deployment rules for Notebooks: Enhancing Efficiency with Microsoft Fabric.

Resolved: Known issue – /tmp/mstunnel Directory not found when upgrading Microsoft Tunnel

We recently discovered an issue for Microsoft Tunnel where the /tmp folder might be cleaned up by the system. This means that the required /tmp/mstunnel/ folder could be missing from the machine and cause the Microsoft Tunnel upgrade to fail.
 
Th… Continue reading Resolved: Known issue – /tmp/mstunnel Directory not found when upgrading Microsoft Tunnel