Browse All Machine Learning Content (206)

ryanjadams explains how to keep Fabric Data Factory pipelines and Copy Jobs fully private when moving data to or from Snowflake, using Workspace-level Private Link, a private Azure Storage staging account, and Snowflake’s Azure Private Link storage integration.

AmirJafari announces general availability of the Microsoft Fabric data agent integration in Copilot Studio, enabling agents to call governed Fabric data as a tool (Fabric IQ Data MCP) and return permission-respecting, data-grounded answers. The post highlights the new tool-based authoring experience, improved orchestration, and expanded publishing targets.

wolfgangdesalvador breaks down Azure’s MLPerf Storage v3.0 results for Azure Managed Lustre, focusing on how sustained throughput and fast checkpoint I/O help keep large AI training clusters from stalling.

Michaela Isaacs explains the GA transition in Power BI and Microsoft Fabric from embedded ODBC drivers to Apache Arrow Database Connectivity (ADBC) drivers, why it improves large-result performance and security posture, and how to validate the change ahead of the tenant-wide cutover.

bgautam announces general availability of the Microsoft Fabric Admin API for listing workspace networking communication policies tenant-wide, aimed at improving security auditing, compliance monitoring, and governance reporting across Fabric workspaces.

Nimrod Shalit introduces a new set of Microsoft Learn resources for implementing CI/CD in Microsoft Fabric, covering platform concepts, best practices, and hands-on tutorials for deploying Fabric items across dev/test/prod using Git integration, Azure DevOps pipelines, Terraform, the Fabric CLI, and the fabric-cicd library.

Virginia_R announces a Preview feature in Fabric data agents that upgrades natural-language-to-DAX translation for Power BI semantic models using an agentic, iterative approach. The post explains how planning, tool use, intermediate-result inspection, and instance value indexing improve filter accuracy, consistency across Microsoft experiences, and overall query reliability.

Rafia Aqil explains how to diagnose and resolve Azure Databricks “capacity” incidents by separating true regional VM SKU shortages from subscription quota limits and Databricks platform ceilings, then applying practical mitigations like SKU swaps, off-peak retries, instance pools, and capacity reservation groups.

meghasony shares guidance on structuring dbt jobs in Microsoft Fabric, focusing on how to place Bronze/Silver/Gold layers across Lakehouse and Warehouse, and how to separate architecture decisions from orchestration choices using Fabric pipelines or native scheduling.

bytecascade explains how Microsoft Fabric Eventstream can securely ingest private operational data (like factory MQTT telemetry) for real-time analytics by using an Azure virtual network bridge and a Fabric streaming virtual network data gateway, without exposing public endpoints.

FabSubhojit announces the general availability of Fabric Migration Assistant for SQL database, a guided workflow for assessing schema compatibility, provisioning SQL database in Fabric, deploying schema with fix suggestions, and copying data. The update adds a Validate step that analyzes a DACPAC before any Fabric resources are created.

Naorbt announces a preview feature that lets you embed a Fabric Map as a reusable tile inside Microsoft Fabric Real-Time Dashboards, so teams can add geospatial context to operational monitoring without duplicating map queries, layers, filters, or styling across dashboards.

robece-msft continues the Microsoft Fabric Business Events series by outlining five real-world business event scenarios and the shared event-driven pattern used to turn business moments into trusted signals and downstream actions across Fabric.

This week in ML and data engineering, Microsoft Fabric pushed further on standardization and operability with Runtime 2.0 (Spark 4.1 and Delta Lake 4.2), a GPU query acceleration preview, and more policy-driven OneLake governance, including a preview mirror of Google Lakehouse Runtime Catalog metadata for Iceberg tables. On the workflow side, Fabric Warehouse CI/CD moved closer to familiar database project patterns with DacFx and a VS Code Schema Compare path, while agent updates (including GPT-5.1 references and MCP-based connections) continued the shift from assisted authoring to tool-connected automation that still needs validation and logging. Rounding out the week, new guidance focused on practical cost loops in Azure Databricks and on building AI-ready apps with vector search and RAG in Azure SQL Database, plus a broader view of how Work IQ, Foundry IQ, and Fabric IQ frame RAG as the grounding layer for enterprise agents.

goupadhy announces the August 2026 on-premises data gateway release (version 3000.330), highlighting Power BI Desktop compatibility plus updates across security, authentication, diagnostics, and reliability, along with guidance to upgrade to stay current with dependency and CVE-related fixes.

robece-msft continues the Microsoft Fabric Business Events series by showing how to react to business events using Fabric Activator and Eventhouse, focusing on practical event-driven patterns for turning event streams into signals and actions across Fabric.

murray-kp rounds up the August 2026 Microsoft Fabric updates across OneLake, Data Engineering, Data Warehouse, Real-Time Intelligence, Data Factory, and Fabric data agents, including Git-based CI/CD improvements, Spark runtime upgrades, new security controls, and expanded AI-driven conversational analytics capabilities.

perirocha announces general availability of IDENTITY columns in Fabric Data Warehouse, adding IDENTITY_INSERT and reseed operations to support common migration and enterprise warehousing patterns, especially where preserving surrogate key values is required across dimension and fact tables.

mk_sunitha announces a preview feature for Fabric Apps that enables anonymous (no sign-in) access to selected data and operations, aimed at building public-facing experiences while keeping tight administrative and data-model controls in place.

Rafia Aqil (co-authored with Sanjeev Nair) lays out a three-phase, practical approach to reducing Azure Databricks spend: first getting visibility into where DBUs and cloud costs go, then tightening cluster and code practices, and finally setting up ongoing cost observability with Unity Catalog system tables, tagging, dashboards, and budgets.

Anna Hoffman introduces the Azure SQL Database Foundations series: four videos (with companion repos) that walk developers through getting started with Hyperscale, migrating and optimizing existing databases, scaling for performance, and adding AI features like vector search and RAG directly on operational data.

Bob and Anna demo how to build AI-style retrieval features on Azure SQL Database Hyperscale using vector embeddings and vector indexes, focusing on practical developer capabilities for semantic search and retrieval scenarios.

Microsoft Developer introduces Work IQ, Foundry IQ, and Fabric IQ and how they fit together for building intelligent agents across application workflows and data/analytics scenarios.

MattH_OneLake announces a preview feature in Microsoft Fabric that mirrors Google Lakehouse Runtime Catalog metadata into OneLake, enabling zero-copy access to supported Apache Iceberg tables and making them usable across Fabric experiences like SQL, Power BI, Spark notebooks, and data science workloads.

This week's ML roundup focuses on making agent experiences more governed and repeatable in Microsoft Fabric, from the new Fabric Data Warehouse MCP Server preview to tighter routing controls for Fabric data agents. On the data platform side, Fabric Data Warehouse added new tuning and cost tools, including GPU-powered Query Acceleration and Custom SQL Pools, plus practical guidance for Bronze-Silver-Gold layering. Security and operations also moved forward with CMK REST APIs, identity-based Event Hubs connections for Eventstream, and more production-friendly monitoring and dashboard KPIs to help teams run streaming workloads with clearer controls.

spurthikommajos explains how Microsoft Fabric Eventstream can connect to Azure Event Hubs using Fabric workspace identity (preview), replacing shared access keys with Microsoft Entra ID tokens and Azure RBAC. The post outlines why identity-based auth matters, how permissions are assigned, and the exact setup steps in Fabric and Event Hubs.

Naorbt announces the general availability of a new KPI visualization in Microsoft Fabric Real-Time Dashboards, designed to make operational metrics easier to interpret at a glance using status ranges, configurable scales, value formatting, and reference indicators.

salilkanade1 announces a preview of the Fabric Data Warehouse MCP Server (remote) and Skills for Fabric, aimed at letting MCP-compatible agents execute and iterate on T-SQL against live warehouse data while following Fabric-specific guidance for authoring, consumption, and operational troubleshooting.

Scirqueira explains how to implement the Bronze, Silver, and Gold layers of a medallion architecture in Microsoft Fabric Data Warehouse, with concrete T-SQL patterns for ingestion, cleansing, and analytics-ready shaping, plus practical guidance on repeatability, performance, and governance boundaries between layers.

SupriyaKashyap explains the generally available billing persona model for PowerTable within Fabric Planning in Fabric IQ, including how Viewer, Stakeholder, and Planner roles are assigned dynamically per session and how each role maps to 30-day session metering and capacity consumption attribution.

Sumiran23 announces the general availability of Customer-Managed Key (CMK) REST APIs for Microsoft Fabric workspaces, enabling teams to programmatically assign, inspect, rotate, and reset workspace encryption using keys stored in Azure Key Vault, with tenant-wide visibility for governance and auditing.

goupadhy explains how to choose the right connectivity pattern for Microsoft Fabric data integration workloads, focusing on when to use VNet data gateway, On-premises Data Gateway (standard mode), or direct cloud connections based on where your data sources live and whether private network boundaries must be crossed.

Microsoft Developer presents a demo-heavy session showing how to build AI applications securely on top of SQL and Microsoft’s data platforms, from Azure to Microsoft Fabric, with practical examples developers can reuse.

VMRoman announces a preview update to Microsoft Fabric’s data agent: visual answers in conversations now render using Fabric Visuals (the same visualization foundation used across Fabric). The post explains what changed, why consistent visuals matter, which prompts trigger charts, and the currently supported chart types and data sources.

Anna Hoffman recaps the year’s updates across SQL Server, Azure SQL, and SQL database in Microsoft Fabric, with a focus on developer tooling. She also covers themes like security, performance, availability, CI/CD, containers, and how AI and vectors are shaping the SQL ecosystem, plus a look at roadmap direction.

joannapea explains how Custom SQL Pools in Microsoft Fabric Data Warehouse help isolate workloads and cap how aggressively queries can scale, letting teams trade latency for lower allocation peaks under allocation-based billing. The post includes a vNode-based example, workload fit criteria, and what SQL Pools do not do.

Anasheh announces a preview update for Microsoft Fabric Eventstreams observability in Workspace Monitoring, adding per-eventstream control so teams can choose which pipelines emit monitoring data. The post explains what telemetry is captured, where it lands, and how to query and dashboard it with KQL.

midesa announces general availability of data source routing for Microsoft Fabric data agents, explaining how a data agent decides which data sources to query when answering questions. The post focuses on improving agent responses by controlling and prioritizing where the agent looks for data across Fabric-managed sources.

NevenaNikolic explains Fabric Data Warehouse Query Acceleration (Preview), a GPU-powered execution capability that automatically offloads eligible parts of SQL query plans to GPUs. The post covers where it helps most (high concurrency), which operators benefit, how fallback to CPU works, and how to monitor impact using SSMS and Query Insights.

Microsoft Developer introduces SQL MCP Server, a Data API Builder-based approach for letting AI tools like GitHub Copilot query SQL Server, Azure SQL, and Fabric SQL Database through a governed, RBAC-enforced interface instead of direct raw SQL access.