Browse All Machine Learning Content (249)

Rafia Aqil outlines how to enable Azure Databricks’ Compliance Security Profile (CSP) for HIPAA workloads, including the September 1, 2026 deadline, required prerequisites like Azure VNet encryption and supported VM series, and a rollout approach to validate cluster startup and end-to-end connectivity before production.

fredguis outlines upcoming OneLake Security changes for Microsoft Fabric SQL analytics endpoints, focusing on enterprise-friendly access control. The update improves nested group resolution, shortcut-backed table behavior in hub-and-spoke lakehouse setups, more consistent column-level security with group-based access, and broader service principal support for automated and app-owned data products.

Matt Gordon and Anna Hoffman show how to set up anomaly detection in Microsoft Fabric using streaming change events from Azure SQL/SQL Server, then trigger alerts and actions with Fabric components like Eventstream, Eventhouse, and Activator.

aonelakeuser outlines summer updates to OneLake security in Microsoft Fabric, including broader engine coverage (Eventhouse and Fabric Graph), a simplified column-level security UI, faster Secure tab performance, a redesigned SQL Analytics Endpoint sync model, and generally available OneLake security APIs.

Nora Zhan introduces “Physical-World Intelligence” and explains how GeoAI combines geospatial data (weather, satellite imagery, sensors, and maps) with enterprise context and AI. The article outlines Microsoft Foundry’s geospatial model catalog, Planetary Computer Pro as a GeoAI data plane, and a GeoAI SDK for production-scale inference workflows.

Santhosh_Ravin1 explains how Microsoft Fabric Spark’s Native Execution Engine now accelerates CSV reads with a native, SIMD-optimized reader, improving common data engineering workloads without requiring code changes.

AmirJafari announces updates to Fabric data agents in Microsoft Foundry, focusing on simpler MCP-based connectivity, OneLake Catalog discovery, support for attaching multiple data agents to a single Foundry agent, and improved production troubleshooting via Foundry Observability traces and logs.

John Savill gives a very quick overview of Rayfin and Microsoft Fabric Apps, focusing on where they fit in the Fabric ecosystem and why they matter for analytics and data platform work.

John Savill gives a quick overview of Rayfin and Microsoft Fabric Apps, focusing on the problem they’re trying to solve, how the Fabric Apps data model works, and what app hosting looks like in practice, with a short demo and key takeaways.

mayurjain explains how the OpenAI Assistants API retirement on August 26, 2026 affects programmatic integrations with Microsoft Fabric Data Agents, and why Microsoft recommends moving to the Data Agent Model Context Protocol (MCP) endpoint instead of rebuilding directly on OpenAI’s Responses API.

robece-msft introduces the fundamentals of event-driven architecture in Microsoft Fabric, focusing on Real-Time Hub and how Fabric’s event capabilities help workloads react to meaningful business signals in real time.

This week's ML roundup focuses on the practical path from research ideas to systems you can ship. Microsoft open-sourced ML Video Codec (MLVC) with code, weights, and tooling for real-time deployment on commodity NPUs, while Fabric and SQL updates show clearer patterns for streaming fresh signals into ML enrichment and feature updates. On the platform side, OneLake and Lakehouse improvements reduce friction around query iteration, cross-platform table access, and tighter inbound controls. We close with lessons on scaling large training runs across AMD and NVIDIA via Foundry Managed Compute and a look at Microsoft IQ as a governance-first way to feed agents the right context.

Naba Kumar and the MLVC team announce the open-source release of MLVC, a learned video codec that replaces traditional codec primitives with end-to-end neural compression. The post shares bitrate savings versus H.264/H.265, real-time performance targets on commodity NPUs, and what’s included in the GitHub release (models, weights, training scripts, and conversion tooling).

arindamc explains how to build a real-time “row-to-intelligent-action” pipeline in Microsoft Fabric that captures shopping-cart signals via CDC, reshapes them into analytics-ready rows, and enriches each micro-batch with AI in a Spark Structured Streaming notebook to drive timely actions.

Steve Sweetman explains how AT&T built and scaled its telecom-focused OTel 2.0 models using Microsoft Foundry Managed Compute, combining open models from Hugging Face with AMD and NVIDIA GPU capacity to process around one trillion tokens while optimizing for cost, performance, and deployment speed.

HARMEETGILL announces the general availability of OneLake resource instance rules in Microsoft Fabric, explaining how workspace admins can allow secure service-to-service access from specific Azure resource instances (like Databricks or Azure SQL) without relying on broad IP allowlists or private networking everywhere.

Anna Hoffman introduces Change Event Streaming (CES) in public preview across Microsoft SQL, showing where it fits for modern, event-driven application scenarios and how it differs from approaches like CDC and mirroring in SQL Server 2025, Azure SQL, and Fabric SQL.

avinandac introduces the generally available Lakehouse Query Explorer in Microsoft Fabric, an in-context Spark SQL editor inside the Lakehouse explorer for quick data exploration, validation, and iteration, with guidance on when to switch to notebooks or the SQL analytics endpoint for more advanced workflows.

MattH_OneLake explains how Microsoft Fabric mirroring can surface Snowflake-managed Apache Iceberg tables in OneLake without copying data, by replicating Iceberg metadata via shortcuts and virtualizing the tables as Delta Lake so they can be queried across Fabric engines.

John Savill gives an overview of Microsoft IQ and how it’s meant to bring the right intelligence (enterprise data, web data, and model capabilities) to AI agents, including the different “IQ” surfaces (Work, Fabric, Foundry, Web) and the security/identity considerations around least privilege and protection.

This week focused on making ML systems easier to run in production, from securing outbound AI calls in SQL Server 2025 to tightening governance and cost visibility across OneLake. Fabric updates added storage tiering and reporting, plus clearer architecture patterns for building an AI-ready data foundation. On the real-time side, Eventstreams matured with stronger connectors, event-time processing, and practical CDC-to-action reference flows, while new guidance covered context-aware AI layers and safer automation patterns for calling Fabric REST APIs.

olivialiu-micro explains how SQL Server 2025 enables governed outbound calls to external AI services while keeping control inside the database security model, including permissions, enablement switches, authentication options, and built-in auditing for REST invocation and external model objects.

Rafia Aqil explains Microsoft’s IQ Platform (Work IQ, Fabric IQ, and Foundry IQ) and how it adds business and organizational context to AI systems. The post breaks down Fabric’s OneLake-based data layer, ontology-driven meaning, and Foundry IQ’s managed services for RAG, memory, ranking, and citations.

Mabasile_MSFT announces general availability of OneLake Storage Tiers and Lifecycle Management in Microsoft Fabric, explaining how to keep frequently used data in the hot tier while automatically moving less-accessed data to cool or cold tiers to reduce long-term storage costs.

Mabasile_MSFT announces general availability of the OneLake storage report in Microsoft Fabric, which lets workspace admins generate an item-size breakdown of storage usage in a workspace, including visible, system, and soft-deleted data, plus billing status per item.

mk_sunitha explains a secure pattern for calling Microsoft Fabric REST APIs from User Data Functions (UDFs), using a service principal plus Azure Key Vault to keep secrets out of application code while still enabling governed automation like triggering Fabric pipelines and managing workspaces.

conxu-ms summarizes new Microsoft Fabric Data Factory updates focused on making pipeline orchestration easier, improving monitoring and troubleshooting, and adding AI-assisted operational capabilities for managing data workflows at scale.

goupadhy announces a preview of autoscaling for Microsoft Fabric Virtual Network (VNet) Data Gateway, explaining how gateway node counts scale in and out based on workload signals to balance performance, reliability, and cost, plus where admins configure limits and review diagnostics logs.

arindamc shows how to build a “row-to-intelligent-action” pipeline in Microsoft Fabric: capture Azure SQL changes via CDC into Fabric Eventstreams, reshape them with DeltaFlow, enrich each micro-batch in Spark Structured Streaming using AI Functions for PySpark, and publish Business Events for real-time routing and dashboards.

shiv_narayanan summarizes recent Dataverse Fabric Link updates that make it easier to control which Dataverse tables are synced into Microsoft Fabric, improve production-ready authentication options, and reduce sync latency so operational data shows up faster in OneLake-backed analytics workloads.

ofer announces a new OneLake Architectural Guidance whitepaper and summarizes five repeatable enterprise patterns for building a unified, governed data foundation in Microsoft Fabric, aimed at analytics modernization and AI readiness, including data access unification, medallion architecture, governed data mesh, platform simplification, and external data sharing.

Microsoft Developer demonstrates a real-time 3D digital twin of a wind farm built in Microsoft Fabric, combining LiDAR-derived terrain geometry, live turbine telemetry from a Fabric Eventhouse, and a natural-language interface that can identify underperforming turbines and estimate cost impact.

This week in machine learning, Microsoft pushed both ends of the stack toward more operational AI: Aurora 1.5 adds hourly resolution, 22 variables, and ensemble uncertainty so weather model output looks more like a forecast product. On the data platform side, Fabric and SQL updates focused on making AI workloads practical to run at scale, with GPU-accelerated warehouse queries, controlled Spark runtime release channels, and more direct hooks for embeddings and agent context via MCP. We also saw governance move closer to runtime behavior, including sensitivity labels that can guide agent actions and clearer patterns for shipping Fabric Apps into production.

Sridhar Baynes announces Aurora 1.5, an open-source update to Microsoft’s Earth-system foundation model that adds more weather variables, hourly resolution, and probabilistic ensemble forecasts, with results compared against ECMWF ensembles and examples including tropical cyclone track improvements.

John Savill runs through a quick set of Azure updates from 10th July 2026, covering Azure Front Door Edge Actions, Azure Databricks SQL Serverless regional expansion, Azure Arc-enabled SQL scenarios, VS Code SQL tooling updates, new platform metrics, and Microsoft Entra ID passkey changes.

spurthikommajos introduces the Oracle Database CDC source connector for Microsoft Fabric Eventstream (Preview), explaining how row-level inserts, updates, and deletes can be captured as structured change events and routed to Fabric destinations for real-time analytics, alerts, and downstream workflows.

Microsoft Developer recaps the 2026 updates shipped across SQL Server, Azure SQL, and SQL database in Fabric, highlighting security, tooling, and developer workflow changes announced around SQLCon/FabCon and Microsoft Build 2026.

Alicia Li summarizes the 2026 Q2 updates for Microsoft Fabric Eventstreams, covering new and updated connectors, the now-GA SQL operator, preview features like mirrored database change feed ingestion and business events publishing, plus AI Skills that generate and deploy eventstream topologies via Fabric REST APIs.

arindamc walks through a Microsoft Fabric “row-to-action” pattern where database row changes are mirrored into OneLake, streamed through Fabric Eventstreams, aggregated with windowing, and routed to Activator and Eventhouse for real-time triggers and live KQL dashboards.

bogdanc shares hands-on benchmark results for GPU-accelerated query execution in Microsoft Fabric Data Warehouse, including a transparent TPC-H methodology, single-user latency numbers, and high-concurrency throughput/latency comparisons against CPU execution on an F64 capacity.