Microsoft Fabric Blog presents an overview of Fabric Runtime 2.0 Experimental Public Preview, showcasing new features for data engineering and science with upgraded Spark and Delta Lake support.

Fabric Runtime 2.0 Experimental Preview: Scalable Data Engineering with Spark

Fabric Runtime provides seamless integration within the Microsoft Fabric ecosystem, delivering a powerful environment for data engineering and data science projects built on Apache Spark.

Overview

Fabric Runtime 2.0 is now available in Experimental Public Preview (EPP). It is purpose-built for large-scale data computations within Microsoft Fabric and introduces a set of features and upgrades designed to support advanced analytics workloads.

Switching to Runtime 2.0 EPP

You can enable Runtime 2.0 EPP at both the Workspace settings level and the Environment level for flexibility during experimentation.
Consult the official Runtime 2.0 documentation for details on setup and transitioning between runtime versions.

Core Components and Capabilities

Fabric Runtime 2.0 incorporates the following major upgrades:

Apache Spark 4.0: Latest version for enhanced Spark-based computations
Operating System: Azure Linux 3.0 (Mariner 3.0) for improved performance and compatibility
Java 21, Scala 2.13, Python 3.12: Updated runtime environments for modern development
Delta Lake 4.0: Advanced data lake reliability and performance

Preview Features

Early access to new Spark and Delta Lake APIs
Immediate availability of Spark 4.0 enhancements
Support for smooth future transitions as Java, Scala, and Python versions evolve

Getting Started

Explore the experimental preview to modernize your data engineering and data science workloads within Microsoft Fabric. Start today by reading the official documentation and updating your workspace or environment settings.

Author: Microsoft Fabric Blog

This post appeared first on “Microsoft Fabric Blog”. Read the entire article here