Key Takeaway:
My Fabric journey has been about building understanding layer by layer.
I’ve gone through trainings on Dataflows Gen2, Pipelines, Warehousing with T-SQL, CI/CD, and Data Factory, each adding a piece to how I see the platform working end to end.
Why is this a big deal? This turns Dataflow Gen2 into a more enterprise-grade, automation-friendly, API-integrated tool instead of one-off jobs with fixed values in Power Query. First release in April, became Generally Available (GA) in September 2025
Full playlist: • Learn Apache Spark in Fabric in 30 days
Here's the schedule:
1 Welcome -DAY ONE - Learn Apache Spark in Microsoft ...
2 Why Spark? • Why you should learn Spark in Microsoft Fa...
3 Components of Spark - • FIVE components of the Spark engine in Mic...
4 Spark DataFrame - • Introducing the Spark DataFrame in Microso...
5 Read Files into DataFrame - • How to read CSV, JSON, PARQUET into Spark ...
6 Read/Write to Lakehouse Table - • How to write data to Lakehouse Table in Mi...
7 Basic DataFrame Operations - • Learn THESE important pySpark operations F...
8 DataFrame Filtering - • 14 ways to filter your Spark DataFrame in ...
9 GroupBy and Aggregate Functions - • How to use GROUPBY and AGG functions in py...
10 Handling missing values - • NO MORE NULLS - how to handle missing valu...
11 Joining DataFrames - • How to get better insights by JOINING Spar...
12 Time-series data - • Analyzing DATES and TIMES in Spark in Micr...
13 Spark SQL - • Using your SQL knowledge in Spark in Micro...
14-16 Spark Machine Learning - • Spark Machine Learning End-To-End Project ...
20 Configuring Spark - • Customising Fabric Runtime and Spark in Mi...
21 Autotuning Spark Configuration - • Autotuning your Spark config in Microsoft ...
22 Library Management - • Manage your Python packages (the old way) ...
23 High-concurrency mode - • Running multiple notebooks on same session...
24 Spark Scala - • Writing Spark Scala in Microsoft Fabric No...
25 Fabric MSSparkUtils - • Powerful notebook utility functions (MSSpa...
26 Monitoring Spark - • Monitoring Spark (errors and cost) in Micr...
30 FINALE QnA - • How to use Spark in Microsoft Fabric - YO...
