awesome-microsoft-fabric

A curated unofficial list of awesome Microsoft Fabric resources, updates, blogs, videos and more

• Awesome Microsoft Fabric
  • Overview
  • Roadmap
  • GuidedTour
  • Hack
  • Blogs
  • Ideas and Usergroups
  • Certification
  • Workshops
  • Community
  • Samples
  • Presentation
  • Architecture
  • Videos
  • Learning
  • Administration
  • Security
  • One Lake
  • Next Generation Synapse Analytics
  • Migration
  • Data Integration
  • Data Warehouse
  • Data Factory
  • Data Engineering
  • Data Science / AI
  • EventHouse
  • Power BI
  • Real-Time Analytics
  • Data Activator
  • Data Quality
  • Data Governance
  • Data Mesh
  • Use cases
  • Fabric with OpenAI
  • Microsoft 365
  • Application
  • Copilot
  • Limitations
  • KnownIssues

---

Overview

SaaS - Data & Analytics Platform for the era of AI

For Business and Technical Decision makers

• Overview Get Started - Microsoft Fabric Overview
• Decision Guide

Roadmap

• Fabric Roadmap
• Adoption Roadmap

GuidedTour

• Fabric Guided Tour

Hack

• Fabric AI Hack

Blogs

Blogs to empower teams that are looking to transform the organization with Microsoft Fabric

• Microsoft Fabric Blog Manage your data in one place with Lake Centric SaaS Solution
• Submit your ideas
• Get Started with Fabric
• Synapse Blog
• Fabric Notes
• Data Factory Blog
• Synapse Analytics Blog
• Azure Data Explorer ADX
• Azure Machine Learning
• Azure Migration
• Data Migration
• Capacity and cost management
• Pricing & Billing
• Meta-data driven Pipeline - Part-1 and Part-2 Data
• Semantic Kernel and Fabric
• Azure Open AI with Microsoft Fabric Document Summarization with LLM
• How to leverage Fabric for DataScience
• Eveything you need to know about Fabric Capacities
• Data Warehouse Utilization Reporting in Fabric Capacity Metrics App
• OneLake Shortcuts to Power Platform and Dynamics 365
• Understanding KQL DB Capacity
• Column Level and Row Level Security for Fabric Warehouse
• End to End Workshop - Analyzing wildlife data with Fabric - Includes Datasets & Workshop
• Fabric Copilot Workshop
• Change the game - Exploring Data with Fabric
• OneLake File Explorer
• Semantic Kernel and Fabric
• Fabric Icons
• Delta-RS native support for Rust
• Data Compaction
• Multiple Shortcuts
• Time travelling through data - Magic of Table Clone
• Using your own python library
• Guardrails for Burstable Activity
• Data Quality with Semantic Link
• Mirroring in Fabric
• Fabric and M365
• Fabric for existing synapse users
• Delta Lake Support in Real-Time Analytics with KQL
• SAP data into Fabric
• Semantic Link: OneLake integrated Semantic Models
• Explore Data Transformation in Eventstream for KQL DB
• Lakehouse Vs Warehouse - Deep Dive into usecases
• Datawarehouse Recovery
• Understanding the underlying architecture
• Automate Fabric Datawarehouse queries and commands with data factory
• Fabric Data Factory Data Pipelines to Orchestrate Notebook-based Workflows
• Data Pipelines - Advanced Scheduling Techniques
• Data Flow Gen2 Destinations and managed settings
• Managed Private End Points
• Mapping Azure Synapse Dedicated SQL pools to fabric data warehouse compute
• Analyze Dataverse Tables with Fabric
• Bridging Fabric Lakehouses: Delta Change Data Feed for Seamless ETL
• Integrate onpremise data using data pipelines in data factory - data gateway
• Fast copy in Gen2
• Analyze Dataverse tables in Fabric
• Delta change data feed for seemless ETL
• CosmosDB for NoSQL with Fabric
• Mirroring Azure SQL Database in Fabric
• Fabric git Integration
• Mastering Enterprise T-SQL ETL/ELT: A Guide with Data Warehouse and Fabric Pipelines
• Demystifying Data Ingestion in Fabric: Fundamental Components for Ingesting Data into a Fabric Lakehouse using Fabric Data Pipelines
• Custom Pools - Workspace level capacity pools for data engineering and data science
• Microsoft Fabric Lifecycle Management: Getting started with development in isolation using a Private Workspace
• Build Custom AI applications Retrieval Augmented Generation RAG with LLM - Fabric
• SOC-1 SOC-2, SOC-3 compliance
• CI/CD with warehouse
• How Spark compute works in Fabric
• AI Functions in Fabric
• AI Skill improvements
• Store and access your Iceberg data in OneLake using Snowflake and Shortcuts
• Unlock Iceberg data in onelake
• Fabric Migration Assistant for Datawarehouse / Synapse Migration to Fabric
• Playbook for Metadata driven lakehouse implementation
• SKU Estimator - Mastering SKU estimations - Plan your next project
• Common usecases for building user defined functions UDF
• Integrate API Management in Fabric for GraphQL
• Privacy by Design: PII Detection and Anonymization with PySpark on Microsoft Fabric
• AI functions for better performance—and lower costs
• Secure Your Data from Day One: Best Practices for Success with Purview Data Loss Prevention (DLP) Policies in Microsoft Fabric
• Refresh SQL analytics endpoint Metadata REST API
• Pipeline Activities support OPDG and VNET
• Integrating Fabric with Databricks in private network
• Create SQL Database using Fabric-cli
• Understand OneLake Security Shortcuts

Ideas

• Fabric Ideas
• User Groups

Certification

• Fabric Certification and Career Hub - New Fabric Analytics Engineer Associate certification
• DP-600 Implementing Analytics Solutions Using Microsoft Fabric & Community Measuring Guide

• [DP-600 Exam Full Course (6+ hours)

  Microsoft Fabric Analytics Engineer](https://www.youtube.com/watch?v=Bjk93hi21QM)

Workshop

• Fabric Workshops and Readiness

Community

• Recurively Load Files from Multiple Workspaces
• Build Insightful Analytics with KQL
• Calculate folder size in Lakehouse
• Increase copy activity throughput
• Loading ML Models
• Migrate existing Models to Fabric
• Download ML Models from Registry
• Not all Delta Tables are equal
• Connecting Event Hubs with Fabric
• Fabric - What, why, who, when and how
• Data Wrangler vs Power Query Editor
• Performance Testing PowerBI Direct Lake with Fabric
• On Demand Loading of Direct Lake Power BI datasets
• Getting Started with Microsoft Fabric Licensing
• End to End Implementation
• Azure Synapse Reference - Linkedin Pulse
• How can Microsoft have an impact on your business
• Using BlobFuse V2 - Fabric Notebook virtual filesystem
• Fabric and Snowflake - Sharing data between
• Fabric DataFlow Gen2 to stage or not to stage
• Table partitioning - convert files to tables
• dbt with the lakehouse
• Row Level Security RLS in Datawarehouse
• Public repositories available in Github for Fabric - Collection of links
• Fabric icons
• Analyze Power BI Data in Excel with Fabric
• Security - Item level access SQL Policy and Object Level
• Comparative Analysis of Fabric
• Streamlit with Microsoft Fabric
• Databricks and Unity Catalog integration with Fabric
• Fabric REST API data pipeline
• Use external readers to access onelake data
• Decoding Delta lake compatibility between Fabric and Databricks
• ArcGIS GeoAnalytics for Fabric
• Automating Fabric: Dynamically Configuring Microsoft Fabric Data Pipelines
• Fabric Spark Notebooks and CU-Capacity Unit Consumption
• Optimizing Fabric Spark with High Concurrency Mode
• Running Multiple Spark Notebooks on the Same Capacity
• Reading Snowflake Iceberg Table using Fabric OneLake
• Understanding relation between Microsoft Fabric, Azure Subscription and Entra Tenant
• Mirroring Snowflake Views

Microsoft Fabric Community

• Fabric Community

Samples

code samples

• Fabric Samples for Data Engineering, Data Science, Continous Integration and Development CI/CD, real-time analytics and Developer
• CI/CD GIT integration
• Fabric Workload Development

Presentation

Fabric Readiness

• Introducing Unified Analytics
• Data Engineering with Microsoft Synapse
• Data Science in Microsoft Fabric
• Data Warehousing with Microsoft Fabric
• Synapse Real-Time Analytics in Microsoft Fabric
• Data Integration with Data Factory
• Introduction to Microsoft Fabric for Power BI Users

Architecture

End to End Architectures for technical architects

• Lakehouse Introduction End-to-end scenario from data acquisition to data consumption
• Building ETL step by step
• Criteria to make decisions
• A better Understanding of the Underlying Architecture- Fabric
• Build RAG Data pipeline from Azure Blob Storage to SQL Database in Microsoft Fabric within minutes

Videos

Videos explaining core concepts, how-tos and detailed technical aspects

• Fabric Launch End to End Coverage
• Fabric Introduction by James Serra
• Synapse Search for Fabric related
• Data Factory
• Data Explorer ADX
• Purview
• Power BI
• Create your first Lakehouse
• Datawarehouse Experience in Microsoft Fabric
• Starter Pools vs Custom Pools Demo of Starter Pools in Fabric for Data Engineering and Data Science Workloads
• Enabling Data Mesh in Microsoft Fabric
• Query Optimizations - Performing at Scale
• Building a landing zone in Microsoft Fabric
• Data Wrangler Data Preparation and Exploration in Microsoft Fabric
• Table Clone in Warehouse within Microsoft Fabric
• Share a warehouse
• Load data from landing to bronze in your medallion architecture
• Load existing Delta Tables to Silver
• Granular Access Control
• Concurrency - Performance at Scale
• Shortcuts
• Understanding OneLake with Microsoft Fabric
• One Lake as Glue
• Licensing Guide
• Licensing and Cost
• Using Fabric with Databricks
• Use Python Libraries in Microsoft Fabric
• Using SQL Server in Microsoft Fabric Use CETAS to move data
• End to end Solution with Microsoft Fabric
• Cross Cloud Analytics with Microsoft Fabric
• Playlist: Introduction to Microsoft Fabric - Complete Series
• Microsoft Fabric Decision Tree - deciding which service to use when
• Connect to Microsoft Fabric with 5 Tools (SSMS, ADS, Kusto, Excel, and PowerBI)
• Microsoft Fabric Datawarehouse Sharing - Security and Permissions
• Real-time analytics Tutorial with Microsoft Fabric
• Using Dynamic Management Views to gain Insights with Fabric
• Lakehouse vs Warehouse - James Serra
• Real-time data sharing
• Utilization Reporting - Data Warehouse - Fabric Capacity
• Data Science in Fabric - Model Scoring with PREDICT
• Advanced Notebook Features & writing data analytics jobs with Spark
• Spark Data Engineering Patterns - Delta Tables for PowerBI
• Data Activator Demo
• Row level Security - Warehouse & SQL Endpoint
• Dataverse Integration with Microsoft Fabric
• Microsoft Fabric Capacity Smoothing and Data Warehouse Throttling
• Permissions in Microsoft Fabric Workspace and SQL
• Microsoft Fabric Spark Utilities - mssparkutils
• Data Engineering Starter Kit - Quick Start with Fabric Product Group
• Auto Logging and MLFlow in Fabric
• Model and Experiment Tracking in Fabric MLFLOW
• CSV Ingestion Performance Improvements
• Explore custom spark pools
• Automated Maintenance Features in Fabric
• Incremental Refresh with your Warehouse without a date in Microsoft Fabric
• Real-time analytics (Synapse) with Fabrics
• Consume Warehouse data from other sources
• Everything you need to know to get started with ADX
• Fabric Spark Compute Capabilities - Azure VMs and their impact on Performance
• Mapping personas to Microsoft Fabric roles
• Microsoft Fabric Data Engineering – Apache Spark Jobs Monitoring
• Fabric Apache Spark Jobs monitoring capabilities - Resource Usage Analysis
• Copilot demo in notebooks

#community

• Data pipeline vs Dataflow vs Shortcut vs Notebook in Microsoft Fabric
• Cost and Performance Considerations when ingesting data into Microsoft Fabric
• How to understand DW query cost
• Direct Lake vs Direct Query? Which one is used and how to validate
• End to End Analytics with NY City Taxi Yellow cab data
• Enterprise Grade RAG with Fabric using Cosmos DB and DiskANN
• Performance Optimization - Native Execyution Engine

Learning

Learning Fabric

• Introduction End to End Analytics in Microsoft Fabric
• Lakehouse Get started Lakehouses
• Spark on Lakehouse Use Apache Spark in Lakehouse
• Work with Delta Delta Lake Tables in Microsoft Fabric
• Data Factory Pipelines Pipelines, Activities, Templates
• Data Warehouses Get started with Data Warehouses
• Real-Time Analytics Analyze real-time data
• Data Science Get started with data science in Microsoft Fabric
• Administer Administration, Security and Govern data in Microsoft Fabric
• Medallion Architecture Design Fabric Medallion Architecture with Bronze, Silver and Gold layers of Lakehouse
• DataFlow Gen2 Ingest with Dataflows in Microsoft Fabric
• Data Analysis with Kusto Query Language Explore the fundamentals of data analysis, Gain Insights and Multi-Table Queries
• Azure Data Engineer - free online training from Azure
• Learn together

YT Community

• Learn Microsoft Fabric with Power BI - Amit Chandan - YT Playlist

Administration

Fabric Administration for IT Architects, Administrators

• Fabric Admin
• Understanding the roles and domains
• Administration and Governance
• Secure, Govern, Manage at Scale
• Fabric Tenant Settings - Reports
• Extract Tenant Settings using Powershell and REST API
• Fabric Tenant Settings - Current & Snapshot Comparison
• Fabric Deployment Pipelines using API
• Scale up / Scale down / Pause - Capacity management & Using powershell
• Fabric CLI

Community

• Trusted workspace access for onelake shortcuts - configuring workspace identity - Fabric networking
• Fabric Networking: Managed Private Endpoints with Setup and Considerations
• Fabric Link for Dataverse

Security

• Fabric Security End to End - Whitepaper
• External Data Sharing
• Creating managed and external spark tables in Fabric Lakehouse
• Setting up private link for securing Inbound connectivity in Fabric with Terraform
• Securing Outbound Connectivity in Fabric

One Lake

one drive for data

• One Drive for Data - One Data Lake for entier organization
• Store and Manage Medical Imaging Data in ADLS
• Interacting with OneLake using Shortcuts REST APIs
• Building Common Data Architectures with OneLake - Security
• Easily load Fabric OneLake Data into Excel
• CMK - Customer Managed Keys in OneLake

Community

• Exploring Fabric OneLake vs Azure Data Lake Gen2 Storage Accounts
• Databricks - Writing to OneLake
• Delta Change Data Feed in Fabric Lakehouse

Next Generation Synapse Analytics

Synapse Engineering, Analytics to transform data at scale

Migration

Migrate your existing setup and automate

• Key Considerations Azure Synapse to Fabric
• Dedicated sql pool to Fabric Dedicated sql pool migration
• Dedicated SQL Pool Migrate Dedicated SQL Pool
• Serverless Migrate Serverless SQL
• SQL Server to Fabric Migrate from SQL Server to Fabric
• Comparison Side by Side Compare Synapse Side by Side

• Navigating the Data Platform Landscape: Finding the Perfect Fit for Your Company Azure Synapse OR Microsoft Fabric

• Above presentations delivered in video

Data Integration

Integrate to all your sources and destinations

• Deployment Pipelines
• Event Stream in Fabric with Event Processor
• IoT Hub Data Event Stream for email alerting
• DataFlow Gen2 Destinations

community

• Attach DuckDB

Data Warehouse

Data Warehousing to democratize your data estate with industry learing performance

• How Fabric Polaris Engine Works
• Publishing full DML logs to Delta Lake
• Inline Scalar UDF - User Defined Functions in DWH
• Resultset Caching in Data Warehouse

Data Factory

Data factory to build pipelines, orchestrate and ETL

• Quick Look at Data Factory Create a dataflow and build a pipeline

Data Engineering

Build your data estate and unlock value from your data

• Mapping Data Flow to Spark - Example
• Understand Delta Lake Table Features - delta IO
• Using Shortcuts instead of external tables to reference external data in Fabric Warehouse
• Fabric Data Pipeline Advanced Scheduling Techniques
• Optimistic Job Admission - Spark

Data Science AI

Next generation data science to train, deploy and manage machine learning models

• Semantic Link - Using Fabric Notebooks with Power BI datasets for Machine Learning
• FabricDataFrame - Semantic Link
• Prebuilt AI Services in Fabric
• Copilot for Data Science and Data Engineering
• Code First AutoML and Hyperparameter Tuning
• Streamling Data Science and Data Engineering with Copilot
• LLM Powered Data Enrichment
• Fabric Data Agent - Data Source Instructions
• Best Practices for Data Agent

EventHouse

Real time data

• Fabric Eventhouse real time data
• Fabric RTI accelerator
• Learn ADX in a day

Power BI

Uncover Powerful Insights

• From RabbitMQ to PowerBI reports
• Incremental Refresh on Delta Tables
• Add LLM Prompts to Reports using Power BI Copilot and Microsoft Fabric
• Using KQL Query - Kusto query settings in Power BI
• Semantic Link Labs - Vertipaq Analyser on Dataset
• Refreshing A Power BI Semantic Model With Eventstreams, Pipelines And Activator
• Streamlining Data-Driven Decisions: The Power BI Metric Sets
• Deep dive into using notebooks with your semantic model
• Optimizing text to sql - direct query mode

Real-Time Analytics

Actionable real-time insights and perform analysis on large volumes of data

• Realtime data sharing in Fabric

Data Activator

Build data observability to monitor and detect when data changes

• How Data Activator Works
• Extensive capabilities consolidated
• Automate data driven actions

Data Quality

• Data Quality within Lakehouse

Community

• Accessing Purview Portal in your own Fabric Environment

Data Governance

Fabric and Data Governance

Data Mesh

Implementing Data Mesh in Microsoft Fabric

• What is a data mesh?
• What is a data product?
• What are Data Domains
• What are Data Contracts
• Data Marketplace
• Scenario: Financial Institution Data Mesh
• When to use which - Data Mesh, Data Lakehouse, Data Fabric
• Easily implement data mesh architecture with domains in Fabric

Community

• Data Mesh Principles - Zhamak
• Data Monolith to Mesh - Zhamak
• List of Data Lakehouse and Data Mesh (Linkedin)
• Microsoft Fabric measure up to Data Mesh
• Develop a data mesh with Microsoft Fabric
• Explore Strategies with Microsoft Fabric for Data Driven Organization
• Data Mesh vs Data Fabric
• Adopt a Product Mindset with Microsoft Fabric
• Building a data mesh architecture - Paul Andrew
• Understanding Data Modelling in Data Mesh

Use Cases

Industry use cases

• Fabric end to end use case energy market & Data Engineering
• Unlock data value with Healthcare Data Solutions in Fabric & AI

Community

• Paul Andrew’s Delivering Near Real-Time Satellite Internet Analytics Using Microsoft Fabric
• Paul Andrew’s Marketing Analytics using Microsoft Fabric

Fabric with Open AI

Fabric is the data platform for the era of AI. Open AI use cases through Fabric

• Mapping data flow to Fabric with OpenAI
• Build Intelligent Agents with Microsoft Fabric - Autogen Notebook Example
• Unleash the power of Azure OpenAI and Fabric with Data Search
• Implementing Data Agents in Fabric for Comprehensive Business Insights

Microsoft 365

Microsoft Larger Ecosystem

• Microsoft 365 Data and Fabric Better Together

Application

Build cloud applications for Microsoft Fabric

• Course - Cloud Powered App - Fabric
• Content Moderation with Azure Content Safety and Blob Metadata for Analysis and Insights with Microsoft Fabric

Copilot

Community

• Using Copilot in Fabric Notebook for data engineering

Limitations

• Datawarehouse Limitations

Knownissues

• Known Issues

Copilot

*Copilot & Fabric

• Use Copilot in Fabric