Skip to content

Latest commit

ย 

History

170 Commits

Folders and files

NameName
Last commit message
Last commit date
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐ŸŒŒ FabricBEyeAI

AI-Powered 3D Visualization for Microsoft Fabric Governance & Lineage

Live Demo GitHub Stars License

Transform your Microsoft Fabric tenant into an interactive 3D universe - Visualize workspaces, track lineage across 23 artifact types, and govern your data estate with unprecedented clarity.

๐ŸŽฏ Features โ€ข ๐Ÿš€ Quick Start โ€ข ๐Ÿ“– Documentation โ€ข ๐Ÿค Contributing

FabricBEyeAI 3D Visualization


๐ŸŽฏ Features

๐ŸŒ Complete Fabric Ecosystem Coverage

  • 23 Artifact Types - From Lakehouses to ML Models, Notebooks to Eventstreams
  • Domain-Based Clustering - Visualize organizational structure with Microsoft Fabric domains
  • Real-Time Lineage - Track data flow across Semantic Models, Dataflows, Lakehouses, and Reports
  • Cross-Workspace Dependencies - See how artifacts connect across your entire tenant

๐ŸŽจ Intuitive 3D Visualization

  • Interactive 3D Graph - Powered by Three.js and 3d-force-graph
  • Smart Clustering - Automatic spatial organization by domains and workspaces
  • Focus Mode - Isolate specific workspaces or domains for detailed analysis
  • Search & Highlight - Type to dim non-matching nodes, instantly find artifacts
  • Side Panel - Click any node for full metadata, upstream/downstream lineage
  • Legend Panel - Dynamic color reference for all artifact types in view
  • Fog Effects - Depth perception for complex tenants with thousands of objects

๐Ÿท๏ธ Enterprise Governance

  • Official Microsoft Badges - Certified and Promoted endorsement visualization
  • Endorsement Dashboard - Coverage stats with per-domain breakdown (Certified/Promoted/None)
  • Sensitivity Labels - Confidential, Highly Confidential, Internal, Public classification
  • Compliance View - Instantly spot unlabeled artifacts across your tenant
  • Impact Analysis - BFS downstream tracing: "what breaks if I change this?"
  • Domain Management - Assign unassigned workspaces with smart domain suggestions
  • Batch Operations - Manage multiple workspace assignments efficiently

๐Ÿ”Œ Flexible Data Sources

  • Scanner API Integration - Direct tenant scanning with Microsoft Fabric Admin API
  • Fabric REST API - Domains API + Items API for Notebooks, Pipelines, Eventstreams
  • JSON File Import - Load pre-scanned data for offline analysis
  • Mock Data Support - Demo mode with 50+ sample workspaces for testing

๐Ÿš€ Quick Start

Prerequisites

  • Microsoft Fabric Admin Access - Tenant-level permissions required
  • Node.js 16+ and npm 8+
  • Modern Browser - Chrome, Edge, or Firefox (WebGL support required)

Installation

# Clone the repository
git clone https://github.com/Fabric-Lineage/FabricBEyeAI.git
cd FabricBEyeAI

# Install dependencies
npm install

# Start development server
npm start

Navigate to http://localhost:4200 - The app will automatically reload on file changes.

Using with Your Tenant

  1. Login - Click the login button and authenticate with your Microsoft Fabric credentials
  2. Scan - Initiate a workspace scan or import a JSON file
  3. Explore - Navigate the 3D visualization with mouse/trackpad
  4. Analyze - Use filters, focus mode, and domain clustering to understand your data estate

๐Ÿ“Š Supported Artifacts

Data Engineering

  • ๐Ÿ—๏ธ Lakehouse - Data lake + lakehouse
  • ๐Ÿข Data Warehouse - SQL storage
  • ๐Ÿ““ Notebook - Spark notebooks
  • โšก Spark Job Definition

Data Integration

  • ๐Ÿ”„ Pipeline - ETL orchestration
  • ๐Ÿ’ง Dataflow Gen2 - Data prep
  • ๐Ÿ’ง Dataflow - Legacy Gen1

Real-Time Analytics

  • ๐Ÿ“ก Eventstream - Streaming data
  • ๐Ÿ“Š KQL Database - Real-time analytics
  • ๐Ÿ” KQL Queryset - Query collections
  • ๐Ÿ›๏ธ Eventhouse - Analytics cluster

Traditional Power BI

  • ๐Ÿ“‚ Workspace - Container for artifacts
  • ๐Ÿ“ˆ Report - Interactive reports
  • ๐Ÿ“„ Paginated Report - Pixel-perfect reports
  • ๐Ÿ“Š Dashboard - Pinned visualizations
  • ๐Ÿ—„๏ธ Semantic Model - Dataset/data model

Data Science

  • ๐Ÿค– ML Model - Machine learning models
  • ๐Ÿงช ML Experiment - Training experiments

Other

  • ๐Ÿ“ฆ Datamart - Self-service analytics
  • ๐Ÿ”— SQL Analytics Endpoint - Auto-created
  • ๐Ÿ“ฑ App - Published app bundles

๐ŸŽฎ Usage Guide

Navigation Controls

Action Control
Rotate View Left Mouse Drag
Pan View Right Mouse Drag
Zoom Mouse Wheel
Select Node Click
Multi-Select Ctrl + Click

Key Features

๐ŸŽฏ Focus Mode

Isolate specific workspaces or domains to reduce visual complexity:

  • Click domain name to focus on that domain
  • Click workspace to focus on workspace artifacts
  • Press ESC or click "Show All" to reset

๐Ÿ” Search & Highlight

  • Smart Search - Type to highlight matching nodes; non-matches dim to 8% opacity
  • Type Filters - Show/hide specific artifact types
  • Fog Toggle - Enable depth fog for large tenants
  • Unassigned Toggle - Hide/show workspaces without domains

๐Ÿ“‹ Node Detail Panel

Click any node to open the side panel with:

  • Full metadata (endorsement, sensitivity label, description)
  • Upstream and downstream dependencies
  • Impact Analysis button โ€” traces ALL downstream dependents

๐Ÿ… Governance Dashboards

  • Trust Dashboard - Endorsement coverage bar chart with per-domain breakdown
  • Compliance View - Highlight unlabeled artifacts, badge shows gap count

๐Ÿท๏ธ Domain Management

Assign workspaces to domains with smart suggestions:

  1. Open Domain Assignment panel
  2. Select unassigned workspaces
  3. Choose target domain from suggestions
  4. Click "Assign Selected" to apply

๐Ÿ’พ Export Capabilities

  • Screenshot - Export PNG image of current view
  • JSON Export - Save complete graph data for offline analysis

๐Ÿ› ๏ธ Technology Stack

Category Technologies
Frontend Angular 17, TypeScript 5.2
3D Rendering Three.js, 3d-force-graph v1.73
UI Framework Angular Material
State Management RxJS Observables
Build System Angular CLI, Webpack
API Integration Microsoft Fabric Admin Scanner API v1.0, Fabric REST API (Domains, Items)

๐Ÿ“– Documentation


๐Ÿค Contributing

We welcome contributions from the community! Here's how you can help:

  1. Fork the repository
  2. Create a feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'feat: Add AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

See CONTRIBUTING.md for detailed guidelines.

Development Commands

npm start              # Start dev server (localhost:4200)
npm run build          # Production build
npm run docs           # Build for GitHub Pages
npm test               # Run unit tests
npm run lint           # Run ESLint
npm run e2e            # Run end-to-end tests

๐ŸŒŸ Why FabricBEyeAI?

The Challenge

Modern data platforms are complex, interconnected ecosystems. Understanding:

  • How data flows across your tenant
  • Which workspaces depend on which datasets
  • What artifacts are certified vs. uncertified
  • How to organize and govern at scale

...is nearly impossible with flat lists and tables.

The Solution

FabricBEyeAI transforms complexity into clarity through:

  • 3D Spatial Organization - Natural clustering by domains and workspaces
  • Visual Lineage - See connections at a glance, not buried in metadata
  • Interactive Exploration - Navigate, filter, and focus on what matters
  • Governance Integration - Endorsements, labels, and domain management

๐Ÿ“ License

This project is licensed under the MIT License - see the LICENSE file for details.


๐Ÿ™ Acknowledgments

  • Original Creator - Assaf Shemesh (@assafsun)
  • Microsoft Fabric Team - For the comprehensive Admin Scanner API
  • Open Source Libraries - Three.js, Angular, 3d-force-graph contributors
  • Community Contributors - Everyone who has submitted issues, PRs, and feedback

๐Ÿ”— Links


โญ Star this repo if you find FabricBEyeAI useful!

Made with โค๏ธ by the Fabric Lineage Community

About

FabricBEye based on PowerBEye with AI

Resources

Contributing

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages