Aleksi Partanen Tech
Aleksi Partanen Tech
  • 70
  • 115 651
Automate Microsoft Fabric Capacity Pausing and Save Money
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUEq26ZswRz58k5O5HwoSDvA.html
Are you worried about forgetting to pause your Microsoft Fabric capacity and racking up unnecessary costs? Don't worry! In this video, I’ll show you how to automate the process and ensure you never forget to pause your capacity again.
🔍 What You’ll Learn:
🔹 Step-by-step tutorial on automatic pausing of Microsoft Fabric capacity.
🔹 How to use a web activity in Data Factory to get the status of your Fabric capacity.
🔹 Configuring the correct API calls to check and pause the capacity.
🔹 Setting up parameters and triggers to control multiple capacities and schedule automatic checks.
🔹 Adding error-handling best practices to ensure reliability in your pipeline.
💡 Resources:
🔗 Pipeline template:
drive.google.com/drive/folders/120PaDBpR_n-I1NG_a_Bj6A4V8Z2sbZ6W?usp=sharing
🔗 Managed Identity Tutorial:
th-cam.com/video/lothNX5yanc/w-d-xo.html
💡 Pipeline development help:
GET REQUEST (get_fabric_capacity_running_status)
Expression:
@concat('management.azure.com/subscriptions/',pipeline().parameters.subscription_id,'/resourceGroups/',pipeline().parameters.resource_group_name,'/providers/Microsoft.Fabric/capacities/',pipeline().parameters.fabric_capacity_name,'?api-version=2022-07-01-preview')
Resource:
management.azure.com
IF CONDITION (if_fabric_capacity_state_is_active)
Expression:
@equals(activity('get_fabric_capacity_running_status').output.properties.state,'Active')
POST REQUEST (pause_fabric_capacity)
Expression:
@concat('management.azure.com/subscriptions/',pipeline().parameters.subscription_id,'/resourceGroups/',pipeline().parameters.resource_group_name,'/providers/Microsoft.Fabric/capacities/',pipeline().parameters.fabric_capacity_name,'/suspend?api-version=2022-07-01-preview')
Body:
{"reason":"automatic pause"}
Resource:
management.azure.com
#MicrosoftFabric #DataEngineering #CloudComputing #Automation #CostOptimization #Azure
มุมมอง: 112

วีดีโอ

Guide to T-SQL Notebooks in Microsoft Fabric
มุมมอง 2184 ชั่วโมงที่ผ่านมา
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUEq26ZswRz58k5O5HwoSDvA.html In this video, I'll walk you through everything you need to know about developing T-SQL Notebooks in Microsoft Fabric. We'll explore how to create and use T-SQL notebooks, attach SQL analytics endpoints and data warehouses, and run cross-database queries. Stay tuned for some essential tips on improving your T-SQL development ...
Learn Microsoft Fabric Data Pipelines in 2024
มุมมอง 98019 ชั่วโมงที่ผ่านมา
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html 📂 Materials and Resources: drive.google.com/drive/folders/1jv1-aCFVUkixwJn6aeTv4a5ZuJ10tugw?usp=sharing 🔑 What You’ll Learn in This Masterclass: This Masterclass is packed with 20 lessons, each designed to teach you a core concept of Microsoft Fabric Data Pipelines. From learning the basics to mastering advanced techniques, e...
REST API Pagination in Microsoft Fabric Notebooks: Fetch & Write JSON to Lakehouse
มุมมอง 33714 วันที่ผ่านมา
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html 🔗 Access the demo materials used in this tutorial: drive.google.com/drive/folders/1ux7dMqPAEVmTZvBmBDrbyidCFYNs5o45?usp=sharing In this video, I'll walk you through how to fetch JSON data from an API with paging using Microsoft Fabric Notebooks and how to write that data to a Lakehouse file section. We'll be working with the ...
Run Azure Data Factory Pipelines from Fabric with Parameters & Return Values!
มุมมอง 18714 วันที่ผ่านมา
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUEq26ZswRz58k5O5HwoSDvA.html In this video, I'll show you how to run Azure Data Factory pipelines within Microsoft Fabric data pipelines and pass information between them. We'll cover how to send parameters from Fabric to Azure Data Factory and how to retrieve return values back to Fabric-making integration between these two platforms seamless. 🚀 🔑 What ...
DP-600 vs DP-700: Which Microsoft Fabric Exam Should You Take?
มุมมอง 76214 วันที่ผ่านมา
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUEq26ZswRz58k5O5HwoSDvA.html Are you trying to decide between the DP-600 and DP-700 Microsoft Fabric certification exams? In this video, I’ll break down the key differences between the two and help you choose the right certification for your career path, whether you're aiming to become an Analytics Engineer or a Data Engineer. 🔑 What You’ll Learn: 🔹 The ...
How to Run Notebooks Inside Notebooks in Microsoft Fabric
มุมมอง 17828 วันที่ผ่านมา
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html In this video, I'll demonstrate how to run notebooks inside other notebooks in Microsoft Fabric and show you how to pass parameters and retrieve exit values between them. Whether you're looking to separate code or manage complex workflows, this tutorial will give you the tools to streamline your notebook execution process. 📑 ...
How to Flatten JSON Files with Notebooks in Microsoft Fabric
มุมมอง 294หลายเดือนก่อน
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html 🔗 Explode function tutorial: th-cam.com/video/UwiEy3myCSY/w-d-xo.html 🔗 Access the demo materials used in this tutorial: drive.google.com/drive/folders/1ux7dMqPAEVmTZvBmBDrbyidCFYNs5o45?usp=sharing In this video, I'll show you how to read, process, and flatten JSON files using notebooks in Microsoft Fabric. If you're dealing ...
Explode Function in Fabric Notebooks: Flatten Arrays Like a Pro!
มุมมอง 165หลายเดือนก่อน
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html 🔗 Access the demo materials used in this tutorial: drive.google.com/drive/folders/1ux7dMqPAEVmTZvBmBDrbyidCFYNs5o45?usp=sharing In this video, I’ll demonstrate how to use the explode function in Microsoft Fabric notebooks to flatten arrays, a critical tool when working with hierarchical data. Whether you're dealing with compl...
Using SparkSQL with PySpark in Microsoft Fabric Notebooks
มุมมอง 318หลายเดือนก่อน
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html 🔗 Access the demo materials used in this tutorial: drive.google.com/drive/folders/1ux7dMqPAEVmTZvBmBDrbyidCFYNs5o45?usp=sharing In this video, I'll walk you through how to use SparkSQL with PySpark in Microsoft Fabric Notebooks. 🔍 What You’ll Learn: 🔷 Running SparkSQL using %%sql magic command 🔷 Using SparkSQL in PySpark cell...
Parameters & Exit Values in Microsoft Fabric Notebooks
มุมมอง 315หลายเดือนก่อน
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html In this video, I'll walk you through how to run notebooks within a data pipeline in Microsoft Fabric, pass parameters to these notebooks, and return valuable information back to the data pipeline. These techniques are crucial for building dynamic and adaptable data solutions in Fabric. 🔍 What You’ll Learn: 🔷 How to set up not...
CSV File to Lakehouse Table using Fabric Notebooks
มุมมอง 255หลายเดือนก่อน
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html 🔗 Notebook Intro: th-cam.com/video/xzFeuL9Whgk/w-d-xo.html 🔗 Access the demo materials used in this tutorial: drive.google.com/drive/folders/1ux7dMqPAEVmTZvBmBDrbyidCFYNs5o45?usp=sharing In this video, I'll walk you through the process of copying a CSV file to a Lakehouse Table using a notebook in Microsoft Fabric. We’ll also...
The Ultimate Guide to NotebookUtils in Microsoft Fabric
มุมมอง 314หลายเดือนก่อน
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUEq26ZswRz58k5O5HwoSDvA.html In this video, I'll walk you through how to harness the power of NotebookUtils in Microsoft Fabric, enabling you to perform a range of operations, from fetching secrets from Azure Key Vault to running nested notebooks and managing file systems. 🔍 What You’ll Learn: 🔷 Mastering File System Operations 🔷 Running and Managing Not...
Master Dynamic Data Mapping in Microsoft Fabric Data Pipelines
มุมมอง 4072 หลายเดือนก่อน
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html 🔗 Access the demo materials used in this tutorial: drive.google.com/drive/folders/1ux7dMqPAEVmTZvBmBDrbyidCFYNs5o45?usp=sharing 🔗 ForEach activity: th-cam.com/video/QxhWkhzaYtc/w-d-xo.html 🔗 Lookup activity: th-cam.com/video/q2sc1BaIJAs/w-d-xo.html 🔗 Configuration files: th-cam.com/video/x7z5D7A7L_A/w-d-xo.html In this video,...
How to build Metadata-Driven Data Pipelines in Microsoft Fabric
มุมมอง 4282 หลายเดือนก่อน
🔗 Learn more: th-cam.com/play/PLlqsZd11LpUHKLILXjfW5ORjNiksC3GWZ.html 🔗 Access the demo materials used in this tutorial: drive.google.com/drive/folders/1ux7dMqPAEVmTZvBmBDrbyidCFYNs5o45?usp=sharing In this video, I'll show you how to build configuration-based/metadata-driven generic data pipelines in Microsoft Fabric using configuration files, Lookup activity, and ForEach activity. 🔍 What You’l...
Master Stored Procedures in Fabric Data Pipelines
มุมมอง 4652 หลายเดือนก่อน
Master Stored Procedures in Fabric Data Pipelines
How to Copy a CSV File to Microsoft Fabric Data Warehouse
มุมมอง 2202 หลายเดือนก่อน
How to Copy a CSV File to Microsoft Fabric Data Warehouse
Using Filter Activity in Fabric Data Pipelines
มุมมอง 1672 หลายเดือนก่อน
Using Filter Activity in Fabric Data Pipelines
Mastering the Delete Data Activity in Microsoft Fabric
มุมมอง 1652 หลายเดือนก่อน
Mastering the Delete Data Activity in Microsoft Fabric
Revolutionize Your Data Pipelines - 5 Best Practices!
มุมมอง 3812 หลายเดือนก่อน
Revolutionize Your Data Pipelines - 5 Best Practices!
Switch Activity in Microsoft Fabric Data Pipelines
มุมมอง 2322 หลายเดือนก่อน
Switch Activity in Microsoft Fabric Data Pipelines
Activity Outputs for Advanced Logic in Fabric Data Pipelines
มุมมอง 2243 หลายเดือนก่อน
Activity Outputs for Advanced Logic in Fabric Data Pipelines
Microsoft Fabric Data Warehouse Copilot - Honest Review!
มุมมอง 2753 หลายเดือนก่อน
Microsoft Fabric Data Warehouse Copilot - Honest Review!
Microsoft Fabric Tutorial: Using Return Values in Data Pipelines
มุมมอง 3443 หลายเดือนก่อน
Microsoft Fabric Tutorial: Using Return Values in Data Pipelines
Scheduling & Monitoring Data Pipelines: Microsoft Fabric Guide
มุมมอง 4503 หลายเดือนก่อน
Scheduling & Monitoring Data Pipelines: Microsoft Fabric Guide
Ultimate Fast Track for Azure Data Engineering!
มุมมอง 2743 หลายเดือนก่อน
Ultimate Fast Track for Azure Data Engineering!
Terraform vs Bicep: The One To Use For Azure IaC?
มุมมอง 5763 หลายเดือนก่อน
Terraform vs Bicep: The One To Use For Azure IaC?
Why Data Factory is not worth learning in 2024
มุมมอง 3103 หลายเดือนก่อน
Why Data Factory is not worth learning in 2024
Get Metadata Activity in Fabric Data Pipelines
มุมมอง 3753 หลายเดือนก่อน
Get Metadata Activity in Fabric Data Pipelines
Mastering Lookup Activity in Fabric Data Pipelines
มุมมอง 7744 หลายเดือนก่อน
Mastering Lookup Activity in Fabric Data Pipelines