Mr. K Talks Tech
Mr. K Talks Tech
  • 73
  • 978 271
Part- 8 (Data Reporting using Power BI)- End to End Streaming Azure Data Engineering Project
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through how to load the weather data from Event HUB to KQL DB using Fabric's Event Stream Pipeline.
Download the code from here: buymeacoffee.com/mrktalkstech/e/333857
Support me for my work :) Please Like, Share and Subscribe to my YT channel :)
#DataEngineering #AzureDatabricks #AzureFunctions #EventHub #MicrosoftFabric #RealTimeData #StreamingData #PowerBI #KustoDB #DataActivator #CloudData #WeatherData #EndToEndProject #DataIngestion #DataPipeline #AzureEventHub #RealTimeAlerts
Join this channel to get access to perks:
th-cam.com/channels/zdOan4AmF65PmLLks8Lmww.htmljoin
- - - Book a Private One on One Meeting with me (1 Hour) - - -
www.buymeacoffee.com/mrktalkstech/e/166354
- - - Express your encouragement by brewing up a cup of support for me - - -
www.buymeacoffee.com/mrktalkstech
- - - Other useful playlist: - - -
1. Microsoft Fabric Playlist: th-cam.com/play/PLrG_BXEk3kXybedCIBBI4lmaIbtbn7MdM.html
2. Azure General Topics Playlist: th-cam.com/play/PLrG_BXEk3kXxv0IEASoJRTHuRq_DUqrjR.html
3. Azure Data Factory Playlist: th-cam.com/play/PLrG_BXEk3kXwTClTt3_28CMz2dZoaFhKD.html
4. Databricks CICD Playlist: th-cam.com/play/PLrG_BXEk3kXzMLDAgRbDsbIKvhoWsu-Gq.html
5. Azure Databricks Playlist: th-cam.com/play/PLrG_BXEk3kXznRvTJXwmazGCvTSxdCMsN.html
6. Azure End to End Project Playlist: th-cam.com/play/PLrG_BXEk3kXx6KE4nBmhf6QwSHMbznP2W.html
7. End to End Azure Data Engineering Project: th-cam.com/video/iQ41WqhHglk/w-d-xo.html
- - - Let’s Connect: - - -
Email: mrktalkstech@gmail.com
Instagram: mrk_talkstech
- - - About me: - - -
Mr. K is a passionate teacher created this channel for only one goal "TO HELP PEOPLE LEARN ABOUT THE MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES"
I will be creating playlist which covers the below topics (with DEMO)
1. Azure Beginner Tutorials
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Databricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)
After creating some basic foundational videos, I will be creating some of the videos with the real time scenarios / use case specific to the three common Data Fields,
1. Data Engineer
2. Data Analyst
3. Data Scientist
Can't wait to help people with my videos.
- - - Support me: - - -
Please Subscribe: www.youtube.com/@mr.ktalkstech
มุมมอง: 798

วีดีโอ

Part- 7 (Event Processing and Loading)- End to End Streaming Azure Data Engineering Project
มุมมอง 79414 วันที่ผ่านมา
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through how to load the weather data from Event HUB to KQL DB using Fabric's Event Stream Pipeline. Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #Azu...
Part- 6 (Cost Analysis and Architectural decisions)- End to End Streaming Data Engineering Project
มุมมอง 1Kหลายเดือนก่อน
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 5 (Data Ingestion using Azure Functions)- End to End Streaming Azure Data Engineering Project
มุมมอง 1.4Kหลายเดือนก่อน
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 4 (Data Ingestion using Azure Databricks)- End to End Streaming Azure Data Engineering Project
มุมมอง 2.5K2 หลายเดือนก่อน
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB Download the code from here: buymeacoffee.com/mrktalkstech/e/333857 Support me for my work :) Please Like, Share and Subscribe to my YT channel :) #DataEngineering #AzureDat...
Part- 3 (Data Ingestion using Azure Databricks)- End to End Streaming Azure Data Engineering Project
มุมมอง 2.9K2 หลายเดือนก่อน
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the Data Ingestion process using Azure Databricks in ingesting events to the Event HUB #DataEngineering #AzureDatabricks #AzureFunctions #EventHub #MicrosoftFabric #RealTimeData #StreamingData #PowerBI #KustoDB #DataActivator #CloudData #WeatherData #EndToEndP...
Part 2- End to End Realtime Streaming Azure Data Engineering Project (Environment Setup)
มุมมอง 4.5K3 หลายเดือนก่อน
Welcome back to the next part of our exciting end-to-end real-time streaming Data Engineering project! In this video, we’ll walk through the entire environment setup process, covering all the essential resources we’ll use to build a real-time weather reporting system using Azure services and Microsoft Fabric. TimeStamp: 0:00:00 - Setting up the Weather API 0:03:58 - Creating Resource Group 0:07...
End to End Realtime Streaming Azure Data Engineering Project (Part -1) | Complete Guide with Demo
มุมมอง 9K3 หลายเดือนก่อน
Welcome to an exciting session where we'll build a real-time streaming Data Engineering project using Azure services! This is one of the best ways to get hands-on experience with real-time streaming while understanding architectural decision-making for cost and performance optimization. In this project, we’ll: - Set up a real-time weather report system using Weather API - Implement data ingesti...
Why Most People Fail to Land a Data Engineer Job in 2025 (And How to Avoid It in 6 Steps)
มุมมอง 6K4 หลายเดือนก่อน
#dataengineering #azuredataengineering #aws #gcp #jobs In this video, I have explained 6 important steps that will help you to get hired as a Data Engineer. This is probably the most asked question to me, and that's the reason I decided to make a video on this topic. I hope this is helpful. Please let me know if you have any questions in the comment section. - - - Book a Private One on One Meet...
Must-Know PySpark Interview Question for Data Engineers - Live Demo & Tips!
มุมมอง 4.3K4 หลายเดือนก่อน
#ApacheSpark #DataEngineering #AzureDataEngineer #SparkSQL #DataTransformation #DataFrame #InterviewQuestion #BigData #AzureDatabricks #PySpark #DataAnalysis #DataScience #SQLQuery #Optimization #Efficiency #Tutorial In this video, we'll dive into a popular PySpark interview question often asked by financial and banking companies-calculating the running total for grouped data. We'll explore the...
What is Apache Spark? Learn Apache Spark in 15 Minutes
มุมมอง 12K5 หลายเดือนก่อน
#apachespark #databricks #sparkteam #dataengineering #pyspark #architecture In this video, I have covered the most important topic of Data Engineer which is "Apache Spark". Especially, I have talked about the complete end to end Architecture of Spark Spark covering all the individual components as below, 1. Driver Programme 2. Worker Node 3. Cluster Manager 4. Spark Context or Spark Session 5. ...
Data Engineer's Biggest Nightmare: Solving Merge Conflicts Step-by-Step Guide with Demo
มุมมอง 2.4K5 หลายเดือนก่อน
#AzureDevOps #Git #DataEngineering #InterviewQuestions #DevOpsTutorial #AzureDatabricks #GitRevert #BranchRecovery #CodingBestPractices #TechInterviewTips #MergeConflicts 🔍 What We'll Cover: In this video, we dive into a crucial topic for every Data Engineer: Merge Conflicts. Merge conflicts are one of the most common issues encountered when working collaboratively with Git repositories. Unders...
The Dark Secrets of Data Engineering Projects: What Nobody Tells You!
มุมมอง 10K6 หลายเดือนก่อน
The Dark Secrets of Data Engineering Projects: What Nobody Tells You!
Don't fail to answer these questions in your next Interview- Data Engineering Interview Question
มุมมอง 3.7K7 หลายเดือนก่อน
Don't fail to answer these questions in your next Interview- Data Engineering Interview Question
Tips and Tricks- Delta Lake Table in Apache Spark - Azure Data Engineering Interview Question
มุมมอง 6K7 หลายเดือนก่อน
Tips and Tricks- Delta Lake Table in Apache Spark - Azure Data Engineering Interview Question
Can you solve this simple Spark SQL Interview Question? | Azure Data Engineering Tutorials
มุมมอง 2.3K7 หลายเดือนก่อน
Can you solve this simple Spark SQL Interview Question? | Azure Data Engineering Tutorials
15 Minutes- Libraries in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
มุมมอง 3.6K7 หลายเดือนก่อน
15 Minutes- Libraries in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Azure Synapse Analytics- Interview Questions | Serverless SQL Pool VS Dedicated SQL Pool with Demo
มุมมอง 6K8 หลายเดือนก่อน
Azure Synapse Analytics- Interview Questions | Serverless SQL Pool VS Dedicated SQL Pool with Demo
Most popular Data Warehousing Interview Question- Azure Data Engineering Interview Question Tutorial
มุมมอง 3.6K9 หลายเดือนก่อน
Most popular Data Warehousing Interview Question- Azure Data Engineering Interview Question Tutorial
90% of Data Engineers doesn't know this - PySpark Azure Data Engineering Interview Question Tutorial
มุมมอง 6K9 หลายเดือนก่อน
90% of Data Engineers doesn't know this - PySpark Azure Data Engineering Interview Question Tutorial
Tips and Tricks- Azure Data Engineering Interview Questions | Managed Identity vs Service Principal
มุมมอง 14K9 หลายเดือนก่อน
Tips and Tricks- Azure Data Engineering Interview Questions | Managed Identity vs Service Principal
Microsoft Fabric - End to End Azure Data Engineering Project - Bing news Data Analytics
มุมมอง 32K11 หลายเดือนก่อน
Microsoft Fabric - End to End Azure Data Engineering Project - Bing news Data Analytics
Data Engineer Roadmap 2025 (A complete 6 Months Plan Guide) | Azure Data Engineer Roadmap 2025
มุมมอง 27Kปีที่แล้ว
Data Engineer Roadmap 2025 (A complete 6 Months Plan Guide) | Azure Data Engineer Roadmap 2025
Unlocking Secrets in Azure Databricks with Azure Key Vault! 🗝️✨ | Azure Databricks Tutorials
มุมมอง 10Kปีที่แล้ว
Unlocking Secrets in Azure Databricks with Azure Key Vault! 🗝️✨ | Azure Databricks Tutorials
Top 5 Notebook Features You Can't Miss in Azure Databricks 🚀| Databricks and Azure DevOps Tutorials
มุมมอง 4.1Kปีที่แล้ว
Top 5 Notebook Features You Can't Miss in Azure Databricks 🚀| Databricks and Azure DevOps Tutorials
15 Minutes- Spark Clusters in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
มุมมอง 23Kปีที่แล้ว
15 Minutes- Spark Clusters in Databricks Explained -Tips & Tricks | Azure Databricks Tutorials
Part 1- What is CI/CD? - Continuous Integration and Continuous Deployment in Azure Databricks Demo
มุมมอง 32Kปีที่แล้ว
Part 1- What is CI/CD? - Continuous Integration and Continuous Deployment in Azure Databricks Demo
Create your first Data Ingestion Pipeline in Microsoft Fabric | Microsoft Fabric Tutorials
มุมมอง 10Kปีที่แล้ว
Create your first Data Ingestion Pipeline in Microsoft Fabric | Microsoft Fabric Tutorials
Sending ADF Pipeline alerts to Microsoft Teams Demo | Azure Data Factory Tutorials for Beginners
มุมมอง 8Kปีที่แล้ว
Sending ADF Pipeline alerts to Microsoft Teams Demo | Azure Data Factory Tutorials for Beginners
How to create Azure Databricks? Explained Easy | Azure Databricks Tutorials for Beginners
มุมมอง 4.5Kปีที่แล้ว
How to create Azure Databricks? Explained Easy | Azure Databricks Tutorials for Beginners