- 11
- 20 420
Data Pancakes
Netherlands
เข้าร่วมเมื่อ 1 มี.ค. 2024
Welcome to Data Pancakes, the ultimate TH-cam podcast channel that serves up a hearty breakfast of data knowledge, stacked high with fun, engaging, and easily digestible content!
Just like pancakes are a breakfast staple, we aim to be your go-to source for understanding complex data concepts such as #datamesh, #datafabric, #lakehouse design, and many more. Piethein and Sarath are all about breaking down these intimidating subjects into bite-sized pieces, just like your favorite stack of pancakes!
But we don’t just stop at theory. We'll be dishing up a second serving of practical know-how, showing you how to implement these concepts into industry-leading products like #microsoftfabric and #microsoftpurview.
Join us here at Data Pancakes, where we believe that learning about data should be as enjoyable and satisfying as a plate of hot pancakes. We'll be flipping the traditional view of data on its head, making it appetizing for everyone, from beginners to seasoned professionals.
Just like pancakes are a breakfast staple, we aim to be your go-to source for understanding complex data concepts such as #datamesh, #datafabric, #lakehouse design, and many more. Piethein and Sarath are all about breaking down these intimidating subjects into bite-sized pieces, just like your favorite stack of pancakes!
But we don’t just stop at theory. We'll be dishing up a second serving of practical know-how, showing you how to implement these concepts into industry-leading products like #microsoftfabric and #microsoftpurview.
Join us here at Data Pancakes, where we believe that learning about data should be as enjoyable and satisfying as a plate of hot pancakes. We'll be flipping the traditional view of data on its head, making it appetizing for everyone, from beginners to seasoned professionals.
Episode 11: Data security essentials for Microsoft Fabric
In this episode, we explore the comprehensive process of requesting data products from Microsoft Purview and implementing security within Microsoft Fabric. We'll provide a hands-on demonstration by searching for data products, submitting access requests, and subsequently, showcasing various methods of granting access.
มุมมอง: 1 131
วีดีโอ
Episode 10: Data product practical walkthrough with Microsoft Fabric and Microsoft Purview
มุมมอง 1.8K4 หลายเดือนก่อน
In this video, we delve back into the practical aspects of data products, focusing on Microsoft Fabric. We'll explore how an architecture is layered using Lakehouse entities and workspaces. We'll then shift our attention to Microsoft Purview, focusing on how to scan Microsoft Fabric. We'll examine scoped scans and offer design considerations for managing collections and creating data products. ...
Episode 9: Disambiguation of Data Products: Examining Different Viewpoints
มุมมอง 7305 หลายเดือนก่อน
In this video, we delve into the world of data products and the need for disambiguation. With many different definitions floating around and a lack of standardization, it can be difficult to fully understand what a data product is and how it can be utilized. We examine three different viewpoints on data products, including the business perspective, the technical perspective, and the user perspe...
Episode 8: Data Quality with Microsoft Purview and Microsoft Fabric
มุมมอง 5K6 หลายเดือนก่อน
In this comprehensive educational video, Sarath and Piethein will guide you through the implementation of #MicrosoftPurview and #MicrosoftFabric as effective tools for data quality management. This is crucial, as poor data quality can negatively influence business operations and decision-making processes. We'll initiate the video with a brief recap. Following this, Sarath will provide a step-by...
Episode 7: Demystifying the Medallion and Lakehouse Architectures
มุมมอง 1.5K7 หลายเดือนก่อน
This podcast is a re-recording of the "Demystifying Medallion and Lakehouse Architectures" session that Piethein conducted earlier for Subsurface. Both the session and speaker ratings received 4.7 out of 5 stars! Lakehouse and #medallion architectures are popular subjects, but they are also controversial due to discrepancies between theory and practice. In this episode, we explore the history o...
Episode 6: Managing OKRs with Microsoft Purview
มุมมอง 9158 หลายเดือนก่อน
In this video we explore Objective Key Results (OKRs), a goal-setting framework that enhances alignment, engagement, and transparency within businesses, and its pivotal role in managing your data strategy. We'll guide you on defining OKRs, enriching them with key results, and linking them to real data products. To ensure a practical understanding, we'll demonstrate using Microsoft Purview, a un...
Episode 5: Connecting the dots with Microsoft Purview
มุมมอง 2.1K8 หลายเดือนก่อน
Get ready for a complete picture of data governance and its related roles to Microsoft Purview! In this episode, we'll equip you with authentic knowledge on business and technical domains, data products, and data quality. We'll demonstrate how to use Microsoft Fabric and the newly refreshed Microsoft Purview service to bring it all together. No more confusion - we'll connect all the dots for yo...
Episode 4: Mapping personas to Microsoft Fabric roles
มุมมอง 1.4K8 หลายเดือนก่อน
If you're looking for a way to streamline your data governance roles, this video is a must-watch! In this episode, we will discuss the various personas within a typical business domain and demonstrate how to align them with the roles in #MicrosoftFabric. Additionally, we will cover some crucial aspects of Microsoft Fabric to give you a better understanding of this technology solution. As you wi...
Episode 3: Business domains, domain models, application domains and data domains
มุมมอง 2.1K9 หลายเดือนก่อน
In this episode, we delve into world of data mesh (#datamesh) with business domains, domain models, data domains, and application domains, breaking down these complex concepts into manageable and relatable terms. First, we'll be discussing the integral role that business domains play in defining the scope of a business, followed by concrete example of how domains would interact. After that, we'...
Episode 2: Demystifying Data Mesh
มุมมอง 1.7K9 หลายเดือนก่อน
With so much buzz around Data Mesh (#datamesh), it can be overwhelming to navigate through the various opinions and definitions. That's why in this video, we'll guide you through the core concepts of data mesh, data domains, #dataproducts and show you how they all interrelate. By the end of this episode, you'll have a clear understanding of what data mesh is and how certain concepts will be use...
Episode 1: Serving Up Data Pancakes - Meet the Chefs Behind Your New Data Feast!
มุมมอง 2K9 หลายเดือนก่อน
In this episode, we will be lifting the lid on who we are, our passion for data, and why we decided to create Data Pancakes. We'll be sharing our vision for the channel, our backgrounds, and what led us to this exciting venture. We'll also be giving you a sneak peek into the topics we'll be covering in our upcoming episodes. Expect a mix of easily digestible explanations of complex data concept...
Tengo una consulta, Puedo yo acceder con Microsoft Purview que se encuentra en Produccion a Microsoft Fabric que esta en desarrollo, para poder generar mi catalogo y glosario de datos y felicitaciones muy buen video sigan subiendo mas videos de la herramienta
Great Work !! How we can have the data lineage from source to target ?
Hi Piethein, does this quality scan power bi dataset is on private preview?
Thank you Piethien. Excellent video. I am facing one issue. When I run profile or quality scan it fails, stating that DQ Asset does not exist. But I have successfully registered these data asset under data product. Delta Table schema also I can see different columns. My connection is also successful
Hi once I created a data product and selected a lakehouse which has a semantic model as the data asset and when selecting the data asset in the data quality section, it shows the table as a onelake delta table only and not a power bi table for us to do the data quality. It says required property 'lakehouseQualifiedName' missing error when hovering on the data asset. Could you please let me know what we are doing wrong?
Thank you, Piethein, for the useful session. Is there any possibility of getting a copy of the architectural design you presented?
Thanks a lot for those videos, I watched all 11 episodes so far and looking forward for more! Piethein, could you please advice some best reads to have a better understanding of the architecture as a whole and how all those different applications, you were talking about, interact. Thanks again, looking forward to a new episode.
Yes me too
It would be great to see a sample scenario for master data management for operational purposes with data products in Fabric
Can I create folder within lakehouse so as to create different logical separations as per domain like sales, marketing,product, customer etc and give permission on those logical folders? Idea is to not create many workspaces for domains but rather create only 3 workspaces as per environment dev, test and prod. Otherwise we will have to create dev/test/prod for each data domain and that requires more governance ??setu
You could consider creating separate lakehouses (for each domain) in the same workspace. If that's still an overkill for your needs, you could also define schemas per domain and provide access based on schema, although lakehouses in Fabric still have some limitations with additional schemas from dbo. That's why I would go with a lakehouse per domain
Hello Guys, Great work to make us understand the concept of domains. I have a question around domains, Can I create multiple Data domains like Finance, HR, Sales, Product, Customer, Supplier etc and assign it to 1 Workspace and create 3 lakehouse like you said bronze, silver gold ? Idea is to not create many workspaces for each Data domain ?
How can I get access to the Purview Preview that contains business domains. In don't see it in my Trial?
Hi Piethein, thanks for the great channel, to both of you. Really enjoying them. You mentioned in the video, you would share the slides. Can you share a link? Thanks in advance.
Excellent Explanation
Thank you, looking forward to seeing some data product examples :)
i am interested in data mesh, microsoft fabric etc, thanks for sharing
After hitting profile or rule scan. I am getting error of DQ- Authorization Error Authorization to data source has failed. Please grant Purview managed Identity permission to access datasource. What permissions I am missing can you help me to understand. Thanks for the video and support. Looking forward to hear from you
refer to this article to setup your scan perms : learn.microsoft.com/en-us/purview/register-scan-power-bi-tenant?tabs=Scenario1
Great video, thank you!
Thank you Piethein. How does the domains in Fabric map to Purview domains?
there is no hard binding right now , however we would suggest to have domains in fabric and purview aligned
When the domains created in Fabric will be synced to Purview? do they now? seems not.
@kirankrishna3442 Thank you for the valuable content. I am looking in my own Purview account and In Data Catalog I do not see the Data Management section with - Business domains - Data products - Data quality - Data access Any help on how to enable this feature ?
Thank you for the series. Really enjoying it. I have situation that if you can provide your perspective. We are implementing a pure data mesh principle driven, business focused Data Marketplace. In Fabric, we are using both Domain and Sub Domain constructs. We are setting fewer Domains and are providing the flexibility to those domain owners to spin any number of sub domains to specific business processes that are currently present or may manifest in the future. However, the Purview only provides on level of business isolation called Domains. Since there is no sub domain construct, how does the mapping work here. Is it recommended to map the Purview BIZ domains to FABRIC sub domains. Use a tagging mechanism on Purview to consolidate the Sub Domains to a single domain? Why is Purview not providing the flexibility to map one to one with Fabric?
you could follow our latest episode (9) where we do touch upon this.
🙈 Promo-SM
Excellent, that's exactly what we are currently doing ... mapping the freshly established company Data Governance Framework personas with Fabric overall architecture/framework and built-in roles. I will forward your video to my colleagues :) Thanks for sharing your valuables insights and perspective on that matter ! I'm already a big fan of your "Data Pancakes" channel ! PS: I'm looking forward for your next episode on the recently announced Microsoft Purview Governance Portal ....starting the 8th of April . As you mentioned at the end of this video that would be a core asset to "materialized" our Data Governance Framework and "bring it to life" in a concrete and tangible plane
Good video, thanks!
Glad you liked it!
Hello Piet, I read your 2 books data management at scale, the first and second edition. I also read Zamag book. My background is not data architecture, but as It architec in this new era where data is everywhere, I need to have a full understanding data management. So, I am very happy to be part of this Journey and hope you will leverage sketches to explain the concepts and your views. Let's go
Nice! Thanks, well spoken and the living room offers the best backdrop until yet ... ;) You guys have promised a few things coming up and yes, they are very interesting to me! Wonder also how data dictionary or glossary would apply to the domain concepts and what you mean by them, how this is associated with Purview (or other) in a mixed MS and third party cloud mixed bag - all with BI pipelines and PowerBI results where my KPI really should have the same meaning as it did three domains earlier ... ;) definition creep is to me a major cause of headaches as it is perceived as a data quality issue instead .... (as in value's are incorrect, not definitions).
Great question , our next episode does dive into this.