I really like the measured, calm delivery. As someone who spent more time on the data engineering and architecture side, and less on the PBI side, I didn't spend much time with these cats, but now that we're evolving towards Fabric, I'm excited to connect with this team and the community. Great productions!
For Power BI developers do you think Fabric would easier to learn than old-school Azure BI Stack? Previously the Azure resource consumption, variable pricing where huge obstacle for people to try out new things. Is that obstacle gone if we already have PBI Premium Capacity? How it is looking from access perspective, once it is enable there is access to all 7 segments or Admins can lock Synapse or Data Factory?
Appreciate the feedback Jeremy! We do have plans of digging in more to explain the components. In fairness, if I did that in this video for all of it, it would be a 30-minute video and you wouldn't have watched it. Or at least past the 2-3 minute mark. More to come.
Back in the 90s when Microsoft started adding new jargon each year and in many cases just rebranding new generations of older product with fancy names, we all started referring to it as “Marketecture” …. And now that is also a word in the lexicon of jargon. Welcome to my jibber-jabber about jibber-jabber. 😉
I'd say if you don't know what those services are and what they're for, you won't get much from the video. I understood this perfectly and found it very informative.
Your video is a really good introduction of Fabric. There is another video at top of google keep saying how "cool" fabric is but after watching his video I have absolutely no idea what Fabric does and how to get start.
Thanks Adam , thank you for such well structured explanation. This was really helpful. I had a question do we have all the new copilot features for preview or just the DAX quick measures ? I read the May 2023 release announcement about copilot there it is said that copilot is available for 'Private preview' at the moment Do you have any idea what they meant by 'Private preview'?
The Power Platform isn't part of Microsoft Fabric (except for Power BI). Power BI is a first class workload within Microsoft Fabric. And Power BI is still part of the Power Platform umbrella. There are still great ways to leverage other Power Platform services like Power Apps and Power Automate with Microsoft Fabric. Also, the connectors for Dataverse are front and center. It's just that Power Platform is different from Fabric. Fabric is all about the data platform. Power Platform has really been about those low-code/no-code developers and applications for that. There is a place for both and Power BI straddles the two.
Synapse Link for Dataverse will maintain a near real-time copy of your Power Platorm data in an Azure Data Lake Gen 2 storage. You can preserve timed snapshots of it too. You should be able to make that accessible to the Fabric frameworks.
Yes! Dataflows Gen2 leverages Power Query Online. That is one option you have to getting data into OneLake. Pipelines and Notebooks are another option.
I turned on fabric trial and then tried to create a data lake and load some data into it. All my attempts to load data failed with a very cryptic error: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: We don't support creating directories in Azure Storage unless they are empty. Any chance to help me to figure out what's wrong?
I'd need some more details and try and reproduce it on my end. I don't know how you were loading the data or what exactly you were trying to load. Were you using Dataflows Gen2 or a Pipeline? Or a Notebook? If you did this with Dataflows Gen2, can you try a pipeline and does that work?
I turned on the trial in my org. but whenever trying to interactive with a delta table in the lakehouse from notebook, I got the error: Create database for fabric_lakehouse is not permitted using Apache Spark in Microsoft Fabric. I will get the same error message if I load files to Lakehouse files then using "Load to table" option from there. Can you help me out what could be the issue? I believe it's related to the tenant setting as if I sign up for a new trial, I didn't get the error message. but I don't know where/what to check.
Hi, just a quick question. I am using Azure Virtual Machine and Azure SQL DB for hosting my website and mobile application. Is Microsoft fabric also providing a VM like hosting service?
Would like to understand if there are any PBI Premium only features within Fabric or if the Direct Lake option is available for all users. Also spotted some git integration via PowerBI Project files and if that is Premium only or for all users
All of the capabilities you are aware of with Power BI and Power BI Premium still exist and are now a part of Fabric. It wasn't really talked about as it's not new. They aren't going away though. If you want to import data or leverage DirectQuery in Power BI datasets, you still can. You don't have to change everything to Direct Lake.
Admittedly, Microsoft got caught with their pants down a bit with tableau, BUT, I’ve always said, never bet against Microsoft. If I were starting an analytics practice from scratch today, I would base it on powerBI and Excel. Yes I said excel, specifically because EVERY TAbleau dashboard release, one of the top 5 questions is ‘how do I export to excel’ Thx for the great video GIAC I subscribed
Don t you think that is the problem, that the only way to review data is in excel. It is just a statement on how we are failing in analytics and export data to "enhance" it
@@MrSekter you’re not wrong. I leads to my OTHER unpopular opinion… nobody wants self service. They want analysts that know the business and provide the reporting and insights they need. Self service is a band aid for people not getting what they want. But lastly, I’ve always loved excel, but in the last 4-5 years it’s really come a long way as a viable analytics tool. But I get it, it’s old.
In in-person talks, I usually joke about the fact that why do people want to build a Power BI report? So users can export the data to Excel. I get that laugh because everyone knows it's true. It's a data culture standpoint within organizations. everyone knows excel and that's where their comfort level is. They just want to get their hands on the data to create the pivot table and explore. That's also why I point out options like Analyze in Excel or just connecting to a Dataset from Excel. Don't export the data! leverage what is already created. But that takes education and habit enforcement - doesn't happen over night.
Hey cool! Im starting. I import from sql server database. But m code and DAX are annoying. So I’m tempted to import sometimes from an excel table. Am I shortchanging myself?
This is monumental, and I’ll repeat myself….It’s really a “lake-shaking” breakthrough. However, Microsoft should evaluate how not to exclude its Power BI user base who adopted it for its simplicity. The added complexities and the associated cost should be addressed.
Would love to hear more regarding your thoughts on excluding the Power BI base. Ultimately, the new features require capacity. So, for folks only on the individual user licenses (Pro/PPU), you are right they wouldn't be able to take full advantage of everything. But, they can still leverage all of the Power BI capabilities. What would be the ideal scenario for you?
@@GuyInACube Well, the accruing benefits that we all foresee to come from Fabric are massive. With great value comes associated cost, no doubt. Power BI free license has advanced the fast adoption of the product that has seen many users creating and developing assets in the Service. It would seem Fabric would, by design preclude a free license, given that all the component parts are essentially premium services. Hopefully, Microsoft could introduce a subscription cost that’s so low that most users would be encouraged to immediately signup. May be tier it up; setting the lower cheap tier to exclude those those complex azure services that citizen developers are not yet into.
More information should be out later this week and I'll have a licensing video out next week. This twitter thread from Amir spells out some upcoming info on pricing. twitter.com/AmirNetz/status/1663357490418049024
Q: will fabric also contain ci/cd possibilities without having to set this up manually. Now e.g. we have to use Visual Studio to bring your sql script changes into git. Would be great if this was also a SaaS solution.
Thank you Guy in a Cube! Thank you for bringing the most recent development in BI/Data world! I have a question about how to get data into Power BI from an Access DB (*.accdb) residing on SharePoint. I have tried different things but no vail.
Microsoft has had the Office Suite for a long time with integration between the office products. Fabric is really a data suite. The Microsoft Fabric Data Suite for data professional s call it that so people can wrap their heads around it.
Azure Purview is still a separate offering from Microsoft Fabric. But there are integrations. The Purview Hub is front and center in Fabric. I'm assuming we will see more and more integrations here. Fabric isn't looking to replace Purview, but rather help you leverage it effectively.
Wow, new stuff constantly yet they can't stop Excel crashing Over 10 years ago with Windows 7 and Excel 2010 Excel would crash once a month at the most. These days Office 365 Excel crashes twice a week on me
Dataflows Gen2 is changing the game a bit. Think output destinations and landing it in the lakehouse. When OneSecurity become available, then just apply the RLS on the items in OneLake and every engine takes advantage of it. So, will need to rethink where you want to apply those items so that you only have to do it once! We'll have more info on that once it becomes available.
@@GuyInACube and this can increase the cost of storing the data. Right now dataflows are perfect to store some of the data since it brings no additonal cost on top of power bi licence.
Hi, Guy in Cube team, I hope this message finds you well. My name is Saravanan Balasubramanian, and I work as an Azure Data Architect at Capgemini. I recently had the opportunity to attend your session with Arun, and I found it extremely insightful. I wanted to reach out to you because I currently have a fabric trial account and I'm very interested in gaining access to the Fabric Private Preview. I believe this would be beneficial for my work and would greatly enhance my understanding and utilization of Azure services. Could you please provide me with information on how I can obtain early access to the Fabric Private Preview? I would greatly appreciate your assistance in this matter.
Okay, so, Fabric unifies seven very complex tools into one. Can Microsoft enable a way to use Fabric whereby the customer describes their entire solution in a paragraph of natural language, to Co-Pilot where it will provision ALL the ETL, analytics, data storage and front end (Power BI/Website) for them?
I thought I could sit out that synapyse hype, but now it is 4/7 of all fabric... But wait, it is all only capacity related! so actually no need to know it from a Pro/PPU perspective, right?. I wonder how much % the capacity business of PBI is.
Right. the new workloads require Capacity. So individual license users (Pro/PPU) that don't have any capacity won't have long term access without getting capacity. Although the price point on the upcoming Fabric Capacities is potentially appealing. I don't know what the lower SKU's range on usage will be though. Need to do some testing. Pro/PPU users can see what it's all about with a 60 day Fabric Capacity Trial (P1/F64 equivalent).
The bookmarks are not good. You have to keep tab of how many you have because if you have >10 you can't open a new report . If you are PP subscribee Fabric doesn't mean a thing other than cluttering your workspace. That neon teal color themevlooks good now but I fear it will age badly .
After watching these clips about Copilot in Power BI, I can't help but feel that the role of being a data analyst might become obsolete in the near future. It's just a feeling I have.
Yup! I plan to have a licensing video out next week. I'm expecting some blog info to drop later this week on the Fabric Capacities. That will be included in the video. There is a good twitter thread that Amir Netz has going on about this. twitter.com/AmirNetz/status/1663357490418049024
SaaS Product ... I thought Power BI Service, every Azure Online Products are SaaS, so far 🙂I like Saas, Fabric words! Joke is who will stitch the fabric? Tailor? Microsoft is adding so many consfusing words: 365 products, one products, power products, legacy products. Not sure where it ends up with in 10 years, Standardization is needed for Large Enterprises.
It's way more than that. There are actual integrations and the ability to leverage one copy of the data across all engines which is a really big deal. also having a common monitoring/admin/governance platform across your data estate allows for easier management and reduced TCO. I really recommend digging into the details of this. There is a lot to unpack.
lake house all the things 😁. It's the way things are going for larger amounts of data and leveraging the cloud. Fabric brings a lot of tools and capabilities to that pursuit.
Powerbi was promising, but it is far from good enough to use for Data analysis, visual capability is good, that's it, so I doubt Fabric will actually turn the tide in MS favour when comparing to alternatives. So think twice before invest your time in learning folks
I really like the measured, calm delivery. As someone who spent more time on the data engineering and architecture side, and less on the PBI side, I didn't spend much time with these cats, but now that we're evolving towards Fabric, I'm excited to connect with this team and the community. Great productions!
Agree, they are really smooth and so much great info.
This is best overview I've seen. I'm prepping for an interview and this was a great help.
For Power BI developers do you think Fabric would easier to learn than old-school Azure BI Stack? Previously the Azure resource consumption, variable pricing where huge obstacle for people to try out new things. Is that obstacle gone if we already have PBI Premium Capacity?
How it is looking from access perspective, once it is enable there is access to all 7 segments or Admins can lock Synapse or Data Factory?
Thanks Adam! This was a perfect introduction to Fabric 👌
Appreciate that Ian! Thanks for watching 👊
Hi, how will Microsoft Fabric be different from Azure Synapse Analytics which also integrates various tools at one place?
I'm IN LOVE with that green hoodie of yours💚💚💚💚💚💚
This is a wonderful resource for this new service from Microsoft. Thanks for providing this.
Fantastic intro, really getting clearer, especially with the Microsoft Learn workplan
The Microsoft Learn content is really good. Glad you found that helpful!
Thanks Adam, would love to see you using it in action!!
This is an introduction that assumes you know what all those different services are or do. I do not, so this was just a wall of Microsoft jargon.
Appreciate the feedback Jeremy! We do have plans of digging in more to explain the components. In fairness, if I did that in this video for all of it, it would be a 30-minute video and you wouldn't have watched it. Or at least past the 2-3 minute mark. More to come.
Back in the 90s when Microsoft started adding new jargon each year and in many cases just rebranding new generations of older product with fancy names, we all started referring to it as “Marketecture” …. And now that is also a word in the lexicon of jargon. Welcome to my jibber-jabber about jibber-jabber. 😉
Lots of words, but no meaning.
Haven't a clue after watching the video but seems like I don't need it if I don't even know what it's for.
I'd say if you don't know what those services are and what they're for, you won't get much from the video.
I understood this perfectly and found it very informative.
Your video is a really good introduction of Fabric. There is another video at top of google keep saying how "cool" fabric is but after watching his video I have absolutely no idea what Fabric does and how to get start.
Thanks Adam , thank you for such well structured explanation. This was really helpful.
I had a question do we have all the new copilot features for preview or just the DAX quick measures ?
I read the May 2023 release announcement about copilot there it is said that copilot is available for 'Private preview' at the moment
Do you have any idea what they meant by 'Private preview'?
cant wait to see the complete version of Fabric!
It's going to be an awesome journey! 👊
Great roundup! Thanks very much for this!
Thanks for that SQLDevDBA! 👊
Thanks Adam. Quick question: what about Power Platform? How it will fix inside Fabric? Integration?
The Power Platform isn't part of Microsoft Fabric (except for Power BI). Power BI is a first class workload within Microsoft Fabric. And Power BI is still part of the Power Platform umbrella.
There are still great ways to leverage other Power Platform services like Power Apps and Power Automate with Microsoft Fabric. Also, the connectors for Dataverse are front and center. It's just that Power Platform is different from Fabric. Fabric is all about the data platform. Power Platform has really been about those low-code/no-code developers and applications for that. There is a place for both and Power BI straddles the two.
Synapse Link for Dataverse will maintain a near real-time copy of your Power Platorm data in an Azure Data Lake Gen 2 storage. You can preserve timed snapshots of it too. You should be able to make that accessible to the Fabric frameworks.
Can you use Power Query to do data transformations in Fabric?
Yes! Dataflows Gen2 leverages Power Query Online. That is one option you have to getting data into OneLake. Pipelines and Notebooks are another option.
I turned on fabric trial and then tried to create a data lake and load some data into it. All my attempts to load data failed with a very cryptic error: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: We don't support creating directories in Azure Storage unless they are empty. Any chance to help me to figure out what's wrong?
I'd need some more details and try and reproduce it on my end. I don't know how you were loading the data or what exactly you were trying to load. Were you using Dataflows Gen2 or a Pipeline? Or a Notebook? If you did this with Dataflows Gen2, can you try a pipeline and does that work?
I turned on the trial in my org. but whenever trying to interactive with a delta table in the lakehouse from notebook, I got the error: Create database for fabric_lakehouse is not permitted using Apache Spark in Microsoft Fabric. I will get the same error message if I load files to Lakehouse files then using "Load to table" option from there. Can you help me out what could be the issue? I believe it's related to the tenant setting as if I sign up for a new trial, I didn't get the error message. but I don't know where/what to check.
is there anything within fabric that will enhance the performance and usability of spatial data? Especially from a Power BI perspective?
Hello,
Would it be possible to see how to push my staging data to a scheme that could be maybe called Production ?
Great video Adam, this is $$$ for our IT dept to see :)
This is great. Looking forward to it.
Awesome! Thanks for watching! 👊
Hi, just a quick question. I am using Azure Virtual Machine and Azure SQL DB for hosting my website and mobile application. Is Microsoft fabric also providing a VM like hosting service?
Would like to understand if there are any PBI Premium only features within Fabric or if the Direct Lake option is available for all users. Also spotted some git integration via PowerBI Project files and if that is Premium only or for all users
All of the capabilities you are aware of with Power BI and Power BI Premium still exist and are now a part of Fabric. It wasn't really talked about as it's not new. They aren't going away though. If you want to import data or leverage DirectQuery in Power BI datasets, you still can. You don't have to change everything to Direct Lake.
Thanks a lot Adam. This is wonderful.
Most welcome! Thanks for watching! 👊
Admittedly, Microsoft got caught with their pants down a bit with tableau, BUT, I’ve always said, never bet against Microsoft.
If I were starting an analytics practice from scratch today, I would base it on powerBI and Excel.
Yes I said excel, specifically because EVERY TAbleau dashboard release, one of the top 5 questions is ‘how do I export to excel’
Thx for the great video GIAC
I subscribed
Don t you think that is the problem, that the only way to review data is in excel. It is just a statement on how we are failing in analytics and export data to "enhance" it
@@MrSekter you’re not wrong.
I leads to my OTHER unpopular opinion… nobody wants self service. They want analysts that know the business and provide the reporting and insights they need.
Self service is a band aid for people not getting what they want.
But lastly, I’ve always loved excel, but in the last 4-5 years it’s really come a long way as a viable analytics tool. But I get it, it’s old.
In in-person talks, I usually joke about the fact that why do people want to build a Power BI report? So users can export the data to Excel. I get that laugh because everyone knows it's true. It's a data culture standpoint within organizations. everyone knows excel and that's where their comfort level is. They just want to get their hands on the data to create the pivot table and explore. That's also why I point out options like Analyze in Excel or just connecting to a Dataset from Excel. Don't export the data! leverage what is already created. But that takes education and habit enforcement - doesn't happen over night.
Hey cool! Im starting. I import from sql server database. But m code and DAX are annoying. So I’m tempted to import sometimes from an excel table. Am I shortchanging myself?
Thanks as usual very good Pres :)
This is monumental, and I’ll repeat myself….It’s really a “lake-shaking” breakthrough. However, Microsoft should evaluate how not to exclude its Power BI user base who adopted it for its simplicity. The added complexities and the associated cost should be addressed.
Would love to hear more regarding your thoughts on excluding the Power BI base. Ultimately, the new features require capacity. So, for folks only on the individual user licenses (Pro/PPU), you are right they wouldn't be able to take full advantage of everything. But, they can still leverage all of the Power BI capabilities.
What would be the ideal scenario for you?
@@GuyInACube Well, the accruing benefits that we all foresee to come from Fabric are massive. With great value comes associated cost, no doubt. Power BI free license has advanced the fast adoption of the product that has seen many users creating and developing assets in the Service. It would seem Fabric would, by design preclude a free license, given that all the component parts are essentially premium services. Hopefully, Microsoft could introduce a subscription cost that’s so low that most users would be encouraged to immediately signup. May be tier it up; setting the lower cheap tier to exclude those those complex azure services that citizen developers are not yet into.
Hello, after the trial how much will fabric cost for a single user?
More information should be out later this week and I'll have a licensing video out next week. This twitter thread from Amir spells out some upcoming info on pricing. twitter.com/AmirNetz/status/1663357490418049024
Q: will fabric also contain ci/cd possibilities without having to set this up manually. Now e.g. we have to use Visual Studio to bring your sql script changes into git. Would be great if this was also a SaaS solution.
Thank you Guy in a Cube! Thank you for bringing the most recent development in BI/Data world!
I have a question about how to get data into Power BI from an Access DB (*.accdb) residing on SharePoint. I have tried different things but no vail.
Microsoft has had the Office Suite for a long time with integration between the office products. Fabric is really a data suite. The Microsoft Fabric Data Suite for data professional s call it that so people can wrap their heads around it.
What's a delta file?
Is Azure Purview still the right tool for data governance and discovery? Or will Fabric have the same kind of solutions?
Azure Purview is still a separate offering from Microsoft Fabric. But there are integrations. The Purview Hub is front and center in Fabric. I'm assuming we will see more and more integrations here. Fabric isn't looking to replace Purview, but rather help you leverage it effectively.
Thank you
Wow, new stuff constantly yet they can't stop Excel crashing
Over 10 years ago with Windows 7 and Excel 2010 Excel would crash once a month at the most.
These days Office 365 Excel crashes twice a week on me
RLS in dataflows is all I need.
Exactly!
Dataflows Gen2 is changing the game a bit. Think output destinations and landing it in the lakehouse. When OneSecurity become available, then just apply the RLS on the items in OneLake and every engine takes advantage of it. So, will need to rethink where you want to apply those items so that you only have to do it once! We'll have more info on that once it becomes available.
@@GuyInACube and this can increase the cost of storing the data. Right now dataflows are perfect to store some of the data since it brings no additonal cost on top of power bi licence.
Hi, Guy in Cube team,
I hope this message finds you well. My name is Saravanan Balasubramanian, and I work as an Azure Data Architect at Capgemini. I recently had the opportunity to attend your session with Arun, and I found it extremely insightful.
I wanted to reach out to you because I currently have a fabric trial account and I'm very interested in gaining access to the Fabric Private Preview. I believe this would be beneficial for my work and would greatly enhance my understanding and utilization of Azure services.
Could you please provide me with information on how I can obtain early access to the Fabric Private Preview? I would greatly appreciate your assistance in this matter.
Okay, so, Fabric unifies seven very complex tools into one. Can Microsoft enable a way to use Fabric whereby the customer describes their entire solution in a paragraph of natural language, to Co-Pilot where it will provision ALL the ETL, analytics, data storage and front end (Power BI/Website) for them?
no.
So, if I’m understanding correctly, OneLake is one giant semantic layer for all data repositories you have?
Thanks Adam for summarising the 2-day build conf. however, why is not open to individuals (individual email)?
6:02 Microsoft fabric course
We will be getting one out in time 👊
This is way over my head, unfortunately. It's like offering me a bigger garage for six other cars I don't own.
I thought I could sit out that synapyse hype, but now it is 4/7 of all fabric... But wait, it is all only capacity related! so actually no need to know it from a Pro/PPU perspective, right?. I wonder how much % the capacity business of PBI is.
Right. the new workloads require Capacity. So individual license users (Pro/PPU) that don't have any capacity won't have long term access without getting capacity. Although the price point on the upcoming Fabric Capacities is potentially appealing. I don't know what the lower SKU's range on usage will be though. Need to do some testing. Pro/PPU users can see what it's all about with a 60 day Fabric Capacity Trial (P1/F64 equivalent).
In this video we will dive into some of the new features that will come with Microsoft Fabric. …
The bookmarks are not good. You have to keep tab of how many you have because if you have >10 you can't open a new report . If you are PP subscribee Fabric doesn't mean a thing other than cluttering your workspace.
That neon teal color themevlooks good now but I fear it will age badly .
After watching these clips about Copilot in Power BI,
I can't help but feel that the role of being a data analyst might become obsolete in the near future.
It's just a feeling I have.
And not just DA jobs. If your job involves pushing buttons, it’s inevitable. We will all need to diversify and upskill ourselves.
What about licencing? Can you do a video on licencing?
Yup! I plan to have a licensing video out next week. I'm expecting some blog info to drop later this week on the Fabric Capacities. That will be included in the video. There is a good twitter thread that Amir Netz has going on about this. twitter.com/AmirNetz/status/1663357490418049024
I have no idea what you were talking about
SaaS Product ... I thought Power BI Service, every Azure Online Products are SaaS, so far 🙂I like Saas, Fabric words! Joke is who will stitch the fabric? Tailor?
Microsoft is adding so many consfusing words: 365 products, one products, power products, legacy products. Not sure where it ends up with in 10 years, Standardization is needed for Large Enterprises.
So, they got Power BI Service and fill it with a bunch of Synapse's like serivces.. and got a prety new name! =)
It's way more than that. There are actual integrations and the ability to leverage one copy of the data across all engines which is a really big deal. also having a common monitoring/admin/governance platform across your data estate allows for easier management and reduced TCO. I really recommend digging into the details of this. There is a lot to unpack.
No wonder my company has been working to a data lake.
lake house all the things 😁. It's the way things are going for larger amounts of data and leveraging the cloud. Fabric brings a lot of tools and capabilities to that pursuit.
Man this is Data Bricks. 😅
Direct competition. Tableau is really dead. PowerBi killed it but Fabric cremated it.
Lakehouse all the things! 😎
This means it's the end of powerbi developers
Sounds like this guy works for Microsoft. A lot of marketing and sales pitch regurgitation. Nothing about what it actually is.
Yet another programming jargon. As if there is something really new.
Powerbi was promising, but it is far from good enough to use for Data analysis, visual capability is good, that's it, so I doubt Fabric will actually turn the tide in MS favour when comparing to alternatives. So think twice before invest your time in learning folks
so what do you think is the best tool for data analysis?
@@aleksandrapetela4858 tool is whatever you have or want ^^ even excel, but the main thing you need is logical thinking and Sql
More annoying tracking software?
Thank you