Power BI datasets vs. Power BI dataflows - What gets refreshes?
ฝัง
- เผยแพร่เมื่อ 12 มิ.ย. 2024
- Adam looks at what actually happens when you refresh a Power BI dataset and it is referencing a Power BI dataflows.
Guy in a Cube courses: guyinacu.be/courses
********
LET'S CONNECT!
********
-- / guyinacube
-- / awsaxton
-- / patrickdba
-- / guyinacube
-- / guyinacube
-- guyinacube.com
**Gear**
Check out my Tools page - guyinacube.com/tools/
#PowerBI #PowerBIdataflows #refresh - วิทยาศาสตร์และเทคโนโลยี
3 years later this is still relevant, ty sir! I only refreshed my Data Flow thinking that it would refreshed my report visuals, didn't realize I needed to set refresh schedule for the Dataset as well. Thank you sir, you are a gentleman and a scholar!
What I love most about "Guy in a cube" videos is: They're answering the exact point I am looking at!!.
Very nice one guys really .. keep it up and keep us inspired :)
Thanks Adam! This is definitely helpful as not many people mention this, and I've had to do testing to figure it out. I'd like to see a video that covers the current benefits/shortcomings/roadmap of using a dataflow, and also what it would look like to deploy multiple datasets that use a single dataflow. Two issues I've seen are: AAD might not be supported for Azure SQL when creating a dataflow, and a full download of the dataflow data is needed before a local pbi power query is executed (no query folding for data lake). I really want to use dataflows for our team so we can have centralized management of refreshes from sql (including incremental refresh), and reduce burden on sql servers.
I'd suggest hitting up @SQLAllFather on Twitter. He is the dataflow guru and is doing a bunch of blogs (www.ssbipolar.com) and videos (th-cam.com/channels/psilPn-2qFlrYYuvyFkpPQ.html) on dataflows.
Why would you want to use AAD to refresh a Dataflow? Wouldn't it be more prudent to create a minimally privileged account on the server to use to connect to the database when you create the Dataflow?
If you do insist on using an AAD account though, they are supported when creating a Dataflow. Also, to your question about full downloads of the data, I would possibly try to create an entity from a blank query and reference any values/results from that in another query to try to get around the lack of parameterization abilities in Dataflows in their current state. I will admit I've never actually tried that but I plan on it tomorrow.
@@themosh54 I'm not super knowlegable in AAD vs Local SQL accounts, but our entire org is shifting away from SQL accounts as their is less control over who has creds, less centralized management, and a higher security risk when sharing passwords for that account. Most people are moving to AAD managed service identities (MSI) instead. At the very least, they're using their own AAD account.
If I create another entity then it's just going to increase my overall refresh time and storage consumption. At that point it's not even worth building another entity because loading the data into my dataset would be just as performant. It'd be better if there was some kind of query folding available for the underlying CDM/Datalake.
Hello Adams, thanks for your great work ; could you explain where the App Navigation comes from ?
Hi and thanks for the explanation! I have the case where although dataset seems to be updated according to schedule the data inside are updated...and therefore the changes are not reflected in the report..On the other hand in the dataflow everything looks ok...any ideas ?
Can we access and display the last refresh date of a dataflow(s) used in a dataset? The PBI portal now shows the last refresh date of the dataset but that is misleading if the dataset references out of date dataflows...
hey so does this means we can set up different refresh timings for underlying datasets in data flow? or if one data source fails to refresh it still refreshes other datasources in dataflow without failing report?
Thanks Adam, one question, how does it work with DirectQuery and the Enhanced Computed Engine Settings?. I have a Power BI Embedded Capacity A1 and I'm using these dataflow feature but only the Dataset itself is refreshing with a 15 minute basis and not the dataflow.
Thanks Adam, this is great. Is there a way to update the data flows via API like you would a dataset?
Hey Nicolas. Yes, there's an API to refresh dataflow (docs.microsoft.com/en-us/rest/api/power-bi/dataflows/refreshdataflow), unfotunaltely no easy way to trigger a dataflow refresh from Power Automate, that would firts refresh in sequence, my dataflow, and then my related datasets... this is a real lack, but I'm pretty sure Microsoft is already working on this. They could even make that Power Automate template to detect all of my dataflow-related datasets, and refresh them right after refreshing dataflow !
That's what I was confused, a power automate refresh on dataset not giving the updates based on the latest changes in excel source file
Hello Adam, What about the other way around. I have a workspace where when the root dataflow is triggered, it seems to want to trigger all the dataflows that are dependent on it. I get a lot of refresh errors as the APIs those other flows refer to get overwhelmed or rejected due to many requests at once. Is there a way to stop that?
Has anyone tried a "Scheduled" data refresh on a share point online picture library? If so what function did you use?
What is the possibility of integration between DATAFLOW into the database (SQL for example) ???
Should the dataflow live in the same workspace as the dataset?
Can you provide dynamic parameters stored procedure in power bi
If the question is, can you provide parameter input from the report the answer is unfortunately No. You can provide parameter input externally that drives the results. Check out this video th-cam.com/video/iiNDq2VrZPY/w-d-xo.html.
How can you refresh a dataflow from flow?