Thanks for that, I've created two views from a table in Power Bi and I'l like to merge them.But Power BI doesn't bring the view's name in Merge setting. How can I merge 2 views with same structure with DAX?
Hey man, i have a situation and I want your advice. So i am making a dashboard in which data comes to a table after every 5 min automatic refresh. User wants the history of data. Now if i use append so after every refresh, the data will get into a new appended table. Now the issue is after every refresh data will take place of previous data, I don’t want that. I want if first refresh have 20 records and second have 30 records then total after 2 refreshes should be 50 records instead of 30 in the new history table. But this is failing and user wants the whole data. Could You please help me how can I achieve this? Tell me if you want more explanation. Looking forward for your reply.
Hi , Can we merge data from SAP BW and Salesforce Table. I have one set of data say targets in the salesforce and targets achieved in SAP BW. Can i do the visualization in Power BI
Awesome video! Being new to Power BI, I was stuck on how to combine data from identical tables from 10 different SQL DBs . The append queries option is already available on the toolbar! No need for complicated DAX (like Calculated tables) . Thanks!
I am doing the same but for 68 SQL DBs. My problem is that when only 1 server is down, you can’t refresh the append table for the other 67 which are available.
You are awesome in Explaining everything in an easy way... Fabulous. Many many many Namaskars🙏🙏🙏🙏🙏(Indian style) & thanks a lot. I almost saw all your videos
Great work again. I have another question related to DAX you might help with. How can we extract the second latest date depending on id's. E.g a table with a date, an id and a revenue column. Now we would like to get the difference between the latest revenue and the second latest revenue for each id. Any ideas? Thank you
There are a number of ways you can achieve this. In DAX, or in Power Query. as an example, you can use TOPN to get the first two rows, and then get the first record of those two. When it comes to DAX, there are always multiple methods of doing things.
Hi Reza thanks for the video. I have a question. I have a data today with unique IDs 1 to 10. Tomorrow i have another dataset where i have data for unique IDs 5,6 &7 and also some new unique IDs like 11,12,13. What i want to do is to ; -keep data as it is for unique IDs 1,2,3,4,8,9,10 -update dataof unique IDs 5,6,7 with second file -add unique IDs 11,12,13 so in the end i will have a data set with 13 rows.. It is kind of a delta concept that i would like to have. Is it possible?
If you need to both Append and Merge, is it better/more efficient/effective (from a memory standpoint, etc.) to Merge and then Append, or Append and then Merge? Thanks.
Radacad, can you provide a solution to the need of stacking records in more than 2 column's (let's say 3 or more) data into one single column in powerBI / powerQuery Thank you
Well done Reza, your tutorials are super easy to understand and are very informative. The key takeaway from this tutorial is disabling query load (which I was not doing before).
This is very helpful! However I have a slightly different situation- I have a file where I already have visuals completed using table 1. I need to add table 2 which has all the same columns, but I don't want to append because then I have to change all of visuals to the Append table. Is there a way to do this?
Hi, i am trying to combine three excel sheet,one sheet contains header and other sheet does not contains header details,I have selected example file as first sheet ,i am getting data from only from first sheet not from other sheet. can you pls guide me on this ? or is it possible to combine that one sheet with header and other sheet without header ?
depends on how the files are structures it might be possible. if they all have the same number of columns, you can get data from each sheet, do NOT use the first row as header, append them and then add some more transformations into it.
Great tutorials as usual Reza, well done. I have smal question, I have 10 folders containing information related to 10 assets / equipment. Inside each folder, I have 12 files where each file contains the monthly data related to the particular asset. So in total I have 120 files providing information for 1 year. All these 120 files shares a common column which is the timestamp based on hourly data gathering. However remaining column headings are different (equipment-1 run hour, equipment-2 run hour, etc…). What do you suggest for combining all into single table based on the common timestamp. Do I need to combine each asset table separately into single table and then merge all the 10! Thnk yoy.
Good content, Reza. Thanks! Besides not wanting to create a large number of table relationship what are other benefits of merging queries? I heard it isn't ideal to have too many flat tables.
I came down to this video after struggling to find why my appended query result and SQL 'UNION' result wouldn't match. Even after trying remove duplicates the total rows weren't matching. Thanks to Reza, @6:41 portion of this video highlights the issue where he specifically says that we need to select all columns before removing duplicates. I happened to miss that part which might seem obvious but wouldn't strike when you're trying to circumvent an issue. Loved the solution.
kind of. but there are scenarios that merge will also cause adding extra rows, if you have multiple values per the combination of fields you choose for the merge in one of the tables. in general, however, kind of correct.
Hi, thanks for the video it's helps a lot, I just have a question actually i've created a merged table but it doesn't take new columns that are added into the first table till i select them from the list, is there a way to developpe newcolumns automaticaly i want to select them all at once without adding every time the new one
After merge you have to expand into the columns from the source table. There might be some ways to automate it, such as getting the list of columns from the source table, and using that to expand the columns. This has to be done using M scripting though, no possible through the graphical interface yet.
Great tutorial! But...I have Table1 (ID from 1 to 10) and Table2 (ID from 1 to 30) I need to append to Table1 records from Table2 only from 11 to 25 Is there a simple way to append a filtered recordset in PQ?
Quick question: If I have two tables, A, B, containing project information of the same structure, is it possible to append the rows of table A into table B using Append? I want to keep using table B and do not want a 3rd table containing the combined rows.
Hi Thomas. That is exactly what the Append is for. Yes, you can append the two tables using this approach, and don't worry about the third table, you can use APPEND instead of APPEND AS NEW.
two tables at a time. which means you can merge table 1 and table 2, then merge the result with table 3 and so on. You can merge as many as data sources you want.
Thanks for that, I've created two views from a table in Power Bi and I'l like to merge them.But Power BI doesn't bring the view's name in Merge setting.
How can I merge 2 views with same structure with DAX?
The tips you give in addition to explaining the concepts really help at the timer of interviews. Thanks a ton!!
Hey man, i have a situation and I want your advice. So i am making a dashboard in which data comes to a table after every 5 min automatic refresh. User wants the history of data. Now if i use append so after every refresh, the data will get into a new appended table. Now the issue is after every refresh data will take place of previous data, I don’t want that. I want if first refresh have 20 records and second have 30 records then total after 2 refreshes should be 50 records instead of 30 in the new history table. But this is failing and user wants the whole data. Could You please help me how can I achieve this? Tell me if you want more explanation. Looking forward for your reply.
Hi , Can we merge data from SAP BW and Salesforce Table. I have one set of data say targets in the salesforce and targets achieved in SAP BW. Can i do the visualization in Power BI
THE WAY YOU TEACH IS AWESOME.
Very helpful!! Simple explanation covering very important aspects such as CPU performance and others. Congratulations!!!!
Thanks for the nice content, can u also share a tutorial on reference and duplicate in power query. I am confused somehow. Not strong clarity.
Will do for sure
Awesome video! Being new to Power BI, I was stuck on how to combine data from identical tables from 10 different SQL DBs . The append queries option is already available on the toolbar! No need for complicated DAX (like Calculated tables) . Thanks!
I am doing the same but for 68 SQL DBs. My problem is that when only 1 server is down, you can’t refresh the append table for the other 67 which are available.
@@BarelyToast then it will be hectic situation bro...
Hey pls can u help me, what if we have two tables and we need to merge those two but theres no primary key and foreign key (no common column)
You are very brief yet explain everything related to a topic. So useful! thank you so much!
awesome video tutorial thanks! very helpful
You explained very well. Thanks for sharing. I just subscribed your channel 👍🏻
Thanks and welcome
Great video! Do you happen to play classical guitar by any chance? Long fingernails on the right hand seem to suggest so..
Nice catch ;) yes.
sir I need more in power query................................jazakallah,
Query folding & Incremental refresh
You are awesome in Explaining everything in an easy way... Fabulous. Many many many Namaskars🙏🙏🙏🙏🙏(Indian style) & thanks a lot. I almost saw all your videos
glad to help :)
Great work again. I have another question related to DAX you might help with.
How can we extract the second latest date depending on id's. E.g a table with a date, an id and a revenue column. Now we would like to get the difference between the latest revenue and the second latest revenue for each id. Any ideas? Thank you
There are a number of ways you can achieve this. In DAX, or in Power Query. as an example, you can use TOPN to get the first two rows, and then get the first record of those two. When it comes to DAX, there are always multiple methods of doing things.
You just saved my job! Thank you.
I like the way that you draw boxes, numbers, etc. in your video. Could you advise what software/utility you are using?
It is called ZOOMIT, a free small tool developed by Microsoft. you can download and use it too.
Hi Reza thanks for the video. I have a question. I have a data today with unique IDs 1 to 10. Tomorrow i have another dataset where i have data for unique IDs 5,6 &7 and also some new unique IDs like 11,12,13. What i want to do is to ;
-keep data as it is for unique IDs 1,2,3,4,8,9,10
-update dataof unique IDs 5,6,7 with second file
-add unique IDs 11,12,13
so in the end i will have a data set with 13 rows.. It is kind of a delta concept that i would like to have. Is it possible?
Thank you for explaining it so well!
If you need to both Append and Merge, is it better/more efficient/effective (from a memory standpoint, etc.) to Merge and then Append, or Append and then Merge?
Thanks.
It was exactly what I was looking for, thanks.
Geat video, many thanks for the sharing.
Great and Clear explanation. Thank you. I found this to be very helpful. I have subscribed!
Thanks for the sub!
Thank you very much ! It was very simply explained & understand the concept
Radacad, can you provide a solution to the need of stacking records in more than 2 column's (let's say 3 or more) data into one single column in powerBI / powerQuery Thank you
Awesome Explanation... I liked it very much.. Saw 3 vedios on the same concept but all were shit.. Thanks to you..
Could I make calculations among different tables without using merge?
Awesome video..
Is it possible to merge 3 tables together in powerbi?
Well done Reza, your tutorials are super easy to understand and are very informative. The key takeaway from this tutorial is disabling query load (which I was not doing before).
😊👊
Thank you for an easy, logical, and understandable explanation!
You are welcome!
Thank you for this Vedio..
Helpful Video
16:00 I was going to highlight a mistake in my comment until I saw Reza's nails and backed off 😁
😅😅
This is very helpful! However I have a slightly different situation- I have a file where I already have visuals completed using table 1. I need to add table 2 which has all the same columns, but I don't want to append because then I have to change all of visuals to the Append table. Is there a way to do this?
Very helpful. Thank you. This is exactly what I needed.
Nicely done. Btw what are you using for the zooming in, mouse clicks and rectangles creation.
Great video, thanks!
Is it possible to combine two tables without having no single column same so what can we do in power query?
Hi,
i am trying to combine three excel sheet,one sheet contains header and other sheet does not contains header details,I have selected example file as first sheet ,i am getting data from only from first sheet not from other sheet.
can you pls guide me on this ?
or is it possible to combine that one sheet with header and other sheet without header ?
depends on how the files are structures it might be possible. if they all have the same number of columns, you can get data from each sheet, do NOT use the first row as header, append them and then add some more transformations into it.
Good camera, what are you using?
Panasonic GH5
Great tutorials as usual Reza, well done.
I have smal question, I have 10 folders containing information related to 10 assets / equipment. Inside each folder, I have 12 files where each file contains the monthly data related to the particular asset. So in total I have 120 files providing information for 1 year.
All these 120 files shares a common column which is the timestamp based on hourly data gathering. However remaining column headings are different (equipment-1 run hour, equipment-2 run hour, etc…).
What do you suggest for combining all into single table based on the common timestamp. Do I need to combine each asset table separately into single table and then merge all the 10! Thnk yoy.
Good day, Reza, and thank you for putting this video together. I learnt some new items within Power Query and thank you. Much appreciated.
Reza, thanks for understandably explaining these two functions.
Thank you Reza, this is very helpful!
Good content, Reza. Thanks! Besides not wanting to create a large number of table relationship what are other benefits of merging queries? I heard it isn't ideal to have too many flat tables.
to create dimensions mainly. I have a video about creating shared dimension
helpful
Best Explanation Ever! Loved it
Thankq soo much
9:55- Merge starts
Thanks, man, you're the best.
9:00 disable load
I came down to this video after struggling to find why my appended query result and SQL 'UNION' result wouldn't match. Even after trying remove duplicates the total rows weren't matching. Thanks to Reza, @6:41 portion of this video highlights the issue where he specifically says that we need to select all columns before removing duplicates. I happened to miss that part which might seem obvious but wouldn't strike when you're trying to circumvent an issue. Loved the solution.
Glad it helps :) Thanks for sharing your experience
Hi Reza, Thanks for making this simple, Can I understand it this way, Append is for Rowside and Merge is for Column side?
kind of.
but there are scenarios that merge will also cause adding extra rows, if you have multiple values per the combination of fields you choose for the merge in one of the tables.
in general, however, kind of correct.
Hi, thanks for the video it's helps a lot, I just have a question actually i've created a merged table but it doesn't take new columns that are added into the first table till i select them from the list, is there a way to developpe newcolumns automaticaly i want to select them all at once without adding every time the new one
After merge you have to expand into the columns from the source table. There might be some ways to automate it, such as getting the list of columns from the source table, and using that to expand the columns. This has to be done using M scripting though, no possible through the graphical interface yet.
@@RADACAD thanks
I'll look for an other way to do it
Thanks Reza for this clear and thorough tutorial
Thanks 😊
Thank you for your clear explanation.
Glad it was helpful!
Awesome!
Thank you - excellent concise video. Thank you for taking to time to create and share.
Perfect video to explain difference between merge and append
Informative and thorough, thank you!
Clear, concise, excellent. Thank you
Can someone share the link where he teaches all other merge types please?
radacad.com/choose-the-right-merge-join-type-in-power-bi
Thank you so much, it was very useful.
Thanks. Great teaching; no time wasted.
Great video with great content and explanation! Thank you Sir and keep up with the hard work. These tips will help a lot during interviews.
took me a while to find the answer to this. Quite straight forward in the end, so thanks for explaining
Great tutorial! But...I have Table1 (ID from 1 to 10) and Table2 (ID from 1 to 30)
I need to append to Table1 records from Table2 only from 11 to 25
Is there a simple way to append a filtered recordset in PQ?
You can filter the Table2 records and then append that result to Table1
You can Append both tables, and then remove duplicates. Or alternatively filter the table2 first, and then Append.
Thanks allot. Precisely explained :)
useful video champ.
Quick question: If I have two tables, A, B, containing project information of the same structure, is it possible to append the rows of table A into table B using Append? I want to keep using table B and do not want a 3rd table containing the combined rows.
Hi Thomas.
That is exactly what the Append is for. Yes, you can append the two tables using this approach, and don't worry about the third table, you can use APPEND instead of APPEND AS NEW.
@@RADACAD Thanks for the reply!
Very well explained. Thank you so much!
Awesome video! Thank you.
These are the kinds of software instructional videos that are best: ones that are direct and to the point. It's great review for me. Thank you!
Thanks. We are glad you like it.
Append is like union all
That is right :)
excellent tutorial, thank you!
Great Video
great job and thank you!
Simply, thank you!!
explaining good
Well done!
vey helpful :-)
can we not merge more than two data sources in power query ?
two tables at a time. which means you can merge table 1 and table 2, then merge the result with table 3 and so on. You can merge as many as data sources you want.