You are awesome in Explaining everything in an easy way... Fabulous. Many many many Namaskars🙏🙏🙏🙏🙏(Indian style) & thanks a lot. I almost saw all your videos
I came down to this video after struggling to find why my appended query result and SQL 'UNION' result wouldn't match. Even after trying remove duplicates the total rows weren't matching. Thanks to Reza, @6:41 portion of this video highlights the issue where he specifically says that we need to select all columns before removing duplicates. I happened to miss that part which might seem obvious but wouldn't strike when you're trying to circumvent an issue. Loved the solution.
Well done Reza, your tutorials are super easy to understand and are very informative. The key takeaway from this tutorial is disabling query load (which I was not doing before).
Awesome video! Being new to Power BI, I was stuck on how to combine data from identical tables from 10 different SQL DBs . The append queries option is already available on the toolbar! No need for complicated DAX (like Calculated tables) . Thanks!
I am doing the same but for 68 SQL DBs. My problem is that when only 1 server is down, you can’t refresh the append table for the other 67 which are available.
Thanks for that, I've created two views from a table in Power Bi and I'l like to merge them.But Power BI doesn't bring the view's name in Merge setting. How can I merge 2 views with same structure with DAX?
Hi, thanks for the video it's helps a lot, I just have a question actually i've created a merged table but it doesn't take new columns that are added into the first table till i select them from the list, is there a way to developpe newcolumns automaticaly i want to select them all at once without adding every time the new one
After merge you have to expand into the columns from the source table. There might be some ways to automate it, such as getting the list of columns from the source table, and using that to expand the columns. This has to be done using M scripting though, no possible through the graphical interface yet.
If you need to both Append and Merge, is it better/more efficient/effective (from a memory standpoint, etc.) to Merge and then Append, or Append and then Merge? Thanks.
Good content, Reza. Thanks! Besides not wanting to create a large number of table relationship what are other benefits of merging queries? I heard it isn't ideal to have too many flat tables.
Hi , Can we merge data from SAP BW and Salesforce Table. I have one set of data say targets in the salesforce and targets achieved in SAP BW. Can i do the visualization in Power BI
Great work again. I have another question related to DAX you might help with. How can we extract the second latest date depending on id's. E.g a table with a date, an id and a revenue column. Now we would like to get the difference between the latest revenue and the second latest revenue for each id. Any ideas? Thank you
There are a number of ways you can achieve this. In DAX, or in Power Query. as an example, you can use TOPN to get the first two rows, and then get the first record of those two. When it comes to DAX, there are always multiple methods of doing things.
Quick question: If I have two tables, A, B, containing project information of the same structure, is it possible to append the rows of table A into table B using Append? I want to keep using table B and do not want a 3rd table containing the combined rows.
Hi Thomas. That is exactly what the Append is for. Yes, you can append the two tables using this approach, and don't worry about the third table, you can use APPEND instead of APPEND AS NEW.
Hey man, i have a situation and I want your advice. So i am making a dashboard in which data comes to a table after every 5 min automatic refresh. User wants the history of data. Now if i use append so after every refresh, the data will get into a new appended table. Now the issue is after every refresh data will take place of previous data, I don’t want that. I want if first refresh have 20 records and second have 30 records then total after 2 refreshes should be 50 records instead of 30 in the new history table. But this is failing and user wants the whole data. Could You please help me how can I achieve this? Tell me if you want more explanation. Looking forward for your reply.
Hi Reza thanks for the video. I have a question. I have a data today with unique IDs 1 to 10. Tomorrow i have another dataset where i have data for unique IDs 5,6 &7 and also some new unique IDs like 11,12,13. What i want to do is to ; -keep data as it is for unique IDs 1,2,3,4,8,9,10 -update dataof unique IDs 5,6,7 with second file -add unique IDs 11,12,13 so in the end i will have a data set with 13 rows.. It is kind of a delta concept that i would like to have. Is it possible?
kind of. but there are scenarios that merge will also cause adding extra rows, if you have multiple values per the combination of fields you choose for the merge in one of the tables. in general, however, kind of correct.
Hi, i am trying to combine three excel sheet,one sheet contains header and other sheet does not contains header details,I have selected example file as first sheet ,i am getting data from only from first sheet not from other sheet. can you pls guide me on this ? or is it possible to combine that one sheet with header and other sheet without header ?
depends on how the files are structures it might be possible. if they all have the same number of columns, you can get data from each sheet, do NOT use the first row as header, append them and then add some more transformations into it.
This is very helpful! However I have a slightly different situation- I have a file where I already have visuals completed using table 1. I need to add table 2 which has all the same columns, but I don't want to append because then I have to change all of visuals to the Append table. Is there a way to do this?
Radacad, can you provide a solution to the need of stacking records in more than 2 column's (let's say 3 or more) data into one single column in powerBI / powerQuery Thank you
Great tutorial! But...I have Table1 (ID from 1 to 10) and Table2 (ID from 1 to 30) I need to append to Table1 records from Table2 only from 11 to 25 Is there a simple way to append a filtered recordset in PQ?
Great tutorials as usual Reza, well done. I have smal question, I have 10 folders containing information related to 10 assets / equipment. Inside each folder, I have 12 files where each file contains the monthly data related to the particular asset. So in total I have 120 files providing information for 1 year. All these 120 files shares a common column which is the timestamp based on hourly data gathering. However remaining column headings are different (equipment-1 run hour, equipment-2 run hour, etc…). What do you suggest for combining all into single table based on the common timestamp. Do I need to combine each asset table separately into single table and then merge all the 10! Thnk yoy.
two tables at a time. which means you can merge table 1 and table 2, then merge the result with table 3 and so on. You can merge as many as data sources you want.
THE WAY YOU TEACH IS AWESOME.
The tips you give in addition to explaining the concepts really help at the timer of interviews. Thanks a ton!!
You are very brief yet explain everything related to a topic. So useful! thank you so much!
You are awesome in Explaining everything in an easy way... Fabulous. Many many many Namaskars🙏🙏🙏🙏🙏(Indian style) & thanks a lot. I almost saw all your videos
glad to help :)
These are the kinds of software instructional videos that are best: ones that are direct and to the point. It's great review for me. Thank you!
Thanks. We are glad you like it.
I came down to this video after struggling to find why my appended query result and SQL 'UNION' result wouldn't match. Even after trying remove duplicates the total rows weren't matching. Thanks to Reza, @6:41 portion of this video highlights the issue where he specifically says that we need to select all columns before removing duplicates. I happened to miss that part which might seem obvious but wouldn't strike when you're trying to circumvent an issue. Loved the solution.
Glad it helps :) Thanks for sharing your experience
Thank you for an easy, logical, and understandable explanation!
You are welcome!
Well done Reza, your tutorials are super easy to understand and are very informative. The key takeaway from this tutorial is disabling query load (which I was not doing before).
😊👊
took me a while to find the answer to this. Quite straight forward in the end, so thanks for explaining
Very helpful!! Simple explanation covering very important aspects such as CPU performance and others. Congratulations!!!!
Thanks Reza for this clear and thorough tutorial
Awesome video! Being new to Power BI, I was stuck on how to combine data from identical tables from 10 different SQL DBs . The append queries option is already available on the toolbar! No need for complicated DAX (like Calculated tables) . Thanks!
I am doing the same but for 68 SQL DBs. My problem is that when only 1 server is down, you can’t refresh the append table for the other 67 which are available.
@@BarelyToast then it will be hectic situation bro...
Perfect video to explain difference between merge and append
Good day, Reza, and thank you for putting this video together. I learnt some new items within Power Query and thank you. Much appreciated.
Reza, thanks for understandably explaining these two functions.
Awesome Explanation... I liked it very much.. Saw 3 vedios on the same concept but all were shit.. Thanks to you..
You just saved my job! Thank you.
Thank you very much ! It was very simply explained & understand the concept
Good camera, what are you using?
Panasonic GH5
Thanks. Great teaching; no time wasted.
I like the way that you draw boxes, numbers, etc. in your video. Could you advise what software/utility you are using?
It is called ZOOMIT, a free small tool developed by Microsoft. you can download and use it too.
Great and Clear explanation. Thank you. I found this to be very helpful. I have subscribed!
Thanks for the sub!
Thanks for that, I've created two views from a table in Power Bi and I'l like to merge them.But Power BI doesn't bring the view's name in Merge setting.
How can I merge 2 views with same structure with DAX?
Hi, thanks for the video it's helps a lot, I just have a question actually i've created a merged table but it doesn't take new columns that are added into the first table till i select them from the list, is there a way to developpe newcolumns automaticaly i want to select them all at once without adding every time the new one
After merge you have to expand into the columns from the source table. There might be some ways to automate it, such as getting the list of columns from the source table, and using that to expand the columns. This has to be done using M scripting though, no possible through the graphical interface yet.
@@RADACAD thanks
I'll look for an other way to do it
Best Explanation Ever! Loved it
Great video! Do you happen to play classical guitar by any chance? Long fingernails on the right hand seem to suggest so..
Nice catch ;) yes.
If you need to both Append and Merge, is it better/more efficient/effective (from a memory standpoint, etc.) to Merge and then Append, or Append and then Merge?
Thanks.
Good content, Reza. Thanks! Besides not wanting to create a large number of table relationship what are other benefits of merging queries? I heard it isn't ideal to have too many flat tables.
to create dimensions mainly. I have a video about creating shared dimension
Great video with great content and explanation! Thank you Sir and keep up with the hard work. These tips will help a lot during interviews.
Hi , Can we merge data from SAP BW and Salesforce Table. I have one set of data say targets in the salesforce and targets achieved in SAP BW. Can i do the visualization in Power BI
Great work again. I have another question related to DAX you might help with.
How can we extract the second latest date depending on id's. E.g a table with a date, an id and a revenue column. Now we would like to get the difference between the latest revenue and the second latest revenue for each id. Any ideas? Thank you
There are a number of ways you can achieve this. In DAX, or in Power Query. as an example, you can use TOPN to get the first two rows, and then get the first record of those two. When it comes to DAX, there are always multiple methods of doing things.
Thank you for explaining it so well!
Clear, concise, excellent. Thank you
Hey pls can u help me, what if we have two tables and we need to merge those two but theres no primary key and foreign key (no common column)
Quick question: If I have two tables, A, B, containing project information of the same structure, is it possible to append the rows of table A into table B using Append? I want to keep using table B and do not want a 3rd table containing the combined rows.
Hi Thomas.
That is exactly what the Append is for. Yes, you can append the two tables using this approach, and don't worry about the third table, you can use APPEND instead of APPEND AS NEW.
@@RADACAD Thanks for the reply!
Hey man, i have a situation and I want your advice. So i am making a dashboard in which data comes to a table after every 5 min automatic refresh. User wants the history of data. Now if i use append so after every refresh, the data will get into a new appended table. Now the issue is after every refresh data will take place of previous data, I don’t want that. I want if first refresh have 20 records and second have 30 records then total after 2 refreshes should be 50 records instead of 30 in the new history table. But this is failing and user wants the whole data. Could You please help me how can I achieve this? Tell me if you want more explanation. Looking forward for your reply.
Is it possible to combine two tables without having no single column same so what can we do in power query?
Hi Reza thanks for the video. I have a question. I have a data today with unique IDs 1 to 10. Tomorrow i have another dataset where i have data for unique IDs 5,6 &7 and also some new unique IDs like 11,12,13. What i want to do is to ;
-keep data as it is for unique IDs 1,2,3,4,8,9,10
-update dataof unique IDs 5,6,7 with second file
-add unique IDs 11,12,13
so in the end i will have a data set with 13 rows.. It is kind of a delta concept that i would like to have. Is it possible?
Could I make calculations among different tables without using merge?
Hi Reza, Thanks for making this simple, Can I understand it this way, Append is for Rowside and Merge is for Column side?
kind of.
but there are scenarios that merge will also cause adding extra rows, if you have multiple values per the combination of fields you choose for the merge in one of the tables.
in general, however, kind of correct.
It was exactly what I was looking for, thanks.
Very helpful. Thank you. This is exactly what I needed.
Nicely done. Btw what are you using for the zooming in, mouse clicks and rectangles creation.
Can someone share the link where he teaches all other merge types please?
radacad.com/choose-the-right-merge-join-type-in-power-bi
Thanks for the nice content, can u also share a tutorial on reference and duplicate in power query. I am confused somehow. Not strong clarity.
Will do for sure
Thank you - excellent concise video. Thank you for taking to time to create and share.
Hi,
i am trying to combine three excel sheet,one sheet contains header and other sheet does not contains header details,I have selected example file as first sheet ,i am getting data from only from first sheet not from other sheet.
can you pls guide me on this ?
or is it possible to combine that one sheet with header and other sheet without header ?
depends on how the files are structures it might be possible. if they all have the same number of columns, you can get data from each sheet, do NOT use the first row as header, append them and then add some more transformations into it.
Is it possible to merge 3 tables together in powerbi?
This is very helpful! However I have a slightly different situation- I have a file where I already have visuals completed using table 1. I need to add table 2 which has all the same columns, but I don't want to append because then I have to change all of visuals to the Append table. Is there a way to do this?
Radacad, can you provide a solution to the need of stacking records in more than 2 column's (let's say 3 or more) data into one single column in powerBI / powerQuery Thank you
You explained very well. Thanks for sharing. I just subscribed your channel 👍🏻
Thanks and welcome
Great tutorial! But...I have Table1 (ID from 1 to 10) and Table2 (ID from 1 to 30)
I need to append to Table1 records from Table2 only from 11 to 25
Is there a simple way to append a filtered recordset in PQ?
You can filter the Table2 records and then append that result to Table1
You can Append both tables, and then remove duplicates. Or alternatively filter the table2 first, and then Append.
Great tutorials as usual Reza, well done.
I have smal question, I have 10 folders containing information related to 10 assets / equipment. Inside each folder, I have 12 files where each file contains the monthly data related to the particular asset. So in total I have 120 files providing information for 1 year.
All these 120 files shares a common column which is the timestamp based on hourly data gathering. However remaining column headings are different (equipment-1 run hour, equipment-2 run hour, etc…).
What do you suggest for combining all into single table based on the common timestamp. Do I need to combine each asset table separately into single table and then merge all the 10! Thnk yoy.
Thank you Reza, this is very helpful!
Informative and thorough, thank you!
Thank you for your clear explanation.
Glad it was helpful!
awesome video tutorial thanks! very helpful
Geat video, many thanks for the sharing.
Very well explained. Thank you so much!
Thanks allot. Precisely explained :)
Thank you so much, it was very useful.
Thanks, man, you're the best.
9:00 disable load
Query folding & Incremental refresh
Awesome video..
9:55- Merge starts
Great video, thanks!
Thank you for this Vedio..
excellent tutorial, thank you!
Awesome video! Thank you.
sir I need more in power query................................jazakallah,
can we not merge more than two data sources in power query ?
two tables at a time. which means you can merge table 1 and table 2, then merge the result with table 3 and so on. You can merge as many as data sources you want.
useful video champ.
Helpful Video
16:00 I was going to highlight a mistake in my comment until I saw Reza's nails and backed off 😁
😅😅
Simply, thank you!!
great job and thank you!
Thanks 😊
Great Video
explaining good
Thankq soo much
Well done!
helpful
Awesome!
vey helpful :-)
Append is like union all
That is right :)