Hi Rohan, thank you for sharing the knowledge with such a great content. Your videos helped me for preparing the interviews, thank you for that as well. Following is the question that I am thinking about for a long time, please reply back if possible with a recommended solution - Suppose we have a target (file/table) having 120 columns/fields in it and apart from the primary/unique key columns, say around 70 fields can be update. Any number of fields from these 70 can be update in a single run. So how can we know due to which particular fields the update has occurred? or in other words, if we want to find only those fields which are changing its value from the previous run for a set of records. Thanks in advance
This is possible but with custom solution. Inside tmap you need to lookup against target first and then compare values, if something is changed, you may want to capture the field name and keep appending and add it to a custom column at the end or capture it a separate table..
@@LearningwithRohan "Comparing the main and lookup fields in tMap is feasible only when there is 20-30 or may 50 fields. But if the no.of fields needs to compare is more than that it will be difficult to apply these many conditions manually". This type of replies I had got in past during my interviews so I thought there might be some other ways as well to do this. But I don't know if we have anything else to do here. BTW Thank you very much Rohan 😊 Please keep posting such meaningful and learning contents for the users.
Logic should build to identify each record having any duplication if so then skip those records instead of failing the job and dump those failed records in separate table . Can we achieve this in Talend using the components?
![🔴 ฟุตบอลแชมป์กีฬา 7HD แชมเปียน คัพ 2024 [รอบ 8 ทีมสุดท้าย] - ช่วงบ่าย](http://i.ytimg.com/vi/M0S_ReCIkxg/mqdefault.jpg)
![โอ้เธอช่าง... - บี้เดอะสกา ft. ต๋อง เทวัญ (Prod. by ป๋าเพชร) [Official MV]](http://i.ytimg.com/vi/zbWhiLFmVL0/mqdefault.jpg)
This helped me find a unique constraint at my employer's Production environment. Thanks for posting!
You are welcome
very helpful.thanks. you explained in easy n clear way
Happy Learning
Thanks for helping to others from your channel keep it up😀
Welcome! Check out my website talendpro.com and download my mobile app!
Great explanation! Thanks for making this video! The timestamps are useful as well!
Ways to find duplicates:
1. Group by and Having
2. Window function (cte, row number)
3. Analytical (case, when, lag)
Yes 👍
Good info
hello,when i'm using many left join i get duplicate rows. and how to tuning it without to using row_number to delete that
Hi Rohan, thank you for sharing the knowledge with such a great content. Your videos helped me for preparing the interviews, thank you for that as well.
Following is the question that I am thinking about for a long time, please reply back if possible with a recommended solution -
Suppose we have a target (file/table) having 120 columns/fields in it and apart from the primary/unique key columns, say around 70 fields can be update. Any number of fields from these 70 can be update in a single run. So how can we know due to which particular fields the update has occurred? or in other words, if we want to find only those fields which are changing its value from the previous run for a set of records.
Thanks in advance
This is possible but with custom solution. Inside tmap you need to lookup against target first and then compare values, if something is changed, you may want to capture the field name and keep appending and add it to a custom column at the end or capture it a separate table..
@@LearningwithRohan "Comparing the main and lookup fields in tMap is feasible only when there is 20-30 or may 50 fields. But if the no.of fields needs to compare is more than that it will be difficult to apply these many conditions manually". This type of replies I had got in past during my interviews so I thought there might be some other ways as well to do this. But I don't know if we have anything else to do here.
BTW Thank you very much Rohan 😊
Please keep posting such meaningful and learning contents for the users.
Logic should build to identify each record having any duplication if so then skip those records instead of failing the job and dump those failed records in separate table . Can we achieve this in Talend using the components?
Yes possible multiple ways - sort - aggregate - tmap.. download my app from talendpro.com
Hi, how to reconcile quickly?
And how to find out if the reference IDs are matching or not quickly?
Download my mobile app from talendpro.com for free group chat and free resources
Wow, loved it man. Superb way taught🫡❤
You’re welcome
Can we do it by self join?
Yes possible
Can you post more videos on Talend on cloud environment.
Ya, more coming on talend
Can you make one mini project in Talend sir
Next month
I recommend everyone to get strong on SQL as well.. pls don’t neglect sql
What is cte_src?
That’s the CTE block
How can we delete rows using CTE and rownum
Are you referring to sql server? Or mysql?
MySQL