I have a question, is there a way through the SCD component to keep a 'last modified' timestamp/date column up to date when using an SCD component. Instead of both the start and end date like displayed in your video?
Etechman WebDeveloper I guess custom SCD components are available for this. But with the default component I guess it is not possible. But I have achieved the same requirement with multiple components and not with a single SCD component.
Thank you for sharing your knowledge! I have one question to SCD Type 2! If i change like in your Video the price from one Product it will set the End_date column for all my Products and insert them all new again. Normaly he has only to change this Product, wich ein choose! Can you pleas anwser me this question? Best regards from Germany!
Can you please elaborate more? If a column is under SCD Type 2 change and if it undergoes a change, only that product details will be changed (i.e., only for that product a new line will be inserted and old one being updated), but it will not change for all the products which does not undergo any change in that particular column. To experiment this, take a source file and run the job. Just change only one product's value in the "same file" which undergo SCD type 2 and do not alter any other product. If you run the job again, you can notice that only that particular product will have 2 rows and rest of the products will be unchanged. If this did not happen, then I doubt that you might have done some mistake in configuring the SCD component.
Karthikeyan Balasubramanian Thank you for your answer! I I did it just like in the video I only have MySQL as the database not MSSQL. And I change only the price of one Product. The remaining products remain the same. I think it needs a merge component that checks what is new, what has changed or what was deleted or i am wrong? I saw the Video now 6 times :-)
Karthikeyan Balasubramanian Yes, I have the data as well. I have reproduced it. And if i change one product and delete the other products from the .csv File it will works fine. But if i change it in the video just one product and run the job (and not deletet the other not changed products) ist will set all the End_Date to getdate and insert them as new columns. But OK thank you for you help. I have learned a lot from this tutorial! I am a beginner in Talend and i have to learned now. So Thank you!
Informative..🙏
Thanks for this useful demo
Really nice tutorial for beginners :)
thanks for the video :)
Bro u have knowledge on talend sap
I have a question, is there a way through the SCD component to keep a 'last modified' timestamp/date column up to date when using an SCD component. Instead of both the start and end date like displayed in your video?
Etechman WebDeveloper
I guess custom SCD components are available for this. But with the default component I guess it is not possible. But I have achieved the same requirement with multiple components and not with a single SCD component.
Thank you for sharing your knowledge! I have one question to SCD Type 2! If i change like in your Video the price from one Product it will set the End_date column for all my Products and insert them all new again. Normaly he has only to change this Product, wich ein choose! Can you pleas anwser me this question?
Best regards from Germany!
Can you please elaborate more?
If a column is under SCD Type 2 change and if it undergoes a change, only that product details will be changed (i.e., only for that product a new line will be inserted and old one being updated), but it will not change for all the products which does not undergo any change in that particular column.
To experiment this, take a source file and run the job. Just change only one product's value in the "same file" which undergo SCD type 2 and do not alter any other product. If you run the job again, you can notice that only that particular product will have 2 rows and rest of the products will be unchanged.
If this did not happen, then I doubt that you might have done some mistake in configuring the SCD component.
Karthikeyan Balasubramanian Thank you for your answer! I
I did it just like in the video I only have MySQL as the database not MSSQL. And I change only the price of one Product. The remaining products remain the same. I think it needs a merge component that checks what is new, what has changed or what was deleted or i am wrong? I saw the Video now 6 times :-)
Tarikffm79 I think I have demonstrated with a live example (with data) and you could have noticed how the data is being changed in each run.
Karthikeyan Balasubramanian Yes, I have the data as well. I have reproduced it. And if i change one product and delete the other products from the .csv File it will works fine. But if i change it in the video just one product and run the job (and not deletet the other not changed products) ist will set all the End_Date to getdate and insert them as new columns. But OK thank you for you help. I have learned a lot from this tutorial! I am a beginner in Talend and i have to learned now. So Thank you!
Tarikffm79 Please let me know if you need any help. I will try to help you during my free time...