The speed is so perfect that I dont see a need to change. You cover things which I have not found in other videos till date and and thats make your technique of teaching so perfect. Thanks for a hard work you are putting on after this videos. They are really helpful
I consider myself a fast learner but I did not fully understand the concept of UPSERT after watching a bunch of videos on TH-cam. This video is by far the best on UPSERT. I now fully understand UPSERT. I am making it a point of duty to watch all your other videos. Thank you Aamir.
This is an awesome video. I enjoyed watching this video and recommend others. UPSERT functionality explained clearly and it;s used daily in the work place. I am sure all developers will like. This much time is needed to explain to address all levels of audiences. Thanks for educating the community and appreciate your volunteership. Thanks a bunch
You are an excellent Teacher and Keep Rocking. All your videos are like spoon feeding which is really amazing and makes you to concentrate more and more
Excellent!. This video refreshed my SSIS Skills. This is very useful and used on a day to day basis. Amir thank you very much for putting it together and explaining nicely.
Thanks a lot for the video this is really helpful for a beginner in SSIS. I have a doubt lets say we want to delete one entry from that list so how to do that.
Hi sir ur all videos very nice and very help to improve ssis knowledge .i want to get incremental load based source datetime column. I haven't seen such videos in TH-cam. Kindly upload based on datetime incremental load. Thanks in Advance Sathiya
Hi TechBrothersIT! Thank you so much! This is an excelent tutorial! I have one queston: how can I handling if I have 1 flat file and in this file contains more rows with same ID, but I don't want to insert into the sql table only the first one?
very good tutorial ..really helpful. however in my case the first look up is not able to find out the duplicate records(my flat file column names and table names are diff).can you help?
Hey great videos learnt a lot, when writing and mapping for updating a row you had only one condition like ssn=? and you mapped it but, what if there is two conditions like where ssn=? and firstname=? how to map that.
Hello Sir , hope you are doing good. Some videos helped me a lot in understanding the concept of SSIS. I have a quick question for you that in update statement can we use this condition : update tablename set column1=?, column2=? Where column3=? And column4=? Can we use 2 condition in where clause if yes can you please help me regarding this . I tried to use this condition but no luck.
great and useful video for me, Thanks a Lot Aamir . Here 1 have one doubt on how to to apply SCD type 2 , which one will be efficient and good in terms of performance the one using Script or the one using SSIS Package. I will be waiting for the video for best practice in SCD-2 implementation
@@TechBrothersIT Thank you A lot for taking out you valuable time and commitment to share your knowledge and skills which help to us to grow in our initial phase of career.
One query may be I am late here... SSN is the key column you used to insert row records, but while updating you are using combination of ssn, lastname etc.. Won't the ideal situation if we get same SSN then update the record irrespective of other column change values .. as we have SSN as the id column..
Thanks for the Tutorial, i'm clear now And i have a question ( since i'm very newbie in ssis) Do you have any tutorial that is somekind like this : When the insert or Update Success, it will Update the LoadTime or the UpdateTime in the Source File ( on your tutorial you updated the destination) Thanks, Ronald
as far as i know you cannot update source file. you can create a new "source" file using flat file destination with whatever columns you have in the original source file and then use file system task to move the original source file to some other location (archive). As a developer you know you are creating a new file, but the user who just executes the package will think the source file is getting updated. do lemme know here if this method works for you.
I am using a merge join to do this but the performance is horrible as I have 2.1mil records. will your design work well for 2.1mil records? I have been trying few different ways but so far the performance is an issue. any thoughts?
2.1 million is not a big number. Not sure what exactly you are doing. If your dataset is too big , you can always load into staging table and then use join in tsql query ( that you can use as source) and further transform as required. Good luck.
Thank you for the confirmation Aamir sb. I would also like to know if i can incorporate a DLL file into SSIS. I have created a project. It picks up data from a database. Now i want to perform some validations checks (which are in my DLL) before i post it into my LIVE database... How do i do this? Thanks in advance.
+suresh boga You are welcome. for SCD2, I would suggest to use Merge Statement. Please check below link. www.techbrothersit.com/2013/10/tsql-how-to-load-slowly-changing.html
Hi Team, Can please help on this issue. I have one senior like i needs to delete records row by row using ssis package. 1. I have a 1 TB live database 2. Have moved 75% data to staging database and while moving to staging tables have added insert and deleted columns in each table 3. Also moved staging data to archive database 4. Now i want to compare live & archive database and delete data in live database if data is match and also update deleted column in staging table I HAVE STRUCK IN STEP 4 Note: Delete records row by row and update deletion date in deleted column in staging tables with time & date
Hey i have a question ive been trying to implement this, but the error ive found is that it this works if the dimension already has info, correct me if im wrong but i would really could use some help
Hi. I have a QQ. I have the source table in SQL Server Database and the Target Table is in Oracle Database. And I'm dealing with in average 140000 records. Which is the best way to do the incremental load with two different databases used. This is an urgent request. Also, with the date field in SQL Server yyyy-mm-dd and in oracle is dd-MON-yy. How can I use that date field in both for update task in the conditional conflict task. OLE DB Command is slow in updating 140000 records. Kindly please advise.
Hi Emad Hanna, I will suggest you to write the data from SQL Server table to Oracle Staging table and then use update statement instead of using OLE DB Command Transformation. OLE DB Command Transformation perform operation on each row at a time, that make is slow.
The speed is so perfect that I dont see a need to change. You cover things which I have not found in other videos till date and and thats make your technique of teaching so perfect. Thanks for a hard work you are putting on after this videos. They are really helpful
Hi Ronak, I am glad to hear that you liked my effort. Thanks for kind words and leaving comments.
I consider myself a fast learner but I did not fully understand the concept of UPSERT after watching a bunch of videos on TH-cam. This video is by far the best on UPSERT. I now fully understand UPSERT. I am making it a point of duty to watch all your other videos. Thank you Aamir.
This is an awesome video.
I enjoyed watching this video and recommend others.
UPSERT functionality explained clearly and it;s used daily in the work place.
I am sure all developers will like.
This much time is needed to explain to address all levels of audiences.
Thanks for educating the community and appreciate your volunteership.
Thanks a bunch
You are an excellent Teacher and Keep Rocking. All your videos are like spoon feeding which is really amazing and makes you to concentrate more and more
Thanks for kind words Kishore and thanks for watching.
You Are Simply Supeb
Excellent!. This video refreshed my SSIS Skills. This is very useful and used on a day to day basis. Amir thank you very much for putting it together and explaining nicely.
You are the best Aamir!!! Your videos has almost covered everything in SSIS. Never seen so informative videos!! you did an awesome job!!
Thank you so very much for support. Glad to hear that you liked my work.
Thanku very much,there are many videos on ssis on youtube,but u r d best,it is not at all long,instead very informative.
You are very welcome. I am very happy to know that you liked my effort. Appreciate your comments and encouragement. Happy learning and all the best!
Thank you very much for considering the basic starter on ssis, you are indeed a very good teacher.
THANKS A LOT!!!
Really great video! I appreciate you taking the time going through each step thoroughly.
Thanks!
this long video deserved that time ,thank you sir !
Great tutorial. It's really helpful. I have some issues with update records and I can solve the issues after I have watched this vid. Thank you.
Great video sir. Thanks for waking up early and doing this!
Excellent ! Thank you for your patience. You were very well in your teaching. keep going. Mohammed
Thanks for kind words Mohammed, You are welcome and once again thanks for watching.
Great Tutorial! Great speed, I was using data from Excel and with minimal changes I had it working, thank you!
Thanks and you are welcome:) , Glad to hear that you liked my effort. Thanks for watching and leaving comments!
Thank you for going slow!! Very much appreciated!
You are welcome. Thanks for watching.
Thanks for making this videos, and also to make them long... It is easier to follow and very understandable...:)
Hello Amir Sir: This is very good video I don't thing is long, your approach is correct Thanks you.
Hi Dear, Thanks for kind words and liking my effort. Thanks for watching and support!
Hello Aamir and Raza, It´s a great video ... thanks a lot from Brazil
Highly appreciated efforts
It's a really nice video!! but as per the video title why u don't give an example on SCD (Slowly changing Dimension) Transformation?
Thank you...You are such a great teacher!!! Excellent skill.....
Thank you for support.
thanks Amir!
Thanks a lot for the video this is really helpful for a beginner in SSIS. I have a doubt lets say we want to delete one entry from that list so how to do that.
Hi there, the tutorial was very helpful. It covered all cases in my dimention load.
it is great. you don't need to be faster than this brother. Thank u
Thank you dear for watching and leaving comments.
Hi sir ur all videos very nice and very help to improve ssis knowledge .i want to get incremental load based source datetime column. I haven't seen such videos in TH-cam. Kindly upload based on datetime incremental load.
Thanks in Advance
Sathiya
Hi TechBrothersIT! Thank you so much! This is an excelent tutorial! I have one queston: how can I handling if I have 1 flat file and in this file contains more rows with same ID, but I don't want to insert into the sql table only the first one?
Sir , Great Video hope you are well
Very good video ! Muchas gracias !
very good tutorial ..really helpful. however in my case the first look up is not able to find out the duplicate records(my flat file column names and table names are diff).can you help?
Hey great videos learnt a lot, when writing and mapping for updating a row you had only one condition like ssn=? and you mapped it but, what if there is two conditions like where ssn=? and firstname=? how to map that.
Hats off for you. Thank you so much for going slow.
Thank you, appreciate your comments.
Great tutorial
Can you please demonstrate how to add a modified record as a new row?
Great video. Thank you very much!
You are most welcome. Thanks for watching.
Excellent. Helped me out big time.
+Tom Jusits Glad to hear that it was helpful. Thanks for watching!
Awesome videos. Simple and complete. Hope this helps me crack the interview next week :p
+Shailesh Navghare good luck. Hope you did good in interview.
Great tutorial!
¡Gracias!
Thanks!
Thank you!!
fantastic tutorial, thank you!
i love this video.. so clear, so concise! thanks so much for all the thought and effort u put into this, very helpful :)
Thank you for kind words. Glad to hear that you liked it.
Thank You
You are welcome.
Thank you for wonderful video!!!!!!!!
You are welcome. Thanks for kind words
thank you!!!!!
you saved my day!! :)
Hello Sir , hope you are doing good. Some videos helped me a lot in understanding the concept of SSIS. I have a quick question for you that in update statement can we use this condition :
update tablename
set column1=?,
column2=?
Where column3=? And column4=?
Can we use 2 condition in where clause if yes can you please help me regarding this . I tried to use this condition but no luck.
Thank. You.
Thank you. It really helped!
You are welcome dear, thanks for watching.
Thank you. It really helps.
+Benjamin Tua Glad to hear that it was helpful. Thanks for watching!
great and useful video for me, Thanks a Lot Aamir . Here 1 have one doubt on how to to apply SCD type 2 , which one will be efficient and good in terms of performance the one using Script or the one using SSIS Package. I will be waiting for the video for best practice in SCD-2 implementation
Hi, you can take a look into this www.techbrothersit.com/2013/10/tsql-how-to-load-slowly-changing.html
@@TechBrothersIT Thank you A lot for taking out you valuable time and commitment to share your knowledge and skills which help to us to grow in our initial phase of career.
One query may be I am late here... SSN is the key column you used to insert row records, but while updating you are using combination of ssn, lastname etc..
Won't the ideal situation if we get same SSN then update the record irrespective of other column change values .. as we have SSN as the id column..
That was great ....
Thanks for the Tutorial, i'm clear now
And i have a question ( since i'm very newbie in ssis)
Do you have any tutorial that is somekind like this :
When the insert or Update Success, it will Update the LoadTime or the UpdateTime in the Source File ( on your tutorial you updated the destination)
Thanks,
Ronald
as far as i know you cannot update source file. you can create a new "source" file using flat file destination with whatever columns you have in the original source file and then use file system task to move the original source file to some other location (archive). As a developer you know you are creating a new file, but the user who just executes the package will think the source file is getting updated. do lemme know here if this method works for you.
great job sir
Thank you Aamir!
You are welcome!
I am using a merge join to do this but the performance is horrible as I have 2.1mil records. will your design work well for 2.1mil records? I have been trying few different ways but so far the performance is an issue. any thoughts?
2.1 million is not a big number. Not sure what exactly you are doing. If your dataset is too big , you can always load into staging table and then use join in tsql query ( that you can use as source) and further transform as required. Good luck.
dhunyawad
You are welcome dear!
Hi sir, all are your videos help to improve my knowledge .i m having doubt with incremental load data based on last execution date.may u kindly help
Thank you Aamir sb for the wonderful videos. For this "upsert" can i replace the text file with another SQL Server table?
thanks again.
You are welcome. Sure you can. Thanks for watching.
Thank you for the confirmation Aamir sb. I would also like to know if i can incorporate a DLL file into SSIS. I have created a project. It picks up data from a database. Now i want to perform some validations checks (which are in my DLL) before i post it into my LIVE database... How do i do this? Thanks in advance.
really used for me
Thank you very much Aamir for such a wonderful video
I want to look at remaining part of scd
can you please help me...
+suresh boga You are welcome. for SCD2, I would suggest to use Merge Statement. Please check below link.
www.techbrothersit.com/2013/10/tsql-how-to-load-slowly-changing.html
Hi Team,
Can please help on this issue.
I have one senior like i needs to delete records row by row using ssis package.
1. I have a 1 TB live database
2. Have moved 75% data to staging database and while moving to staging tables have added insert and deleted columns in each table
3. Also moved staging data to archive database
4. Now i want to compare live & archive database and delete data in live database if data is match and also update deleted column in staging table
I HAVE STRUCK IN STEP 4
Note: Delete records row by row and update deletion date in deleted column in staging tables with time & date
Tx
Hey i have a question ive been trying to implement this, but the error ive found is that it this works if the dimension already has info, correct me if im wrong but i would really could use some help
Im loading data from db to the dimension
I can do it with excel file?
yes, you can use the same technique for excel
What if you delete a record ?
Hi. I have a QQ. I have the source table in SQL Server Database and the Target Table is in Oracle Database. And I'm dealing with in average 140000 records. Which is the best way to do the incremental load with two different databases used. This is an urgent request. Also, with the date field in SQL Server yyyy-mm-dd and in oracle is dd-MON-yy. How can I use that date field in both for update task in the conditional conflict task. OLE DB Command is slow in updating 140000 records. Kindly please advise.
Hi Emad Hanna, I will suggest you to write the data from SQL Server table to Oracle Staging table and then use update statement instead of using OLE DB Command Transformation. OLE DB Command Transformation perform operation on each row at a time, that make is slow.
Thanks for going slow
Thank you. Take it slow. ! :)
You are very welcome :)