this was helpful. But how to load data , if there is only one filename and the data is updated within the file based on date. For eg: We have data in a csv file till feb 8 2023, now they added data of the next 7 days within the same file( from feb 9 to feb 15 ) . How will you add it through SSIS? For each loop wont work because its not taking separate files.. @learn SSIS
how to remove the one month older files in a folder when we are saying to remove the specified files in the database .those files have to delete.for example if i insert the ram in the database table then in the folder with the name ram files one month older have to delete.
Hi, I have created a video about how to delete more than 3 months older files from a folder th-cam.com/video/rTKfMVWIc2M/w-d-xo.html Now in your case there are 2 major things 1. Get the file name from sql table and store it in an object variable. Use foreach loop container with ado enumerator and loop through all files those you got in object variable. 2. Delete the file if it is more than 1 month old. At the moment I am out of station, I can try to make a video once I will be back.
In File system deployment, if someone changes or replaces the existing package then i want to send email alert. Mail contains details like User name who replaced/changed ssis packages, date time of both packages (old & new pkg) when package got replaced, pkg size of both packages.
I have personally never used this one but there is a FileSystemWatcher class in C# which can be used for this one, so may be you can write a C# console app or may be an SSIS package and in the SSIS package you can write the code in the script task. stackoverflow.com/questions/721714/notification-when-a-file-changes
Before creating a sql table inside execute sql task, put this query IF NOT (EXISTS (SELECT * FROM INFORMATION_SCHEMA.TABLES WHERE TABLE_SCHEMA = 'dbo' AND TABLE_NAME = 'Person')) Replace the Person with actual table name, then it will only create a sql table if tables does not exists.
@@garibhasanov3705 With the dynamic column mapping Do you mean if you have 10 CSV files and you want to import all CSV files into 10 sql server tables and if tables are not there in database then create the table and import all CSV files from a folder to a database ?
@@learnssis No. Please watch this video. There is video but its not so clearly to understand th-cam.com/video/Szuiy1GbkMs/w-d-xo.html&ab_channel=COZYROC
Thank you always for your insightful Videos
Thank you Debby.
this was helpful. But how to load data , if there is only one filename and the data is updated within the file based on date. For eg: We have data in a csv file till feb 8 2023, now they added data of the next 7 days within the same file( from feb 9 to feb 15 ) . How will you add it through SSIS? For each loop wont work because its not taking separate files.. @learn SSIS
You can use lookup transformation to identify and load the new records. Take a look at this video
th-cam.com/video/8dRIjVhKoKs/w-d-xo.html
can you create a video of how to refresh powerbi report/dashboard with ssis?
I am sorry but I don't have any idea how refresh of powerbi report/dashboard is done.
how to remove the one month older files in a folder when we are saying to remove the specified files in the database .those files have to delete.for example if i insert the ram in the database table then in the folder with the name ram files one month older have to delete.
Hi, I have created a video about how to delete more than 3 months older files from a folder
th-cam.com/video/rTKfMVWIc2M/w-d-xo.html
Now in your case there are 2 major things
1. Get the file name from sql table and store it in an object variable. Use foreach loop container with ado enumerator and loop through all files those you got in object variable.
2. Delete the file if it is more than 1 month old.
At the moment I am out of station, I can try to make a video once I will be back.
In File system deployment, if someone changes or replaces the existing package then i want to send email alert.
Mail contains details like User name who replaced/changed ssis packages, date time of both packages (old & new pkg) when package got replaced, pkg size of both packages.
I have personally never used this one but there is a FileSystemWatcher class in C# which can be used for this one, so may be you can write a C# console app or may be an SSIS package and in the SSIS package you can write the code in the script task.
stackoverflow.com/questions/721714/notification-when-a-file-changes
Could we use this logic to stop package if its a holiday?
I have created below video to skip running the package if it is holiday
th-cam.com/video/bqiMuGJGFzc/w-d-xo.html
@@learnssis awesome thanks!
iam getting error "There is already an object named in the database"
Before creating a sql table inside execute sql task, put this query
IF NOT (EXISTS (SELECT * FROM INFORMATION_SCHEMA.TABLES WHERE TABLE_SCHEMA = 'dbo' AND TABLE_NAME = 'Person'))
Replace the Person with actual table name, then it will only create a sql table if tables does not exists.
Please take a video for dynamic column mapping
Can you please elaborate more, what do you mean by dynamic column mapping ?
@@learnssis Can you please search over internet "ssis dynamic column mapping"
@@garibhasanov3705 With the dynamic column mapping Do you mean if you have 10 CSV files and you want to import all CSV files into 10 sql server tables and if tables are not there in database then create the table and import all CSV files from a folder to a database ?
@@learnssis No. Please watch this video. There is video but its not so clearly to understand
th-cam.com/video/Szuiy1GbkMs/w-d-xo.html&ab_channel=COZYROC
DTS Script Task : Runtime error
at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)
at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()