In this video, we learnt about additional column in Copy activity of ADF pipeline #azuredatafactory #adf #azuresynapseanalytics #synapseanalytics #microsoft #azure #cloud
you are adding column, let say in ADLS one csv file which contain four column and requirement is we need to push two column in one folder and two columns in another folder and target is ADLS Gen2
You need to use dataflow in ADF. Inside dataflow, create two branches of source. Use select transformation in each of the branch and select the required column. Add two sinks respectively pointing to the resp folders
actually I replied to the panel using dataflow using select transformation we can achieve this but panel stresed on how to achieve using copy activity and panel pretty sure that we can achieve using copy activity, I was blank but you explained very well and these days panel attacking on candidates with mental brutality😀
@@SantoshKumar-yr2md If the req is to use copy activity, then probably you need to use 2 copy activities pointing to same source but different sink, and in mapping tab delete the respective unwanted columns from each of the copy activity.
Thanks for uploading videos...i am interested in doing the certifications also...which one is better for azure developers and helps in getting the better job....Thanks in advance.
Only one query , as we are trying to generate the file_path but the output have file name instead of relative file path. please help me on this .
you are adding column, let say in ADLS one csv file which contain four column and requirement is we need to push two column in one folder and two columns in another folder and target is ADLS Gen2
You need to use dataflow in ADF. Inside dataflow, create two branches of source. Use select transformation in each of the branch and select the required column. Add two sinks respectively pointing to the resp folders
actually I replied to the panel using dataflow using select transformation we can achieve this but panel stresed on how to achieve using copy activity and panel pretty sure that we can achieve using copy activity, I was blank but you explained very well and these days panel attacking on candidates with mental brutality😀
@@SantoshKumar-yr2md If the req is to use copy activity, then probably you need to use 2 copy activities pointing to same source but different sink, and in mapping tab delete the respective unwanted columns from each of the copy activity.
will try thanks@@azurecontentannu6399
Thanks for uploading videos...i am interested in doing the certifications also...which one is better for azure developers and helps in getting the better job....Thanks in advance.
Related to data engineering: Az900, Dp900, Dp203
Thanks for reply and which one should we take first
@@shivab4048 Az900 is azure fundamentals
@@azurecontentannu6399 I have one doubt. need your help
Great Content. Appreciate your effort in making this !!
Thank you so much 😊
God level content , Thanks mam.