42. Lookup Activity in Azure Data Factory

In this video, i discussed about Lookup Activity in Azure Data Factory
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
#Azure #ADF #AzureDataFactory

[@shwetarawat4027]

Very helpful video, I was exactly looking for this

[@mr.prasadyadav]

Thank you nice Lecture , if it's possible do with complete scenario we should understand very clearly .

[@padmanabhareddym4146]

Make sure you create all required prerequisites and execute the pipelines we well.

[@aditikadam5609]

Your videos are very helpful

[@aditikadam5609]

Can you make a video on how to use lookup activity for csv files ?
I want to get values from one column of csv file which I have in datalake

[@Globetrotter0510]

Thanks for the clear explanation

[@WafaStudies]

Welcome

[@rajunadimpalli9636]

God bless you...you are wonderful

[@prajwalujjani8784]

Hi I understand this one....Can you please Explain by connecting to sql server so it makes more sense

[@sambasiva_368]

Can we use U-SQL activity in place of lookup activity? Because, in both the scenario we are querying on a db and fetching the values.
If we can't ? Please share the difference between u-sql and lookup activity?

[@balamanikanta1907]

Hi maheer,
Update query in lookup actually updating the table but with failure message.
Can you please suggest any workaround for this.

[@tejpatnala709]

hi brother,, doest it require to add .firstRow.FoderName part in dataset parameter value in case 1 , i guess it is already filtering the required folder name from activity output by enabling only first row option, so why to hardcode again entire parameter value with firstrow.FolderName, @activity('Lookup')output.firstRow.FoderName)
it means it cannot just give the exact value (output1) by enabling first row only option, iguess it will work since we are actually filtering folder name from table by select query statement..
explination ???please crt me......

[@kirill_mizko]

Thanks you!!!!!!

[@WafaStudies]

Welcome 🤗

[@venkatraohyd]

Where exactly the select doldername from....table is getting executed? Meaning in which DB? You created a DS with on existing sql sb right. Help me to understand this point please.❤

[@satyanagaraju]

Hi...your putting lot of efforts to make these vide'os..just add 10% more effort to make the lab..so that your channel become to next level (high)

[@allshort6436]

What if i need to deal with 10000 record?? Is there any way to push the limit from 5000 to more!!!

[@Deva21v]

Is it similar to SSIS execute SQL task?

[@AjEzqa]

For the first requirement you used output.firstRow.FolderName but in the second requirement you used just @item{}. Wouldn't this give the whole row i.e. both the columns? how will it pick just the second column FolderName for each item?

[@rahulkv7166]

in second case its output.value and in copy it will be @item{}.columnn_name

[@pragyakhare1274]

In copy activity sql query we have selected only 1 column ie outputFoldername, so it will take only foldername column from the table.

[@purushothamnaidu5544]

Can someone please explain the difference between lookup activity and get metadata activity...Also explain me when we are going to use LookUp activity and Get Metadata activity in realtime, that would really really helpful to me, Thanks in advance!!

[@kandasamyarunachalam3321]

In Get meta data activity, it will fetch th data of the file like name,sizez,type ,but in look up activity it will read and retrieve the data present inside the file..
Anyone can correct me if I'm wrong 👍

[@pedja2518]

Thanks

[@WafaStudies]

Thank you for super thanks 🤗

[@sarc007]

Jazakallah Khair for sharing this video :) . I would like to connect with you on this :)

[@chandrasekharthiyagarajan9634]

Hi Can someone help me with below error "Failed to convert the value in 'folderPath' property to 'System.String' type." I followed the same steps as like in video but got above error in "Copy Activity". Any help is highly appreciated.

[@samsheertc]

Map like this folder=@item().FolderName in the Copy Activity->Sink

[@thatikondakrishna7590]

@@samsheertc Thanks bro. It helped me 👍

[@sonamkori8169]

Please provide the links in the description which u have showed in the video

[@WafaStudies]

Thank you for feedback. Will do that in upcoming videos

[@apsram1]

can we use the output of look up activity in a SQL of source in copy activity?

[@syedzubairhussaini333]

Yes

[@naveenshindhe2893]

Hi, Can we execute insert SQL like below in Lookup activity.. please let me know.
insert into Table1 (Column1) Select ('test1');
select x;

[@likhithramesh9065]

Lookup is to query and fetch results. Insert isn't possible

[@subhashkomy]

Brother you didn't run this after completing. This won't work. You missed foldername parameter in Sink after @item(). It should be @item().foldername

[@tejpatnala709]

thats what i am thinking, either he added wrongly in first case( @activity('Lookup')output.firstRow.FoderName) or he missed foldername in second case (@item().foldername) which was wrong ?
also doest it require to add .firstRow.FoderName part in dataset parameter value in case 1 , i guess it is already filtering the required folder name from activity output enabling only first row option, so why to hardcode again entire parameter value @activity('Lookup')output.firstRow.FoderName)

[@gurupradeep9648]

Thanks, brother. I tried to execute it but failed with an error. Fixed it by adding the folder value

[@MrManishelectra]

Hey.. what is the diffrence between lookup activity and get Metadata activity?

[@babuganesh2000]

Metadata works with limited connectors, Lookup has wide variety of connectors and also by default it returns 1 row. I think lookup and copydata activity works hands to hand

[@UmerPKgrw]

In each video, u tell about user properties :-( add it in title.

[@aqlanable]

we have general, settings and user proprties , if you want to see more about user proprties please check the previous video

[@mohamedhusain7807]

@@aqlanable 🤣