We add data into lakehouse through Dataflow Gen2 and then we created a pipeline activity in lakehouse by taking data from Dataflow Gen2, right?? Please correct me if I am wrong. My query is what is the need of adding Dataflow to pipeline?
Hi, thank you for your question. Dataflow Gen2 act as an activity in pipeline under data factory experience. If you just want to use the Data Flow Gen2, you cannot schedule it or trigger automatically. Suppose you want to do some automation where you are transforming data using Data Flows Gen2 and then load this data in a Data Warehouse then you need to use a pipeline to combine these activities and later you can schedule it. I hope this answers your query.
We add data into lakehouse through Dataflow Gen2 and then we created a pipeline activity in lakehouse by taking data from Dataflow Gen2, right??
Please correct me if I am wrong.
My query is what is the need of adding Dataflow to pipeline?
Hi, thank you for your question. Dataflow Gen2 act as an activity in pipeline under data factory experience. If you just want to use the Data Flow Gen2, you cannot schedule it or trigger automatically.
Suppose you want to do some automation where you are transforming data using Data Flows Gen2 and then load this data in a Data Warehouse then you need to use a pipeline to combine these activities and later you can schedule it.
I hope this answers your query.
Great information 🎉