Step 4 - Move the processed data into SQL Data Warehouse using Data Factory

By the end of this lab, you will be able to copy the data from data lake store to sql data warehouse using data factory.

[@AISHWAR04]

Really good video! One thing the place where we write scala code in notebook, after transforming the data i.e selecting required columns, can’t we write code in scala itself to write the transformed data to azure sql dw instead of creating a file in data lake?
Also, can we implement SCD2 in notebook using scala or python in spark and then load into dimension tables in azure sql dw?