hi sir, i have a question, i have a source table data in project1 and i need a pipeline schedule weekly to etl new data from the source to the destination table in project2, Can i use Data Fusion or I need airflow to do this, (ps: I dont wanna user copy function)
@@anjangcpdataengineering5209 when I am trying add the file which is separated with delimiter , it’s throwing an saying body_21 can not be null and with similar errors. I want add the files how is it and do transformations later. (I am not able on header toggle also .. if I do throwing an error with some error connection.
informative session, excellent presentation
with out skip completed . thanks for your upload very useful content. your (Harish Reddy). waiting for next video........
Thanks 👍
Same here. Thank you for this tutorial.
Hi
Detailed tutorial. Excellent video!
Thank for this wonderful content ...
Thank you sir for the demo. 🙏
Thank You SIr . It is a wonderful session. can we expect videos from GCP Airflow topic
Please do a tutorial for dataform, how to make data transofrmations there
Hello just want to ask if the 1st demo is an example of ETL data pipeline? And the 2nd demo is it ELT?
hi sir, i have a question, i have a source table data in project1 and i need a pipeline schedule weekly to etl new data from the source to the destination table in project2, Can i use Data Fusion or I need airflow to do this, (ps: I dont wanna user copy function)
Yes you can use Datafusion , provide necessary IAM roles to Datafusion SA to access data from your source project
Hi Anjan, I added test Cvs file in gcs bucket manually but I am unable to open in cloud storage default. Could you please explain why?
@@harinireddy2875 are you not able to open the content of the CSV file ? Did you check the ACL of that bucket?
Yes, access is present
@@anjangcpdataengineering5209 when I am trying add the file which is separated with delimiter , it’s throwing an saying body_21 can not be null and with similar errors. I want add the files how is it and do transformations later. (I am not able on header toggle also .. if I do throwing an error with some error connection.
Please upload next video
Hi. , going throu some personal issues , sure will come back .
@@anjangcpdataengineering5209 no problem sir , hope your issues will get resolve soon🙂