Thankyou so much....with your help I got role in jpmc... however I am scared as I don't belongs to coding background ...how I will survive as data engineer
One more thing to confirm about depends_on_past is not correctlty explained,For example if we have two tasks task1 and task2 and suppose if dag starts to run and when task1 completes and if task2 fails ,and When next day dag runs and task1 runs and completes but it will not start task2 because the previous day task2 is in failed state ,so depends_on_past works in this way i,e it depends on the same task for the previous instances to see if it got completed.
Hi Saurabh ji, Thank you so much for the Airflow lecture. Could you please tell us about resolving error when we will select web server as Private Network. And if possible kindly share the codes also.
Very well structured,Thanks for the detailed explanation
Very nice video ❤ thank u so so much 😊
Salute you for your efforts and courage. Thank you Saurabh.
Thankyou so much....with your help I got role in jpmc... however I am scared as I don't belongs to coding background ...how I will survive as data engineer
Please create a video helm airflow and helm spark chart in kubernetes and submit a job in pyspark. Thank you sir ji so much for the video ❤❤❤
I think you need to use catchup in DAG.. instead of default_args . Your videos are very informative and easy to follow.. Thanks .
Great video 💯 Bro
... Thank alot..🤟
One more thing to confirm about depends_on_past is not correctlty explained,For example if we have two tasks task1 and task2 and suppose if dag starts to run and when task1 completes and if task2 fails ,and When next day dag runs and task1 runs and completes but it will not start task2 because the previous day task2 is in failed state ,so depends_on_past works in this way i,e it depends on the same task for the previous instances to see if it got completed.
Do you have whole content of glue & Emr
I'm intrested to learn , Please reply
Hi Saurabh ji, Thank you so much for the Airflow lecture.
Could you please tell us about resolving error when we will select web server as Private Network.
And if possible kindly share the codes also.
Sir your videos are very useful. Please post the video on AWS EMR on EKS.
Why simple_3.py file ran for 19times,I couldn't get why it ran for so many time ,Did you get to know whats the reson behind the run?