Backfill, catchup and how start date is determined in Apache airflow - Airflow Tutorials
ฝัง
- เผยแพร่เมื่อ 21 ก.ค. 2024
- In this episode, We will talk about how airflow determines the start date of a Dag Run. We will also pick up one of the most important concept which is catchup and see with the help of an example on how you can use catch up to backfill your data in Apache Airflow.
Get your free trial of Qubole: www.qubole.com/free-trial - วิทยาศาสตร์และเทคโนโลยี
Very Well Explained the concepts. thanks. Looking forward for few more advanced concepts as well.
Appreciate your efforts.
Thank you so much!
Great content! Subscribed!!
Really well explained videos .... looking forward for more
Thank you so much!
Hi, thanks for your video, very helpful. May I ask do you know if catchup applies to failed DAG runs? i.e. will it reattempt a DAG run that failed on a prior date?
Your videos are great, please upload more topics on airflow.
Yes, a lot more in the pipeline ;)
@@AadityaSharma04 Hope you have not resigned from Qubole ;)
@@MrSmarthunky Hahah Yes I have
Awesome man awesome
Hi....Can you make a video on Jenkins Operator usage in Airflow....Thanks
Very Nice videos..Can we vidoes on complicated python DAG scripts having file sensors and other operators like Bash Operator.....Would really appreciate..
Hey..need more videos..Your videos are Great..Please upload..
I have left Qubole so won't be uploading anything here.
Is it a full course of airflow?
can we make it to trigger on 13th mid night itself?
Set startdate as 12th then with interval as daily
Hey ! Why don't you come up with an advanced tutorial . Your videos are amazing .
Thank you so much!
We are taking it in a step by step manner. Advance topics will come but first we feel that we should cover up all the basics.
Where I get more videos?
Unfortunately, this is the last video in the series :(
when u continue this series ??
I have left Qubole so won't be uploading anything here.
@@AadityaSharma04 where then?
@@kritivarshney3200 Microsoft Azure