Airflow in Practice Stop Worrying Start Loving DAGs - Sarah Schattschneider

แชร์
ฝัง
  • เผยแพร่เมื่อ 14 ต.ค. 2024

ความคิดเห็น • 33

  • @Shambo271
    @Shambo271 3 ปีที่แล้ว +7

    Excellent presentation. It's clear that you use Airflow, know Airflow and your pacing (during the presentation) is perfect. Thank you for the help.

  • @DodaGarcia
    @DodaGarcia ปีที่แล้ว

    What a fantastic talk! I've been using Airflow for a few days now and this cleared up a lot of the lingering questions I still had.

  • @stanchen8634
    @stanchen8634 4 ปีที่แล้ว +36

    16:48 Isn't it the 3rd of every month at 10;05 in the morning?

  • @ajeetis
    @ajeetis 4 ปีที่แล้ว +6

    Great talk! Very well explained for all airflow beginners.

  • @ssb26
    @ssb26 3 ปีที่แล้ว +2

    Very useful session, serves as a good introduction to everyone who would like to learn about Apache Airflow.

  • @okechukwuudokoro8157
    @okechukwuudokoro8157 4 ปีที่แล้ว +2

    Awesome presentation. I got a better understanding of Airflow. The concepts were explained in simple terms

    • @me_buckbeak7389
      @me_buckbeak7389 4 ปีที่แล้ว

      Hi , do you know how to call a yml file from another Linux server to Airflow server through DAG ? The yml consists Linux service restart.

  • @yannickpezeu3419
    @yannickpezeu3419 2 ปีที่แล้ว

    thanks for this perfect presentation

  • @imrankhakwani
    @imrankhakwani 3 ปีที่แล้ว

    Very useful presentation. Thank you.

  • @prateekshrivastava7733
    @prateekshrivastava7733 3 ปีที่แล้ว +1

    nice explanation.. Thanks.

  • @upendramb7456
    @upendramb7456 4 ปีที่แล้ว +1

    Can Airflow be used run tasks on hosts outside of kubernetes, as some apps run on dedicated hosts?

    • @ShashankSingh
      @ShashankSingh 3 ปีที่แล้ว

      I am guessing, if such an operator doesnt exist already you can write it for yourself. but IIRC aws batch operator, python virtualenv operator exists

  • @hannimedable
    @hannimedable 4 ปีที่แล้ว

    Thanks for the presentation! One part still unclear for me about ETL, maybe someone can answer me here.\
    If we work with really big DB like 10Tb, should DAG select all data and download it to airflow instance, and then load it to BigQuery or something else? Or DAG should split job and download data with batches?

    • @me_buckbeak7389
      @me_buckbeak7389 4 ปีที่แล้ว

      Hi , do you know how to call a yml file from another Linux server to Airflow server through DAG ? The yml consists Linux service restart.

  • @맛있는치킨-s4k
    @맛있는치킨-s4k 4 ปีที่แล้ว +1

    It was a nice talk! Thank you for sharing your excellent story!

  • @kannappansirchabesan8577
    @kannappansirchabesan8577 4 ปีที่แล้ว

    Very good talk. Thank you

  • @rahulthomas5
    @rahulthomas5 4 ปีที่แล้ว

    Hello, i would like to know whether there is a way airflow can use autosys job as a dependent job.

    • @me_buckbeak7389
      @me_buckbeak7389 4 ปีที่แล้ว

      Hi , do you know how to call a yml file from another Linux server to Airflow server through DAG ? The yml consists Linux service restart.

  • @ashrafalkibsi
    @ashrafalkibsi 4 ปีที่แล้ว +1

    now I love Airflow even more

  • @rajanjoseph4877
    @rajanjoseph4877 4 ปีที่แล้ว +1

    Very useful 👍

  • @brothermalcolm
    @brothermalcolm 2 ปีที่แล้ว

    directed acyclic dag

  • @dsinghr
    @dsinghr 4 ปีที่แล้ว +11

    good that she finds time to write DAGs after running around jungles in Hunger games

  • @konutek7716
    @konutek7716 3 ปีที่แล้ว

    Cool

  • @jakerutherford5716
    @jakerutherford5716 3 ปีที่แล้ว +9

    Didn't know Jennifer Lawrence was so knowledgeable about Airflow

  • @ThangTran-jv7mm
    @ThangTran-jv7mm 4 ปีที่แล้ว +6

    I didn't know Jennifer Lawrence was also a talented developer as well. =D

    • @beixu9998
      @beixu9998 4 ปีที่แล้ว

      hah!!!, I thought the same!

  • @user-pp3xq1ot8l
    @user-pp3xq1ot8l 3 ปีที่แล้ว

    You are looking so beautiful... flawless, very attractive n natural !!!

  • @_Machiavel_
    @_Machiavel_ 4 ปีที่แล้ว

    lot off blala