DAG Writing Best Practices in Apache Airflow

แชร์
ฝัง

ความคิดเห็น • 24

  • @atom
    @atom 3 ปีที่แล้ว +41

    They are sharing their code with 360p quality. Genius

  • @JasonZhang-se2jo
    @JasonZhang-se2jo 2 ปีที่แล้ว

    Your Guys are amazing , pass the airflow " kindness" to all the people who are looking forward to airflow : )

    • @Astronomer
      @Astronomer  ปีที่แล้ว

      Thank you so much!

  • @haliltaylan6181
    @haliltaylan6181 ปีที่แล้ว +3

    Did you record this with a toaster?

  • @wailshudar
    @wailshudar 3 ปีที่แล้ว +6

    If posting this video in 360p was suppose to be a joke. I'll tell you now that it ain't a good one.

    • @Astronomer
      @Astronomer  3 ปีที่แล้ว +2

      We upgraded our platform after realizing the quality issues and will be reshooting the content soon.

  • @chrisfalter5183
    @chrisfalter5183 2 ปีที่แล้ว +8

    Astronomer has published a handy summary of this presentation here: www.astronomer.io/guides/dag-best-practices
    The code from the webinar is published here: github.com/astronomer/webinar-dag-writing-best-practices
    Both resources are available and quite helpful.

  • @chrishanni2779
    @chrishanni2779 ปีที่แล้ว +2

    great video: can you do the next ones at higher resolution so we can read the code

    • @davyroger3773
      @davyroger3773 ปีที่แล้ว

      Seconded!

    • @Astronomer
      @Astronomer  ปีที่แล้ว

      Definitely, thanks for the feedback!

  • @brendoaraujo9110
    @brendoaraujo9110 2 ปีที่แล้ว

    Hello, I have an airflow running on my machine with Postgresql on the scheduler's backend and LocalExecutor, but when I put my dags to run it consumes a lot of server CPU, how could I solve this high consumption problem?

  • @ayushm777
    @ayushm777 2 ปีที่แล้ว

    How to get the different log and error info in two different files instead of one common log.?

  • @harshitsinghai1395
    @harshitsinghai1395 3 ปีที่แล้ว +5

    at least use 720p

  • @md.shahriarrahmanrana3866
    @md.shahriarrahmanrana3866 3 ปีที่แล้ว +5

    Can you please provide the files used here, its unclear and not readable at all :(

    • @Astronomer
      @Astronomer  3 ปีที่แล้ว +1

      You can find the example DAGs linked at the beginning of this article: www.astronomer.io/blog/dag-writing-best-practices-in-apache-airflow

    • @majorcemp3612
      @majorcemp3612 3 ปีที่แล้ว +1

      The link is broken "404 error"

    • @bitsofinfo8934
      @bitsofinfo8934 2 ปีที่แล้ว

      @@Astronomer where are the examples? there is no github link or source code in the link you have...

  • @cherrejim
    @cherrejim 3 ปีที่แล้ว +3

    Interesting but the quality of the video is very bad... but thanks for the content. What's is the best practices for historical loads? Make sense have a dag that will only execute once? Thanks

    • @Astronomer
      @Astronomer  3 ปีที่แล้ว +4

      We upgraded our platform after realizing the quality issues and will be reshooting the content soon.

    • @majorcemp3612
      @majorcemp3612 3 ปีที่แล้ว +2

      Hi, when is the "soon" ? 😅 It seems that a lot of people are waiting for a fix of this bad quality video 😅

  • @vahidshoeibinia498
    @vahidshoeibinia498 2 ปีที่แล้ว +1

    360p?????????

  • @erkansirin6849
    @erkansirin6849 2 ปีที่แล้ว

    Codes are not readable \: