How to write your first DAG in Apache Airflow - Airflow tutorials.

แชร์
ฝัง
  • เผยแพร่เมื่อ 14 ต.ค. 2024

ความคิดเห็น • 32

  • @chayanshrangraj4298
    @chayanshrangraj4298 ปีที่แล้ว

    Great tutorial! I literally picked up my laptop to check the air noise. lol.

  • @yashrajsinghrana9756
    @yashrajsinghrana9756 3 ปีที่แล้ว +3

    yeah waiting for more videos please continue this series

    • @lordozb
      @lordozb 3 ปีที่แล้ว +1

      I have left qubole so won't be uploading anything here :(

  • @spradhan36
    @spradhan36 2 ปีที่แล้ว +1

    The airflow videos are really nice, but can you please create a playlist. Because I don’t find the upcoming vides !

  • @邱政亞
    @邱政亞 2 ปีที่แล้ว +1

    why i add a new dag file, but airflow webserver ui no show the new dag, but airflow dags list command already exist

  • @deejaysnake
    @deejaysnake 4 ปีที่แล้ว +5

    Thank you! It was simple and fully understandable!

    • @lordozb
      @lordozb 4 ปีที่แล้ว

      Thanks :)

  • @yogeetadevghare443
    @yogeetadevghare443 ปีที่แล้ว

    Hello all, i am new to apache airflow... I have used talend tool for etl ...
    I had one doubt that can we create and run Dag without apache airflow tool?

  • @AnandP2812
    @AnandP2812 2 ปีที่แล้ว

    Hi. Thanks for the great tutorial. I am new to Airflow, and could you show me an example of how to implement bigquerytocloudstorageoperator into the code, please? Thanks.

  • @rhejromanov485
    @rhejromanov485 3 ปีที่แล้ว +1

    your videos are great.
    feedback: enter the sequence number in the title for orientation.

  • @evilmonk4339
    @evilmonk4339 3 ปีที่แล้ว +1

    More videos on apache airflow please

  • @younusmohammad6050
    @younusmohammad6050 4 ปีที่แล้ว +5

    Brother waiting for more videos :-)

  • @shivangitomar5557
    @shivangitomar5557 3 ปีที่แล้ว +1

    The best videos!!!

  • @ludmillatsurumaki7453
    @ludmillatsurumaki7453 3 ปีที่แล้ว

    Hi! Great Video!
    My DAG does not appear on the DAGs' list. Do you have any clue about what may be the problem?

  • @adityasvasisht4743
    @adityasvasisht4743 4 ปีที่แล้ว +1

    Hi! Great beginner friendly videos! Love it!
    I have a question. So I have created a python script that sends email to a bunch of people using the Gmail API. Now I want to schedule this script on airflow but I can't seem to import Google's API modules.
    When I run the webserver, airflow UI tells that my dag is broken as module is not found. Is there a way to import other modules such as 'googleapiclient' into airflow?
    Am I using airflow correctly? I'm trying to create an ETL pipeline where I extract data from an external API, transform the data using pandas and load the data into Google sheets and then send email if all the three processes before is executed without any error.

  • @astiksachan8135
    @astiksachan8135 3 ปีที่แล้ว

    Video was great and easy to understand , Thanks :D

  • @astiksachan8135
    @astiksachan8135 3 ปีที่แล้ว

    Can you add the link for the Github for the Slides you used ?

  • @priyankayadav-fx5ks
    @priyankayadav-fx5ks 3 ปีที่แล้ว

    How dag_1 file will go on server..?

  • @shobhaiyer4669
    @shobhaiyer4669 3 ปีที่แล้ว

    Fantastic video

  • @raajeshmoorthy29
    @raajeshmoorthy29 3 ปีที่แล้ว

    Hi, Can we schedule for updating data into tables for multiple mysql database?? And How?

    • @lordozb
      @lordozb 3 ปีที่แล้ว

      You can use MySQL operator for that

  • @mubashirali9396
    @mubashirali9396 2 ปีที่แล้ว

    What is the editor u used

    • @lordozb
      @lordozb 2 ปีที่แล้ว

      sublime text

  • @pragyanarang8461
    @pragyanarang8461 3 ปีที่แล้ว +1

    Why we use from before import?

    • @suryavamsi7508
      @suryavamsi7508 3 ปีที่แล้ว

      if you want to import particular method from that module

  • @martinmagana4688
    @martinmagana4688 3 ปีที่แล้ว

    lol, don't think we didn't see that register message pop up! buy sublime text already! it's a great editor

  • @tharukamuthumali997
    @tharukamuthumali997 3 ปีที่แล้ว

    Thank you so much!

  • @leandroroberto1593
    @leandroroberto1593 3 ปีที่แล้ว

    my airflow show this...
    Only works with the Celery or Kubernetes executors, sorry

  • @davidk7212
    @davidk7212 ปีที่แล้ว

    Hello sir. Please redo new video in Hindi.

  • @adityasvasisht4743
    @adityasvasisht4743 4 ปีที่แล้ว +2

    Hi! Great beginner friendly videos! Love it!
    I have a question. So I have created a python script that sends email to a bunch of people using the Gmail API. Now I want to schedule this script on airflow but I can't seem to import Google's API modules.
    When I run the webserver, airflow UI tells that my dag is broken as module is not found. Is there a way to import other modules such as 'googleapiclient' into airflow?
    Am I using airflow correctly? I'm trying to create an ETL pipeline where I extract data from an external API, transform the data using pandas and load the data into Google sheets and then send email if all the three processes before is executed without any error.