Managed Airflow Instance with Google Cloud Composer | Product Spotlight | Google Cloud Platform

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 ต.ค. 2024
  • In the first product spotlight video, we are covering Google Cloud Composer, a fully managed Airflow service.
    Composer provides a highly available and scalable Airflow installation with awesome monitoring and logging out of the box.
    Composer leverages lot of other Google Cloud Services such as Google Kubernetes Engine, Google App Engine, Google Cloud Storage, Cloud PubSub and more.
    ___________________________________________________________________
    Cloud Composer Versions : cloud.google.c...
    Sample DAG : gist.github.co...
    ___________________________________________________________________
    I regularly blog and post on my other social media channels as well, so do make sure to follow me there as well.
    Medium ► lnkd.in/dPu9iKi
    GitHub ► github.com/kay...
    LinkedIn ► lnkd.in/d5AtTna
    TH-cam ► lnkd.in/dt-XAWY
    #GoogleCloudPlatform #GoogleComposer #Airflow

ความคิดเห็น • 27

  • @presha8041
    @presha8041 8 หลายเดือนก่อน

    Can you add the provider package here, i am trying to add mongo db but i am failing to add its provider package here

  • @khurramkhan5878
    @khurramkhan5878 7 หลายเดือนก่อน

    hello sir i m creating composer environment but here is image version please assist me how to create

  • @anonymous-ze5fg
    @anonymous-ze5fg 2 ปีที่แล้ว +5

    great content, please make more video on this GCP composer and GKE with airflow,

    • @khurramkhan5878
      @khurramkhan5878 7 หลายเดือนก่อน

      hello sir i m creating composer environment but here is image version please assist me how to create

  • @ExploreWithArghya
    @ExploreWithArghya ปีที่แล้ว

    Sushil.. I'm really messed up with airflow cost.. Please tell me how configure airflow_monitoring - schedule interval ?

  • @kakaji_cloud8106
    @kakaji_cloud8106 4 หลายเดือนก่อน

    Do we need to pay for Composer , even if any process is not running in composer?

    • @kaysush
      @kaysush  3 หลายเดือนก่อน

      Yes. The machines for running scheduler are always running.

  • @shivakumaryadav8997
    @shivakumaryadav8997 2 ปีที่แล้ว +1

    Hi Sishil
    Great video.
    Can you help or make a video on how to Create a basic Airlfow DAG to move a csv file from one location to another.

  • @dineshkakade9979
    @dineshkakade9979 2 ปีที่แล้ว +2

    great video to understand composer

  • @justdoittomorrow7119
    @justdoittomorrow7119 3 ปีที่แล้ว +2

    Really insightful.Thanks Sushil

  • @amnihs394
    @amnihs394 2 ปีที่แล้ว +2

    Good work, it is really helpful. Thanks a lot

  • @bagesh1
    @bagesh1 2 ปีที่แล้ว +2

    Great content and explanation

  • @sudhirkenguva4095
    @sudhirkenguva4095 2 ปีที่แล้ว +1

    Hi Sushil, Thanks for this great content, Please make video of using git with cloud composer

    • @khurramkhan5878
      @khurramkhan5878 7 หลายเดือนก่อน

      hello sir i m creating composer environment but here is image version please assist me how to create

  • @dileepreddy7469
    @dileepreddy7469 2 ปีที่แล้ว +1

    Great content and very informative. Keep up the good work. Cheers☺️

  • @DileepKumar-ko6cy
    @DileepKumar-ko6cy 2 ปีที่แล้ว +1

    Great video and clear explanation ,Thank you so much 👍

  • @saleenapatel
    @saleenapatel ปีที่แล้ว +1

    awesome video

  • @pratikshirbhate8026
    @pratikshirbhate8026 ปีที่แล้ว

    Very well explained. Just one question, do we need additional compute instance or gke instance to execute compute intensive functions like training a machine learning model, or processing a data from GCS bucket?

  • @DileepKumar-ko6cy
    @DileepKumar-ko6cy 2 ปีที่แล้ว

    Very Good Content ,Could you create more videos on GCP .Thank you so much for putting your efforts 👍

  • @leleuf3
    @leleuf3 2 ปีที่แล้ว

    What a video! Thanks Man! You’re the best!!! I catch a legacy project and I’m suffering to build the same environment to run my tests. I don’t know where to seek help. I’m newbie in GCP. I have no idea if I run the tests in my local computer or if I use a copy of the project in the cloud, but the second option I have no idea how to do.

  • @amalkumar5201
    @amalkumar5201 ปีที่แล้ว

    Sir i want to join your session gco

  • @ATPuKc
    @ATPuKc ปีที่แล้ว

    Great video! Thank you very much

  • @dharmendra811
    @dharmendra811 2 ปีที่แล้ว

    You are amazing man, please make more videos on composer and dataflow

  • @febriyantabidin
    @febriyantabidin 2 ปีที่แล้ว

    great explain about the product

  • @JenilCalcuttawala
    @JenilCalcuttawala 2 ปีที่แล้ว

    Great content & explanation.!

  • @udaypatel83
    @udaypatel83 2 ปีที่แล้ว

    Good explanation! Thanks a lot

  • @binoypaul4030
    @binoypaul4030 2 ปีที่แล้ว

    Awesome - please make more use cases on this topic