GCP Composer | Airflow GCS to BigQuery and BigQuery Operators

แชร์
ฝัง
  • เผยแพร่เมื่อ 18 พ.ย. 2024

ความคิดเห็น • 17

  • @amulyapreethi4449
    @amulyapreethi4449 ปีที่แล้ว +2

    Thank you so much..that was details explaination where a person is very new to gcp like me also can get understand..thanks alot for helping out and making understand concepts. 👏

  • @dharmatejaadepu8597
    @dharmatejaadepu8597 ปีที่แล้ว +1

    Thank you so much sir , for the clear explanation.

  • @lifelearningneo
    @lifelearningneo ปีที่แล้ว +1

    This is awesome session I ever watch,, thank you so much sir,, One request can you show that production level code without hard codding , I need to understand that code flow please

  • @ravipandey7488
    @ravipandey7488 4 หลายเดือนก่อน +1

    Thank you for this awesome video, it explained the flow very well.
    Could you please also upload a similar video where we can loan on premise data in bigquery using composer.
    If the video is already there, please put the link in the comment.

  • @Solidux2
    @Solidux2 ปีที่แล้ว +1

    Gracias, excelente trabajo

  • @saintr392
    @saintr392 ปีที่แล้ว +2

    We need more on dataflow and composer part

  • @RaghavendraKalapatapu
    @RaghavendraKalapatapu ปีที่แล้ว

    Thank you for the video !! but i have one question on BQ Connection. where do you mention the connection string in BIGQuery operator or how do you map the BQ Connection to this DAG ? Thank you again for the videos !!very useful to watch

  • @Manuveerlapati
    @Manuveerlapati 4 หลายเดือนก่อน

    Is there any way I can find path for csv file (greenhouse_dtls) file to download?

  • @shwetarawat4027
    @shwetarawat4027 ปีที่แล้ว +2

    Can you use mike? as the voice is too feeble to hear.. Good content but audio quality could be improved

  • @santoshkumargouda6033
    @santoshkumargouda6033 ปีที่แล้ว

    Hi, Can you please help me with how can i move the data from snowflake to bigquery with code, I am using cloud composer?

  • @sahlavh3935
    @sahlavh3935 ปีที่แล้ว

    Can we use bigquery operator when we have to do query on many number of tables, in a batch

  • @AlvaroAraujo-bb8sz
    @AlvaroAraujo-bb8sz ปีที่แล้ว

    dont I need any kind of hook?

  • @koutams7994
    @koutams7994 ปีที่แล้ว

    Hi,
    Can we create table directly without mentioning schema?

    • @anjangcpdataengineering5209
      @anjangcpdataengineering5209  ปีที่แล้ว

      Yes we do, we have to mention as schema auto detect, there is an option , you can explore that option

  • @chukkalaumalakshmi6505
    @chukkalaumalakshmi6505 ปีที่แล้ว +1

    Code is not clear anjan