AWS Athena Glue and QuickSight Tutorial | Athena and QuickSight Integration | Serverless Analytics

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 เม.ย. 2021
  • In this video, I have explained the Serverless Analytics pipeline using Athena, Glue, and QuickSight.
    If you liked this video and want to appreciate my work, you can buy me a coffee☕️
    www.buymeacoffee.com/wadhara
    You can also support by Sharing and Subscribing to this channel🚀.
    Keep Supporting👋
    Connect with me on LinkedIn -
    / ajaywadhara
    #AthenaTutorial #QuickSight #AwsGlue

ความคิดเห็น • 33

  • @tieduprightnowprcls
    @tieduprightnowprcls ปีที่แล้ว +4

    00:26 Sample Diagram
    02:24 s3 setup
    02:43 glue setup
    08:03 athena hands-on
    14:34 quicksight intro
    15:22 quicksight features
    18:02 quicksight SPICE
    19:47 SPICE vs direct queries
    22:00 how to setup quicksight account
    25:28 quicksight hands-on

  • @codewithmaheshhbalwan
    @codewithmaheshhbalwan 2 ปีที่แล้ว

    Thanks, bro
    I was getting zero records when I ran queries on the Athena table but got it done by following your step by step tutorial. 👍

  • @Pradify_ai
    @Pradify_ai 3 ปีที่แล้ว

    Great. Nicely explained 🤘🏻

  • @revathilokku1003
    @revathilokku1003 ปีที่แล้ว

    Very informative video. Thanks a lot

  • @tarvinder91
    @tarvinder91 2 ปีที่แล้ว

    This was super helpful and so much learning to start with. Good job in making such a video

    • @AjayWadhara
      @AjayWadhara  2 ปีที่แล้ว

      Thanks bhaji 🙏🏻

  • @NIYANTAjmp
    @NIYANTAjmp ปีที่แล้ว

    very well explained. Thank you

  • @chandshaik4573
    @chandshaik4573 3 ปีที่แล้ว

    Hi Ajay could you please post the junit test case preparation for api gateway lambda function in java

  • @sanarehmani479
    @sanarehmani479 2 ปีที่แล้ว

    hello there, I cannot seem to get any data when I run SQL queries against Athena? Do you know why the data is not loaded in and how to load the data in the glue catalog so i am able to query Athena?

  • @diegov9799
    @diegov9799 ปีที่แล้ว

    Hi, when I created a custom query about a date, the data is not showing ok in quicksight. Just show the same date.

  • @bhojpuriyalaika8550
    @bhojpuriyalaika8550 2 ปีที่แล้ว

    Hi Ajay,
    when i am running the athena.I am not getting any value and getting query successfully completed. Could you help me why getting and how we can resolve this

  • @mandarbirwadkar
    @mandarbirwadkar 3 ปีที่แล้ว +3

    Hi Ajay ,do we required Athena here ,can we directly take data from Glue?

    • @tieduprightnowprcls
      @tieduprightnowprcls ปีที่แล้ว

      26:53 here we can't see Glue as data source but Athena is present.

  • @RedCloudServices
    @RedCloudServices 2 ปีที่แล้ว

    Ajay thank you. Quicksight now supports NLQ but how could you submit a Quicksight query using a voice skill?

    • @AjayWadhara
      @AjayWadhara  2 ปีที่แล้ว

      Hey Greg, not sure about this.

  • @altair7676
    @altair7676 2 ปีที่แล้ว +1

    So let's say a new csv file is uploaded every week into your S3 bucket. Does this pipeline automatically get the new csv file, import to database in Athena, then visualize in quicksight ?

    • @AjayWadhara
      @AjayWadhara  2 ปีที่แล้ว

      You have to use some Event Driven behaviour here.
      Lets say, On S3 upload, Lambda trigger that will run crawler, and once crawler finishes, you can execute your queries

  • @irisli3829
    @irisli3829 2 ปีที่แล้ว

    Looks like quicksight supports fetching data directly from S3, then what is the point of using Glue/Athena/Redshift Spectrum in between S3 and Quicksight? Does that save money or provide better query functionalities?

    • @AjayWadhara
      @AjayWadhara  2 ปีที่แล้ว

      Think about fetching data through complex queries...And showing the resulting data into QuickSight

  • @krishnasanagavarapu4858
    @krishnasanagavarapu4858 2 ปีที่แล้ว

  • @isratfardous1203
    @isratfardous1203 3 ปีที่แล้ว

    Hi Ajay, this is very useful tutorial. I am looking for someone who can help me in my current project. Is there any way I can contact with you?

    • @AjayWadhara
      @AjayWadhara  3 ปีที่แล้ว

      You can contact me at ajay.wadhara@gmail.com

  • @a7garg
    @a7garg 2 ปีที่แล้ว

    i have orders data partitioned on date in s3 . how to handle this

    • @a7garg
      @a7garg 2 ปีที่แล้ว

      my bucket is like s3:/orders/date/. data in parquet 100 files. for each date. how to handle this type of senario for analysis in Quick sight

  • @bhavanivani448
    @bhavanivani448 2 ปีที่แล้ว

    Hi Ajay ,looking for aws job support

  • @thevishalln
    @thevishalln 3 ปีที่แล้ว +1

    S3 -> Glue -> Athena
    S3 -> Athena
    Why is glue needed when You can query from S3 directly?

    • @AjayWadhara
      @AjayWadhara  3 ปีที่แล้ว +1

      You can, but Glue crawlers helps you identify the schema automatically and adds data catalog which can be used in other services such as Athena, EMR, RS

  • @deepadandamudi6831
    @deepadandamudi6831 3 ปีที่แล้ว +1

    I am looking for a trainer who can teach me. Would you be ineterested?

  • @picolosantiago5392
    @picolosantiago5392 2 ปีที่แล้ว

    Please avoid moving the mouse too much around the screen it tend to loose focus on the topic

  • @Mr9951432442
    @Mr9951432442 8 หลายเดือนก่อน

    Hi Ajay, very informative and and helpful. I have some data in database and I want to use Athena to generate reports. Could you please share me the Video if you have it.