Intro to Amazon EMR Toolkit

แชร์
ฝัง
  • เผยแพร่เมื่อ 12 ก.ย. 2024

ความคิดเห็น • 11

  • @tysong9883
    @tysong9883 4 หลายเดือนก่อน

    Hi Dacort, I can’t finish the “Reopen in Container” step, as after it downloads the docker image, an error pops up saying “yum doesn’t have enough cache data to continue” at step “RUN yum install -y sudo && “Hadoop ALL=(ALL) NOPASSWD:ALL”..
    Wondering if you might know any reason behind? Thank you so much!

  • @panchao
    @panchao ปีที่แล้ว

    Thanks for creating this nice tool. In the Glue catalog view, can we also see the partition keys of a table?

    • @dacort
      @dacort  ปีที่แล้ว

      Unfortunately not yet!

  • @arjunshah6594
    @arjunshah6594 ปีที่แล้ว

    This is great Damon. Just a quick question. Does this need a connection to AWS similar to the AWS Toolkit in Visual Studio? Somehow even after having AWS local profile and the necessary permissions, the explorers does not load

    • @dacort
      @dacort  ปีที่แล้ว

      It's not quite as robust as the AWS Toolkit authentication. It just uses the default profile from your environment. Do you get an error message or is there just nothing showing up? As long as you can run "aws emr list-clusters" or "aws emr-serverless list-applications" from your terminal, it should work in VS Code. There is also an "EMR: Select AWS Region" command to change regions.

    • @arjunshah6594
      @arjunshah6594 ปีที่แล้ว +1

      @@dacort That's great. So the terminal commands used to work but not load up the explorer. But selecting the EMR:Select AWS Region solved the issue and now I can see all the explorers populated. Thank you so much. This is great :)

    • @dacort
      @dacort  ปีที่แล้ว

      @@arjunshah6594 WOO HOO! Awesome. :) Thanks for giving it a try!

  • @atoz12325
    @atoz12325 ปีที่แล้ว

    Thanks for the video Dacort..Please share how to connect my own S3 from Docker container. I try to add AWS keys in docker file as ARG. but it did not worked after rebuild the container. Please advise..

  • @itzikpaz6796
    @itzikpaz6796 10 หลายเดือนก่อน

    Hi, thanks for the great video 😊
    I am searching for an article or any direction to build a development pipeline on top of emr-eks from local/dev to production.

    • @dacort
      @dacort  9 หลายเดือนก่อน

      Sorry for the delay - this article here is for CI/CD with EMR Serverless, but could be adapted to EMR on EKS fairly easily.

  • @sahilbhatia2014
    @sahilbhatia2014 ปีที่แล้ว

    Hi Decort. Thank you for the video but somehow I am unable to connect this with my aws account as we use the SSO (single Sing On) authentication. But I am able to connect via AWS toolkit using the 'aws configure sso' command. Could you please help what can I do in this case?