Transfer full s3 from one account to another | Moving Large S3 Files using dataSync Across Account

แชร์
ฝัง
  • เผยแพร่เมื่อ 10 ธ.ค. 2024

ความคิดเห็น • 38

  • @WilliamVirkin
    @WilliamVirkin 4 หลายเดือนก่อน

    this video explain WAY BETTER than the official documentation in AWS and also that documentation has a lot of inconsistency.

  • @reemdawg5980
    @reemdawg5980 3 หลายเดือนก่อน

    Hello @Jawad, from which account is the 'aws datasync create-location' being run from, in which account will the location appear?

  • @fahadsayed6933
    @fahadsayed6933 6 หลายเดือนก่อน +1

    works like a charm! .. thank you very much. It saved me a lot of time.

  • @KarimiGE
    @KarimiGE 3 หลายเดือนก่อน

    hello @Jawad, why do the bucket ACLs need to be disabled?

  • @BeSavage177
    @BeSavage177 ปีที่แล้ว

    Thanks for this!! Does this support accounts across different organizations so data can be transferred to various clients if needed?

  • @moforel
    @moforel 11 หลายเดือนก่อน

    Great Video! Is it possible to use datasync to transfer only objects with a specific tag? If so how?

  • @ravitejanimma3831
    @ravitejanimma3831 ปีที่แล้ว +1

    I have followed your steps, and faced same error. "DataSync location access test failed: could not perform s3:HeadBucket on bucket Access denied. Ensure bucket access role has s3:ListBucket permission."

    • @АняОсипчик
      @АняОсипчик ปีที่แล้ว +1

      not the best approach, but instead of using IAM role/ IAM user i used root user and instead of this string "arn:aws:iam::DIST_ACCOUNT_ID:user/distention_account_logged_in_user" try this: "arn:aws:iam::DIST_ACCOUNT_ID:root", this worked for me

    • @tharunyarramreddy4183
      @tharunyarramreddy4183 ปีที่แล้ว

      @@АняОсипчик if we dont have root user what is the alternative approach

    • @AasthaKasera
      @AasthaKasera ปีที่แล้ว

      @@АняОсипчик Thanks a lot, this worked for me.

  • @KarimiGE
    @KarimiGE 3 หลายเดือนก่อน

    hello @Jawad, which permissions does the logged in user needs to have?

  • @Deix25
    @Deix25 3 หลายเดือนก่อน +1

    Thank you! You saved us hours!

  • @arsaphone
    @arsaphone 10 หลายเดือนก่อน

    Hi sir,
    this policy wont do anything harm to source s3 right? for example the source bucket cannot be accessible bcs the policy

    • @jdkDevelopmentOfficial
      @jdkDevelopmentOfficial  10 หลายเดือนก่อน

      No there's nothing harm this policy is not for public It's for specific entity.

  • @AriefRakhmanSaputra
    @AriefRakhmanSaputra ปีที่แล้ว +1

    Hi @jdkDevelopmentOfficial I followed your steps, but I got an error
    DataSync location access test failed: could not perform s3:GetObject in bucket source11. Access denied. Ensure bucket access role has s3:GetObject permission.

    • @jawadali7728
      @jawadali7728 ปีที่แล้ว

      Make sure you have get files permission in source account.

    •  4 หลายเดือนก่อน

      i put "s3:GetObject", in the firts statement on the source role and works

  • @bakhodiryakubov3981
    @bakhodiryakubov3981 5 หลายเดือนก่อน

    Can you move from Acccount1 West region to Account2 East region as well?

  • @DanielRocha-y7v
    @DanielRocha-y7v ปีที่แล้ว

    How is the EFS to EFS procedure between different accounts?

  • @munchback9006
    @munchback9006 ปีที่แล้ว

    Hi!
    can you please help i am getting this error while creating task : last step of the video
    Failed to create task
    Request ID:
    Action
    datasync:CreateTask
    Status code
    400
    API response
    DataSync location access test failed: could not perform s3:HeadBucket on bucket careem-pubweb-staging. Access denied. Ensure bucket access role has s3:ListBucket permission.

    • @munchback9006
      @munchback9006 ปีที่แล้ว

      i need to allow full access on datasync of source account to my cli user ?

    • @jdkDevelopmentOfficial
      @jdkDevelopmentOfficial  ปีที่แล้ว +1

      No need for full access but I think you're missing S3:ListBucket permission.

  • @anubhavbiswas4142
    @anubhavbiswas4142 ปีที่แล้ว

    Does this feature involves cost? If I want to move millions of objects to another AWS account, will this incur any cost?

    • @jdkDevelopmentOfficial
      @jdkDevelopmentOfficial  ปีที่แล้ว

      Yes, It's costing but not too much you can find more details in their pricing module.

    • @anubhavbiswas4142
      @anubhavbiswas4142 ปีที่แล้ว

      @@jdkDevelopmentOfficial thank you.. Yes i went through the pricing.. Thank you for this informative video

  • @civil5109
    @civil5109 ปีที่แล้ว +1

    Thanks jdk develoment its is working now

  • @durantapatra443
    @durantapatra443 ปีที่แล้ว

    how to transfer 1GB single file ?

    • @jdkDevelopmentOfficial
      @jdkDevelopmentOfficial  ปีที่แล้ว

      You can transfer 1GB file using"aws sync" using aws cli.

    • @siriusleto3758
      @siriusleto3758 7 หลายเดือนก่อน

      If you use MFA it will be more complicated. They never explain it in the tutorial.

  • @jogurt5661
    @jogurt5661 ปีที่แล้ว +1

    Great work, thx

  • @syednawaz819
    @syednawaz819 ปีที่แล้ว

    It helped. Thanks a lot.

  • @gigadanelia8339
    @gigadanelia8339 ปีที่แล้ว +1

    Thanks!

  • @marxito0
    @marxito0 4 หลายเดือนก่อน

    excellent
    thank

  • @oblivstarr
    @oblivstarr ปีที่แล้ว

    🔥🔥🔥

  • @InternalAmbition
    @InternalAmbition ปีที่แล้ว +1

    This video is great! Thank you