ETL | Amazon Kinesis Data Stream | AWS Lambda | S3 | Kinesis to Amazon S3 Bucket using AWS Lambda

===================================================================
1. SUBSCRIBE FOR MORE LEARNING :
/ @cloudquicklabs
===================================================================
2. CLOUD QUICK LABS - CHANNEL MEMBERSHIP FOR MORE BENEFITS :
/ @cloudquicklabs
===================================================================
3. BUY ME A COFFEE AS A TOKEN OF APPRECIATION :
www.buymeacoff...
===================================================================
Repo link : github.com/Rek...
#etl #kinesisdatastream #awslambda #s3

[@rachitshah9957]

Thanks for this wonderful tutorial

[@cloudquicklabs]

Thank you for watching my videos.
Glad that it helped you.

[@mishramankamal]

I see that you have configured to the batch of 100, I just wanted to know for each batch, will there be a separate lambda invocation?

[@cloudquicklabs]

Thank you for watching my videos.
Indeed, it create a separate instance of lambda for the batch.

[@vinodpk5382]

In production how to grant access for external service. Is it through IAM roles or API gateways?

[@cloudquicklabs]

You can agrant access to external service via multiple options.
1. IAM users.
2. Federated Access (which supports)
3. API gateway as application for tasks

[@PanduPandey-s8r]

One doubt .. in s3 what files and from where you upload objects in s3 bucket.. can you clarify my doubt

[@cloudquicklabs]

Thank you for watching my videos .
This videos talks about capturing steaming data and storing in it low cost Storage s3 bucket.

[@nikhille2444]

I am not able to send the records from kinesis data genrator to s3 bucket

[@cloudquicklabs]

Thank you for watching my videos.
Please let me know what is the error that you are facing now.

[@MdMainuddincse]

KDG sent 500 messages but why we only see 74 objects in S3?

[@cloudquicklabs]

Thank you for watching my videos.
Please check the concurrency limit on your lambda. May be that could be the reasons

[@lucasbardoux4640]

@@cloudquicklabs Can't be, because the invocation limit is 1,000.

[@lucasbardoux4640]

Yes, same thoughts here. ^^