AWS DynamoDB Streams | How to setup and create Lambda triggers

This video explains how to enable DynamoDB streams and attach lambda triggers to it.
To know more about DynamoDB itself please watch this - • AWS DynamoDB Deep Dive

[@jayaprakashnarayanaa]

Haven’t seen videos from past 3 months , nice to see one from you.

[@listentolearn2363]

thanks for your support!

[@parrou3]

Hi from Tunisia, I am using AWS Amplify, and all configs are done automatically, I don't have to do it manually, your video is very interesting because it gives me an idea about what happened behind the scene. , thank you

[@listentolearn2363]

glad you found it interesting :)

[@prathapn01]

I have followed the same sequence as mentined in your vedio but still facing below error :
InvalidParameterValueException: Cannot access stream arn:aws:dynamodb:us-east-1:. Please ensure the role can perform the GetRecords, GetShardIterator, DescribeStream, and ListStreams Actions on your stream in IAM.

[@romihans]

Hi! This was very useful! As a next step could your provide us code or some sort of guidelines as to how to upload the new image or old image to an sns topic from where an email subscriber can get a notification. I have tried but have had limited success with this aspect of integration into sns

[@listentolearn2363]

Hello, thank you.. Sure, I will try to make one

[@deepakranjanmishra5641]

Very Nice Explanation.

[@listentolearn2363]

Thank you!

[@onlyice]

Lovely video, super thanks for creating it.

[@listentolearn2363]

Thank you :)

[@arunverma6384]

Amazing video.... 👍

[@listentolearn2363]

Thank you 👍

[@ricardofonseca3340]

Hi, I am following your exact steps but I get a record with no data, there is just the metadata on it. What am I missing?Thanks

[@listentolearn2363]

Hope you selected the New and Old images option when enabling streams?
Key attributes only - Only the key attributes of the modified item.
New image - The entire item, as it appears after it was modified.
Old image - The entire item, as it appeared before it was modified.
New and old images - Both the new and the old images of the item.

[@Surajmenon31]

How would you configure error handling here? Say splitbatchonError or max retries? Should we create the event source on the lambda side for this?

[@listentolearn2363]

Hello,
Yeah, you could setup retries. However, if the error is not a runtime glitch and something that needs fixing like data error or related then might be better to setup monitoring and alerting mechanisms.

[@deepakranjanmishra5641]

Can you please elaborate the use case ?

[@listentolearn2363]

if you would like more details, please refer this - docs.aws.amazon.com/amazondynamodb/latest/developerguide/Streams.html

[@deepakranjanmishra5641]

@@listentolearn2363 Thank you

[@user-us3fl4gy3x]

Document count in indices of domain for user table is zero aws but there is data in my user table of dyanmodb
HOw can i solve it?

[@listentolearn2363]

Please check the lambda logs to see if there are any errors while streaming data.

[@yichenwang8008]

if I put the lambda inside a VPC, will that still work?

[@listentolearn2363]

its already in VPC

[@rishabkhuba2663]

How can we create this in CDK?

[@listentolearn2363]

I will try to make a video on CDK

[@rishabkhuba2663]

@@listentolearn2363 Thank you
I figured it out but I took some reference from your videos

[@saradhapurushothaman1755]

Super 👍🏽👌🙋🌹😍

[@listentolearn2363]

Thank you 👍 :)

[@sureshr3008]

Can I please tell me how I can subscribe to dynamoDb stream in APPsync

[@listentolearn2363]

Hi Suresh,
You can only stream dynamodb data to lambda and kinesis at the moment.
You could try using lambda to then integrate with appsync.

[@sureshr3008]

@@listentolearn2363 thank you,
Is it works with integrating lambda function to stream data from dynamiDB to Appsync

[@sureshr3008]

I tried, only query is working but I need subscription

[@listentolearn2363]

I haven't had a chance to try this myself. This might help? dev.to/marcostreng/aws-appsync-subscriptions-with-dynamodb-streams-lambda-and-serverless-104j