There's a bit more involvement here. You can set the retry on the queue level but theoretically that will clash with the # of retries you have on the lambda. So setting the sqs queue retry to 0 helps. Also you need to understand what visibility timeouts are and how they are set for threads that access the message in the queue. The reason you couldn't see the message when you were refreshing was that that timeout had not yet expired before that message was re-placed back into the queue (regular not dlq). The idea and goal is that when the lambda exhausts all the retries and still fails, then the message is then moved to the DLQ. There are configurations on how long the message can stay in the DLQ or regular queue.
Soumil, well explained !! Question : messages that went to dlq , went through sqs-dlq or lambda dlq ? is it mandatory to configure dlq on both lambda and sqs ? or either one would work ?
Hey Soumil, I really appreciate your content. I have a request, can you post a video on a use case that basically runs a scheduled batch job on the files uploaded in an s3 bucket and scan them one by one and if no malware is found, the files are moved into a processed folder of another s3 bucket?
From 0 to now knowing what Deadletter Queues are and how to set up in AWS
Thanks!
Thank you Man. I liked your attitude & way of explaining.
There's a bit more involvement here. You can set the retry on the queue level but theoretically that will clash with the # of retries you have on the lambda. So setting the sqs queue retry to 0 helps. Also you need to understand what visibility timeouts are and how they are set for threads that access the message in the queue. The reason you couldn't see the message when you were refreshing was that that timeout had not yet expired before that message was re-placed back into the queue (regular not dlq).
The idea and goal is that when the lambda exhausts all the retries and still fails, then the message is then moved to the DLQ. There are configurations on how long the message can stay in the DLQ or regular queue.
Thanks a lot for those comments yes you are right and i forgot while i was creating video thanks a lot for posting this
Soumil, well explained !!
Question : messages that went to dlq , went through sqs-dlq or lambda dlq ? is it mandatory to configure dlq on both lambda and sqs ? or either one would work ?
No just configure on sqs side that’s it
@@SoumilShah Thank you !
thanks for the video, very useful
change your solgan in queue to "Bro....Born to Win"😉
Hey Soumil, I really appreciate your content. I have a request, can you post a video on a use case that basically runs a scheduled batch job on the files uploaded in an s3 bucket and scan them one by one and if no malware is found, the files are moved into a processed folder of another s3 bucket?
clutch
Can you please forward me the presentation?
Thank you
thanks