AWS SQS (Simple Queue Service) - Getting Started and Integrating with .NET Apps | .NET ON AWS
ฝัง
- เผยแพร่เมื่อ 15 ก.ค. 2024
- Hello 👋 Amazon Simple Queue Service or SQS in short is a fully managed message queuing service that enables you to decouple applications and build distributed software systems. Using SQS, you can send, store, and receive messages between different applications without losing messages or requiring other services to be available.
In this video, let’s learn how to get started with Amazon SQS and use it from a .NET Application. We will learn how to send and receive messages, different properties, and concepts that you need to know when using SQS.
This video is sponsored by AWS and is part of the .NET on AWS Series.
00:00 - Introduction
03:08 - Create Queue and Send Message
13:17 - Delay
15:40 - Reading Message
20:36 - Short & Long Polling
25:17 - Visibility Timeout
27:09 - Mark as Processed
29:16 - Error Handling
31:28 - Dead Letter Queue
36:18 - Conclusion
🔗Blog - www.rahulpnath.com/blog/amazo...
🔗Source - rahulpnath.visualstudio.com/D...
🔗AWS SQS - docs.aws.amazon.com/AWSSimple...
Additional Watching
📹AWS Lambda - • AWS LAMBDA For The .NE...
📹AWS DynamoDB - • AWS DynamoDB For The ....
📹AWS Series - • .NET on AWS
📹ASP NET Core Series - • ASP.NET Core
Come say hi! ✋
🌍 Blog - rahulpnath.com/
✉ Subscribe to my Newsletter - www.rahulpnath.com/subscribe
🐦Twitter - / rahulpnath
📸Instagram - / rahulpnath
🎥 Recording Setup and Workflow - www.rahulpnath.com/blog/youtu...
Make sure to SUBSCRIBE to the channel. THANK YOU for helping me grow this channel !! - แนวปฏิบัติและการใช้ชีวิต
That's a comprehensive guide if ever I saw one. This is a no-nonsense, straight to the point, with examples that work. Very well done!
Happy to hear that. Do checkout my AWS series here bit.ly/aws-net-series. Also do drop in topic suggestions if you have any!
It's a very cool explanation...so easy to understand thank you sir
You are most welcome! Here is the full AWS Series bit.ly/aws-net-series
Do let me know if you have any topic suggestions.
You are making videos straight to the point . Other wise TH-cam is full of garbage. Please make videos on micro services and how to handle multiple endpoint api transactions .
Thank you Rohit. I have some videos planned out. Hope you are enjoying the AWS Series bit.ly/aws-net-series
As always, clear and straight to the point, great content! Thank you!
Hi Rahul, Thanks for doing this. Your videos are really special and helps the community because each concept is explained in detail and practical in nature. Please keep doing what you are doing.
I have one small request, can you do a video on how to combine multiple cloud provider services in a better way, for example my solution will use both aws parameter store and azure keyvault, how can we make a adapter library which can deal with such scenario s
Thank you and happy you are liking the content Nilanjan! I have two videos that show how to connect to Parameter Store and Key Vault. Both uses Configuration Providers to extend the .NET configuration. This is agnostic of cloud provider and will work regardless of where you are hosting. The authentication mechanism will slightly be different based on where your application is hosted.
www.rahulpnath.com/blog/connect-net-core-to-azure-key-vault-in-ten-minutes/
www.rahulpnath.com/blog/aws-parameter-store/
Let me know if that helps or if you have any additional questions
I like the way you teach sqs: simple and straight to the point.
Do you also have vidoes on AWS Event Bridge and Step Functions?
I would like to watch your approach on them :)
Thank you Recep, glad you are liking the style. I don’t have yet on those topics, thank you for the suggestion. I’ll add it to my list. Here is the full AWS playlist th-cam.com/play/PL59L9XrzUa-kl89ThijziX03fgTrbZCd7.html
@@RahulNath I have finished 5 videos in them and gave them likes. And, I will watch remaining videos in this list too :)
@@mryildiz702 Wow thank you ! So guess you are liking them then. I also have a Udemy course on Lambda here if that interests you
www.udemy.com/course/aws-lambda-dotnet/?couponCode=AUG-WITH-RAHUL
@@mryildiz702 A lot of what’s in the course is already covered here though, just that’s it’s more structured 😀 Have a great weekend
in kubernetes context, if the consumer app is created as a pod, would it require a 'service' to listen to SQS? if i want to increase the number of consumer pod, will it be consumed by all the pods causing each pod to do the exact same process? thx. awesome video
Hello Rahul, thanks for great explanation. I am wondering how we can add retry policies to Sqs in .Net Core. For example i want to send a message to Sqs and i want to retry sending if it fails due to network errors or other connection errors. Is there any way to do this? Thanks 💯
I talk about error handling and Dead letter queues at 29:16 Was that what you were looking at? Based on the maximum receive count it will retry the message. You can also read the associated blog post here www.rahulpnath.com/blog/amazon-sqs/
Hi Rahul, It's a helpful video. I am using SQS together with SNS. When I create a SQS queue with an access policy, AWS appends another policy automatically. I don't know why and dont want that. What could be the possible reason AWS is doing that?
I do talk about SNS to SQS and the setup here www.rahulpnath.com/blog/amazon-sns-to-lambda-or-sns-sqs-lambda-dotnet/
Does that answer you question ? If not what policy are you seeing getting added - if you can provide more details that’ll be helpful
Hi Rahul, is it a good practice to use SQS to upload files to S3 buckets? I'm working on a file upload solution and trying to send files as a message to SQS (a byte array). From there I triggered a Lambda to write that to S3. At the moment I'm uploading files to S3 from my API. But I have to consider what happens when Network errors occurred. This is where I think I can keep them in a queue for later processing (when the Network is available). Any thoughts on this idea?
I would directly store to S3 like what you are doing currently. Otherwise, you are moving data/bytes multiple times from your App - SQS and to S3. Since both S3 and SQS are AWS hosted the uptime guarantee is all the same, there is no advantage in doing it via SQS. If you want to trigger some action after the file is uploaded you could trigger it via SQS/SNS. Does that help or feel free to ask if you any additional questions?
@@RahulNath Thanks for the reply
@@shauncs have you considered this option of directly uploading to S3?
aws.amazon.com/blogs/compute/uploading-to-amazon-s3-directly-from-a-web-or-mobile-application/
You could also think about client local storage (browser local store or native store if exe) and uploading retries from there . Uploading to SQS failing has the same likelihood of S3. Does that help ?
@@RahulNath Thanks for the suggestion. I'll have a look. !
@@shauncs Do let me know how it goes
Thanks for the Video Rahul. I have to ask a question regarding sending a multiple messages to SQS. suppose If I don't know how many request I have to send , In that case If I use send multiple message to SQS, I will send only one massage or more than one massages right ? is this correct ? or with send multiple message into SQS, do we need to always send more than one message at a time.
I think sending 1 or more messages in the batch request should be fine.
@@RahulNath Thanks Rahul