AWS - Auto Scaling Group, Launch Configuration, Scale-out & Scale-in Policies
ฝัง
- เผยแพร่เมื่อ 24 มี.ค. 2017
- - How to setup AWS Auto-scaling from scratch?
- How to choose subnets correctly?
- Configuring a Public ELB with Private EC2 instances.
- Defining Scaling policies to add and remove instances.
Additionally ---
1. Cooldown period
2. Warmup Period
3. Connection Draining
All with a simple DEMO.
-----------------------------------------------------------
✌️ KnowledgeIndia is an initiative to teach Cloud and related technologies in an easy & practical manner. We believe in jargon-free discussion.
👍 There are many videos on our channel through which you can learn Cloud for free. If you find our videos helpful, then please share it & help others as well. If you would like to be part of this initiative, connect with us and send a message (links given below).
👉 Join our Hands-on CLOUD TRAINING - www.knowledgeindia.in/p/hands...
👉 Connect with us for CLOUD CONSULTING requirements. Best way is to connect on LinkedIn and send a direct message.
👉 Become a TH-cam Channel Member and get many benefits - www.knowledgeindia.in/p/membe...
☕ You can support us here - www.buymeacoffee.com/knowledg...
☕ You can support us here - ko-fi.com/knowledgeindia
▬▬▬ 🔰 L E A R N I N G C L O U D ⤵️ ▬▬▬
1️⃣ Subscribe to KI TH-cam Channel - th-cam.com/users/knowledgeindi...
2️⃣ Receive email alerts - bit.ly/ki-google-group
3️⃣ Join our LinkedIn Group - bit.ly/ki-linkedin-group
4️⃣ Join TH-cam MEMBERSHIP - / @knowledgeindia
5️⃣ Launch your CLOUD CAREER - www.knowledgeindia.in/p/launc...
6️⃣ All our Video Tutorials - www.youtube.com/@knowledgeind...
7️⃣ Guidance on Cloud Certification - • 5 TIPS to CHANGE JOB w...
8️⃣ Hands-on AWS Training - www.knowledgeindia.in/p/hands...
▬▬▬ P O P U L A R V I D E O S ▬▬▬
👉 • AWS - VPC Demo, Public...
👉 • AWS Storage - S3 vs EB...
👉 • AWS Security - IAM (Pa...
👉 • AWS Cloud Architect In...
👉 • AWS ECS Part-1 | ECS C...
👉 • AWS Databases - Differ...
👉 • AWS CloudFormation DEM...
▬▬▬ V I D E O P L A Y L I S T S ▬▬▬
👉 AWS for Beginners: • AWS Tutorials for Begi...
👉 Containers on AWS: • Containers on AWS - EC...
👉 Cloud JOBS Interview Series: • Cloud Architect Interv...
👉 LIVE Sessions - Q&A: • AWS Interview Question...
👉 AWS Security: • AWS Security Videos |...
👉 AWS Networking: • AWS VPC & Networking -...
👉 AWS Pricing: • AWS Pricing - Cost Opt...
👉 AWS Automation: • AWS Automation Videos
👉 AWS SysOps Administrator: • AWS SysOps Administrat...
👉 AWS Solutions Architect: • AWS Solutions Architec...
👉 Enterprise Use-cases: • Enterprise Use-case Se...
👉 Azure - Learn from Basics: • AZURE - Learn from Bas...
👉 Meeting Cloud Professionals: • Interview with CLOUD P...
✅ Check all our playlists here: www.knowledgeindia.in/p/all-a...
▬▬▬ L I N K S ▬▬▬
▶️ LINKEDIN - bit.ly/ki-linkedin
▶️ TWITTER - bit.ly/ki-twitter
▶️ QUORA - bit.ly/ki-quora
▶️ TWITCH - bit.ly/ki-twitch
▶️ BLOG - www.knowledgeindia.in/
👆 We try our best to answer most of the COMMENTS. Please write your appreciation/feedback/questions in the comments section below. ✌️
You are really amazing sir ..........!! Knowledge sharing is a quality not everyone possess but you does . Really your clear explanation helped me a lot to understand AWS environment . Thank you sir God bless you and ur family :)
Thanks. Please do check out our playlists for more such practical videos..
Guru Jee I do not have words to appreciate the service that you are providing..... YOU ARE JUST GREAT !!!
Thanks JK. Please support us by sharing the videos. Also, please write above on LinkedIn and tag us..
your presentation is superb. Please post new ui Autoscaling groups videos..
before watching this video, i watched dozen videos for load balancing and cloudwatch alarm setting, you explained so clearly and within short time, not dragging. Super
Thanks. Please share it with more people in your circle
These videos are like good old movies which will not fade at all, everytime you see you learn, revise and is awesome. Thank you Sir.
Thanks a lot Anand. Do write on LinkedIn about the same..
Yep,thanks for responding!!
I got the concepts but the confusion here is we are correlating the same terminologies like connection draining in the EBS space as well as in ASG.
Awesome tutorial
Awesome video, easy to understand. Thanks KI. When it comes to AWS I watch your videos only. Great way of teaching , keep it up.
Thanks Chandra. Please write about KnowledgeIndia on LinkedIn/Facebook.
Thank you so much sir for such amazing videos. Can you please make a video for AWS WAF as well, it would be really helpful. Thanks in advance!!!
Very nice and useful for learner like me. Your tutorials clear all impotent and small pieces of theories. Thank you so much and god bless you.
Thanks Chandan. may I request to share the videos on Facebook and LinkedIn with the same comments as you expressed here.
Please spread the word. Thanks a lot.
in.linkedin.com/in/knowledgeindia & fb.me/AWStutorials
of course I'll. This will help every one.
Nice Presentation . Thanks
Thanks for your appreciation. You can support our initiative of Free Practical Cloud Tutorials by sharing this video with your friends on Social channels, whatsapp etc.
If it helped you solve a problem and you would like to applaud us, click the Applaud button :)
For regular 1-1 interaction with me, check our Membership - th-cam.com/channels/zpHRBVnkzBfSsXostYuW1g.htmljoin
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
At 15.52 when you attached LB then does it added two instances in two different public subnet ?
Its nice and clear explanation about the auto-scaling in AWS.
I have one question about it?
How can I set a load test for this instance please share the PHP code for it.
Thanks in advance!!
And to add on it, having the knowledge of AWS only will help?? As I am layman with all scripting and other things. Please suggest.
where is the load test code?
i don't find it in description section,
where we can find it or could you upload it and show how to set it up and test it as well in a separate video cause that's a nice one way of testing auto-scaling
hello, is there a way by which i can add an already existing ec2 mc/ami running a website be added to the launch configuration as template to autoscaling group/ currently deployed 2 instances in different region through a classic load balancer (which mandates to define two regions minimum for load balancing instead of autoscaling from 1 to multiple), just that it will help reduce additional instances when load is minimal
Sir, where can i get the ELB load testing app you used in the video
Please ans on below query...
1) Lets say if there is a client requirement that his wesite/Application is highly critical that should never go down doesn't matter how much load comes in ...and we'll be creating the auto scaling group(ASG) for his requirement....then as per your diagram...where we'll be keeping the client app....in the private subnets across the AZ's?.....or we can do like this we'll be creating instances manually and put them in the same subnets(private one) where we'll be keeping our ASG...and while creating the ELB we'll add these manually created instances in ELB.....
Sir tusi great ho :-) I really like your videos Champ.
Thanks a lot.. SUBSCRIBE to TH-cam channel: th-cam.com/users/knowledgeindia
Watch our videos in correct order: bit.ly/2GVzLti
Connect on LinkedIn, receive AWS updates & Practical Scenario Questions - bit.ly/2XC5bZg
If you have got benefited, consider joining our TH-cam Membership: bit.ly/37sdLP1
Join AWS Practical Learning Group on LinkedIn: bit.ly/2Vx7aOi
SUBSCRIBE to our blog for AWS exercises & case-studies: www.knowledgeindia.in/
Hi Sir, One small question....I have two Autoscalling groups, In each autoscalling group I have 50 instances means total 100 instances. I want to append one of the entry in /etc/hosts file in the 50 instances of one autoscalling group.
Very helpful video Sir, Could you please help me with the AMI you used in the example, as I am not able to test.
Hello Sir . On creating autoscalling group I am getting error " instance was started in response to a difference between desired and actual capacity, increasing the capacity from 0 to 1."
suppose autoscallin group add one Ec2 instance now if warm up period is 30 sec and cool down is 100 sec so autoscalling will wait for 130 sec or only 100 sec ?if 100 sec then my warm up period should always be less then cool down period
This is superb tutorial to understand Auto scaling groups, ELB. Very clearly explained and easy to follow along. I do have a question. Let's say, my application depends on numerous assets that are stored in a shared EBS volume, can I make sure that volume is loaded in all the instances that are spun up? Can the EBS volume be shared between two availability zones?
You should use EFS for that purpose. That can be shared across multiple EC2 instances
Hi, can you please share the details of the program that you are running in your web server? I am sorry if you have shared earlier, I checked but could not find in comments section
Hello I have an issue. I created my launch Instance for the ASG as you did within my custom VPC. I added my User text to run a php application. My Instances are Amazon Linux ami 2. So when i am trying to reach them i m getting 504 Gateway error . I checked for instance logs they looks fine apache running perfectly and all. So could help me where i am making any mistake or anything. Thanks Waiting for your response
How are you doing the load testing ?
i could not find ur video on ElasticCache, can anyone share link !!
Thank you Sir! You earned another sub here!
Awesome, thank you! Keep watching and sharing with your circle.
Hi, thanks for the video, can you post something about scaling by memory?
Hello
I am getting following error
Auto Scaling group could not be created
One or more security groups in the launch configuration are not linked to the VPCs configured in the Auto Scaling group
while launching ASG using LC
Sir can you explain and configure the Autoscaling based on Memory utilization.
Hi, This is one of the best video i ever seen.. great.. Can you please share the Load script.
Nice explanation with regards to the ASG concepts!!!
Can you please elaborate the below stuffs in one line if possible to remember them quickly?
Warm up period
Connection Draining
Cool down period
Thanks Hari. For one liner definitions, please refer documentation. My suggestion is always to grasp the concept and you would be able to explain it, when required.
Thanks a lot. I was thinking instance gets starts creating only when ELB is started, but surprised to see instance started created as soon as ASG is created. Wondering ASG alone enough to load balancing.
It means we can attach ASG dynamically to ELB?
Can I add more ASG to ALB?
ASG doesn't do load balancing.
one ELB can be specified in multiple ASGs.
great videos, however i am staring with AWS do you have any sequence of tutorial that i should follow to have better understanding
Yes, pick up playlist on our channel - SA our Sysops for the right order
Sir how did u create script at the beginning can u plz tell sir.
Can you plz share the script that you use for load testing?
Hello knowledge India, your tutorials are very good and easy to understand. I am new to IT industry, and have very less knowledge around. I want to start my career in AWS, can you please give me few tips for that?? I am solution architect certified.My current job profile is IT service desk.
Learn things practically, then only it would help. We have many more videos on AWS topics, these are organized in playlists here -- th-cam.com/users/knowledgeindiaplaylists
Also, you might want to subscribe to our blog to receive custom-written AWS related content -- aws-tutorials.blogspot.com
Please SUBSCRIBE to our TH-cam Channel & LIKE and SHARE the videos if they helped you.. Thanks again.
very good tutorial, subscribed
Thank you. Please share with your friends. And watch our playlists
Hi Sirji, i have a question, we would be creating an AMI for configuring autoscaling group, once configured we would be deploying new code to the application servers, so if any instance goes down it would be taking the AMI and autoscale the new instance, which does not have the new code, so what would be the best approach on this? can you please help me out?
you can have an updated launch configuration OR download the latest code using User-data at instance level (when it comes up).
Thank you Sir.
Welcome. Please do check out other videos on our channel as well for the same type of content..
Sir i learn all these from you. Could you please tell me the real time scenerio of aws in a company. I want to get job now for aws cloud. I am having windows server experience and bit of linux. Can i get job. Or shoul i learn something more as u suggest.
Nice video. Can you please share your application to deploy in ec2
Excellent video.
I was wondering if the the code for your AmznLinxWithLoadTest - ami-581da04e or the ami is publicly available because I like the fact you can max the the instance so another instance is launched by the Auto Scaling Group
Thanks Mustaq. Currently I have not put the code online. I shall try to do in upcoming days.
If you or any of your friends are interested in SysOps, you can join upcoming training -
aws-tutorials.blogspot.in/2017/06/aws-sysops-administrator-associate.html Please comment in case of any doubts.
Could you please provide simple script used for load testing?
In the Case of Scaling In/out, if we have used the percentage then it will consider the current instances running capacity or the initial capacity for the auto-scaling group.
running.
Thanks
nice video
Thanks Amar. Please support us by sharing on LinkedIn or FB
hi sir
nice video.. could you please upload video on difference between application load balancer and classic load balancer..
tirupathi reddy sure.. very soon.. please share with your friends.. thanks a lot
Thanks for the video, I find it very useful, I saw few other videos as well on the internet, but below scenario is not addressed anywhere, can you pls help to answer:
Statement:-
Let's say I have an EC2 instance I have configured apache on it, I will call it as Model EC2 instance. All the services on this Web EC2 are up and running.
I have created AMI out of it, and then EC2 instance from this AMI say 'EC2-Created-From-AMI' (also I created LC from this AMI)
Now, when I attach this EC2 'EC2-Created-From-AMI' to my ASG and then ultimately to my ELB, and If I see the status of this 'EC2-Created-From-AMI' instance under ELB it shows OutOfService.
Does this mean:
1. If we create AMI from EC2, it will bring down all the services running on it, at the time of AMI creation
2. The same thing happens to all the instances under ASG created from LC (which LC used the AMI while LC creation)
3. A. In case we want to bring up the services, we need to connect to the servers and bring up services manually
3. B. Or we have to pass, the user data to have services up and running through the command lines.
4. How do the same things be handled in real time scenario, during scale out?
Please help to answer.
Hi Jagdish,
I answered your question in LinkedIn. Important things are - make sure services on EC2 are in auto-start mode (in both cases, whether you put it in AMI or via user-data).
You don't need to connect manually, else the whole purpose of Auto-scaling is lost.
Please help us by sharing the videos and letting your friends/colleagues know.
Thank you Knowledge India, passing scripts to the user data works for me, though I have NOT set the services to auto-start mode. I tested user data script execution successfully and it works for me. I think these are the only two available options to make the services running on the server after the restart and during the scale-out process. Thank you again for your valuable time.
Yes sure, I already discuss about your channel to my colleague who are interested to learn AWS. :)
Hi Sir , i have a doubt . on the completion of load balancing 16:10 sec, there are 4 instance running out of which you terminated 2 , then running instance should be 2 but in video its coming 3 , how come ?
Please watch once again .. and look at the parameters passed while setting up.
Hello,
want to know can we increase the root volume of an running instance. if yes, how ?
Thank you.............. you are amazing
check our video on EBS for that -- th-cam.com/video/HTefwhNticU/w-d-xo.html
Hi SME, in this video, as there is a small glitch happened in SG's, I assume that as we have used the existing AMI and t has launched in DEFAULT VPC; that's why we have faced problem in SG. To solve this we created a new SG and mapped to the Image(Launch Config). Please confirm. Thanks!
Please watch video again and do in parallel, you will be clear then.
What will happen if i have dynamic website content. Autoscaling should be mostly preferable only for static content and which is shown here. Please let me know for dynamic content
Not sure what you meant by dynamic site .. A dynamic website is e.g. a website built using ASP.net where one page could render different content based on user & multiple other factors.. and you use EC2 instances (in auto-scaling group) for this..
You can use S3 for hosting static websites (HTML, images, CSS, js)...
If you are worried about updates to your code on dynamic website, then there are other techniques for it like pushing updates at regular intervals or using blue-green deployment.
I hope you get benefited more from our practical videos. ... Show your support by sharing the videos on LInkedIn & FB..
Hi sir,I am BE ece background and completed CCNA and CCNP course I would like to study AWS but which platform should I choose architecture,dev
I would suggest taking up Architect & SysOps track. That should work better for you.
We have an upcoming training in August, if you want to learn SysOps + Architect both.. Details on FB page.
Please SHARE the videos if you like and don't forget to check out other videos on our TH-cam Channel, you will like those. Please spread the word. Thanks a lot. in.linkedin.com/in/knowledgeindia & fb.me/AWStutorials
Q. If I have to update my application and ensure all the images have the same updates... I understand we have to update our launch configuration in the Auto Scaling group, BUT how do I ensure all the changes for the application, happens immediately across all instances ??
If you want to do immediate and bring all changes at once, then you should try Blue-Green deployment using Route53 weighted routing mechanism. Have another environment setup with new images, and then change the weights in Route53
Please help us by sharing the videos and letting your friends/colleagues know.
Hi sir,
I have my servers under load balancer, now if I configure the auto scaling can I add those servers to autoscaling by any chance
Yes you can add existing instances to an auto scaling group as well. Look at bottom section in asg dashboard
KnowledgeIndia AWS Azure Tutorials ok got it sir,
And in that case while we select the desire min and max do we have set the termination policies bcoz this might create new instances of terminate.
Correct me If m wrong
Can AWS stop load balancing traffic to an instance and then just signal the instance to wrap things up and terminate itself instead of just having it cool down?
No ELB won't do that.
Hello Sir, I have one query, can you please help to answer ----> Does our ELB node consume IP address from any of the subnet? I am aware of the fact that ELB is a fully managed AWS service, but when I created ELB node, I don't see any of the IP address consumed by ELB from any of my available subnets? Please help
Hello Sir, I tried it again to create the ELB node and I found that ELB node consumes IP from one subnet, NOT from both the available subnets.
Does it mean that sometimes it might create one node each, in all or some of the available subnets as per the need? I mean it does not necessarily create nodes in all the available subnets?
While launching ELB, if you have chosen 2 subnets it would consume 1 IP from both subnets. If you give only 1 subnet, then it would consume 2 IPs from that subnet.
Knowledge India Thank you for your time to address the query.... I have selected both the subnets, even I saw the "Instances--> 'Edit Availability zones'" of the ELB has both the subnets registered under it.
One thing could be I just created ELB without any instances in each subnet for testing/demo purpose, that could have consumed single ip from one subnet (NOT from both). If i were having instances in each subnet, that could consume IP address from each subnet.
I didn't understand ''executing as part of user_data then warm up period is important".
Are you trying to say while starting ec2 machine from AMI image if we have to install packages then it will take some time for ec2 instance to get ready hence provide warmup period.
Yes Akash. If we are installing anything via user-data, then we should consider the time involved as only after that installation EC2 would be really usable..
Hello Sir, I'm encountering a error while creating auto scaling ERROR MESSAGE "One or more security groups in the launch configuration are not linked to the VPCs configured in the Auto Scaling group".
For this, I've deleted the entire VPC settings and created a new one and gave the security group as HTTP and SSH. Even after trying multiple number of times i'm facing a same error.
Please help me in sort out this error. It'd be great if it's gets sorted out ASAP.
i have called this thing in the video. please check that SG selected in launch configuration is the one which belongs to the vpc where you finally want to launch the instances.
Please let your friends/colleagues know about our channel & AWS videos...
@@knowledgeindia Thanks for the response bro !! Let me check that again
@@knowledgeindia Thanks for the response bro !! Let me check security group again . .
Nice One could you please upload how to create AWS VPC that would be really more helpful ??
There are multiple videos on VPC already on channel, please see.
Please SHARE the videos if you like and don't forget to check out other videos on our TH-cam Channel, you will like those. Please spread the word. Thanks a lot. in.linkedin.com/in/knowledgeindia & fb.me/AWStutorials We have an upcoming LIVE training in August, if you want to learn SysOps + Architect both.. Details -- www.linkedin.com/pulse/aws-live-training-solutions-architect-sysops-32-hours-knowledge-india
Thank you
Thank you Sir, one small question.... my application is running on cloud, using ASG i want to scale up 3 servers at morning 9am and i want to scale down 2 servers at 6pm like business hours... how can i achieve this.
There is a scheduled event option in asg. Check that please
@@knowledgeindia Thanks for quick response Sir!
There is "Scheduled Action" tab in ASG, --> Create Scheduled Action --> you have to configure option like "Min, Max, Desired Capacity, Recurrence(Cron, Every 5 minutes, Every 30 minutes, Every 1 hour, Every Day, Every Week, Once), Start time, End Time" . for reference link ---> th-cam.com/video/od3kbA43hgU/w-d-xo.html
How to automatically update AMI in Amazon EC2 Auto Scaling Launch Configuration
Can you create a video on how to conduct load test/stress test - to test auto scaling... Thanks
i will try to do so..
Thanks. Please look at our playlists to learn more. Kindly share the videos and spread the word if you find them helpful..
Does it give down time in prod environment ?
No
Sorry typo,it was ELB not EBS!!!!
Scenario:
Currently, we have a single production server running on an EC2 instance. Since we are getting a lot of traffic, we would like to use the Autoscaling feature, but we are kind of new to this.
Following is my understanding:
- We create a custom AMI from our existing production server
- Create a launch configuration from this AMI
- Create an AutoScaling group with this launch configuration
- Set conditions, if CPU usage is greater than 60%, add an instance, if less than 40% terminate 1 instance.
- Add a load balancer to this autoscaling group
- Now as far as I understood, to deploy new code to the auto scaling group, we have to create a new AMI with our updated application version and change the AMI used in the autoscaling group to this new one. Then terminate all the previous instances and create new ones from the updated AMI.
Questions:
1. To create the updated AMI, do I have to keep our previous EC2 instance that is not part of the auto scaling group?
Deploy the new code there and create an AMI from that instance?
2. Or instead of creating new AMIs, we could just ssh into every server and pull new code from there? but the new instance that would spawn would be using the previous code.
3. Also, after adding the new AMI, how do we properly terminate all the previous instances?
4. Finally, How do we properly automate this?
Hi@@krupakarreddy8235 , you dont need to do this for updation of your code, instead of this i would suggest EFS, while you create launch config just add a simple bootstrap script and add EFS to save your code. By doing this you would not require to do such changes in future. If changes required just make that in EFS and everything remainig will work perfectly.
thank you for the great video, can i have the link for the script, i need it badly, thank you once again
Sorry. its long time now..
Anything on elastic bean stalk please
Yes Neeraj, very soon.
How can I get code for the application that is running on this server?
not sure if i have it now.. You can probably login to instance and run command to stress the CPU. google it a bit please.
You have shown an application running @ 2:05, can you share the steps how this application is created ?
Also, if you have tested that machine @2:20, is it on your local or VM, not able to see the full screen.
Can you confirm for any instance we launch with the public IP, it will work on our local and VM (public instance-if port 80 is open with internet GW).
I have seen the security groups video but some time it is confusing when we are using ELB or Auto-scaling.
you have created an AMI at the start of the lecture and reserved. Without taking an AMI, we cannot perform the practical ?
Thanks for such a nice material! Posted you a Qs on Fb, please help if possible.
Replied there. Please ask questions in comments section always.
Thanks for the answer, i think there might be some confusion in que from my side. I am adding the Que again - On my E-commerce site, ELB have 5 instance running in two AZ. During the process of Scale in, it found one instance to remove on which a user is active and doing some transaction. So what is the mechanism to allow user to complete the transaction before instance is removed by ELB OR best practice to validate such point/scenarios at the time of ELB setup?
You should enable Connection Draining at ELB level. This will give a grace period to instances (which are about to be terminated) so that open requests on those instances could get completed.
How can I send you an email? Please reply. Thanks.
Email is updated in about section of TH-cam. Or you can pick from LinkedIn as well
Connection Draining at 14:00
Sir...I would love if you make a video of third party VPN settings on Aws..like example openvpn..
adding it to pending list of actions.. but, there are already many items :)
please answer my below query
Hi, if you can slow down your steps so that the viewer can see clearly where you are clicking on the screen it would help a lot. I feel that you are shifting a bit too fast and I find it a bit hard to follow. 🙏🙏
do you think slowing down video playback in the youtube player can help you?