Get my Fundamentals of Networking for Effective Backends udemy course Head to network.husseinnasser.com for a discount coupon (link redirects to udemy with coupon applied)
I love this guy! He explains it so effectively and with fun! You and Arpit Bhayani are the only two guys that I prefer learning from when it comes to Engineering!
I'm so excited about this, a hands-on microservices. I hope you continue this maybe some event sourcing, cqrs, kubernetes, anything related to microservices 🥰🎉 I hope you'll have a course of a project in microservice structure. ♥️ Thanks a lot.
You need to close haprocy folder ( click the arrow ) then create a new file, it will be created in the root. I might be late but I'm helping : ) ,and thank you for all your efforts and the stuff you taught us.
Keep getting this ridiculous error - Windows Machine. Any idea why this might be? parsing [/usr/local/etc/haproxy/haproxy.cfg:12]: Missing LF on last line, file might have been truncated at position 31. lb_1 | [ALERT] 344/180729 (1) : Error(s) found in configuration file : /usr/local/etc/haproxy/haproxy.cfg
@Hussein Nasser At the end of the video you had to stop and start the docker-compose in order to add a new nodeapp4, but doesn't that defeat the purpose? First issue is that you have to stop all instances (nodeapp* and the lb) instead of doing that dynamically and also adding a new nodeapp will run on the same physical machine, right?
Julian Lishev thanks Julian you make valid points. Two in facts. How do you update the configuration without down time and how do you split the containers on multiple physical machines. I will have to do some research and get back to you on the first one and make a video on it. The second one is probably we need a container orchestrator like k8 or docker swarm. Good points
while Nginx provides full web server, HA proxy is only a proxy, and you go with HA proxy. So my question is that do we need a full web server in front of our backend?
Enjoyable video, thank you. I thought microservice architectur requires some sort of API Gateway to redirect requests? Is running the same app in multiple containers really considered a microservice, or is this just plain dockerizing a basic node app? Cheers
its micro services in the same server( inside docker composer instance which is running on your server). when you separate each apps and dbs etc into different machines you would need APIs to call them instead of communicating in your localhost you would communicate withing your network
Are there performance differences between -> running haproxy/nginx as a docker container vs -> running them directly on the host ? In terms of both processing performance & network performance. thanks Hussein, amazing content! Binge watching them all! Keep going.
The Scientist none that I am aware of, if the container is assigned adequate memory/cpu it should be just as if running directly on the host. That being said it I am assuming the container daemon is running directly on the host not on a VM.
Hi, I'd like to ask you a question. If I have two microservices, how can I run them at the same port but in different paths? For example I want to config a microservice with the path localhost/microservice1/... and another microservice with the path localhost/microservice2/... Should I use an API Gateway? I have some difficulties to do this. Thanks.
correct me if i'm wrong. i think this is not microservices, microservices have a proxy and a registry and a load balancer to select the service required for an incoming request (payment, users...) which are not the same, every service has it's own logic and maybe his own database, whereas this is just duplicating the same service to multiple containers that it would scale
jasser saanoun thanks for your message. This is the simplest minimum basic building block of microservices. The proxies, sidecar pattern, security control plane, service discovery etc are additions to microservices architecture to make it actually manageable and maintainable and the final piece to add is kubernetes to manage all those containers.
Hussein Nasser You’re welcome! Here is the source for that: docs.docker.com/compose/faq/ YAML is a superset of JSON so (theoretically) any valid JSON is also valid YAML. I bet a lot of other applications support it but just don’t advertise it too!
Thanks Hussain ('shukran') one more Good video !! Quick question, How do you specify in docker-compose.yml an External MongoDB server Name (for an application which runs in container & trying to access?), would be very helpful (I believe it has something to do with docker network type of the docker container , since the DNS server inside Docker it is not aware of the external server (also directly editing /etc/hosts through edit command seems to be bit 'ugly' while starting container/ deployments), ANY Quick HELP greatly Appreciated
What if each microservice is in separarte repos ? Do i need to have a docker compose on each repo ? Do i need to pull each microservice and run docker compose on each one ?
Aslamoalikum brother, great content, Excellent work, do you speak urdu? can you entertain urdu speakers with your skills? it will be great services my friend
I thought I was doing something wrong but I cloned the whole Javascript playground and directly from git bash terminal went on the microservices docker build etc and the error is the same for haproxy. can not find the config file. The whole docker and redis community is a cancer to the society
I'm Having the same problem I think: lb_1 | [ALERT] (1) : config : Cannot open configuration file/directory /usr/local/etc/haproxy/haproxy.cfg : No such file or directory nodeapp1_1 | /bin/sh: 1: run: not found nodeapp2_1 | /bin/sh: 1: run: not found
Hussein , Awesome explanation on haproxy, can you please tell us how to run haproxy on container with https . Creating certificate on host machine works great wen haproxy is also started on host machine , but wen haproxy is running as a docker container with certificates created on host machine does not work . I did not find a way to create cert from container itself .Your input is valuable , please respond.
This video is for only load balancers not specifically for microservices. Can you make a video with microservices having different logic instead of just duplicating the same image?
the only difference would be how your API calls different services. you can run redis , postgres etc in the docer-composer and your apps will call them when needed. use only one app if you want and eliminate the load balancer
Yuxiang Zhang hello , it is the same concept just update the config to point to the right host. Of course you will need to orchestrate those hosts and containers if they got out of control
Get my Fundamentals of Networking for Effective Backends udemy course Head to network.husseinnasser.com for a discount coupon (link redirects to udemy with coupon applied)
Damn why does this only have one like? You know a lot about backend. I have a Udemy subscription, going to check the course out!
Love these "hands on" type of video
Now do one with RabbitMQ in the mix.
Nice! Seem like a fun person to be watching tutorials from :)
I love this guy! He explains it so effectively and with fun!
You and Arpit Bhayani are the only two guys that I prefer learning from when it comes to Engineering!
I'm so excited about this, a hands-on microservices. I hope you continue this maybe some event sourcing, cqrs, kubernetes, anything related to microservices 🥰🎉 I hope you'll have a course of a project in microservice structure. ♥️ Thanks a lot.
Love the practical and your love for code and networking. Respect Sir!
THE BEST TUTOR EVER!1!1!111
If you're fancy, use port 80. Love it!
John Lovell exactly not everyone got what it takes to use 80.. takes guts 😅
Cool video!
You are the real life version of Quagmire!
This one is the cooooooooooooooooolest tutorial I have ever never watched
System Design is really beautiful topic
You didn't have to flex on us with the singing skills too xD
You can click on the bottom empty part of the explorer window and then create a new file or folder it with it on root
Dude this is literally the best channel about coding I've ever met dude
This was excellent. Thanks, keep them coming
You are the best, man
You need to close haprocy folder ( click the arrow ) then create a new file, it will be created in the root. I might be late but I'm helping : )
,and thank you for all your efforts and the stuff you taught us.
Keep getting this ridiculous error - Windows Machine. Any idea why this might be?
parsing [/usr/local/etc/haproxy/haproxy.cfg:12]: Missing LF on last line, file might have been truncated at position 31.
lb_1 | [ALERT] 344/180729 (1) : Error(s) found in configuration file : /usr/local/etc/haproxy/haproxy.cfg
Did you find a solution bro?
@@eeebeltran5445 unfortunately not, man. Still waiting :(
same error
use this in docker-compose.yaml
lb:
image: haproxy:1.8
ports:
- "8080:8080"
volumes:
- ./haproxy/:/usr/local/etc/haproxy/
I know this is too late of a reply but I got the same error and I had to add one extra empty line at the end in haproxy.cfg
What a beautiful thumbnail man!
awesome dude
🙏
I subscribe and liked , two seconds into the video, you seem fun😂😂😂
Thanks Joe!!!
thanks my dude
Great video!
Done thanks 🙏
One Video on recommendation system please.
6:44 To get back to the the root folder click on the empty space under your files
Thanks George that works ! 👍
Cool, been waiting for this, thanks!
What an amazing guy! hahah
Thank you for this video not gonna lie clear my lot of doubts, you are the best BTW where is silver play button 🚀🙌
Glad it helped!
you were on a ton of coffee! hahahaa 🤣🤣
Good one bro
What about another version of the video where you use ngnix instead
Kerollos Magdy you read my mind! Coming next week
Good funny man yet information rich, Keep it up man :-)
This video made me subscribe 😆
❤️❤️❤️
this vid acc funny af lmfao.
In the sidebar, right click and add any folder, remove that folder from sidebar... in this way, you can see folder view in vscode sidebar...
Great vid. Good info. Quick question, how would I modify this to balance across 2 actual servers with 2 ip addresses ?
@Hussein Nasser At the end of the video you had to stop and start the docker-compose in order to add a new nodeapp4, but doesn't that defeat the purpose? First issue is that you have to stop all instances (nodeapp* and the lb) instead of doing that dynamically and also adding a new nodeapp will run on the same physical machine, right?
Julian Lishev thanks Julian you make valid points. Two in facts. How do you update the configuration without down time and how do you split the containers on multiple physical machines.
I will have to do some research and get back to you on the first one and make a video on it. The second one is probably we need a container orchestrator like k8 or docker swarm.
Good points
@@hnasr brother did you created any video regarding this update?
Dude, I love you
Great effort ! Thank you
Thanks Amine!!
but the other API endpoints does not work. like get('/fetch',..
while Nginx provides full web server, HA proxy is only a proxy, and you go with HA proxy. So my question is that do we need a full web server in front of our backend?
in vscode left side just right click up of OUTLINE to creak a file or folder on the root of the project
what is the difference between nodejs and haproxy
-t means tag
Missing LF on last line, file might have been truncated at position
Please can you help me
Enjoyable video, thank you. I thought microservice architectur requires some sort of API Gateway to redirect requests? Is running the same app in multiple containers really considered a microservice, or is this just plain dockerizing a basic node app? Cheers
its micro services in the same server( inside docker composer instance which is running on your server). when you separate each apps and dbs etc into different machines you would need APIs to call them instead of communicating in your localhost you would communicate withing your network
i git a problem when i try to use depends_on: - mongo
it gives me this alert config : Failed to initialize server(s) addr.
can anyone help please ?
Any recommendations for a api management gateway tool for usage and user management?
hey hussain i request you to please make some step by step tutorial on building a microservice with node, docker etc please
what did you drink || eat before the video, because i need some
lol what a fun tutorial
Are there performance differences between
-> running haproxy/nginx as a docker container
vs
-> running them directly on the host ?
In terms of both processing performance & network performance.
thanks Hussein, amazing content! Binge watching them all! Keep going.
The Scientist none that I am aware of, if the container is assigned adequate memory/cpu it should be just as if running directly on the host.
That being said it I am assuming the container daemon is running directly on the host not on a VM.
How to dynamcally scale backends without changing the config everytime
Hi, I'd like to ask you a question. If I have two microservices, how can I run them at the same port but in different paths? For example I want to config a microservice with the path localhost/microservice1/... and another microservice with the path localhost/microservice2/... Should I use an API Gateway? I have some difficulties to do this. Thanks.
I believe you can config it in nginx
@@EhSUN37 yes at the end I used Nginx
Nodejs microservice series with real app example
correct me if i'm wrong. i think this is not microservices, microservices have a proxy and a registry and a load balancer to select the service required for an incoming request (payment, users...) which are not the same, every service has it's own logic and maybe his own database, whereas this is just duplicating the same service to multiple containers that it would scale
jasser saanoun thanks for your message. This is the simplest minimum basic building block of microservices. The proxies, sidecar pattern, security control plane, service discovery etc are additions to microservices architecture to make it actually manageable and maintainable and the final piece to add is kubernetes to manage all those containers.
jasser & nasser - make friendship now !
Zoom further please.. Is it 4444 or something else? 😂😂😂
Nice work man..
“God I hate YAML 🍠”
Me too, buddy - fortunately, Docker-compose supports JSON as well if you don’t feel like tearing your hair out ;)
What! I didn’t know that it supports JSON! Thanks Noah 👏👍
Hussein Nasser You’re welcome! Here is the source for that: docs.docker.com/compose/faq/
YAML is a superset of JSON so (theoretically) any valid JSON is also valid YAML. I bet a lot of other applications support it but just don’t advertise it too!
Thanks Hussain ('shukran') one more Good video !!
Quick question, How do you specify in docker-compose.yml an External MongoDB server Name (for an application which runs in container & trying to access?), would be very helpful (I believe it has something to do with docker network type of the docker container , since the DNS server inside Docker it is not aware of the external server (also directly editing /etc/hosts through edit command seems to be bit 'ugly' while starting container/ deployments), ANY Quick HELP greatly Appreciated
What if each microservice is in separarte repos ? Do i need to have a docker compose on each repo ? Do i need to pull each microservice and run docker compose on each one ?
hi i know it's been 2 years already. But would you mind sharing how did you do it?
@@faridadli5984 I think i never did it jajaja
@@alxx736 🤣🤣
Aslamoalikum brother, great content, Excellent work, do you speak urdu? can you entertain urdu speakers with your skills? it will be great services my friend
I thought I was doing something wrong but I cloned the whole Javascript playground and directly from git bash terminal went on the microservices docker build etc and the error is the same for haproxy. can not find the config file. The whole docker and redis community is a cancer to the society
I'm Having the same problem I think:
lb_1 | [ALERT] (1) : config : Cannot open configuration file/directory /usr/local/etc/haproxy/haproxy.cfg : No such file or directory
nodeapp1_1 | /bin/sh: 1: run: not found
nodeapp2_1 | /bin/sh: 1: run: not found
could you pls do the same with java ?
Hussein ,
Awesome explanation on haproxy, can you please tell us how to run haproxy on container with https . Creating certificate on host machine works great wen haproxy is also started on host machine , but wen haproxy is running as a docker container with certificates created on host machine does not work . I did not find a way to create cert from container itself .Your input is valuable , please respond.
i just right click on folder in tree and create file
This video is for only load balancers not specifically for microservices. Can you make a video with microservices having different logic instead of just duplicating the same image?
the only difference would be how your API calls different services. you can run redis , postgres etc in the docer-composer and your apps will call them when needed. use only one app if you want and eliminate the load balancer
it is still a monolothic application
you need a load balancer in your voice
Hi Hussein, do you also have a tutorial on load-balancing remote containers ( containers located on different hosts )? That would be also helpful!
Yuxiang Zhang hello , it is the same concept just update the config to point to the right host. Of course you will need to orchestrate those hosts and containers if they got out of control
@@hnasr Thank you, this is already helpful! Looking forwards to your orchestration tutorials :D
It’s not microservices, it’s a monolith at horizontal scale.
zoom MOAR need closer!
are you sure you know what microservices are?
its not a microservice ,i find it more like a monolithic with loadbalancing
you are hilarious
please dude, behave as you want on your personal videos but it is gonna be perfect for you if you be little serious on your tutorial videos
Ahmet Buğra Çakıcı Thanks Ahmet 🙏
@@hnasr you are welcome my friend, you have really good knowledge thanks for videos
@@hnasr i like your funny stuff, but don't do them too much :D
I wish the tone was slightly more serious. Sadly, I stopped watching 2 mins into the video. You seem to have great knowledge of the subject though.
For people getting 502 ,just update nginx.conf to use
upstream all {
server host.docker.internal:portnumber;
}