Get my Fundamentals of Networking for Effective Backends udemy course Head to network.husseinnasser.com for a discount coupon (link redirects to udemy with coupon applied)
Keep getting this ridiculous error - Windows Machine. Any idea why this might be? parsing [/usr/local/etc/haproxy/haproxy.cfg:12]: Missing LF on last line, file might have been truncated at position 31. lb_1 | [ALERT] 344/180729 (1) : Error(s) found in configuration file : /usr/local/etc/haproxy/haproxy.cfg
I love this guy! He explains it so effectively and with fun! You and Arpit Bhayani are the only two guys that I prefer learning from when it comes to Engineering!
I'm so excited about this, a hands-on microservices. I hope you continue this maybe some event sourcing, cqrs, kubernetes, anything related to microservices 🥰🎉 I hope you'll have a course of a project in microservice structure. ♥️ Thanks a lot.
@Hussein Nasser At the end of the video you had to stop and start the docker-compose in order to add a new nodeapp4, but doesn't that defeat the purpose? First issue is that you have to stop all instances (nodeapp* and the lb) instead of doing that dynamically and also adding a new nodeapp will run on the same physical machine, right?
Julian Lishev thanks Julian you make valid points. Two in facts. How do you update the configuration without down time and how do you split the containers on multiple physical machines. I will have to do some research and get back to you on the first one and make a video on it. The second one is probably we need a container orchestrator like k8 or docker swarm. Good points
You need to close haprocy folder ( click the arrow ) then create a new file, it will be created in the root. I might be late but I'm helping : ) ,and thank you for all your efforts and the stuff you taught us.
I thought I was doing something wrong but I cloned the whole Javascript playground and directly from git bash terminal went on the microservices docker build etc and the error is the same for haproxy. can not find the config file. The whole docker and redis community is a cancer to the society
I'm Having the same problem I think: lb_1 | [ALERT] (1) : config : Cannot open configuration file/directory /usr/local/etc/haproxy/haproxy.cfg : No such file or directory nodeapp1_1 | /bin/sh: 1: run: not found nodeapp2_1 | /bin/sh: 1: run: not found
Hi, I'd like to ask you a question. If I have two microservices, how can I run them at the same port but in different paths? For example I want to config a microservice with the path localhost/microservice1/... and another microservice with the path localhost/microservice2/... Should I use an API Gateway? I have some difficulties to do this. Thanks.
while Nginx provides full web server, HA proxy is only a proxy, and you go with HA proxy. So my question is that do we need a full web server in front of our backend?
Enjoyable video, thank you. I thought microservice architectur requires some sort of API Gateway to redirect requests? Is running the same app in multiple containers really considered a microservice, or is this just plain dockerizing a basic node app? Cheers
its micro services in the same server( inside docker composer instance which is running on your server). when you separate each apps and dbs etc into different machines you would need APIs to call them instead of communicating in your localhost you would communicate withing your network
What if each microservice is in separarte repos ? Do i need to have a docker compose on each repo ? Do i need to pull each microservice and run docker compose on each one ?
correct me if i'm wrong. i think this is not microservices, microservices have a proxy and a registry and a load balancer to select the service required for an incoming request (payment, users...) which are not the same, every service has it's own logic and maybe his own database, whereas this is just duplicating the same service to multiple containers that it would scale
jasser saanoun thanks for your message. This is the simplest minimum basic building block of microservices. The proxies, sidecar pattern, security control plane, service discovery etc are additions to microservices architecture to make it actually manageable and maintainable and the final piece to add is kubernetes to manage all those containers.
Thanks Hussain ('shukran') one more Good video !! Quick question, How do you specify in docker-compose.yml an External MongoDB server Name (for an application which runs in container & trying to access?), would be very helpful (I believe it has something to do with docker network type of the docker container , since the DNS server inside Docker it is not aware of the external server (also directly editing /etc/hosts through edit command seems to be bit 'ugly' while starting container/ deployments), ANY Quick HELP greatly Appreciated
Hussein , Awesome explanation on haproxy, can you please tell us how to run haproxy on container with https . Creating certificate on host machine works great wen haproxy is also started on host machine , but wen haproxy is running as a docker container with certificates created on host machine does not work . I did not find a way to create cert from container itself .Your input is valuable , please respond.
Are there performance differences between -> running haproxy/nginx as a docker container vs -> running them directly on the host ? In terms of both processing performance & network performance. thanks Hussein, amazing content! Binge watching them all! Keep going.
The Scientist none that I am aware of, if the container is assigned adequate memory/cpu it should be just as if running directly on the host. That being said it I am assuming the container daemon is running directly on the host not on a VM.
Aslamoalikum brother, great content, Excellent work, do you speak urdu? can you entertain urdu speakers with your skills? it will be great services my friend
This video is for only load balancers not specifically for microservices. Can you make a video with microservices having different logic instead of just duplicating the same image?
the only difference would be how your API calls different services. you can run redis , postgres etc in the docer-composer and your apps will call them when needed. use only one app if you want and eliminate the load balancer
Hussein Nasser You’re welcome! Here is the source for that: docs.docker.com/compose/faq/ YAML is a superset of JSON so (theoretically) any valid JSON is also valid YAML. I bet a lot of other applications support it but just don’t advertise it too!
Yuxiang Zhang hello , it is the same concept just update the config to point to the right host. Of course you will need to orchestrate those hosts and containers if they got out of control
Get my Fundamentals of Networking for Effective Backends udemy course Head to network.husseinnasser.com for a discount coupon (link redirects to udemy with coupon applied)
Damn why does this only have one like? You know a lot about backend. I have a Udemy subscription, going to check the course out!
Now do one with RabbitMQ in the mix.
Love these "hands on" type of video
Nice! Seem like a fun person to be watching tutorials from :)
Keep getting this ridiculous error - Windows Machine. Any idea why this might be?
parsing [/usr/local/etc/haproxy/haproxy.cfg:12]: Missing LF on last line, file might have been truncated at position 31.
lb_1 | [ALERT] 344/180729 (1) : Error(s) found in configuration file : /usr/local/etc/haproxy/haproxy.cfg
Did you find a solution bro?
@@eeebeltran5445 unfortunately not, man. Still waiting :(
same error
use this in docker-compose.yaml
lb:
image: haproxy:1.8
ports:
- "8080:8080"
volumes:
- ./haproxy/:/usr/local/etc/haproxy/
I love this guy! He explains it so effectively and with fun!
You and Arpit Bhayani are the only two guys that I prefer learning from when it comes to Engineering!
You can click on the bottom empty part of the explorer window and then create a new file or folder it with it on root
I'm so excited about this, a hands-on microservices. I hope you continue this maybe some event sourcing, cqrs, kubernetes, anything related to microservices 🥰🎉 I hope you'll have a course of a project in microservice structure. ♥️ Thanks a lot.
If you're fancy, use port 80. Love it!
John Lovell exactly not everyone got what it takes to use 80.. takes guts 😅
Love the practical and your love for code and networking. Respect Sir!
Cool video!
You are the real life version of Quagmire!
6:44 To get back to the the root folder click on the empty space under your files
Thanks George that works ! 👍
What about another version of the video where you use ngnix instead
Kerollos Magdy you read my mind! Coming next week
but the other API endpoints does not work. like get('/fetch',..
@Hussein Nasser At the end of the video you had to stop and start the docker-compose in order to add a new nodeapp4, but doesn't that defeat the purpose? First issue is that you have to stop all instances (nodeapp* and the lb) instead of doing that dynamically and also adding a new nodeapp will run on the same physical machine, right?
Julian Lishev thanks Julian you make valid points. Two in facts. How do you update the configuration without down time and how do you split the containers on multiple physical machines.
I will have to do some research and get back to you on the first one and make a video on it. The second one is probably we need a container orchestrator like k8 or docker swarm.
Good points
@@hnasr brother did you created any video regarding this update?
System Design is really beautiful topic
This one is the cooooooooooooooooolest tutorial I have ever never watched
This was excellent. Thanks, keep them coming
One Video on recommendation system please.
You need to close haprocy folder ( click the arrow ) then create a new file, it will be created in the root. I might be late but I'm helping : )
,and thank you for all your efforts and the stuff you taught us.
i git a problem when i try to use depends_on: - mongo
it gives me this alert config : Failed to initialize server(s) addr.
can anyone help please ?
Any recommendations for a api management gateway tool for usage and user management?
Great vid. Good info. Quick question, how would I modify this to balance across 2 actual servers with 2 ip addresses ?
THE BEST TUTOR EVER!1!1!111
You didn't have to flex on us with the singing skills too xD
I thought I was doing something wrong but I cloned the whole Javascript playground and directly from git bash terminal went on the microservices docker build etc and the error is the same for haproxy. can not find the config file. The whole docker and redis community is a cancer to the society
I'm Having the same problem I think:
lb_1 | [ALERT] (1) : config : Cannot open configuration file/directory /usr/local/etc/haproxy/haproxy.cfg : No such file or directory
nodeapp1_1 | /bin/sh: 1: run: not found
nodeapp2_1 | /bin/sh: 1: run: not found
Dude this is literally the best channel about coding I've ever met dude
I subscribe and liked , two seconds into the video, you seem fun😂😂😂
Thanks Joe!!!
Hi, I'd like to ask you a question. If I have two microservices, how can I run them at the same port but in different paths? For example I want to config a microservice with the path localhost/microservice1/... and another microservice with the path localhost/microservice2/... Should I use an API Gateway? I have some difficulties to do this. Thanks.
I believe you can config it in nginx
@@EhSUN37 yes at the end I used Nginx
while Nginx provides full web server, HA proxy is only a proxy, and you go with HA proxy. So my question is that do we need a full web server in front of our backend?
Great video!
Done thanks 🙏
You are the best, man
Cool, been waiting for this, thanks!
What a beautiful thumbnail man!
awesome dude
🙏
what is the difference between nodejs and haproxy
Missing LF on last line, file might have been truncated at position
Please can you help me
In the sidebar, right click and add any folder, remove that folder from sidebar... in this way, you can see folder view in vscode sidebar...
Thank you for this video not gonna lie clear my lot of doubts, you are the best BTW where is silver play button 🚀🙌
Glad it helped!
How to dynamcally scale backends without changing the config everytime
Enjoyable video, thank you. I thought microservice architectur requires some sort of API Gateway to redirect requests? Is running the same app in multiple containers really considered a microservice, or is this just plain dockerizing a basic node app? Cheers
its micro services in the same server( inside docker composer instance which is running on your server). when you separate each apps and dbs etc into different machines you would need APIs to call them instead of communicating in your localhost you would communicate withing your network
-t means tag
What if each microservice is in separarte repos ? Do i need to have a docker compose on each repo ? Do i need to pull each microservice and run docker compose on each one ?
hi i know it's been 2 years already. But would you mind sharing how did you do it?
@@faridadli5984 I think i never did it jajaja
@@alxx736 🤣🤣
Good one bro
Great effort ! Thank you
Thanks Amine!!
correct me if i'm wrong. i think this is not microservices, microservices have a proxy and a registry and a load balancer to select the service required for an incoming request (payment, users...) which are not the same, every service has it's own logic and maybe his own database, whereas this is just duplicating the same service to multiple containers that it would scale
jasser saanoun thanks for your message. This is the simplest minimum basic building block of microservices. The proxies, sidecar pattern, security control plane, service discovery etc are additions to microservices architecture to make it actually manageable and maintainable and the final piece to add is kubernetes to manage all those containers.
jasser & nasser - make friendship now !
thanks my dude
Thanks Hussain ('shukran') one more Good video !!
Quick question, How do you specify in docker-compose.yml an External MongoDB server Name (for an application which runs in container & trying to access?), would be very helpful (I believe it has something to do with docker network type of the docker container , since the DNS server inside Docker it is not aware of the external server (also directly editing /etc/hosts through edit command seems to be bit 'ugly' while starting container/ deployments), ANY Quick HELP greatly Appreciated
hey hussain i request you to please make some step by step tutorial on building a microservice with node, docker etc please
Good funny man yet information rich, Keep it up man :-)
in vscode left side just right click up of OUTLINE to creak a file or folder on the root of the project
what did you drink || eat before the video, because i need some
Hussein ,
Awesome explanation on haproxy, can you please tell us how to run haproxy on container with https . Creating certificate on host machine works great wen haproxy is also started on host machine , but wen haproxy is running as a docker container with certificates created on host machine does not work . I did not find a way to create cert from container itself .Your input is valuable , please respond.
could you pls do the same with java ?
Dude, I love you
Are there performance differences between
-> running haproxy/nginx as a docker container
vs
-> running them directly on the host ?
In terms of both processing performance & network performance.
thanks Hussein, amazing content! Binge watching them all! Keep going.
The Scientist none that I am aware of, if the container is assigned adequate memory/cpu it should be just as if running directly on the host.
That being said it I am assuming the container daemon is running directly on the host not on a VM.
What an amazing guy! hahah
This video made me subscribe 😆
❤️❤️❤️
Nodejs microservice series with real app example
Aslamoalikum brother, great content, Excellent work, do you speak urdu? can you entertain urdu speakers with your skills? it will be great services my friend
you need a load balancer in your voice
This video is for only load balancers not specifically for microservices. Can you make a video with microservices having different logic instead of just duplicating the same image?
the only difference would be how your API calls different services. you can run redis , postgres etc in the docer-composer and your apps will call them when needed. use only one app if you want and eliminate the load balancer
it is still a monolothic application
“God I hate YAML 🍠”
Me too, buddy - fortunately, Docker-compose supports JSON as well if you don’t feel like tearing your hair out ;)
What! I didn’t know that it supports JSON! Thanks Noah 👏👍
Hussein Nasser You’re welcome! Here is the source for that: docs.docker.com/compose/faq/
YAML is a superset of JSON so (theoretically) any valid JSON is also valid YAML. I bet a lot of other applications support it but just don’t advertise it too!
i just right click on folder in tree and create file
this vid acc funny af lmfao.
you were on a ton of coffee! hahahaa 🤣🤣
Zoom further please.. Is it 4444 or something else? 😂😂😂
Nice work man..
are you sure you know what microservices are?
It’s not microservices, it’s a monolith at horizontal scale.
zoom MOAR need closer!
its not a microservice ,i find it more like a monolithic with loadbalancing
Hi Hussein, do you also have a tutorial on load-balancing remote containers ( containers located on different hosts )? That would be also helpful!
Yuxiang Zhang hello , it is the same concept just update the config to point to the right host. Of course you will need to orchestrate those hosts and containers if they got out of control
@@hnasr Thank you, this is already helpful! Looking forwards to your orchestration tutorials :D
lol what a fun tutorial
please dude, behave as you want on your personal videos but it is gonna be perfect for you if you be little serious on your tutorial videos
Ahmet Buğra Çakıcı Thanks Ahmet 🙏
@@hnasr you are welcome my friend, you have really good knowledge thanks for videos
@@hnasr i like your funny stuff, but don't do them too much :D
you are hilarious
I wish the tone was slightly more serious. Sadly, I stopped watching 2 mins into the video. You seem to have great knowledge of the subject though.
For people getting 502 ,just update nginx.conf to use
upstream all {
server host.docker.internal:portnumber;
}