Kafka + Microservices + Event Driven Architecture with NodeJS

In this tutorial we will learn how to use Kafka to communicate between microservices and pass events between containers
So we will learn how to create microservices and how to manage multiple projects using microservices and actual implementation and use case of Kafka with from scratch
We will also learn what are the extensions of VSCcode for using Kafka
How to write docker compose file and how to manage multiple Servies is what we are going to cover in this session
Find me anywhere : @itsmaheshkariya
#Kafka #Microservices #EventDrivenArchitecture

[@pabloendara-santiago514]

Great Video! But I'm curious to know why did you choose to use kafka-node over kafka-js

[@maheshkariya]

Kafka js is core library you should use it

[@GuilhermeFaxina-r5q]

@@maheshkariya thanks for answering after that much time

[@umeshthakre416]

Your channel is so underrated this is gold level stuff

[@maheshkariya]

This one comment is also equal to tens of million of subscribers. Thanks

[@umeshthakre416]

@@maheshkariya the content which you are providing is what really happens in production and in companies. This is missing from mostly from youtube

[@sideshow00]

Indeed

[@NomadStriver]

@@umeshthakre416 Totally agree.

[@aruprakshit7218]

Fascinating thing I learned today practically. You got me in your channel!

[@maheshkariya]

Welcome 🙏

[@k.ganesan3244]

Great Channel... your videos are advanced level... thanks for sharing.

[@maheshkariya]

Thanks 🙏

[@Piratacapitan]

Nice tutorial!
I can recreate all that you explained!
Nice Job

[@abdusamedakgul2311]

Thanks so much. Clear and very useful content.

[@maheshkariya]

Thanks

[@Lifeofapro2050]

Awesome Bro. I Was able to run the application successfully.

[@maheshkariya]

Thanks and don’t forget to subscribe if you enjoyed Okay 👍

[@N4533M1]

Anyone know where to find the source code for this?

[@kimokimo-se3ur]

Thank you very much for this helpful tuto god bless

[@maheshkariya]

Glad it helped

[@fareedmohammed7612]

Great tutorial. Thanks for this. Please share a link where the code can be accessed

[@DuyTran-ss4lu]

Great

[@swapnilsons]

Better to understood your work is appreciated

[@maheshkariya]

Subscribe will be enough for me I guess. 🙂

[@anvlog7483]

Awesome 👍

[@NomadStriver]

Excellent explanation... very helpful... keep creating such kind of videos.... already subscribed👍👍👍

[@maheshkariya]

Thanks

[@NightstalkerKK]

Can you please provide us with the github to the code?

[@easward]

Unable find this code in ur git repository, please mention it here

[@abderrahmane_24m]

Hello! thanks for the effort, one question though; I'm trying to add the node js app to docker compose, but docker is failing to install node-rdkafka, is there a way to do that?

[@fersomaster]

Could you show us how to deal with failures, between microservices, something about Dead Queue?

[@darrenhudson1033]

Look into the Saga design pattern. It rolls back transactions across multiple services if there has been an error.

[@berndeveloper]

Can you update this same format but doing it with the modern way to work with Kafka Kraft and NestJs?, good explanation btw!.

[@sideshow00]

How long would it take a new person to learn all this?

[@mkstallion89]

Great Video. Can you create a video with same example and rollback or failure

[@maheshkariya]

Sure

[@uditpandya3836]

A great tutorial! A couple of errors though. Mongodb keeps waiting for connections. Had to use network: to get rid of it. A second error which I haven't been able to solve is ` Error: getaddrinfo EAI_AGAIN kafka`. Any solution for this will be appreciated. Thanks!

[@okunlolaoluwaseun4390]

Thanks alot bro

[@AbhishekBisht-yt1el]

Hi Mahesh, Great content. This is something I’m doing as well.
I’m trying to send mongdb data to kafka broker through streams. My only issue is, I’ve not added wait time like you did over here and I get connection refuse after 3000 simultaneous requests to kafka broker.
The data I need to send is huge, lets say around 100K documents in an hour. Is there an effective way to do it? Will adding more brokers help? Will adding multiple server instances help?

[@ivancalisaya4218]

Buen video 👍

[@0xcoder542]

@Mahesh Kariya - thank you for creating such a great video. May I know is there a github link where I can get the source code?

[@VaishnavPureddiwar]

do you have a repo link?

[@ibringit]

🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰🥰

[@pankajwp]

Whats the autocomplete tool.. you are using for code completion..

[@maheshkariya]

GitHub copilot 😞

[@pankajwp]

@@maheshkariya ohh

[@abc_cba]

You're simply phenomenal.
How can we use this application to display on the front end as a React app?
Can you counsel me ?
I am willing to pay a fee for this

[@maheshkariya]

FYI thanks button is there after like button to support or pay directly. and no worries it will work same with react as well. this is mainly for background task like server side calling based on that you can trigger any thing via socket or calling api timely in 5 or 10 seconds which is standard way actually.

[@abc_cba]

@@maheshkariya thanks for responding, can you guide me through ?

[@kushaluk2381]

Hi ,Docker compose is showing error in vs code .. please help me to resolve this :
version: "3.8"
services:
zookeeper:
container_name: zookeeper
image: wurstmeister/zookeeper
ports:
- 2181:2181
kafka:
container_name: kafka
image: wrustmeister/kafka
ports:
- 9092:9092
volumes:
# - ./data/kafka:/tmp/zookeeper
- ./var/run/docker.sock/var/run/docker.sock
environment:
- KAFKA_ADVERTISED_HOST_NAME=kafka
- KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181
mongo:
container_name: mongo
image: mongo
ports:
- 27017:27017
volumes:
- ./data/mongo:/data/db
environment:
- KAFKA_ADVERTISED_HOST_NAME=kafka
- KAFKA_ZOOKEEPER_CONNECT=zookeeper:2181
mongo:
container_name: mongo
image: mongo
ports:
- 27017:27017
volumes:
- ./data/mongo:/data/db
postgres:
container_name: postgres
image: postgres
ports:
- 5432:5432
volumes:
./data/postgres:/var/lib/postgresql/data
environment:
- POSTGRES_USER=postgres
- POSTGRES_PASSWORD=postgres
- POSTGRES_DB=postgres

[@lynnegaming7328]

can i make it without docker

[@maheshkariya]

Might be

[@a_guy_called_Jerry]

okay

[@mdomerarafat4611]

Note: you have to create the topic by yourself.

[@maheshkariya]

Yes I guess

[@bhuvanye8370]

can anyone share the source code

[@maratakulov758]

the sound man..

[@shashankawasthi9291]

Why do you emphasize so much on the letter 'T' ? It makes the presentation too irritating for a tutorial session. Feels like I am in a gaming commentary session. Talk in natural voice man. On the other hand... the content is pretty good i cant skip it so will have to tolerate your voice. Thanks for the content :)

[@maheshkariya]

Oh! Sorry for that so in new videos I am not making such mistakes but Thank you so much for letting me bro will fix it 😎

[@Alfakatt]

Is he the first indian you ever heard speaking English or tf is your problem? 🤦🏻

[@maheshkariya]

@Alfakatt 😂😂

[@saeeduchiha5537]

It's a nice effort, but it's full of errors and not so well put together. I think it's not the creater's fault, its simply a very advanced topic cooked in a too short time!

[@maheshkariya]

You are right, But I still use same tutorial exactly to copy and create Kafka stuff this is one of my best videos, Don’t underestimate this one try again it will work for sure 100%

[@saeeduchiha5537]

@@maheshkariya I did try it and ...it didn't! sorry!

[@SahilRai2]

any newbie to kafka, should not watch this video.

[@Arcane_Dragon878]

thanks bro

[@NathanielBabalola]

Please create a Express J's microservice from scratch.
Also if you can please avoid speaking so closely to the mic

[@maheshkariya]

Sure I will make it

[@NathanielBabalola]

@@maheshkariya hello, good evening.... just wanted to ask, if we're still going to get this

[@paulvalor8022]

So many OKs. OK?

[@maheshkariya]

Hmm I will work on it

[@mahendranath2504]

Thank you so much 🤝, I liked it, and I'm a happy subscriber 🤗 like 👍 your video, could you do with rabbitMQ but any changes 🤌

[@maheshkariya]

Sure sure thanks bro