- 19
- 786 890
Brijesh Gupta
India
เข้าร่วมเมื่อ 1 ก.ย. 2014
Consumer configs | heartbeat interval | session timeout | max.partition.fetch.bytes |fetch.max.bytes
This video explains kafka consumer configs in detail
You will get answers to below Consumer configs in this video
heartbeat.interval.ms
session.timeout.ms
max.partition.fetch.bytes
fetch.max.bytes
Find below the Part-1 of "Kafka Consumer configs".
th-cam.com/video/m9hofCYzH3g/w-d-xo.html
Find below the detailed video on "SSL/TLS".
th-cam.com/video/E0TU65hfsJg/w-d-xo.html
Find below the video on "Consumer groups in Kafka".
th-cam.com/video/zVSaT0glaX8/w-d-xo.html
Find below the video on "Topic creation, run console Producers, run console Consumer" in Kafka.
th-cam.com/video/pj6VoHAAXGQ/w-d-xo.html
Find below the video on how to setup Zookeeper cluster with 3 zookeeper node on local machine.
th-cam.com/video/l6Ta75ZSXi4/w-d-xo.html
Find below the video on how to setup Kafka cluster with 3 broker on local machine.
th-cam.com/video/tk5cUqQA9E8/w-d-xo.html
Find below the link to Kafka tutorial series Playlist.
th-cam.com/play/PLxv3SnR5bZE82Cv4wozg2uZvaOlDEbO67.html
Find below the official documentation of Apache Kafka.
kafka.apache.org/documentation.html
I graduated from IIT BHU Varanasi and currently work as a Software engineer with a MNC company.
MIC :- amzn.to/34Z12rr
TRIPOD :- amzn.to/3FxFI91
LIGHT STAND :- amzn.to/322VXNr
Green Curtain :- amzn.to/3KdKbB6
Connect with me on LinkedIn.
www.linkedin.com/in/BrijeshGupta96
Connect with me on FaceBook.
brijesh.iitbhu
Connect with me on Instagram.
BrijeshGupta__
You will get answers to below Consumer configs in this video
heartbeat.interval.ms
session.timeout.ms
max.partition.fetch.bytes
fetch.max.bytes
Find below the Part-1 of "Kafka Consumer configs".
th-cam.com/video/m9hofCYzH3g/w-d-xo.html
Find below the detailed video on "SSL/TLS".
th-cam.com/video/E0TU65hfsJg/w-d-xo.html
Find below the video on "Consumer groups in Kafka".
th-cam.com/video/zVSaT0glaX8/w-d-xo.html
Find below the video on "Topic creation, run console Producers, run console Consumer" in Kafka.
th-cam.com/video/pj6VoHAAXGQ/w-d-xo.html
Find below the video on how to setup Zookeeper cluster with 3 zookeeper node on local machine.
th-cam.com/video/l6Ta75ZSXi4/w-d-xo.html
Find below the video on how to setup Kafka cluster with 3 broker on local machine.
th-cam.com/video/tk5cUqQA9E8/w-d-xo.html
Find below the link to Kafka tutorial series Playlist.
th-cam.com/play/PLxv3SnR5bZE82Cv4wozg2uZvaOlDEbO67.html
Find below the official documentation of Apache Kafka.
kafka.apache.org/documentation.html
I graduated from IIT BHU Varanasi and currently work as a Software engineer with a MNC company.
MIC :- amzn.to/34Z12rr
TRIPOD :- amzn.to/3FxFI91
LIGHT STAND :- amzn.to/322VXNr
Green Curtain :- amzn.to/3KdKbB6
Connect with me on LinkedIn.
www.linkedin.com/in/BrijeshGupta96
Connect with me on FaceBook.
brijesh.iitbhu
Connect with me on Instagram.
BrijeshGupta__
มุมมอง: 16 442
วีดีโอ
Docker tutorial in hindi | Normal Computers | Multi-boot Computers | Video 1
มุมมอง 1.4K4 ปีที่แล้ว
Docker tutorial in hindi | Normal Computers | Multi-boot Computers | Video 1
Consumer configs | bootstrap.server | client.id | key & value Deserializer |group.id|fetch.min.bytes
มุมมอง 13K4 ปีที่แล้ว
This video explains kafka consumer configs in detail You will get answers to below Consumer configs in this video bootstrap.server client.id key.deserializer value.deserializer group.id fetch.min.bytes Find below the Part-1 of "Kafka Producer configs". th-cam.com/video/HEmvGLi2Fmo/w-d-xo.html Find below the detailed video on "SSL/TLS". th-cam.com/video/E0TU65hfsJg/w-d-xo.html Find below the vid...
Producer configs | compression.type | batch.size | linger.ms | buffer.memory | max.request.size |#15
มุมมอง 17K4 ปีที่แล้ว
This video explains kafka producer configs in detail You will get answers to below Producer configs in this video compression.type batch.size linger.ms buffer.memory max.request.size Find below the Part-1 of "Kafka Producer configs". th-cam.com/video/HEmvGLi2Fmo/w-d-xo.html Find below the detailed video on "SSL/TLS". th-cam.com/video/E0TU65hfsJg/w-d-xo.html Find below the video on "Consumer gro...
Producer configs | bootstrap |client.id | key&value Serializer|connections.max.idle.ms | acks config
มุมมอง 14K4 ปีที่แล้ว
This video explains kafka producer configs in detail You will get answers to below Producer configs in this video bootstrap.server client.id key.serializer value.serializer connections.max.idle.ms acks config Find below the detailed video on "SSL/TLS". th-cam.com/video/E0TU65hfsJg/w-d-xo.html Find below the video on "Consumer groups in Kafka". th-cam.com/video/zVSaT0glaX8/w-d-xo.html Find below...
What is SSL | Man in the middle attack | SSL vs TLS | SSL handshake explained wid example | In Hindi
มุมมอง 43K4 ปีที่แล้ว
This video explains about Secure Sockets layer (SSL) in detail. You will get answers to below questions in this video what is encryption what is decryption what is SSL what SSL stands for what is TLS what TLS stands for what is the difference between SSL and TLS what is MIMA (Man in the middle attack) what is SSL handshake how SSL works how SSL handshake works how SSL works step by step how SSL...
#Demo of Kafka internals | Demonstration of kafka producer, consumer & consumer group internals |#13
มุมมอง 13K4 ปีที่แล้ว
This video demonstrates the kafka internals which I taught in last few videos. I showed the demo of following Producer internals Consumer internals Consumer group internals Find below the video on "Consumer groups in Kafka". th-cam.com/video/zVSaT0glaX8/w-d-xo.html Find below the video on "Internals of Kafka Consumer" in Kafka. th-cam.com/video/C3CtoUmkIkU/w-d-xo.html Find below the video on "I...
Group coordinator | Group leader | Rebalance Internals | Apache Kafka Tutorial in Hindi | Video 12
มุมมอง 14K4 ปีที่แล้ว
This video explains about Group coordinator, Group leader and the process involved in Consumer group rebalancing You will get answers to below questions in this video what is group coordinator in kafka. who is group coordinator. what does a group coordinator do. what is group leader in kafka. who is group leader. what does a group leader do. difference between group coordinator and group leader...
Consumer group in kafka | consumer group rebalancing | Apache Kafka Tutorial in Hindi | Video 11
มุมมอง 20K4 ปีที่แล้ว
This video explains Consumer groups in Kafka and a detailed overview of Consumer Group Rebalancing. You will get answers to below questions in this video what is kafka consumer group what is kafka consumer group id how kafka consumer group works why kafka consumer group what is consumer group rebalancing process involved in group rebalancing Find below the video on "Internals of Kafka Consumer"...
Internals of Kafka Consumer | Offsets in Kafka | Apache Kafka Tutorial in Hindi | Video 10
มุมมอง 20K4 ปีที่แล้ว
This video explains how kafka consumer works and a detailed overview of offsets and their types. You will get answers to below questions in this video what is kafka consumer what is kafka consumer lag what is kafka consumer group id how kafka consumer read from partition how kafka consumer works internally how kafka consumer poll work how kafka consumer maintains offset where is kafka consumer ...
Internals of Kafka Producer | Offsets in Kafka | Kafka Tutorial in Hindi | Video 9
มุมมอง 18K4 ปีที่แล้ว
This video explains the internals of Kafka Producer and different stages of records when Producer send messages to Kafka cluster. You will also get answers to below questions in this video how kafka producer works how kafka producer works internally how kafka producer choose partition what is kafka producer key What is message key in Kafka How messages are logically stored in Kafka cluster. Wha...
Internals of Topics, Partitions & Replication Part-2 | Partition re-assignment | Kafka in Hindi | #8
มุมมอง 21K4 ปีที่แล้ว
This video explains the various commands for partition re-assignment (To alter number of Partitions and replication in a Kafka Cluster after creation of topics). This video also covers the following -: 1) How to increase Partitions of an already created topic. 2) How to increase Replicas of a partition. 3) How to re-assign or move partitions from one set of brokers to other set of brokers. Find...
Internals of Topics, Partitions and Replication Part-1 | Controller node | Kafka in Hindi | Video 7
มุมมอง 28K4 ปีที่แล้ว
This video explains the various states of Partitions and replicas in a Kafka Cluster and Also briefly tells about the Controller node. This video also covers the following -: 1) How to increase Partitions of an already created topic. 2) How to increase Replicas of a partition. 3) How to re-assign or move partitions from one set of brokers to other set of brokers. Find below the video on how to ...
Kafka Cluster Setup | 3 node Kafka Cluster | Local machine | Apache Kafka Tutorial in Hindi| Video 6
มุมมอง 38K4 ปีที่แล้ว
This video explains how to setup Kafka cluster with 3 Kafka nodes on local machine. Also explains what happens to topics when a broker crashes. What happens to the replicas of topics. Find below the video on how to setup Zookeeper cluster with 3 zookeeper node on local machine. th-cam.com/video/l6Ta75ZSXi4/w-d-xo.html Find below the video on how to setup Kafka cluster with 1 broker on local mac...
Zookeeper Cluster Setup | 3 ZK Node Cluster | Local machine | Apache Kafka Tutorial in Hindi|Video 5
มุมมอง 44K4 ปีที่แล้ว
This video explains how to setup Zookeeper cluster with 3 zookeeper nodes on local machine. This video also explains how to validate whether Zookeeper clusters are in quorum and which node is leader and which nodes are followers. Find below the video on how to setup Zookeeper cluster with 1 zookeeper node on local machine. th-cam.com/video/BkL5blN057M/w-d-xo.html Find below the link to Kafka tu...
Topic Creation | Run Console Producers & Console Consumer | Apache Kafka Tutorial in Hindi | Video 4
มุมมอง 59K4 ปีที่แล้ว
Topic Creation | Run Console Producers & Console Consumer | Apache Kafka Tutorial in Hindi | Video 4
Kafka Installation & Setup | Zookeeper Installation & Setup | Apache Kafka Tutorial in Hindi|Video 3
มุมมอง 96K4 ปีที่แล้ว
Kafka Installation & Setup | Zookeeper Installation & Setup | Apache Kafka Tutorial in Hindi|Video 3
Kafka Architecture | Key terminologies | Kafka Features | Apache Kafka Tutorial in Hindi | Video 2
มุมมอง 98K4 ปีที่แล้ว
Kafka Architecture | Key terminologies | Kafka Features | Apache Kafka Tutorial in Hindi | Video 2
What is Kafka | Messaging System | Distributed Environment | Apache Kafka Tutorial in Hindi |Video 1
มุมมอง 213K4 ปีที่แล้ว
What is Kafka | Messaging System | Distributed Environment | Apache Kafka Tutorial in Hindi |Video 1
hii i want notes this topic
Nice work Brijesh 👍
Thank you sir for explaining in a very good manner and in an easy method 🎉
Shandar
Shandar
Shandar
He is just translating English definitions to Hindi. Don;t expect to learn how SSL works.
Thanks bro
Good information explained in simple words, thank you. pls explain how to solve this error - Found no committed offset for partition.
nice explanation
Hi Sir , please make more video and complete this playlist ateast
Hi Brijesh, i have a doubt. when i run " bin/kafka-server-start.sh config/server.properties " It says "Classpath is empty. Please build the project first" . Please help me out. zookeeper is running fine. issue with kafka.
great explanation. we create zookeeper cluster for fault tolerance of zookeeper, right?
Yes, Thats correct
Very nice explanation. I am following this channel for Kafka Learning and till now I understood everything. The way of teaching is very good.
Thank you
Excellent presentation. Very keen to go through the further videos. Thanks so much.
Thanks
I am getting timeout error
i understood the concept but : Producer produced the data to a topic And then Consumer, consumed the data from that topic. So where this consumed data sits in the Kafka cluster ? And when what happens to the created topic which is there in the Kafka broker ? It'll just sit there and deleted when it hits the retention period?
Messages stay within persistence layer of Kafka cluster until they hit the retention threshold. on the other hand, Topics and partitions stay forever until someone manually deletes them
You are the best.... Please start making more videos on other topics...🙏🙏🙏
Thanks
@@BrijeshGupta Most welcome.Looking ahead for more such educational videos…
Your explanation so clear and easy to understand. Thanks for sharing your knowledge.
Thank you
Bhai video clarity is very poor. Try to use better camera . Amazing session ever !!❤
Please publish airflow and snowflake tutorial
Is there any chances messaging system loose their data if YES then how we will retrieve data ?
Great
zookeeper is deprecated but concept you explained very well
Super Video. Thanks for making it.
jo ppt aap use kar rahe ho. wo mujhhe kahan se milenge
I had followed the same steps to setup kafka broker on three different node/vm with different IPs. But as I start all three broker I get the following error java.io.IOException: Connection to server2-Ip:9092 (id: 2 rack: null) failed. Note in my ubuntu server the firewall is inactive.
He tried his best to explain things.. If you know by heart the architecture of Kafka then only you'll understand good
koi dikhawa nhi, koi fake accent nhi, koi criticism nhi. This is what an ideal teacher is expected of. Brijesh Sir thanks for this tutorial. I am planning for a switch and I know this tutorial will play a crucial role in my goal achievement.
Thanks. Wishing you all the very best 🙏
Very well explained
Good explanation
The simplest meaning of a Topic in Kafka is that it is equivalent to a Table in SQL database . I immediately understood the concept of topic.
great vid
LOVE FROM PAK
not friendly for English
Please make video on kafka message store at filesystem level
Ara aadmi ho ya James Bond, gazad banaye ho
Bro why are you not posting more videos in the Kafka series?😢
@brjjesh kumar gupta pls we need more videos like this on kubernetes and docker and on other topic as well
In a Kafka cluster, the group coordinator is responsible for managing consumer group membership and assigning partitions to consumers. If a particular coordinator is down, it should automatically be replaced by another broker in the cluster to ensure high availability and fault tolerance? in my case If a particular coordinator is down, then consumer not join other orordinator, getting error "No active consumer" Please help how to solve this problem.
In a Kafka cluster, the group coordinator is responsible for managing consumer group membership and assigning partitions to consumers. If a particular coordinator is down, it should automatically be replaced by another broker in the cluster to ensure high availability and fault tolerance? in my case If a particular coordinator is down, then consumer not join other orordinator, getting error "No active consumer" Please help how to solve this problem.
Thanks for this brilliant playlist, please make a playlist with Java implementation also, I was expecting that also but it didn't have.
Good
good
Nice tutorial perfect pitching point to point
best at 1.75x speed, neatly expalined 👏👏
All concepts are very well explained. Thank You Sir
JAI SHREE RAM🙏
Hi Brijesh, your explanation is too good, can you please also create playlist for Pinot db if possible.
Thank you for this tutorial.. Aapne bhut ache se explain kiya …. Can you please create tutorials on other tech also? Like mongo db, Kubernetes or react.js