What is Kafka | Tutorial | Beginners Guide

แชร์
ฝัง
  • เผยแพร่เมื่อ 28 ม.ค. 2025

ความคิดเห็น • 78

  • @vatsalbalde
    @vatsalbalde 3 ปีที่แล้ว +3

    On my weekends i keep on binge watching your videos.They are so well constructed and informative

  • @pallavkanaujiya
    @pallavkanaujiya 3 ปีที่แล้ว +1

    You are putting best effort to explain and provide us the clean and working code. Thanks a lot for all your help and explanations.

  • @manedurphy
    @manedurphy 3 ปีที่แล้ว

    I just hopped on to youtube to learn about Kafka and this was in my notifications. Perfect timing!

  • @georgelza
    @georgelza 3 ปีที่แล้ว

    Non the less... one of the best examples of how to stand up a Kafka cluster on a laptop that I've seen, thanks Marcel.

  • @nikhildogra7706
    @nikhildogra7706 3 ปีที่แล้ว +2

    Following all your tutorials thanks so much,waiting for video on keycloak

  • @nicotarquini
    @nicotarquini 2 หลายเดือนก่อน

    Thank you Marcel for all explications!! Excellent tutorial I'm going to test it! Greeting from Argentina

  • @kenchang3456
    @kenchang3456 3 ปีที่แล้ว +1

    I recall you've talked about docker and I think kafka before but I'm so glad you've decided to revisit these two great tools. Thank you very much!

  • @gompro
    @gompro 3 ปีที่แล้ว +3

    Kind of video I’ve been waiting for. Great!

  • @mohammadtalep9913
    @mohammadtalep9913 2 ปีที่แล้ว +1

    Great work. Thanks for the sharing

  • @costa2016
    @costa2016 3 ปีที่แล้ว +1

    That was pure gold! Thanks for sharing your knowledge!

  • @rakavana8383
    @rakavana8383 3 ปีที่แล้ว +2

    Hi, 14:14 , i am facing issue with starting a zookeeper instance. It is not showed up when i run docker ps command. Follwed the same instruction set as specified your get repo. Please help. thanks.

    • @MarcelDempers
      @MarcelDempers  3 ปีที่แล้ว +1

      Instead of docker run -d , use -it for an interactive terminal which will display a log with the reason for failure

    • @deepakdagar_change_is_in
      @deepakdagar_change_is_in 3 ปีที่แล้ว +1

      @@MarcelDempers yes me too... it gives :invalid option
      github.com/overhangio/tutor/issues/31

    • @deepakdagar_change_is_in
      @deepakdagar_change_is_in 3 ปีที่แล้ว

      Please suggest, if you resolved it. Seems like something to do with mounting of volumes in docker

    • @pereirabrian
      @pereirabrian 3 ปีที่แล้ว

      @@deepakdagar_change_is_inI also got : invalid option. This is a Windows problem. The To fix it, use Notepad++ to open the dockerfile. In the Notepad++ menu do this. Edit -> EOL conversion -> Unix LF. Then run all the commands. This solves it. Repeat for script files and property files if required.

    • @pedro-br1mo
      @pedro-br1mo 2 ปีที่แล้ว +1

      @@pereirabrian Thanks!! That solved it!

  • @bimasion6750
    @bimasion6750 2 ปีที่แล้ว

    I found u very informative sir, thank you so much

  • @RenierBotha-nl1kv
    @RenierBotha-nl1kv 2 ปีที่แล้ว

    This was an excellent intro to Kafka! Well done and keep it up

  • @georgelza
    @georgelza 3 ปีที่แล้ว +1

    ... would be great if at the 15:52 mark you included the -v to mount a volume on host into the container to store the kafka data files, aka making them persistent. easy enough to do... but all might not know how.

  • @Fayaz-Rehman
    @Fayaz-Rehman 3 ปีที่แล้ว +1

    Great - Could you also make a video - how to run kafka on kubernetes. Thanks

  • @Series0Tubes
    @Series0Tubes ปีที่แล้ว

    Thank you good sir. Very nice work.

  • @diljithm.d234
    @diljithm.d234 3 ปีที่แล้ว

    Been waiting for an easy Kafka tutorial for understanding. Thank you!!
    Please do a video on how to setup Apacha Solr and Zookeeper.

  • @benalexander9583
    @benalexander9583 3 ปีที่แล้ว

    Just wanted to say keep up the great work man. Your videos have been a great help in my education/career

  • @atulchahande4966
    @atulchahande4966 3 ปีที่แล้ว +2

    waiting for next video

  • @Aju-G
    @Aju-G 3 ปีที่แล้ว

    Waiting over❤

  • @musclecode
    @musclecode 3 ปีที่แล้ว +1

    Awesome as always 💪

  • @s3999
    @s3999 3 ปีที่แล้ว

    Top quality content... as always!

  • @kevinyu9934
    @kevinyu9934 3 ปีที่แล้ว

    Very helpful. I'd like to see more videos about more real-life application built with Kafka! Keep going man!!!

  • @SaiPravesh
    @SaiPravesh 3 ปีที่แล้ว

    Great video, your channel is really under rated your work is amazing...

  • @assaduzzaman_dsi
    @assaduzzaman_dsi 3 ปีที่แล้ว +1

    Nice and excellent video. It is my humble request if you add a video for multiple zookeeper instances and a question do you have any plans for do the same on kubernetes?

    • @MarcelDempers
      @MarcelDempers  3 ปีที่แล้ว +1

      This is the first level 💪🏽
      The final boss is Kubernetes 🤓

  • @TheAll-AroundAficionado
    @TheAll-AroundAficionado 3 ปีที่แล้ว

    I'd like to see a future video on Zookeeper please.

  • @rksingh4965
    @rksingh4965 3 ปีที่แล้ว

    Your videos are awesome👍👍👍....which tool do you use as editor for creation dockerfile

  • @azamatabdullaev4580
    @azamatabdullaev4580 3 ปีที่แล้ว +2

    Very useful!

  • @CeezGeez
    @CeezGeez 3 ปีที่แล้ว

    11:50 - I wouldn't actually mind a follow-up video with a deep dive on Zoo Keeper

  • @a_k__
    @a_k__ 3 ปีที่แล้ว

    This is great! Keep up the good work!

  • @leniedor733
    @leniedor733 3 ปีที่แล้ว

    Would you upload a video with kafka 3.x version? The reason is just because Zookeeper is no longer in use and is set depricated in this new version.
    Thanks

  • @daesvideo
    @daesvideo 3 ปีที่แล้ว +1

    Hi, excelent tutorial, but I get an error when tring to run docker and can not run the container, the error is: invalid option | /bin/bash: - . Help me please, Thank you very much!.

  • @ganpatraoapte9034
    @ganpatraoapte9034 3 ปีที่แล้ว

    Great video
    Would like one on zookeeper, thanks

  • @karlovasiradio
    @karlovasiradio 3 ปีที่แล้ว +14

    I'd like to watch a video about Zookeeper explanation.

    • @georgelza
      @georgelza 3 ปีที่แล้ว

      ditto... even though confluent is working on getting rid of Zookeeper, there is still loads of other technologies thats dependant on it.
      G

  • @rogerkaskar5399
    @rogerkaskar5399 3 ปีที่แล้ว

    This is great thank you! Would you be able to do a HA Kafka with 3 Kafka nodes and 3 Zookeeper nodes in a Kubernetes cluster?

    • @MarcelDempers
      @MarcelDempers  3 ปีที่แล้ว +1

      Of course 💪🏽 That is the final boss. This is level 1. We'll get there 😎

  • @nathan_falkon36
    @nathan_falkon36 ปีที่แล้ว

    you are the real mvp

  • @christianherrera9524
    @christianherrera9524 3 ปีที่แล้ว

    Great video 👍

  • @manishalankala1622
    @manishalankala1622 3 ปีที่แล้ว

    Great work , i would also like if this can be achieved via (aks,gke,eks) via terraform

  • @exit-zero
    @exit-zero 3 ปีที่แล้ว

    Great stuff!

  • @AshishKumar-ft6wv
    @AshishKumar-ft6wv 2 ปีที่แล้ว

    your are G.O.A.T.

  • @shyiramberejoseph9406
    @shyiramberejoseph9406 3 ปีที่แล้ว

    Hello, Could you work on file management in kubernetes such as uploaded files and database?

  • @weitanglau
    @weitanglau 3 ปีที่แล้ว

    Will you be making a video with KIP500 (v2.8) features in the future?
    This removes the need for zookeeper! I think it will be interesting!

  • @georgelza
    @georgelza 3 ปีที่แล้ว +1

    love it... but would have been great if you rather used confluent kafka, as there is loads of extra capability that people want... eventually, instead of the bare bones public drop.

  • @marklong6572
    @marklong6572 3 ปีที่แล้ว

    It will be nice to see how we can deploy Kafka on a k8s cluster.

  • @anton20002
    @anton20002 ปีที่แล้ว

    Respect 💪

  • @Gigabyteserviceofficial
    @Gigabyteserviceofficial 3 ปีที่แล้ว

    Please create a video about HAproxy & sticky session

  • @banul1449
    @banul1449 2 ปีที่แล้ว

    I'm sorry but i dont understand something. When i stopped the broker container witch stored the topic's message, after launching it back up, the message was still there. I thought that after stopping container this data would be lost, so where it is preserved?

    • @banul1449
      @banul1449 2 ปีที่แล้ว

      oh, its all stored in data folder, logs also so that's the answer, so we didnt need to search for topics messages inside the containsers, we could also look in our 'local' data folder

  • @juniordevmedia
    @juniordevmedia 3 ปีที่แล้ว

    Doesn't Kafka work without ZooKeeper now? or maybe i am mistaken. Thanks for the tutorial ❤️

    • @MarcelDempers
      @MarcelDempers  3 ปีที่แล้ว +3

      I've seen an article about it but I believe it's still on the roadmap 💪🏽

  • @vladoportos
    @vladoportos 3 ปีที่แล้ว

    Looks like MQTT, but its a java application ? Not to keen on Java apps ( personal experience in corp tought me that java is like Unity engine in game world, easy to start with but tends to die under heavy utilization )

    • @MarcelDempers
      @MarcelDempers  3 ปีที่แล้ว +1

      Kafka is a beast under heavy utilization :) 💪🏽

  • @rajdeeppal2375
    @rajdeeppal2375 ปีที่แล้ว

    Hi @devopsguy . Your videos are awesome . Just a request could you make videos on cloud functions ( lambda / azure functions / Google cloud functions ) . Like with the entire folder structure and the use cases . It will be really helpful bro

  •  3 ปีที่แล้ว

    You rock!

  • @GerhardGrasberger
    @GerhardGrasberger 3 ปีที่แล้ว

    very helpful video, thank you so much! where can i get this ultra cool t-shirt? ;-)

  • @yasirkaram
    @yasirkaram 3 ปีที่แล้ว +1

    How does Kafka messaging different from Axon or RabbitMQ in the CQRS world?

    • @MarcelDempers
      @MarcelDempers  3 ปีที่แล้ว +6

      Kafka is more of an event streaming system where Rabbit is a pure message queue. With Rabbit, 1 consumer gets the message, with Kafka, all consumers get a copy of the message. Messages can also be re-consumed\streamed with Kafka. With Rabbit once a message is consumed, its gone.

  • @a_k__
    @a_k__ 3 ปีที่แล้ว

    Can you make a video about elasticsearch?

  • @napstablook25
    @napstablook25 2 ปีที่แล้ว

    Followed the tutorial. I got Timed-out error while creating the topic. Used kafka version 3.1.0

    • @napstablook25
      @napstablook25 2 ปีที่แล้ว

      the issue is the create topic command. the option "zookeeper" is deprecated. You need to use --bootstrap-server and point it to "kafka-1:9092,kafka-2:9092,kafka-3:9092"

  • @soaring_dove
    @soaring_dove 3 ปีที่แล้ว

    skip to 0:00, that's where the GNAWWWLIDGE starts

  • @diegrootam
    @diegrootam 3 ปีที่แล้ว

    Esse homi tá pegando quanto no supino? A cada vídeo, +5cm de braço. Hurra, conta o segredo aí. By the way, excellent video. Congrats

  • @plopp.
    @plopp. 3 ปีที่แล้ว

    💪👍

  • @KrachaborasJB
    @KrachaborasJB 3 ปีที่แล้ว

    Give me Zookeeper !!! :)

  • @kurapatikumar2296
    @kurapatikumar2296 ปีที่แล้ว

    Zookeeper videos