Kafka Producers Explained
ฝัง
- เผยแพร่เมื่อ 10 ต.ค. 2024
- Learn how the data gets into Apache Kafka! Understand how Producers work and how to use them!
If you want to learn more: links.datacumu...
Get the Learn Apache Kafka for Beginners v3 course at a special price!
Don’t forget to subscribe to get more content about Apache Kafka and AWS!
I'm Stephane Maarek, a consultant and software developer, and I have a particular interest in everything related to Big Data, Cloud and API. I sat on the 2019 Program Committee organizing the Kafka Summit. I'm also an AWS Certified Solutions Architect, Developer, SysOps Administrator, and DevOps Engineer.
My other courses are available here: courses.datacu...
Follow me on social media:
LinkedIn - / stephanemaarek
Twitter - / stephanemaarek
Medium - / stephane.maarek
If you want to learn more, check out my Apache Kafka Series - Learn Apache Kafka for Beginners v2 course : links.datacumulus.com/apache-kafka-coupon
@stepane It's worth mentioning that, producers with acks=all will wait for sync from the min.isr broker property and not all replicas as mentioned in replication factor
BEST explanation I found So Far!
Very helpful. Thank you so much!
> They only have to specify one broker
How does the producer manage the broker crash? Or does it actually store a list of all brokers?
Who is that ONE person that has disliked this video? Haters got no chill.
How does sendBuffer work? What is the concept of batch-size plus linger.ms? What the concept of request-timeout and delivery-timeout and how does there configuration vary based on load throughput?
Hi Stephane,
Awesome videos... Can user create its own hashing function for partitioning data to multiple partitions while using key...
What is the cons without the key?
@stephen.....
Im facing issues on posting 1lakh messages per second from my producer java code, which has a single thread and 2 runnable methods with for loop of 5000 iterations each and also have provided delay through Scheduledfuture.can you please help
Amazing! The best tutorials on Kafka by far and no Indian accent is a huge plus vs 99% others.
Choosy Beggar
Is posting 1 lakh messages per second possible????
Anyone knows what could be the reason for invalid schema field in avro schema?
This does not explain anything. How does Kafka decide which key goes where? Where is keyed data replicated? Is the leader supposed to replicate with ack=1 or does it mean there is no replication?
Better read the reference doc.