Refactor First
Refactor First
  • 68
  • 332 927
Kafka Streams - Aggregate, Transform & Join With Windowing In 20 MINS | Spring Cloud Stream
In this video will look into how we can do Aggregation, Transformation and Joining using Spring Cloud Stream Kafka Streams
We will look into right from producing the message to a Kafka topic, then aggregating a Kafka stream, transforming it, and then finally joining two Kafka Streams.
You can always read about this in the article here: refactorfirst.com/spring-cloud-kafka-streams-aggregate-join-windowing
You can support me by buying me a coffee : www.buymeacoffee.com/amrutprabhu
-----------------
Gear I use :
-----------------
Sony Alpha a6000 : Amazon India : amzn.to/3RM7QMJ
Germany : amzn.to/3G1Iw24
US : amzn.to/3cpKZ9E
UK : amzn.to/3J0g5Ry
Razer Microphone : Amazon India : amzn.to/3aQxI9C
Germany : amzn.to/3DRRrAh
US : amzn.to/3ITKu3Q
UK : amzn.to/3v3RHbU
---- Chapters ---------
00:00 - Introduction
00:27 - Creating Spring Cloud Streams Kafka Project
01:22 - Kafka Stream Dependencies
01:38 - Kafka Streams Pipeline Example Overview
03:06 - Sending Message to Kafka Topic (Kafka Producer)
04:14 - Kafka Producer Properties
05:21 - Viewing Messages In The First Kafka Topic
06:10 - Kstream or Kafka Stream Transformation
06:58 - Spring Cloud Kafka Stream Properties
07:35 - Kafka Streams Serializer and Deserializer
09:14 - Viewing Kstream or Kafka Streams Transformation Output
10:02 - KStreams Or Kafka Streams Aggregation
12:41 - Spring Cloud Kafka Stream Aggregator Properties
14:06 - Viewing Kafka Stream Aggregation Output in Kafka Topic
15:47 - Kstream Or Kafka Stream Join Operation
17:30 - Spring Cloud Kafka Stream Joining Properties
18:44 - Custom Serializer Deserializer
19:40 - Viewing Kafka Stream Joining Output in Kafka Topic
21:06 - Conclusion
Music Credits:-
Sappheiros - Rain
----------------------------
Social Media
TH-cam th-cam.com/users/sappheiros
Spotify goo.gl/hE9MDJ
Twitter SappheirosMusic
Instagram sappheirosmusic
Facebook SappheirosMusic
Discord discord.gg/Pk87yN9
soundcloud.com/sappheirosmusic/rain1
--------------------------------------------------
มุมมอง: 3 022

วีดีโอ

How To Use Redis and Redis Insight With A Spring Boot Application
มุมมอง 1.7Kปีที่แล้ว
In this video, we will look at how you can use Redis inside a Spring Boot application. We will be making use of Redis Stack and explore its search and indexing capabilities. We will also look at the a browser client called Redis Insight to explore the contents of Redis. Finally we will also look into how we can store JSON documents inside Redis and search based on the JSON fields. You can also ...
How I Communicate with S3 Bucket In A Spring Boot Application Using Spring Cloud AWS S3
มุมมอง 4.3Kปีที่แล้ว
In this video we will look into how we can communicate with an AWS S3 bucket using Spring Cloud AWS S3. We will explore the various dependencies required and also look at the entire setup and code walkthrough. We will also write an integration test with Testcontainers and LocalStack. You can also read about this along with the GitHub link to the code: refactorfirst.com/spring-cloud-aws-s3-local...
How To Do Distributed Tracing With Opentelemetry in Spring Boot
มุมมอง 10Kปีที่แล้ว
In this video we will look into how we can capture distributed traces that are generated as part of communication between service. We will use Opentelemetry standards to export the traces from a Spring boot Application and the visualize the traces on a Jaeger dashboard. We will start the Jaeger dashboard using the docker image using docker compose. You can also read about this along with the Gi...
How to Connect Spring Boot 3 With MongoDB
มุมมอง 1.2Kปีที่แล้ว
In this video, we will will look into how we can communicate with MongoDB using Spring Boot 3. We will start our own MongoDB instance using docker compose and then save and retrieve data from MongoDB. We will also explore how to use ProblemDetails Object to report errors from an API. You can also read about this along with the GitHub link to the code: refactorfirst.com/spring-boot-with-mongodb-...
How FIDO2 Passwordless Authentication Works With Keycloak
มุมมอง 4.5Kปีที่แล้ว
In this video we will look into how we can do passwordless login using the FIDO2 WebAuthn passwordless authentication. We will explore how you can use your laptop to authenticate yourself to any website that provides FIDO2 authentication. We will then look at how you can do the same using your mobile device. You can also read about this along with the GitHub link to the code: refactorfirst.com/...
How To Use AWS Lambda Snap Start With Spring Cloud Function and Terraform
มุมมอง 624ปีที่แล้ว
In this video we will look into how we can run an AWS Lambda with Spring Boot and Spring cloud Functions. We will create a Lambda and API gateway using terraform and then check the performance of a Spring Boot Application by enabling Snap Start option on the Lambda function. You can also read about this along with the GitHub link to the code: refactorfirst.com/kick-start-spring-boot-application...
How To Add Network Problems with Toxiproxy
มุมมอง 1Kปีที่แล้ว
In this video we will look into how we can introduce some network problems to see how our application would react to it. We would add a latency in the connection and then a timeout to simulate network problems scenarios. You can support my content via : www.buymeacoffee.com/amrutprabhu You can also read about this along with the GitHub link to the code: refactorfirst.com/create-network-problems...
How to Deploy An Application With Skaffold
มุมมอง 751ปีที่แล้ว
In this video we will look at how you can use Skaffold to deploy a Spring Boot Application on a Kubernetes cluster. We will build our docker image with JIB plugin and use a Helm chart to deploy our application on to a Kubernetes cluster. You can also read about this along with the GitHub link to the code: refactorfirst.com/deploy-application-on-kubernetes-with-skaffold-helm-jib You can support ...
How To Implement GraphQL Query & Mutation in a Spring Boot Application
มุมมอง 1.3Kปีที่แล้ว
In this video we will look into implementing GraphQL query and mutation operations in a Spring Boot application. We will first define a Query, implement it and then execute the queries. Finally we will create an Integration test for the entire setup. You can also read about this along with the GitHub link to the code: refactorfirst.com/spring-boot-with-graphql Spring Boot Application Testing Ma...
How to Fetch Secrets from AWS Secrets Manager in a Spring Boot Application
มุมมอง 6Kปีที่แล้ว
In this video we will look into working with AWS Secrets Manager in a Spring Boot application. You will get to learn the following: - How to pull database credentials from AWS Secrets Manager in a Spring Boot Application. - How to use LocalStack with Spring Boot Application. - How to write integration test using Testcontainers for LocalStack and MySQL. You can also read about this along with th...
How To Remote Debug Java Application In A Kubernetes Pod With IntelliJ Or VSCode
มุมมอง 6Kปีที่แล้ว
In this video we will look into how we can debug a Java application running in a Kubernetes Cluster using IntelliJ Idea or VSCode ( Visual Studio Code). You can also read about this along with the GitHub link to the code: refactorfirst.com/how-to-remote-debug-java-application-on-kubernetes You can support me by buying me a coffee : www.buymeacoffee.com/amrutprabhu Gear I use : Sony Alpha a6000 ...
How to Use DynamoDB In A Spring Boot Application
มุมมอง 4.2K2 ปีที่แล้ว
In this video we will look into how we can communicate with a DynamoDB instance using a Spring Boot application. We will looking into defining a Primary Composite Key and then query the data using either the primary key or the partition key. You can also read about this along with the GitHub link to the code: refactorfirst.com/using-dynamodb-with-spring-boot You can support me by buying me a co...
How to Send Push Notifications with Spring Boot Using Websockets and STOMP
มุมมอง 41K2 ปีที่แล้ว
In this video we will be looking at how we can send a push notification to a client using spring boot application. We make use of WebSockets and STOMP protocol to send notifications to with all the clients or to specific client. You can also read about this along with the GitHub link to the code: refactorfirst.com/spring-boot-websockets-stomp-notifications You can support me by buying me a coff...
How to Fix Keycloak Logout Issue With Spring Cloud Gateway - Part 3
มุมมอง 3K2 ปีที่แล้ว
In this video we will be looking at how we solve the Keycloak logout issue with Spring Cloud Gateway Application. We will be using OAuth2 OpenId Connect (OIDC) mechanism to authenticate the user and then trigger a logout to log out the user the from the spring session as well as the Keycloak session. How To Integrate Keycloak With Spring Cloud Gateway : th-cam.com/video/TrASdBQu2_k/w-d-xo.html ...
How To Create Kubernetes Controller Using Spring Boot
มุมมอง 3.5K2 ปีที่แล้ว
How To Create Kubernetes Controller Using Spring Boot
How to Create a Kubernetes Custom Resource Definition (CRD) - Part 1
มุมมอง 7K2 ปีที่แล้ว
How to Create a Kubernetes Custom Resource Definition (CRD) - Part 1
3 Ways to Build Docker Images For Spring Boot Application
มุมมอง 2.9K2 ปีที่แล้ว
3 Ways to Build Docker Images For Spring Boot Application
How to Monitor Spring Boot Application With Prometheus and Grafana
มุมมอง 19K2 ปีที่แล้ว
How to Monitor Spring Boot Application With Prometheus and Grafana
How To Create CryptoCurrency With Smart Contract
มุมมอง 1932 ปีที่แล้ว
How To Create CryptoCurrency With Smart Contract
How To Use Spring Cloud Stream With Kakfa
มุมมอง 6K2 ปีที่แล้ว
How To Use Spring Cloud Stream With Kakfa
How to Connect Kafka With Spring Boot
มุมมอง 1.6K2 ปีที่แล้ว
How to Connect Kafka With Spring Boot
How To Integrate Circuit Breaker And Retry In A Spring Boot Application Using Resilience4J
มุมมอง 9K2 ปีที่แล้ว
How To Integrate Circuit Breaker And Retry In A Spring Boot Application Using Resilience4J
How to Integrate Spring Cache With Ehcache 3 In A Spring Boot Application
มุมมอง 10K2 ปีที่แล้ว
How to Integrate Spring Cache With Ehcache 3 In A Spring Boot Application
How To Externalize Configuration With Spring Cloud Config Server
มุมมอง 3.6K2 ปีที่แล้ว
How To Externalize Configuration With Spring Cloud Config Server
How To Integrate Jaeger Distributed Tracing With Spring Boot
มุมมอง 6K2 ปีที่แล้ว
How To Integrate Jaeger Distributed Tracing With Spring Boot
How To Integrate Keycloak RBAC With Spring Gateway And Resource Server - Part 2
มุมมอง 7K2 ปีที่แล้ว
How To Integrate Keycloak RBAC With Spring Gateway And Resource Server - Part 2
How To Integrate Keycloak With Spring Cloud Gateway - Part 1
มุมมอง 16K2 ปีที่แล้ว
How To Integrate Keycloak With Spring Cloud Gateway - Part 1
How To Do Distributed Tracing With Spring Cloud Sleuth In Spring Boot
มุมมอง 1.7K3 ปีที่แล้ว
How To Do Distributed Tracing With Spring Cloud Sleuth In Spring Boot
How To Use Micronaut Framework In Java? JPA Example With MySQL.
มุมมอง 3.1K3 ปีที่แล้ว
How To Use Micronaut Framework In Java? JPA Example With MySQL.

ความคิดเห็น

  • @molluru
    @molluru 9 วันที่ผ่านมา

    I tried same way but while connecting from intelliJ I get Unable to open debugger port (127.0.0.1:8888): java.io.IOException "handshake failed - connection prematurally closed"

  • @SuganyaBalasubramanian-b2k
    @SuganyaBalasubramanian-b2k 10 วันที่ผ่านมา

    Thanks for this amazing video. Can you please help to explore on AWS distro for open telemetry and Spring boot application

  • @iHelperRo
    @iHelperRo 10 วันที่ผ่านมา

    How can I remove those spring security default pages? Moving to Spring ouath2 client is the biggest pain in the ass with ui integration and everything.

  • @hamedhatami4831
    @hamedhatami4831 หลายเดือนก่อน

    How inconvenient is on Spring as compared to Quarkus OpenTelemtry enablement!

  • @AbhishekKumar-rr8ov
    @AbhishekKumar-rr8ov 2 หลายเดือนก่อน

    Refactor First - This is working fine if microservices is communicating each other with Rest API , but if microservices is communicating via GRPC its not working. Please suggest. Thanks in advance.

  • @victorwanderley52
    @victorwanderley52 2 หลายเดือนก่อน

    Great video. Thank you so much!

  • @ashoks609
    @ashoks609 2 หลายเดือนก่อน

    Hi I have question B3 header with custom traceid-spanid generated and sent from UI is not overriding auto generated one. Is there way to do that ? Thanks

  • @dishijain
    @dishijain 2 หลายเดือนก่อน

    Thanks worked very well with IntelliJ + GCP cluster deployment.

  • @dautofreitas8318
    @dautofreitas8318 2 หลายเดือนก่อน

    Thank you, excellent video.

  • @user-yf8jf3fo2x
    @user-yf8jf3fo2x 2 หลายเดือนก่อน

    i am loosing traceId between 2 services with this way, context not propоgated ( i use feign)

  • @cooltechie2193
    @cooltechie2193 3 หลายเดือนก่อน

    Can u guide me how to monitor rmq using prometheus and grafana

  • @HimanshuSharma-bq8oo
    @HimanshuSharma-bq8oo 3 หลายเดือนก่อน

    It is not working for me. I am using Spring version 2.3.1.RELEASE and Java version 1.8 Application is starting but AWSSecretManager classes are not loading. Please help.

  • @josvanoorschot6072
    @josvanoorschot6072 3 หลายเดือนก่อน

    Excellent job!

  • @saidmzee4107
    @saidmzee4107 3 หลายเดือนก่อน

    hello how can I make prometheus to not include its requests on the total number of requests made to the application, to only scrape the requests that have hit the application endpoints and not /actuator/prometheus

  • @GautamKumar-dg8qc
    @GautamKumar-dg8qc 3 หลายเดือนก่อน

    Thanks for this good content. I have one doubt, suppose in your case each retry is making 3 calls to the server, but this 3 is counted 1 as one for the circuitbreaker, what if I wanted to count the retries also in the circuitbreaker. means one call = 3 retries = 3 failurecall in circuitbreaker.

  • @user-qz1cz5xy5r
    @user-qz1cz5xy5r 3 หลายเดือนก่อน

    Nice work thanks keep up

  • @reynaldiichsanrahmawan724
    @reynaldiichsanrahmawan724 4 หลายเดือนก่อน

    Can I test it on postman? If so, how?

    • @narendrajangid11
      @narendrajangid11 4 หลายเดือนก่อน

      If you know than plz tell me how

  • @francoisgs1
    @francoisgs1 4 หลายเดือนก่อน

    Hi my new mic has a TRRS jack (3 black lines) but can see the sound is received by mic but cant hear from my mac? any suggestions? thanks

  • @elmahdiaitlmahfoud2309
    @elmahdiaitlmahfoud2309 4 หลายเดือนก่อน

    hello sir, why the producer is publishing messages every 1second in "first-topic"

  • @muppedaanvesh
    @muppedaanvesh 4 หลายเดือนก่อน

    Clear explanation, thank you! 👏🏻

  • @PrajwalM-ex8uc
    @PrajwalM-ex8uc 4 หลายเดือนก่อน

    Very Nice video, I have a question, is it possible to display the spring boot application's logs as well in the jaeger UI? How can we achieve it?

  • @francisco.amorim
    @francisco.amorim 5 หลายเดือนก่อน

    Does the second port support an egpu?

  • @user-zn8dm8cp5t
    @user-zn8dm8cp5t 5 หลายเดือนก่อน

    what if there is no authentication required or if the authentication is handled in the gateway?

  • @sequ3nce515
    @sequ3nce515 5 หลายเดือนก่อน

    Привет) Хорошее видео, спасибо. Посмотрел ещё парочку других. Специально оставил комментарий на русском, чтобы было понятно насколько разнородная может быть аудитория :)

  • @dimiro1
    @dimiro1 5 หลายเดือนก่อน

    I found this particular video useful

  • @Abhay.Bhandari
    @Abhay.Bhandari 5 หลายเดือนก่อน

    I have followed same steps but in my case generatePerson method is called again and again. Result is not getting stored in cache probably. Even there is no error in console. Why? What are the possibilities for where I am doing wrong?

  • @joaopaulodasilvajpaulosi1304
    @joaopaulodasilvajpaulosi1304 5 หลายเดือนก่อน

    I keep getting the following error Failed to publish metrics. Server responded with HTTP status code 404 and body 404 page not found

  • @lighninggamerz6571
    @lighninggamerz6571 5 หลายเดือนก่อน

    One thing I would like to know is using aws-secretsmanager-jdbc library if the application is using old password and now if secrets rotation happens how application works without restarting it ? I mean how application establishes the connection with new password without restarting ?

  • @phanhuudong1607
    @phanhuudong1607 5 หลายเดือนก่อน

    Can kafka push notifcation to moblie ? How to do that ?

  • @larsfischer2679
    @larsfischer2679 6 หลายเดือนก่อน

    Very useful demonstration, also works with Keycloak 24.

  • @DanielS.-km8gf
    @DanielS.-km8gf 6 หลายเดือนก่อน

    That was awesome!

  • @Demon_KD
    @Demon_KD 6 หลายเดือนก่อน

    Can you please suggest any udemy course to learn this kstreams, joins, ktables.

  • @sharadawasthi3258
    @sharadawasthi3258 6 หลายเดือนก่อน

    Excellent explanation - easy to learn!

  • @soumyagarg3735
    @soumyagarg3735 6 หลายเดือนก่อน

    What should be the hostname in the case where my application is deployed on kubernetes pod on gcp as clusterIp type of Instance such that it does not have a external ip address.

  • @tomjosi742
    @tomjosi742 6 หลายเดือนก่อน

    took me a while to figure about the docker thing. after doing little research though i was able to figure it out. great video keep it up .

  • @pankajbohra8637
    @pankajbohra8637 7 หลายเดือนก่อน

    How test using postman

    • @narendrajangid11
      @narendrajangid11 4 หลายเดือนก่อน

      If you know than plz tell me

  • @sumansaurabh6501
    @sumansaurabh6501 7 หลายเดือนก่อน

    Getting different traceId in both my application.

  • @eduardoholzmann853
    @eduardoholzmann853 7 หลายเดือนก่อน

    have some reference for use it with postman API? i need implement this with Flutter

  • @buntykumar7270
    @buntykumar7270 7 หลายเดือนก่อน

    Very informative video

  • @girishanker3796
    @girishanker3796 7 หลายเดือนก่อน

    Great video

  • @BasitSeyl3r
    @BasitSeyl3r 7 หลายเดือนก่อน

    how test user can answer private message?

  • @pranavmahajan4190
    @pranavmahajan4190 7 หลายเดือนก่อน

    Mitra ekadam mast tutorial aahe. Thanks

  • @tejeswarsahu5578
    @tejeswarsahu5578 7 หลายเดือนก่อน

    Is there a way to connect with u via email if possible... just wanted to take some suggestions about these kind of video recordings.. Thanks for all these knowledge

  • @BeingDeveloperWithAB
    @BeingDeveloperWithAB 7 หลายเดือนก่อน

    Will this work in stateless rest API and separate UI client

  • @JohnWindberg
    @JohnWindberg 7 หลายเดือนก่อน

    How about configuring log exporting to the otel-collector? I'm not having any luck getting that working.

  • @dotherap
    @dotherap 8 หลายเดือนก่อน

    Man, with all due respect, you have to go easy on the word 'particular'. Otherwise great video!

  • @himanshumahajan2405
    @himanshumahajan2405 8 หลายเดือนก่อน

    Hi Nice video. I have some doubts - 1. Can we do batch processing with KafkaStreams in Spring Cloud Stream ? 2. Is it possible to read and write to topics with different broker address ? 3. For scalable systems, does it support multithreading ? Because I tried consumer: concurrency property, doesn't seem to work.

  • @AadhithyanA
    @AadhithyanA 8 หลายเดือนก่อน

    In this tutorial, user is manually registering at the user side, OK that's fine. Here I had a issue that when the user is created by "ADMIN" and that user is supposed to login, it tells like "invalid username or password"!!!. please help me to solve!!. Thanks in advance.

    • @AadhithyanA
      @AadhithyanA 8 หลายเดือนก่อน

      Anyone!!

  • @Arjun-tg1go
    @Arjun-tg1go 8 หลายเดือนก่อน

    You have covered wide range of topics in your channel.. kudos to you! 👍🏼 One suggestion if I may, use some graphic for the topic you are covering at the beginning so that it lays the foundation and then you can get into the code.

  • @nenuanenenuane6645
    @nenuanenenuane6645 8 หลายเดือนก่อน

    thanks this is what i was looking for 😊