MuleSoft | Parallel Processing using Splitter-Aggregator Design Pattern in Mule 4

แชร์
ฝัง
  • เผยแพร่เมื่อ 11 พ.ย. 2024

ความคิดเห็น • 22

  • @random-accessmemory9201
    @random-accessmemory9201 2 ปีที่แล้ว

    Very helpful on my new role as an Mulesoft Developer. Thank you!

  • @vishalshah8626
    @vishalshah8626 4 ปีที่แล้ว

    Excellent explained. I liked the way you are explaining the topics.

  • @random-accessmemory9201
    @random-accessmemory9201 2 ปีที่แล้ว

    My aggregation is incompelete that's why the setting of variable on "Aggregation complete" is not working.

  • @samgod9599
    @samgod9599 5 ปีที่แล้ว +1

    Very useful Info. Thanks for sharing

  • @konakalla1983
    @konakalla1983 5 ปีที่แล้ว +1

    For each works on single thread. I still did not understand how parallel processing is achieved in this example. Can you please clarify if I missed something?

    • @pratikpriyadarshi8910
      @pratikpriyadarshi8910 5 ปีที่แล้ว

      We can set the batchSize to vars.size in order to achieve parallel processing. Please refer to the example below:

    • @manojk8859
      @manojk8859 4 ปีที่แล้ว +1

      @@pratikpriyadarshi8910 : in this case why would you need for each then, as you are sending complete incoming data as it is without splitting

  • @thedeveloper2513
    @thedeveloper2513 5 ปีที่แล้ว +2

    Thanks siva. Very interesting topic

  • @sureshkumar-fw7jx
    @sureshkumar-fw7jx 3 ปีที่แล้ว

    Thanks for detailed explanation with use case. Can you please let us know, i which kind of scenario we have to use so that it give us a clue... :) thanks again.

  • @smitalawande9890
    @smitalawande9890 4 ปีที่แล้ว

    Hi siva,
    Can this be achieved by Batch Scope and Batch Aggregator? If yes then then how does it differ?
    Thank You,
    Smita

    • @sivathankamanee-channel
      @sivathankamanee-channel  4 ปีที่แล้ว +1

      Hi Smita - The Batch component is for asynchronous and Fire-and-forget pattern. This Splitter-Aggregator is for real-time processing where the performance can be improved slightly by parallel execution of mutually exclusive tasks. So, the 2 components are for completely different purposes. Please feel free to let me know if you need more use-case examples.

    • @smitalawande9890
      @smitalawande9890 4 ปีที่แล้ว

      @@sivathankamanee-channel Can large amount of data be handled by Splitter-Aggregator pattern? or will have to consider Batch component in this case?

    • @sivathankamanee-channel
      @sivathankamanee-channel  4 ปีที่แล้ว

      Hi Smita - Technically handling large amount of data depends on infrastructure. You need to either vertically or horizontally scale for large data or split it to smaller chunk of data.

    • @manojk8859
      @manojk8859 4 ปีที่แล้ว

      @@sivathankamanee-channel : when you say "where the performance can be improved slightly by parallel execution of mutually exclusive tasks" , I didn't exactly get where is parallel execution happening, for each execution takes place sequentially and not parallel as far as i know, please correct me if I am wrong.

  • @niranjansamunuri1564
    @niranjansamunuri1564 5 ปีที่แล้ว

    Nice video please do more videos on mule 4

  • @satyawas699
    @satyawas699 4 ปีที่แล้ว

    Nice videos sir

  • @swethareddyreddygari7569
    @swethareddyreddygari7569 5 ปีที่แล้ว +1

    Nice and intresting .Could you please explain spliiter and gather for xml or json payload

    • @sivathankamanee-channel
      @sivathankamanee-channel  5 ปีที่แล้ว

      Hi SwethaReddy - I have already added the video for Splitter-Gather. Please check this out: th-cam.com/video/gpgn7yQg26I/w-d-xo.html

  • @chukkaraghavendrarao
    @chukkaraghavendrarao 5 ปีที่แล้ว +1

    sir we need admin classes ... please provide us the sessions on mule admin

  • @satyabondili6482
    @satyabondili6482 5 ปีที่แล้ว +1

    Awesome

  • @saravanalinga
    @saravanalinga 4 ปีที่แล้ว

    great

  • @ysrsridhar
    @ysrsridhar 4 ปีที่แล้ว

    Thanks for the videos. They are great. Regarding for-each I have the following confusion.
    1 Regular For-each basically is used for iterative/ sequential processing .
    2. Parallel For-each is used for parallel processing.
    3. Regular For-each with batch-size is used to split the processing into batches of mule messages and does parallel processing.
    4. Scatter gather does parallel processing.
    5. Batch Job is parallel processing.
    I feel its an overkill by Mule 4 to provide so many overlapping activities for processing in parallel. When to use what and how exactly they differ is getting difficult to understand.
    Also when we say parallel processing for for-each ( with batch size) and parallel for -each - are we saying they are going to spawn multiple threads ?
    Can you help create a video to explain 1. differences in each of these 2. the way threads are spawned in each of these ? This will hugely benefit many of us learning and working on mule.
    Thanks again for your wonderful series of Mule learning vidoes. Appreciate it and enjoying them thoroughly.