Hi Bala, I have one query regarding threads that you’d mentioned in QP I.e. 10 per node as per node configuration you have but at kafka-data there are only 6 partitions formed by default then how it will be allocated to 10 threads? Please if you can give some explanation about this and what is value of pySetting in DSS which is responsible for number of partitions at Kafka-data.
Hi, Standard Agent follow the physical table (pr_sys_qeues) and will use Queue for an agent method for queuing the items for processing. When it's come to Queue Processor will not follow the physical table right and we are using Queue for processing method for queuing the items for processing. Question, where these queued items will go and sit and how Queue processor will pick those and process them ? Want to understand on the how QP will process the items which are queued by Queue for processing method or with Run in back ground Shape in a flow ?
When you use dedicated queue processors the it always delayed for execution status. So whenever you queue an item using queue for processing method, it will store that item event into delayed_queue_items table. When it reaches the time them it will fetch the record from above table and publish that item as a message even to kafka topic, after that there is a realtime datflow subscribes the event and process it.
Absolutely loved it ...great session
Good session ,very useful
Keep watching
Hi Bala, I have one query regarding threads that you’d mentioned in QP I.e. 10 per node as per node configuration you have but at kafka-data there are only 6 partitions formed by default then how it will be allocated to 10 threads?
Please if you can give some explanation about this and what is value of pySetting in DSS which is responsible for number of partitions at Kafka-data.
Good Explanation
Keep watching
Hi,
Standard Agent follow the physical table (pr_sys_qeues) and will use Queue for an agent method for queuing the items for processing. When it's come to Queue Processor will not follow the physical table right and we are using Queue for processing method for queuing the items for processing. Question, where these queued items will go and sit and how Queue processor will pick those and process them ?
Want to understand on the how QP will process the items which are queued by Queue for processing method or with Run in back ground Shape in a flow ?
When you use dedicated queue processors the it always delayed for execution status. So whenever you queue an item using queue for processing method, it will store that item event into delayed_queue_items table. When it reaches the time them it will fetch the record from above table and publish that item as a message even to kafka topic, after that there is a realtime datflow subscribes the event and process it.
What will happen if someone not taking delayed QP?