Adam here. The DSP is the iterative evolution of data streaming. I've divided up the components into six major pieces to illustrate how it works. But let me ask you - what have you found for yourselves? Do you use something similar or different? And how has it affected your business use cases?
Can we connect data lakes with table formats e.g. iceberg and use the data portal part to actually label what the headings in those data formats mean? If yes, next question is can we do governance in the data portal like RBAC/ABAC for different sources of data.
Adam here - Tableflow is still in preview, so keep an eye on it here: www.confluent.io/product/tableflow/ That being said, we provide the ability to label headings / schemas in Confluent Data portal today for TOPICS. But since the table is derived from the topic, I believe that you'll also be able to add additional information as needed, since it's all using the same data portal. In terms of governance, yes, the intent is to integrate Tableflow with the existing RBAC.
while doing patching of Kafka brokers, usually we do last for C3 patching right. if we done C3 first and then activate controller broker patching. any issue vl happen ?
Adam here. The DSP is the iterative evolution of data streaming. I've divided up the components into six major pieces to illustrate how it works. But let me ask you - what have you found for yourselves? Do you use something similar or different? And how has it affected your business use cases?
@@ConfluentDevXTeam you didn't mention the Kafka Streams , will it be replaced by Flink ?
Great job. I understood everything. I'd love to see practical examples
Can we connect data lakes with table formats e.g. iceberg and use the data portal part to actually label what the headings in those data formats mean? If yes, next question is can we do governance in the data portal like RBAC/ABAC for different sources of data.
Adam here - Tableflow is still in preview, so keep an eye on it here: www.confluent.io/product/tableflow/
That being said, we provide the ability to label headings / schemas in Confluent Data portal today for TOPICS. But since the table is derived from the topic, I believe that you'll also be able to add additional information as needed, since it's all using the same data portal. In terms of governance, yes, the intent is to integrate Tableflow with the existing RBAC.
Great video would also be nice to get something similar for data mesh
while doing patching of Kafka brokers, usually we do last for C3 patching right. if we done C3 first and then activate controller broker patching. any issue vl happen ?
Adam here - I have no idea. I don't think you'll get the tech support you're looking for in the TH-cam comments of this video.