The point about Rust freeing up reviewer resources is the really critical thing about it, IMO. My experience is that open source projects can have like several times more regular contributors doing serious stuff than a C++ project with equivalent reviewer resources.
This series is awesome, and I know the CMU Group has had a couple of papers researching Arrow and columnar formats. I wonder if DataFusion will enable a lot more research into various implementation aspects of the area.
It does the same thing. DataFusion can be said to be more composable, and it's got a small ecosystem with Ballista and such. But they're pretty similar.
Here are some a more concepts oriented presentations: 2023-03-31 The Apache Arrow DataFusion Architecture Part 1: Query Engines: th-cam.com/video/NVKujPxwSBA/w-d-xo.html: th-cam.com/video/NVKujPxwSBA/w-d-xo.html 2023-04-04 The Apache Arrow DataFusion Architecture Part 2: Logical Plans and Expressions.: th-cam.com/video/EzZTLiSJnhY/w-d-xo.html
The point about Rust freeing up reviewer resources is the really critical thing about it, IMO. My experience is that open source projects can have like several times more regular contributors doing serious stuff than a C++ project with equivalent reviewer resources.
This series is awesome, and I know the CMU Group has had a couple of papers researching Arrow and columnar formats. I wonder if DataFusion will enable a lot more research into various implementation aspects of the area.
pretty quick after zoom session. Thnx for uploading
Love Alamb!
Interesting video. It would be great if you could share link to slides.
Would you mind providing the link to the slides? They contain tons of links that I'd like to visit ;-)
docs.google.com/presentation/d/1WFQE8UcWoH6XcV_RCANPagAmj5HLepKGC7DNYnrBekU/edit#slide=id.p
th-cam.com/video/iJhRbDFJjbg/w-d-xo.html
I tried to leave the link but youtube doesn't show it -- maybe it needs moderation
Did u find it?
Sort comments by NEWEST and you will see the link to slides in this very thread.
How is data fusion different from velox ?
It does the same thing. DataFusion can be said to be more composable, and it's got a small ecosystem with Ballista and such. But they're pretty similar.
Lopez Lisa Harris Elizabeth Lopez Joseph
He speaks very fast. He could invest in less content, more on concepts and more pointers.
Here are some a more concepts oriented presentations:
2023-03-31 The Apache Arrow DataFusion Architecture Part 1: Query Engines: th-cam.com/video/NVKujPxwSBA/w-d-xo.html: th-cam.com/video/NVKujPxwSBA/w-d-xo.html
2023-04-04 The Apache Arrow DataFusion Architecture Part 2: Logical Plans and Expressions.: th-cam.com/video/EzZTLiSJnhY/w-d-xo.html
2023-04-05 The Apache Arrow DataFusion Architecture Part 3: Physical Plan and Execution: th-cam.com/video/2jkWU3_w6z0/w-d-xo.html
@@andrewlamb11 Thank you.
@@andrewlamb11 Thank you