Delta-rs, Apache Arrow, Polars, WASM: Is Rust the Future of Analytics?

แชร์
ฝัง
  • เผยแพร่เมื่อ 21 พ.ย. 2024
  • Rust is a unique language whose traits make it very appealing for data engineering. In this session, we'll walk through the different aspects of the language that make it such a good fit for big data processing including: how it improves performance and how it provides greater safety guarantees and compatibility with a wide range of existing tools that make it well positioned to become a major building block for the future of analytics.
    We will also take a hands-on look through real code examples at a few emerging technologies built on top of Rust that utilize these capabilities, and learn how to apply them to our modern lakehouse architecture.
    Talk by: Oz Katz
    Here’s more to explore:
    Why the Data Lakehouse Is Your next Data Warehouse: dbricks.co/3Pt... Lakehouse Fundamentals Training: dbricks.co/44a...
    Connect with us: Website: databricks.com
    Twitter: / databricks
    LinkedIn: / databricks
    Instagram: / databricksinc
    Facebook: / databricksinc

ความคิดเห็น • 6

  • @ScienceMinisterZero
    @ScienceMinisterZero ปีที่แล้ว +8

    Rust is the future of analytics for sure.

  • @domfp133
    @domfp133 8 หลายเดือนก่อน +1

    Grateful for the presentation

  • @tommynaugle3572
    @tommynaugle3572 9 หลายเดือนก่อน +2

    Are there plans to include polars in a future runtime?

    • @DenCato
      @DenCato หลายเดือนก่อน

      Indeed, providing Polars support and i.e do distributed Polars would be such a nice addition

  • @john-8268
    @john-8268 ปีที่แล้ว

    great job

  • @xorlop
    @xorlop 9 หลายเดือนก่อน

    Completely glossed over kafka and exactly once semantics... :(