Introducing Dagster+ : Beyond traditional orchestration

แชร์
ฝัง
  • เผยแพร่เมื่อ 4 ก.ค. 2024
  • The Dagster Labs team introduces you to Dagster+, a data orchestration platform that pushes the boundaries of traditional orchestration.
    With Dagster+ you can weave data quality, data cataloging, DataOps best practices, and advanced observability into your platform.
    00:00 Intro
    04:42 Data Catalog
    09:57 Data Reliability
    16:28 Branch Deployments with Change Tracking
    19:40 Dagster+ Insights
    26:06 Partnerships Ecosystem
    28:09 Wrap up
    (Note: this is a slightly edited version of the original launch video that was published on April 17th 2024)
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 4

  • @JohnCF
    @JohnCF 8 วันที่ผ่านมา

    Came here excited to learn about new features in the latest Dagster version. But it looks like you've decided to widen the feature-gap between the open source offering and the enterprise offering... even though this will be a maintenance burden on your team... causing delays in "backporting" features and bugfixes to the open-source version going forward. Kinda disappointed...

    • @dagsterio
      @dagsterio  8 วันที่ผ่านมา

      Thanks for the comment @JohnCF. If you go through the enhancements introduced with this Dagster+ launch, you will see that many of them (in fact, all of them except for Dagster Insights) benefit both the open-source and the commercial offerings. The data cataloging capability is a good example of that. From our perspective, these new additions are moving us forward on both the OSS and the Dagster+ roadmaps. In addition, by providing more value to those organizations that adopt Dagster+ we are able to guarantee the longevity and accelerated development of Dagster Open-Source.

    • @JohnCF
      @JohnCF 6 วันที่ผ่านมา

      @@dagsterio Does that mean what's mentioned at 7:15 about column lineage is available in open-source too? The phrasing definitely sounded like it's only available for Enterprise users...

    • @dagsterio
      @dagsterio  5 วันที่ผ่านมา

      @@JohnCF Correct. Column level lineage is a Dagster+ feature and is not available in Dagster Open-Source.