Introducing Dagster+ : Beyond traditional orchestration
ฝัง
- เผยแพร่เมื่อ 4 ก.ค. 2024
- The Dagster Labs team introduces you to Dagster+, a data orchestration platform that pushes the boundaries of traditional orchestration.
With Dagster+ you can weave data quality, data cataloging, DataOps best practices, and advanced observability into your platform.
00:00 Intro
04:42 Data Catalog
09:57 Data Reliability
16:28 Branch Deployments with Change Tracking
19:40 Dagster+ Insights
26:06 Partnerships Ecosystem
28:09 Wrap up
(Note: this is a slightly edited version of the original launch video that was published on April 17th 2024) - วิทยาศาสตร์และเทคโนโลยี
Came here excited to learn about new features in the latest Dagster version. But it looks like you've decided to widen the feature-gap between the open source offering and the enterprise offering... even though this will be a maintenance burden on your team... causing delays in "backporting" features and bugfixes to the open-source version going forward. Kinda disappointed...
Thanks for the comment @JohnCF. If you go through the enhancements introduced with this Dagster+ launch, you will see that many of them (in fact, all of them except for Dagster Insights) benefit both the open-source and the commercial offerings. The data cataloging capability is a good example of that. From our perspective, these new additions are moving us forward on both the OSS and the Dagster+ roadmaps. In addition, by providing more value to those organizations that adopt Dagster+ we are able to guarantee the longevity and accelerated development of Dagster Open-Source.
@@dagsterio Does that mean what's mentioned at 7:15 about column lineage is available in open-source too? The phrasing definitely sounded like it's only available for Enterprise users...
@@JohnCF Correct. Column level lineage is a Dagster+ feature and is not available in Dagster Open-Source.