Sketching Pipelines Using DAG Authoring UI

แชร์
ฝัง
  • เผยแพร่เมื่อ 14 ต.ค. 2024
  • Presented by Amogh Desai & Shubham Raj.
    Cloudera Data Engineering (CDE) is a serverless service for Cloudera Data Platform that allows you to submit various Spark jobs and Airflow DAGs to an auto-scaling cluster. Running your workloads as Python DAG files may be the usual, but not the most convenient way for some users as it involves a lot of background around syntaxes, the programming language, aesthetics of Airflow, etc. The DAG Authoring UI is a tool built on top of Airflow APIs to allow one to use a graphical user interface to create, manage, and destroy complex DAGs.

ความคิดเห็น • 1

  • @rembautimes8808
    @rembautimes8808 หลายเดือนก่อน

    Very innovative feature, customers will definitely appreciate it