- 24
- 7 204
بالعربي Devblogit
Netherlands
เข้าร่วมเมื่อ 20 ก.ค. 2024
Apache Airflow EmailOperator
In this video, you will learn how to use EmailOperator to send emails using Apache Airflow
you can find the source code here
github.com/ansamAY/airflow_material/tree/f8f31484d8b1fa106733522b60599737712370cc/Airflow_EmailOperator
Edit your ".env" file
" AIRFLOW__SMTP__SMTP_HOST="smtp.sendgrid.net"
AIRFLOW__SMTP__SMTP_PORT="587"
AIRFLOW__SMTP__SMTP_USER="apikey"
AIRFLOW__SMTP__SMTP_PASSWORD="Your API"
AIRFLOW__SMTP__SMTP_MAIL_FROM="Your Email" "
#education #dataengineering #programming #dataarchitecture #apacheairflow #datafactory #softwareengineer #technology
you can find the source code here
github.com/ansamAY/airflow_material/tree/f8f31484d8b1fa106733522b60599737712370cc/Airflow_EmailOperator
Edit your ".env" file
" AIRFLOW__SMTP__SMTP_HOST="smtp.sendgrid.net"
AIRFLOW__SMTP__SMTP_PORT="587"
AIRFLOW__SMTP__SMTP_USER="apikey"
AIRFLOW__SMTP__SMTP_PASSWORD="Your API"
AIRFLOW__SMTP__SMTP_MAIL_FROM="Your Email" "
#education #dataengineering #programming #dataarchitecture #apacheairflow #datafactory #softwareengineer #technology
มุมมอง: 50
วีดีโอ
Apache Airflow Pools
มุมมอง 105วันที่ผ่านมา
In this video, we break down how to optimize task execution and resource allocation using Pools and Priority Weight settings. Learn: - What are Pools in Apache Airflow? - How to manage limited resources effectively. - How Priority Weight impacts task scheduling. - Real-world examples of Pools and Priority Weight in action. Whether you're a beginner or an advanced user, this video provides actio...
SQL Constraints
มุมมอง 7014 วันที่ผ่านมา
In this video, you will learn, - data types in SQL -Constraints like NOT NULL, UNIQUE, DEFAULT, INDEX, CHECK VALUE -Difference between primary key and foreign key #programming #database #sql #technology #dataengineering #dataanalyticscourse
SQL Introduction
มุมมอง 3414 วันที่ผ่านมา
In this video, you will lean -What is SQL? - What are DDL, DML, and DCL commands? - The roadmap to learn SQL #database #technology #softwareengineer #dataengineering #datascience #dataanalyticscourse -
Apache Airflow SLAs
มุมมอง 8621 วันที่ผ่านมา
In this video you will learn the following: -What is SLA? -What is the difference between SLA and timeout? -How to code SLA? #education #dataengineering #programming #dataarchitecture #apacheairflow #technology #datatechnology
Apache Airflow Sensors
มุมมอง 167หลายเดือนก่อน
In this video you will learn about the following: -What is a sensor? -How can you use SqlSensor -How can you use PythonOperator you can check the source codes here : github.com/ansamAY/airflow_material/tree/7f96cc3161131dd2c45561f519bd6b4a7f6ba79f/Airflow_Sensors #education #dataengineering #programming #dataarchitecture #apacheairflow #datafactory #technology #softwareengineer
What is a data fabric?
มุมมอง 242หลายเดือนก่อน
In this video, you will learn - What is data fabric? - The advantages of data fabric - Why do you need a data fabric -Tools that support data fabric #technology #software #softwareengineer #dataarchitecture #datascience #dataengineering #dataanalyticscourse #datafactory #data_fabric #microsoft
Variables in Apache Airflow
มุมมอง 169หลายเดือนก่อน
In this video, you will learn how to use variables in DAGS #technology #software #softwareengineer #dataarchitecture #apacheairflow #apachespark #datascience #dataengineering #dataanalyticscourse
How to Build DAG in Apache Airflow (Part3)
มุมมอง 280หลายเดือนก่อน
In this video you will learn : - How to create a task - How to use PostgresOperator - Dependency between tasks #technology #software #softwareengineer #dataarchitecture #apacheairflow #apachespark #datascience #dataengineering #dataanalyticscourse
How to Build your First DAG (Part 2)
มุมมอง 199หลายเดือนก่อน
In this video, you will learn tips about running and schedule time. and the difference between timedelta and corn expression. add this line in .env file after edit it with your time zone AIRFLOW CORE DEFAULT_TIMEZONE=Europe/Amsterdam #technology #software #softwareengineer #dataarchitecture #apacheairflow #apachespark #datascience #dataengineering #dataanalyticscourse
How to build your first DAG (Part 1)
มุมมอง 296หลายเดือนก่อน
In this video, you will learn about how to build your first DAG in Apache Airflow #technology #software #softwareengineer #dataarchitecture #apacheairflow #apachespark #datascience #dataengineering #dataanalyticscourse
The Fastest Way to Run Airflow Locally
มุมมอง 262หลายเดือนก่อน
In this video, you will learn how to run airflow locally in 2 steps check this link to know how to install Astro CLI www.astronomer.io/docs/astro/cli/install-cli/ #technology #software #softwareengineer #dataarchitecture #apacheairflow #apachespark #datascience #dataengineering #dataanalyticscourse
Setting Up Apache Airflow with Docker
มุมมอง 318หลายเดือนก่อน
In this video you will learn the following: How to Run airflow locally via Docker #technology #software #softwareengineer #dataarchitecture #apacheairflow #apachespark #datascience #dataengineering #dataanalyticscourse
How does Apache Airflow Work?
มุมมอง 225หลายเดือนก่อน
In this video you will learn: - How do all components of Apache Airflow work together? #technology #software #softwareengineer #dataarchitecture #apacheairflow #apachespark #datascience #dataengineering #dataanalyticscourse
Core Concepts of apache airflow
มุมมอง 255หลายเดือนก่อน
In this video you will learn: - What does DAG mean? - What does Operator mean? - The types of operators #technology #software #softwareengineer #dataarchitecture #apacheairflow #apachespark #datascience #dataengineering #dataanalytics
AI vs ML vs Gen AI vs LLM | What is the difference?
มุมมอง 2055 หลายเดือนก่อน
AI vs ML vs Gen AI vs LLM | What is the difference?
Data warehouse vs Data Lake vs Data lakehouse | What is the difference?
มุมมอง 9665 หลายเดือนก่อน
Data warehouse vs Data Lake vs Data lakehouse | What is the difference?