Right now try switching between Airflow and Prefect. Sometimes Airflow is a lil bit overkill for certain ETL/ELT operations. Much modular with prefect and more pythonic than Airflow I guess, coz developing ELT/ETL orchestration in Prefect feels less hassle than Airflow. Just based on my experience.
great instead of negative engineering i'm now spending my time configuring five thousand broken python dependencies fuck this i'll negative engineer any day over this mess
Time for a prefect3 refresher 😅
Right now try switching between Airflow and Prefect. Sometimes Airflow is a lil bit overkill for certain ETL/ELT operations. Much modular with prefect and more pythonic than Airflow I guess, coz developing ELT/ETL orchestration in Prefect feels less hassle than Airflow. Just based on my experience.
great instead of negative engineering i'm now spending my time configuring five thousand broken python dependencies fuck this i'll negative engineer any day over this mess