Building ETL Pipeline using AWS Glue and Step Functions

Manage AWS Glue Jobs with Step Functions
Create an ETL solution using AWS Step Functions
also send notification when job succeeded by event bridge.
In this video , we create workflow using AWS Glue, AWS Step Function and AWS Event Bridge and SNS service.
we follows below steps.
1.create glue crawler and Glue ETL job
2.Create step function to execute Crawler and glue ETL job
3.Create SNS topic which send mail.
4.Event bridge trigger SNS when Glue ETL job succeeded.
THANK YOU FOR WATCHING .. PLEASE LIKE SHARE AND SUBSCRIBE
AWS GLUE ETL AND REDSHIFT RELATED DATA ENGINEERING VIDEOS.
• Create Redshift Cluste... (Create Redshift Cluster and Load Data using Python)
• AWS Glue ETL with Pyth... (AWS Glue ETL with Python shell |Read data from S3 and insert Redshift)(Not using Pyspark with glue)
• AWS GLUE Complete ETL ... (AWS GLUE Complete ETL Project Demo| Load Data from AWS S3 to Amazon RedShift)(Data engineer Project)
• Redshift using Python|... (Redshift using Python| Load and insert and copy data into redshift using psycopg2 )
• Aws Redshift tutorial ... (Aws Redshift tutorial |Amazon Redshift Architecture | Data Warehouse Concept)
• Building ETL Pipeline ... (Building ETL Pipeline using AWS Glue and Step Functions)
• AWS GLUE CRAWLER TUTOR... (AWS GLUE CRAWLER TUTORIAL with DEMO| Learn AWS GLUE)
• AWS GLUE CONCEPT|GLUE ... (AWS GLUE CONCEPT|GLUE DATA CATALOG|GLUE TUTORIAL)
In case of any query, you can contact us directly on WhatsApp [phone]
and you can write mail [e-mail]
Request you to subscribe my channel Techno Devs with Saurabh and Press Bell icon & get regular updates on videos.

[@akashzade7361]

Thank you saurabh

[@jjayeshpawar]

Thanks for the video! Please make one video on step function error handling. If there is error at each step, what will we do?

[@mohandoke8306]

Great Saurabh ❤

[@TechnoDevs]

Thanks for watching my video.

[@mdali-jw1kf]

Hello Saurabh bhai,
Could you please create video on AWS data exchange. Basic introduction followed by demo?

[@TechnoDevs]

sure bro.

[@waseemswork]

Hi Saurabh,
Could you please create a video on "How to run Jar file in AWS Glue ETL" ?