AWS GLUE Complete ETL Project Demo| Load Data from AWS S3 to Amazon RedShift(Data engineer Project)

#AWS GLUE
Complete ETL project which used S3,AWS Glue, Pyspark, Athena, Redshift and also scheduler .
we create Glue Crawler ,Glue ETL script and design automatic workflow. you learn complete workflow.
Code available in below GitHub link.
github.com/saurabhgarg013/My_...
Amazon Glue Tutorial
complete Amazon Glue Project Tutorial in Hindi and English mix.
this video is long but very useful. you can learn how to write Glue ETL script
which read data from s3 and insert into redshift using AWS GLUE PYSPARK
and along with that you will learn about Glue Pyspark Code.
Below are the topics covered in the video:
AWS Crawler
AWS Glue ETL script
AWS Glue Workflow
AWS Glue with Redshift
AWS GLUE Concept
AWS Glue: Read CSV Files From AWS S3 Without Glue Catalog
AWS Glue: Insert data into Redshift Without Glue Catalog
AWS s3 + Glue +Athena
AWS s3 + Glue +Redshift
Pyspark Concept
Glue Dynamic Frame concept
Components of AWS Glue
Data catalog
Database
Crawler and Classifier
Glue Job
Trigger and workflow
Troubleshoot the AWS Glue error "VPC S3 endpoint validation failed
Setting up an S3 VPC gateway endpoint
To set up an S3 VPC gateway endpoint, follow these steps:
Open the Amazon VPC console.
In the navigation pane, choose Endpoints.
Choose Create Endpoint.
For Service Name, select com.amazonaws.us-east-1.s3. Be sure that the Type column indicates Gateway.
Note: Be sure to replace us-east-1 with the AWS Region of your choice.
For VPC, select the VPC where you want to create the endpoint.
For Configure route tables, a route to the S3 VPC endpoint is automatically added.
For Policy, leave the default option Full Access.
Choose Create Endpoint.
AWS GLUE ETL AND REDSHIFT RELATED DATA ENGINEERING VIDEOS.
• Create Redshift Cluste... (Create Redshift Cluster and Load Data using Python)
• AWS Glue ETL with Pyth... (AWS Glue ETL with Python shell |Read data from S3 and insert Redshift)(Not using Pyspark with glue)
• AWS GLUE Complete ETL ... (AWS GLUE Complete ETL Project Demo| Load Data from AWS S3 to Amazon RedShift)(Data engineer Project)
• Redshift using Python|... (Redshift using Python| Load and insert and copy data into redshift using psycopg2 )
• Aws Redshift tutorial ... (Aws Redshift tutorial |Amazon Redshift Architecture | Data Warehouse Concept)
• Building ETL Pipeline ... (Building ETL Pipeline using AWS Glue and Step Functions)
• AWS GLUE CRAWLER TUTOR... (AWS GLUE CRAWLER TUTORIAL with DEMO| Learn AWS GLUE)
• AWS GLUE CONCEPT|GLUE ... (AWS GLUE CONCEPT|GLUE DATA CATALOG|GLUE TUTORIAL)
AWS ATHENA AND LAMBDA RELATED
• ATHENA COMPLETE TUTORI... (ATHENA COMPLETE TUTORIAL WITH DEMO |AWS ATHENA TABLE PARTITION|DEMO)
• How to run Athena quer... (How to run Athena query from AWS Lambda DEMO|AWS ATHENA FROM LAMBDA)
• Athena using Python f... (Athena using Python for Beginners)
In case of any query, you can contact us directly on WhatsApp [phone]
and you can write mail [e-mail]
Request you to subscribe my channel Techno Devs with Saurabh and Press Bell icon & get regular updates on videos.

[@devanshpandey9098]

it is the one and only one video on the youtube through which you can understand whole concept of Athena,Redshift,Glue and S3 very easily.

[@akshaymuktiramrodge3233]

I don't know how to thank you...believe me this is one of the finest explanation of Glue on internet and also includes Athena and redshift. Thank you so much Saurabh . @Techno Devs with Saurabh

[@vinodsagar2412]

Sir.... No one in youtube will share this kind knowledge, u are really A God Of AWS.... thanks a lot .... guruji

[@Lakshvedhi]

One of the best video I saw on TH-cam about this topic. Thank you so much. Please make lot more videos on AWS data engineering.

[@user-el7qo3wf2k]

amazing content.

[@adityaverma4770]

it is truly a gem ...dil se shukriya!!

[@johnsonrajendran6194]

No other video is as in-depth as yours.

[@pushkarratnaparkhi2205]

Explained in great detail. Thanks a lot for your efforts.

[@user-ek8ro7my5v]

Hats off for you, Sir. Explanation was marvelous!

[@vaibhavvasani2401]

Thank you so much for the detailed tutorial.. covered fully from start to end

[@sajalhsn13]

Very in depth hands-on lesson. Greatly appreciate your hard work. Keep doing the good job. 💚

[@javeedmohammedabdul9274]

The way you explain step by step is just wow

[@Stardust_Tech_Studio]

Thanks Saurabh ... Your way of explanation and also your knowledge level is 10/10.

[@cloudandsqlwithpython]

This is excellent video on AWS...great work sir

[@shanmugagpa5863]

Really intuitive. Very well explained.

[@RAHULKUMAR-px8em]

Please Sir make a Playlist for all Services of stepwise services, Those are used in the AWS Data Engineer; Because New Joiner of your channel are confused which learn first and which learn next after this

[@saurabh2898]

crystal clear understanding ... GREAT

[@sayedsamimahamed5324]

Simply Wow. My hand automatically moved to the like and subscribe button even before completing the video. This video is a pure gem. Thank you for your knowledge. I will share you some more ideas to create video. Jate jate phirse apko bohot bohot dhanyawaad.

[@ankushchavhan_]

Great Session

[@itronicsolutions]

Really Very Helpful session with deep knowledge . Thank you so much for this. Please keep it up.