ETL | AWS Glue | AWS S3 | Data Cleansing | Transforming data with AWS Glue in ETL workflows

[@sujithadas9844]

Loved your series on AWS Glue.. nicely explained.. 😊 Please upload more scenarios with other transformations such as join and filter !
Subscribed already.. thank you !!

[@cloudquicklabs]

Thank you for watching my videos.
Glad that it helped you.
Indeed I shall make more videos around this topic ahead.

[@KamalKumar-s7t]

Excellent video, please make more videos like that on ETL, admire your hard work, very smooth explanation…… Thanks

[@cloudquicklabs]

Thank you for watching my videos.
Indeed , I shall make videos on data engineering.
Glad that my videos helped you.

[@prabhajayashetty2297]

This is Excellent !!
Need help on loading the transformed data into Redshift. currently we getting error.
Is it mandatory to store the transformed data into s3 again in parquet format ?

[@cloudquicklabs]

Thank you for watching my videos.
It's not mandatory to keep it in s3.
Please check latest videos on this topic from my TH-cam channel. You would find the better.

[@rashmishah5682]

Thanks a lot....please make more videos with different transformation and also the use of cloudwatch and lambda with it....

[@cloudquicklabs]

Thank you for watching my videos.
Glad that it helper you.
I shall make more videos around this topic and Thank you for giving inputs.

[@richardlphillips]

Very helpful video. Thank you 🙂

[@cloudquicklabs]

Thank you for watching my videos.
Glad that it helped you.

[@WolfmaninKannada]

Excellent brother❤

[@cloudquicklabs]

Thank you for watching my videos.
Glad that it helped you.

[@yadi4diamond]

excellent

[@cloudquicklabs]

Thank you for watching my videos.
Glad that it helped you.

[@bellamkondapushpashree4923]

It is showing failed at the end after running the job ...can you make a video on how to debug this issue

[@cloudquicklabs]

Thank you for watching my videos.
You can find ETL pipeline logs if you go pipeline runs or you can also find the same at Cloudwatch log groups.

[@faisalmali3809]

How can I run multiple glue jobs.

[@cloudquicklabs]

Thank you for watching my videos.
Do you mean creating multiple job or multi threading within a job ?

[@KeyBooksInsights]

Bro your copying one one file could please tell me how to copy multiple files

[@cloudquicklabs]

Thank you for watching my videos.
It does copies all files present underneath folder path given in job. It's been mentioned in videos.

[@NandhuVlogs.]

Bro You create Glue job by using python script...... In real time..... Visual ETL is Never preferred......

[@cloudquicklabs]

Thank you for watching my videos.
Indeed , I would creating videos on creating job via python script. But this video is to focus on ETL topic.