This video was quite informative. I've had hands-on experience utilizing lambda functions in various projects, such as updating partitions in Athena Tables. Additionally, in a separate project, I employed Lambda to consolidate multiple small CSV files into a single file on a weekly basis.
Hello, I'm thoroughly enjoying your videos on Data Engineering, and I'm curious about your upcoming plans. Could you share what's coming next? Will there be any content focusing on data quality checks using tools like Great Expectations or dbt? I'd be very interested in learning about industry-standard tools used for data quality checks during the ETL pipeline. Keep up the great work, and please continue sharing videos on Data Engineering! Your insights and tutorials are incredibly helpful.
Thank you so much. We hope to create as many awesome instructional videos that cut across data related fields such as data engineering, machine learning engineering, data science/data analyis which our audience will find most valuable. And yes, we plan to create videos on using tools such as great expectation and dbt including other orchestration tools such as prefect. We plan also delving into data warehousing using snowflake. Thanks for your comment.
I will be doing this in some weeks time. However, in the next week or so, I will be releasing an end-to-end data pipeline project where you will learn how to load data from S3 to redshift using airflow. Watch out for it.
Another simplified video even for dummies!..I make it a point to always check out for your releases...You are the best!!!!
I'm glad you find our videos valuable. Thank you so much for the kind words. This really means a lot to me.
Thank you so much for making this concept very easy to understand. It's much easier to learn from your teaching style.
Thanks so much for your kind words. I'm glad you found it easy to understand.
This video was quite informative. I've had hands-on experience utilizing lambda functions in various projects, such as updating partitions in Athena Tables. Additionally, in a separate project, I employed Lambda to consolidate multiple small CSV files into a single file on a weekly basis.
Awesome. Thx for sharing.
You are the best , please upload more videos so we can learn and grow from your knowledge.
Thank you! I'm glad you find our videos valuable. We will continue to upload awesome instructional videos.
Hello,
I'm thoroughly enjoying your videos on Data Engineering, and I'm curious about your upcoming plans. Could you share what's coming next? Will there be any content focusing on data quality checks using tools like Great Expectations or dbt? I'd be very interested in learning about industry-standard tools used for data quality checks during the ETL pipeline.
Keep up the great work, and please continue sharing videos on Data Engineering! Your insights and tutorials are incredibly helpful.
Thank you so much. We hope to create as many awesome instructional videos that cut across data related fields such as data engineering, machine learning engineering, data science/data analyis which our audience will find most valuable. And yes, we plan to create videos on using tools such as great expectation and dbt including other orchestration tools such as prefect. We plan also delving into data warehousing using snowflake. Thanks for your comment.
Hello sir, please can you create a video tutorial on how to copy data from s3 to redshift using glue?
I will be doing this in some weeks time. However, in the next week or so, I will be releasing an end-to-end data pipeline project where you will learn how to load data from S3 to redshift using airflow. Watch out for it.
Alright. Will be looking forward to it. Will you be adding a session for visualisation too? Like connecting Power BI to redshift?
@@godswillomonkhodion6393 Yes, we will be connecting quicksight to redshift.