![Data Guy](/img/default-banner.jpg)
- 8
- 12 565
Data Guy
เข้าร่วมเมื่อ 7 ต.ค. 2023
How to prepare for Data Engineering Interview
This video goes over what to expect in data engineering interview rounds, how to prepare for it.
SQL
* Joins
* Self Join
* Window Functions
Coding
* String
* Dict
* Array
* Parse CSV/some file
System Design
* Design a data pipeline for a business usecase
Data Modelling
* Dimensional Modelling
* OBT
Behavorial Round
* Follow STAR
Important Concepts
* Spark
* Optimization
* Configuration
* Redshift or Snowflake or Databricks
* Knowledge of some cloud services
* Orchestration service like Airflow
SQL
* Joins
* Self Join
* Window Functions
Coding
* String
* Dict
* Array
* Parse CSV/some file
System Design
* Design a data pipeline for a business usecase
Data Modelling
* Dimensional Modelling
* OBT
Behavorial Round
* Follow STAR
Important Concepts
* Spark
* Optimization
* Configuration
* Redshift or Snowflake or Databricks
* Knowledge of some cloud services
* Orchestration service like Airflow
มุมมอง: 1 168
วีดีโอ
Data Engineering Interview - Cracking System Design
มุมมอง 1.1K3 หลายเดือนก่อน
This video covers framework and a checklist that will be helpful for your interviews.
Data pipeline design - Top 10 most viewed products
มุมมอง 9665 หลายเดือนก่อน
In this video, we will dive deep into use case of designing batch data data pipeline. We will go in detail on how to approach designing a pipeline in multiple ways given input requirements. Useful Resources: AWS SNS:aws.amazon.com/sns/ AWS SQS:aws.amazon.com/sqs/ AWS Lambda:aws.amazon.com/lambda/ AWS Glue:aws.amazon.com/glue/ AWS Kinesis:aws.amazon.com/kinesis/ AWS OpenSearch:aws.amazon.com/ope...
Real Time Data Pipeline Design
มุมมอง 1.7K9 หลายเดือนก่อน
In this video, we will dive deep into use case of designing real time data pipeline. We will go in detail on how to approach designing a pipeline. Useful Resources: AWS SNS:aws.amazon.com/sns/ AWS SQS:aws.amazon.com/sqs/ AWS Lambda:aws.amazon.com/lambda/ AWS Glue:aws.amazon.com/glue/ AWS Kinesis:aws.amazon.com/kinesis/ AWS OpenSearch:aws.amazon.com/opensearch-service/ AWS Quicksight: aws.amazon...
Data Engineering System Design Interview Framework
มุมมอง 7K9 หลายเดือนก่อน
In this video, we dive deep into framework that can be used for system design interview rounds for data engineers. CAP Theorem: www.geeksforgeeks.org/the-cap-theorem-in-dbms/ Whether you're preparing for a job interview at Big Tech companies or simply looking to enhance your data engineering skills, this video will be helpful. Don't forget to like this video, subscribe to Data Guy and hit the n...
Meta SQL Interview Question and Answer
มุมมอง 2039 หลายเดือนก่อน
In this video, we dive deep into SQL interview question asked in Meta DE interview round using CASE WHEN concept. Link to question explained in the video: datalemur.com/questions/click-through-rate Whether you're preparing for a job interview at Big Tech companies or simply looking to enhance your SQL skills, this video will be helpful. Don't forget to like this video, subscribe to Data Guy and...
FAANG SQL Interview Questions and Answers
มุมมอง 1779 หลายเดือนก่อน
In this video, we dive deep into 3 SQL interview questions from bigtechinterviews.com - 1 easy, 1 medium and 1 hard. Links to questions explained in the video: Q1 - app.bigtechinterviews.com/challenge/2oKppuIcHL5fur5l3wi6ij?context=eyJjb21wYW55SWQiOiI0d0dLaDJDQzNiT2VCOGpjQWl5dzB3In0= Q2 -app.bigtechinterviews.com/challenge/1t1Cd3k8b5lNpauAPk8vQV?context=eyJjb21wYW55SWQiOiIxYjljbXV1TDZSWGpXaGE0Z...
Amazon SQL Interview Questions and Answers
มุมมอง 2399 หลายเดือนก่อน
In this video, we dive deep into sample Amazon SQL interview questions from leet code interview experience - leetcode.com/discuss/interview-question/1070712/Amazon-DE-interview-question. Whether you're preparing for a job interview at Amazon or simply looking to enhance your SQL skills, this video will be helpful. Don't forget to like this video, subscribe to Data Guy and hit the notification b...
I am looking for mock interviews for FAANG companies preparation, and I will compensate for each session. Please let me if you are available
I am preparing for Big Tech companies and need some mock interviews sessions, I will pay for it, Share your LinkedIn in or ping me how to contact you.
great video, keep posting!
Is it applicable to service based companies also?
Why send data to sns when we can directly send to kinesis
watched all your videos. your system design framework video is great. please please try to make more data engineering system design, data modelling videos. there's a huge shortcoming for it.
If someone know Pyspark do python really required?
Not much python required but u should know enough to perform spark (pyspark) tasks
Can you please create videos oj system design for data engineering
Plz create batch processing data pipeline end to end real time
For the hard question do we need sub queries I thought you just have the same condition in a where clause directly
Great video sir, but what about linklist, stack and queue or oterh dsa topics are not those asked in interview?
Those are generally not asked in data engineer interviews, if you focus on leetcode medium level string, dict, list related problems - you should be good .
good video...thank u for sharing knowledge..
Thanks and welcome
Great content sir, could really use some resources to for preparing for these interviews. Thank you so much for sharing these.
Glad it was helpful!
Clear and precise 😊
Thanks! :)
It would be better if you also include a design with spark , EMR , S3 , Hive/Delta lakehouse architectures so that more people can relate.
Definitely, will try to comeup with videos covering the same architecture using different services for people to relate. Thanks for the comment.
awesome framework for thinking about DE interview! A "Part 2" would be very valualbe by covering the "Low Level Design" part such as scalability, validation etc from your other videos.
Sure - will make one video covering all the details.
Thank you for the insightful video! It was exactly what I was searching for. Could you possibly create a video demonstrating a real-time example of a system design interview question? I think it would be incredibly helpful to see how to approach and structure responses, particularly distinguishing between high-level and low-level design may be for a batch or real-time ETL pipeline example during an interview. Such a tutorial would really aid in visualizing the thought process and strategies to tackle these complex questions. Looking forward to possibly seeing this content!
Sure - Im planning to make few videos on designing pipelines in detail. Please stay tuned!
I have been doing hiccups on system design rounds so if you can come up with questions and use cases of system design and the approach or probable solutions to them then it'd be a great content man as nobody is touching these things
Definitely - plan is to focus on videos related to designing real world usecases.
Great video man, keep them coming it's quite informative and helpful for guys like me who's experience around 2 yrs in DE who can learn and take away alot from this, Just a suggestion please come up with different real word use case scenario on system design and interview focused with more frequency
Thank you for the comment - motivated to do more and sure, will make more videos consistently on designing real world use cases.
Great video!
Glad you enjoyed it
the video of system design framework, Realtime pipeline design and this video is very good and upto the mark. BUT there are something that you can improve and will be helpful. 1. font size is very small please zoom in while recording. 2. increase the voice 3. the video quality gets better on 720p and using 360p feels like 144p sometimes. kindly address this 4. you are designing pipeline with AWS, kindly give reference of other cloud platforms too that if we use AZURE or GCP how this pipeline will change. this helps lot to understand. As I'm azure data engineer some where i find it difficult to connect
Thanks for the feedback - agreed, recording quality isn't up to the mark. Will definitely improve it and yes - will make videos covering all 3 cloud platforms.
Please share the complete set of videos! This is the best video I came across!
Glad you liked it. I will create more videos on system design usecases. Please stay stuned!
Super helpful video! Appreciate the knowledge sharing. Thank you!
Thank you! :)
Great stuff
Hey, you are really great. Please create videos consistently. When I checked your channel there were only 4-5 videos, I would really appreciate it if you came up with more such videos.
Hi, Glad you liked the videos. Definitely, going to upload videos more frequently moving forward.
Good one! Appreciate your efforts.
Very nice walkthrough.
Glad you liked it! :)