I am currently taking the IBM course as a stepping stone to changing career to data engineering from a non tech background. IBM Data Engineering is so beginner friendly where you get to understand foundational principles of data engineering. It is on these foundations and work experience(no matter how small) that one will need to proceed to Google cloud data engineering certification. Google Data Engineering certificate is for practicing data engineers that want to use Google Cloud Platform/Tools to get data engineering work done.
Yes. As a non tech bachelor's degree recipient, Google Data Engineer certificate indicates that there must be some understanding of Intermediate Python, and other skills or programming languages, as I was looking today. And , IBM is more like 0 knowledge of data engineering or data science (to use an umbrella term). Reviews complained about it taking to long as it has 14 courses. But I am thinking 🤔, well at least is beginner friendly. Yeah. Thank you for confirming the ease and beginner friendly of the IBM course.
@@ppa1983 I crunched it in a few months- on the other hand I wasnt a complete beginner. I think its probably better to do the IBM course first as its not focused much on the cloud services as I remember it.
I think the differences in value between Google's and IBM is evident in the difference of difficulty, the prerequisites, etc. It would seem based off of the recommended prerequisites Google listed for their DE professional certification exam that it's tailored to those who are already in the industry and looking to further their career's value, which I remember you've already mentioned in a previous video talking about Google's Data Engineering Coursera preparation course. Though it's good to note that because this is not a necessary requirement to register for the exam, any talented newcomer with no prior experience may attempt it as well. Whilst IBM's is aimed for those making to make a career transition, so its bar is lower, aiming to help enrollees become equipped well enough to take on any typical entry-level data engineering job. That's the main reason I decided to go with IBM's, the more digestible content should help me learn the foundations and work as well as I can within my ability, so that eventually I can produce resume projects that comfortably reflect my ability - at least that's the hope anyway! You're right in that if you spend more than 3 hours a week doing course content, you'll get it done sooner than the estimated time of completion. The calculated time for video content is accurate, but the readings, assignments, quizzes, projects, and hands-on labs are conservatively estimated so that if you take good notes and process the information well, I'd imagine most would be completing content faster than the estimated time. I'm currently able to devote about 2-4 hours every weekday, and am completing a week's worth of learning material each day, so truthfully the best estimates are; if you do it full-time, you'll be done with IBM's in about 2-4 months. On part-time, maybe around 6 months.
First, thank you for your very detailed response! I love it when other people add to the conversation because I am just one small perspective! In particular, I love the info on the timeline!
This is the exact reason why I decided to enroll in IBM’s course, which will provide me with a formal layout of the field, allowing me to navigate comfortably, and utilize various tools, to solidify my skills for projects/and entry-level employment. Then transition to GCP for more specialization😁... Keep up the good work 🙌
I am taking IBM's course for couple of months. Your comment for time estimations is not false, but if you are the type of person taking lots of notes during the sessions, it takes a bit longer than even their estimations. I also like to play around the lab environments when I'm on them, so yea it took lot more than their estimations.
The google cert looks interesting and I've been eyeing it for a while. Hopefully, Ill eventually get around to taking it.... eventually #EasilyDistracted Thanks for sharing this Ben!
Glad I saw your videos on data engineering. This gave me a clear way on what certifications to focus on. In the past month I decided to shift from Software Engineering to a more specialized role in data engineering. I saw your video on data engineering roadmap and it provides tons of value for me. Thank you!
So interesting as always! I’ve done the full learning path of the Google Cloud DE in a month, and I’m preparing for the final exam. Pd: I’ve just done my DE interview and think I nailed it, just waiting for the response. Thank you so much for your advices 😊
hey man, good to know that you have done well on your exam. Hope you get that job. I was wondering any course or book that would help me crack this. About me: never done any DE before. willing to learn. I know programming, ML. tHanks in advance.
Hi Eren, I was totally beginner, just with few Big Data concepts I gained on a subject during my Telecommunications Master’s. I’ve studied telecommunications engineering and due to my interest in Big Data, I took also some beginner courses of Big Data and finally, decided to take the full Professional Data Engineer Course of Google Cloud in Coursera to prepare to the exam. (I finally got my DE position😊)
@@Alez101010 good for you. My congratulations! And the last question, How much time you spent a day and how many months did it take for you? Thank you my friend for answer👍
Thanks this is true, I completed Google last year and I am about to finish IBM, doing both will give you broader understanding, but if you are a beginner I recommend you do IBM first it starts from scratch
Great video but I’m curious as to why you didn’t address the exam portion of this comparison. IBM doesn’t appear to have an exam for the moment and the DE exam is apparently very difficult for google- taking the course only helps your prepare for the exam.
Thanks for video. Definitely doing Google’s DE cert now. This has nothing to do with nothing, but one recommendation for the backdrop, maybe hide the Himalayan salt rock lamp’s wire to the back. Would look better for videos 👍
Speaking from personal experience with the IBM DE Cert, it's absolutely worth it and logically makes sense as part of your transition to DE. It gives a superb overview of the individual components of DE work, and really gets you in the correct mindset for this kind of work. I would recommend taking it, securing a job in the area (if you haven't already), and constantly improving your Python and SQL language skills, as to me they are and will always be the lifeblood of the profession. The platforms and ETL tools can all be learned through experience, but the language end of stuff is something you should be striving to improve on.
i'm following your channel for some time now. I was thinking of changing careers to data science, as it is very similar in the soft skills part to what i do now ( SEO ). I landed on your vid - why you should rather be a DE instead of DS. The part which made DS seem so familiar to me - explaining to people where the data comes from, how to look at it, etc - is actually the reason why i looked over changing the profession. I don't care for talking to people :) machine on the other hand ... :) So i was very happy to hear about DE. I made it to this video to decide where should i start. I got to say - i thought i will take what would seem an easier path with IBM, and with time skill up to Google cert. i made it superfast through the first 4 courses - i think it took me about a month to graduate all of them. That being said - i think there is too low emphasis on the part JUNIOR in the IBM DE course description. not knowing python beforehand, not having years of experience working with websites (CMS, whatever small of DB) and not having many years experience in working with web developers and technical layer of websites - it would be really hard to grasp the ideas, understand how each aprt connects to another, and what are some other possible uses. It would be great to see a followup - like "if you are beginner, take IBM certification, but additionally learn python, one RDBMS" - its all possible with coursera plus and courses they have, which is a nice bonus, but still, one should not expect to be fully functioning , even junior DE after graduating :) It just scratches the surface - and even me, unworthy little greenhorn DE enthusiast can see it :)
it is going great, and all inspired by you ! I outlined 72 courses I should take. I just finished 12th course (4 on postgress, 9 from IBM DE track) and tomorrow I get started with the Data Warehousing Udemy course you recommend :) A lot of work ahead, but i am happy to say i just started on 1st of may :) So quite a progress :)
@@kamilguzdek2789 hello there, is it true that the db2 cloud has a lot of issues when doing lab work? I’m planning on enrolling in this program and all the reviews for the python courses or SQL have bad reviews with people complaining about the difficulties logging and submitting homework in the IBM systems. Please advise
@@juanrosa6969 thats not my experience at all. Not once had i ad a buggy online lab, which i can’t say for google cloud courses. I think majority of time when you leave review online is when you had a bad experience. If you consider how many people take the courses, i’d say that the unhappy ones are still at low number. Also - i admit i had some difficult moments, but when i looked up the course discussion forums, i realisef that i didn’t follow closely the task guidelines, and took some things for granted, hence the lab didn’t work - so my fault :) i think it happened twice, and i took 16 ibm courses
Hi, I have a question hopefully you’ll see the comment and answer, I’m a data analyst trying to move to data engineering. So is google certificate the right one for me as it says it is an intermediate course. or should I be doing IBM certificate as I am new to data engineer field? BTW, love all the knowledge, information, guidance you provide here.
IBM's course is good for someone starting from scratch (I have no computer background, I have enrolled). It requires an IBM Cloud Lite account, and though they say it is supposed to be free for 6 months for those who enroll, the feature code thing simply doesn't work. That is a major hassle since the tools have to be set up on the cloud account.
@@SeattleDataGuy cannot say for sure about that because I haven't actively thought about it yet, but at the time of choosing, I went with IBM because from what I read on the net, it is supposed to be the more beginner friendly of the two. Planning to pursue the gcp, but not without a few months of self-study stuff that a software engineer ought to know, and at least 3 months on the gcp trial account.
hey data guy first off thank you so much for making these videos easy for us newbies to understand, it really does make me feel like i got a chance at this data engineering thing one day, secondly i want ask you do data engineers code more than regular software engineers and is the level of code more difficult or easier than the typical software engineer, also do data engineer do alot of repetitive code or is it more of creative code on every project/job they do. im asking this because i really want to land a data engineering role but i really struggle at coding i want to learn how to code efficiently but its like im lost in the matrix at times. granted i just started so everyone says it takes time.
Hey Ben, which one will you prefer, a person who has experience with the cloud tools and has delivered some project against someone who hasn't done a project but has a certification(GCP or any other public cloud).
@@SeattleDataGuy fantastic video! I love all your content. So it sounds like you would self study python and SQL then go to GCP instead of do the IBM course then do GCP? I’m currently taking a python course and will start SQL courses soon. At which point, I was debating diving into IBM. And later GCP. Do you have any thoughts on which of the above is better? I’m someone starting with no CS background as well.
Thank for this course. I have been trying to change my career from the Infrastructure side to becoming a Data Engineer. I think I should start with the IBM course and follow with the Google cousre because I have no real knowledge of db's. Waht do you guys think?
If one of the benefits of the IBM certificate path is to provide high level context for everything then would the best of both worlds be to read Kimball, take the Udemy Data Warehousing for beginners course, and then go through the Google Certificate process?
I'm most of the way through the IBM data engineering course (9 of 13 courses) and I must admit, I'm very disappointed. The curriculum is a mess and there is little room for practice and growth. I already have background in Python, SQL, and Microsoft products such as SSMS, SSRS, and Power Platform, so the related courses for SQL and Python were easy. There is a big focus on IBM products, which I guess it wo be expected, but I found dB2 clunky and difficult to navigate compared to SSMS. My company is paying for the coursework and it's tied to my bonus, so it makes sense for me to finish, but I've already started taking classes through Microsoft Learn for data engineering. The content feels more complete and in a proper order than the IBM coursework and as our company operates with Microsoft products, I will have an opportunity to learn more about Azure and SSIS, which aren't a part of the IBM program. Also, Microsoft offers the education for free. If you want to get the certification, it's $165 I think and way cheaper than the $49/month for the IBM program.
@@perceptron5983 I just started with the Microsoft program, but I've also used DataCamp a lot and it is probably my favorite resource. I was introduced to it along with Coursera, Plurasite and LinkedInLearning during my masters degree. DataCamp is probably the easiest program to follow and has a lot of tools for a variety of different programs and learning tracks as well as help finding a job. The reason I'm interested in Microsoft is that the learning is free and it's a bit more product-specific.
Hello SDG, Would you suggest IBM Data Engineering followed by IBM Data warehousing and GCP at the last on coursera or DataCamp Data Engineering track ? Time isn't a problem. Yes, I'm switching career. I'm already learning Python and Sql already.
Hey!! Amazing content bro!! I have some experience at a user level on Microsoft SQL Server . Can you please recommend me a course to get deep into it? I prefer a certification. Thanks!
Thanks for the comment! Hmm, I don't know if there are as many sql server focused certs. But there are plenty of azure ones. docs.microsoft.com/en-us/learn/certifications/exams/dp-300
I imagine they can be helpful. But all courses and bootcamps are up to the person. You won't get a job with just a bootcamp. But it can help. At the end of the day, you will likely need a referral and some example projects to really make it work.
I am switching roles from Data Science to Data Engineering and it is super hard to learn DE because you don't have people teaching a full end to end project like in DS. DS you can learn how to deploy a full working model in thousands of youtube videos. Why in DE it is not so easy to find full project lesson videos?
Because the area of expertise is much broader than in DS. You need to narrow down the choices by deciding what kind of project you want to do for educational purposes. My tip: go for a batch-only pipeline. To give you some ideas, this is my current project: Load tabular data from Google Sheets into PySpark. Do some transformations for data cleansing (renaming columns, adjust data types etc.). Then save in Postgres. Create a View in Postgres containing necessary derived columns. Add Redash behind it for data visualisation, sourcing the data from the Postgres view. This helps you in learning quite a few topics: - API sourcing - Access Management (creating Keys in Google Cloud for Google Sheets) - Batch Transformations with Spark - SQL - Data Modeling (dump everything into one postgres table, or do you need more tables for normalization?) - Data Visualization Hope that helps :)
Thank you so much for giving that answer! Yes I would agree. Data engineering has such a broad definition that its hard to really teach a full course. But batch and classic data warehousing is usually a great place to start.
I'm an analyst (diff titles throughout years, but relatively same shit from my experience - biz data analyst, BI dev). That said...I wanted to do deeper level data solutions & now I'm doing self-paced Dataquest data engineering path. I'm wondering how these cert programs compare and if I can take the certs with knowledge gained in Dataquest.
Everything I find online says you need a degree in data analysis, etc. Do these certificates replace the need for a degree? Doing both IBM's and/or Google's for instance would be enough? That would be ideal. I'd sooner take my time really understanding/learning with a one year cert that'll get me a near 6 or near 6 figure job than need 2 more years to change courses mid way.
Certificates can help...but usually only if you already have experience. Most jobs I have seen do require at least a 4 year degree and I have met english majors who have become DEs. But usually it was because they also had an IT background some how.
Hi, I recently joined as a fresh graduate and working in support project as a Data Engineer role. Actually I'm more interested in programming and development projects. Can you suggest me which role is best for programming perspective, Data Engineering or Software Engineering, also considering the future scope in both of them.
@@SeattleDataGuy Yes I was going to ask about Azure! I'm studying for the fundamentals now and would do the DE cert next, since they are #2 in the market, but GCP seems to have a lot of perks. So a video comparing Azure and GCP DE certs would be awesome!
I am currently having exposure to working on AWS in my current project.If I want to get into data engineering role should i opt also opt for AWS certified DE certi ?
@@SeattleDataGuy actually sir i haven't started till now its last 6 months of my academic so im asking for your suggestion that can i go with Ibm like from basics or any other course as you suggest
When looking at job descriptions, it's a direct NO for me, when I see they use Azure. Idk, I simply dislike many things MS does. For Azure for example I absolutely hate their documentation. It's cluttered, bloated with irrelevant information etc. Also, Azure pushes many MS specific tools, which simply does not match very well with me being a MacOS user.
@@SeattleDataGuy right. My comment was a bit too harsh. There’s things I like as well. I find their UI to be very nice and it wasn’t as confusing as AWS when I first saw it.
In tech it's always been a little that way. As long as you have experience and the know how people care less. I know people with english degrees who are software engineers, data scientists and DEs. I like certs only after I have worked with a tool for a long time because it helps fill in all the gaps but since you have worked with the tool you already have context.
Not really. In fact, u have to provide evidence of your competency. Some companies just dont have enough resources to test every applicants thoroughly. Thus, having certs & side projects help a lot. Degrees are no longer seen as a good evidence tho
I am currently taking the IBM course as a stepping stone to changing career to data engineering from a non tech background. IBM Data Engineering is so beginner friendly where you get to understand foundational principles of data engineering. It is on these foundations and work experience(no matter how small) that one will need to proceed to Google cloud data engineering certification. Google Data Engineering certificate is for practicing data engineers that want to use Google Cloud Platform/Tools to get data engineering work done.
I was thinking the same thing. for beginner, the IBM seems better choice
Yes. As a non tech bachelor's degree recipient, Google Data Engineer certificate indicates that there must be some understanding of Intermediate Python, and other skills or programming languages, as I was looking today.
And , IBM is more like 0 knowledge of data engineering or data science (to use an umbrella term). Reviews complained about it taking to long as it has 14 courses.
But I am thinking 🤔, well at least is beginner friendly. Yeah. Thank you for confirming the ease and beginner friendly of the IBM course.
@@ppa1983 I crunched it in a few months- on the other hand I wasnt a complete beginner. I think its probably better to do the IBM course first as its not focused much on the cloud services as I remember it.
I am just starting the IBM course. How did your experience go? Did you finish? Did you switch?
Me too, I am just starting the IBM cert. Best choice👍
I think the differences in value between Google's and IBM is evident in the difference of difficulty, the prerequisites, etc. It would seem based off of the recommended prerequisites Google listed for their DE professional certification exam that it's tailored to those who are already in the industry and looking to further their career's value, which I remember you've already mentioned in a previous video talking about Google's Data Engineering Coursera preparation course. Though it's good to note that because this is not a necessary requirement to register for the exam, any talented newcomer with no prior experience may attempt it as well.
Whilst IBM's is aimed for those making to make a career transition, so its bar is lower, aiming to help enrollees become equipped well enough to take on any typical entry-level data engineering job. That's the main reason I decided to go with IBM's, the more digestible content should help me learn the foundations and work as well as I can within my ability, so that eventually I can produce resume projects that comfortably reflect my ability - at least that's the hope anyway!
You're right in that if you spend more than 3 hours a week doing course content, you'll get it done sooner than the estimated time of completion. The calculated time for video content is accurate, but the readings, assignments, quizzes, projects, and hands-on labs are conservatively estimated so that if you take good notes and process the information well, I'd imagine most would be completing content faster than the estimated time. I'm currently able to devote about 2-4 hours every weekday, and am completing a week's worth of learning material each day, so truthfully the best estimates are; if you do it full-time, you'll be done with IBM's in about 2-4 months. On part-time, maybe around 6 months.
First, thank you for your very detailed response! I love it when other people add to the conversation because I am just one small perspective! In particular, I love the info on the timeline!
@@SeattleDataGuy of course, happy to to clarify since I'm currently taking the courses
This is the exact reason why I decided to enroll in IBM’s course, which will provide me with a formal layout of the field, allowing me to navigate comfortably, and utilize various tools, to solidify my skills for projects/and entry-level employment. Then transition to GCP for more specialization😁... Keep up the good work 🙌
I am taking IBM's course for couple of months. Your comment for time estimations is not false, but if you are the type of person taking lots of notes during the sessions, it takes a bit longer than even their estimations.
I also like to play around the lab environments when I'm on them, so yea it took lot more than their estimations.
you just answered my question ❤
The google cert looks interesting and I've been eyeing it for a while. Hopefully, Ill eventually get around to taking it.... eventually #EasilyDistracted
Thanks for sharing this Ben!
I look forward to your video on the subject! But yeah there are too many things to focus on!
Glad I saw your videos on data engineering. This gave me a clear way on what certifications to focus on. In the past month I decided to shift from Software Engineering to a more specialized role in data engineering. I saw your video on data engineering roadmap and it provides tons of value for me. Thank you!
So interesting as always! I’ve done the full learning path of the Google Cloud DE in a month, and I’m preparing for the final exam. Pd: I’ve just done my DE interview and think I nailed it, just waiting for the response. Thank you so much for your advices 😊
So many congrats! I am so excited to hear that you nailed your interview!
hey man, good to know that you have done well on your exam. Hope you get that job. I was wondering any course or book that would help me crack this. About me: never done any DE before. willing to learn. I know programming, ML. tHanks in advance.
Was you begineer when you toke Google Cloud DE course? If not, what was your bacground? Could you please share more info? Thank you
Hi Eren, I was totally beginner, just with few Big Data concepts I gained on a subject during my Telecommunications Master’s. I’ve studied telecommunications engineering and due to my interest in Big Data, I took also some beginner courses of Big Data and finally, decided to take the full Professional Data Engineer Course of Google Cloud in Coursera to prepare to the exam. (I finally got my DE position😊)
@@Alez101010 good for you. My congratulations!
And the last question, How much time you spent a day and how many months did it take for you? Thank you my friend for answer👍
Thanks this is true, I completed Google last year and I am about to finish IBM, doing both will give you broader understanding, but if you are a beginner I recommend you do IBM first it starts from scratch
Hi brother , can you share with me the course of mit
Hello bro, i have one question
Another great video, as always. Its always interesting to see comparisons on cert values based on current trends. Keep up the great content Ben!
Thank you! I really appreciate all the support.
Great video but I’m curious as to why you didn’t address the exam portion of this comparison. IBM doesn’t appear to have an exam for the moment and the DE exam is apparently very difficult for google- taking the course only helps your prepare for the exam.
If you enjoyed this video, then consider signing up for my newsletter! seattledataguy.substack.com/
Thanks for video. Definitely doing Google’s DE cert now.
This has nothing to do with nothing, but one recommendation for the backdrop, maybe hide the Himalayan salt rock lamp’s wire to the back. Would look better for videos 👍
Glad you liked the video! Yeah probably a good call. Either use the rock lamp or don't
@@SeattleDataGuy I think you can use it. It’s super cool. Just put the cord to the back out of camera’s view
Honestly, just get both. Start with IBM then go to the Google cert. *** If you don't currently have the skills necessary covered by IBM.
Speaking from personal experience with the IBM DE Cert, it's absolutely worth it and logically makes sense as part of your transition to DE.
It gives a superb overview of the individual components of DE work, and really gets you in the correct mindset for this kind of work.
I would recommend taking it, securing a job in the area (if you haven't already), and constantly improving your Python and SQL language skills, as to me they are and will always be the lifeblood of the profession. The platforms and ETL tools can all be learned through experience, but the language end of stuff is something you should be striving to improve on.
How long did it take to finish?
i'm following your channel for some time now.
I was thinking of changing careers to data science, as it is very similar in the soft skills part to what i do now ( SEO ).
I landed on your vid - why you should rather be a DE instead of DS. The part which made DS seem so familiar to me - explaining to people where the data comes from, how to look at it, etc - is actually the reason why i looked over changing the profession. I don't care for talking to people :) machine on the other hand ... :)
So i was very happy to hear about DE.
I made it to this video to decide where should i start.
I got to say - i thought i will take what would seem an easier path with IBM, and with time skill up to Google cert.
i made it superfast through the first 4 courses - i think it took me about a month to graduate all of them.
That being said - i think there is too low emphasis on the part JUNIOR in the IBM DE course description.
not knowing python beforehand, not having years of experience working with websites (CMS, whatever small of DB) and not having many years experience in working with web developers and technical layer of websites - it would be really hard to grasp the ideas, understand how each aprt connects to another, and what are some other possible uses.
It would be great to see a followup - like "if you are beginner, take IBM certification, but additionally learn python, one RDBMS" - its all possible with coursera plus and courses they have, which is a nice bonus, but still, one should not expect to be fully functioning , even junior DE after graduating :)
It just scratches the surface - and even me, unworthy little greenhorn DE enthusiast can see it :)
First thank you for following. I really appreciate it! Hopefully your data journey is still going strong. I will have to add it to the list.
it is going great, and all inspired by you !
I outlined 72 courses I should take.
I just finished 12th course (4 on postgress, 9 from IBM DE track) and tomorrow I get started with the Data Warehousing Udemy course you recommend :)
A lot of work ahead, but i am happy to say i just started on 1st of may :) So quite a progress :)
@@kamilguzdek2789 hello there, is it true that the db2 cloud has a lot of issues when doing lab work? I’m planning on enrolling in this program and all the reviews for the python courses or SQL have bad reviews with people complaining about the difficulties logging and submitting homework in the IBM systems. Please advise
@@juanrosa6969 thats not my experience at all.
Not once had i ad a buggy online lab, which i can’t say for google cloud courses.
I think majority of time when you leave review online is when you had a bad experience. If you consider how many people take the courses, i’d say that the unhappy ones are still at low number.
Also - i admit i had some difficult moments, but when i looked up the course discussion forums, i realisef that i didn’t follow closely the task guidelines, and took some things for granted, hence the lab didn’t work - so my fault :) i think it happened twice, and i took 16 ibm courses
@@KamilGuzdek thanks for the info man. I’m definitely going for the IBM and ignore the bad reviews lol
Hi, I have a question hopefully you’ll see the comment and answer, I’m a data analyst trying to move to data engineering. So is google certificate the right one for me as it says it is an intermediate course. or should I be doing IBM certificate as I am new to data engineer field? BTW, love all the knowledge, information, guidance you provide here.
IBM's course is good for someone starting from scratch (I have no computer background, I have enrolled). It requires an IBM Cloud Lite account, and though they say it is supposed to be free for 6 months for those who enroll, the feature code thing simply doesn't work. That is a major hassle since the tools have to be set up on the cloud account.
Yeah, did you prefer the gcp certification?
@@SeattleDataGuy cannot say for sure about that because I haven't actively thought about it yet, but at the time of choosing, I went with IBM because from what I read on the net, it is supposed to be the more beginner friendly of the two. Planning to pursue the gcp, but not without a few months of self-study stuff that a software engineer ought to know, and at least 3 months on the gcp trial account.
@@AK-kz8pe Did you end up pursuing the Google Cloud Engineering Cert?
Thanks man, Keep it up!
Thank you!
hey data guy first off thank you so much for making these videos easy for us newbies to understand, it really does make me feel like i got a chance at this data engineering thing one day, secondly i want ask you do data engineers code more than regular software engineers and is the level of code more difficult or easier than the typical software engineer, also do data engineer do alot of repetitive code or is it more of creative code on every project/job they do. im asking this because i really want to land a data engineering role but i really struggle at coding i want to learn how to code efficiently but its like im lost in the matrix at times. granted i just started so everyone says it takes time.
Thank you so much for this valuable content!
Glad you enjoyed it! Please share with your friends.
Great contents bro. Thanks.
New subscriber.
you're welcome!
Hey Ben, which one will you prefer, a person who has experience with the cloud tools and has delivered some project against someone who hasn't done a project but has a certification(GCP or any other public cloud).
Projects, in my opinion, will always stand out the most.
@@SeattleDataGuy But where to find the projects and most importantly, for those who are new..where to learn those skills...
Hey Ben, thanks for the video, what would you recommend for someone who is starting from scratch? Thanks 😊
I would say go take some python and sql course and then come back and take GCP cert
@@SeattleDataGuy fantastic video! I love all your content. So it sounds like you would self study python and SQL then go to GCP instead of do the IBM course then do GCP?
I’m currently taking a python course and will start SQL courses soon. At which point, I was debating diving into IBM. And later GCP. Do you have any thoughts on which of the above is better? I’m someone starting with no CS background as well.
Super video , thabks for sharing
Glad you liked it!
Thank for this course. I have been trying to change my career from the Infrastructure side to becoming a Data Engineer. I think I should start with the IBM course and follow with the Google cousre because I have no real knowledge of db's. Waht do you guys think?
Thanks for the comment! Why not just take a course on DBs and then go to the google cert?
If one of the benefits of the IBM certificate path is to provide high level context for everything then would the best of both worlds be to read Kimball, take the Udemy Data Warehousing for beginners course, and then go through the Google Certificate process?
You might also have to add in some SQL and python but yeah I am all for GCP
I'm most of the way through the IBM data engineering course (9 of 13 courses) and I must admit, I'm very disappointed. The curriculum is a mess and there is little room for practice and growth. I already have background in Python, SQL, and Microsoft products such as SSMS, SSRS, and Power Platform, so the related courses for SQL and Python were easy. There is a big focus on IBM products, which I guess it wo be expected, but I found dB2 clunky and difficult to navigate compared to SSMS. My company is paying for the coursework and it's tied to my bonus, so it makes sense for me to finish, but I've already started taking classes through Microsoft Learn for data engineering. The content feels more complete and in a proper order than the IBM coursework and as our company operates with Microsoft products, I will have an opportunity to learn more about Azure and SSIS, which aren't a part of the IBM program. Also, Microsoft offers the education for free. If you want to get the certification, it's $165 I think and way cheaper than the $49/month for the IBM program.
Thank you for the information! Did not know microsoft offered a Data Engineering career path. I'll check it out.
@@perceptron5983 I just started with the Microsoft program, but I've also used DataCamp a lot and it is probably my favorite resource. I was introduced to it along with Coursera, Plurasite and LinkedInLearning during my masters degree. DataCamp is probably the easiest program to follow and has a lot of tools for a variety of different programs and learning tracks as well as help finding a job. The reason I'm interested in Microsoft is that the learning is free and it's a bit more product-specific.
Good analysis ty
Glad you like it!
Hello SDG, Would you suggest IBM Data Engineering followed by IBM Data warehousing and GCP at the last on coursera or DataCamp Data Engineering track ? Time isn't a problem. Yes, I'm switching career. I'm already learning Python and Sql already.
Hey!! Amazing content bro!! I have some experience at a user level on Microsoft SQL Server . Can you please recommend me a course to get deep into it? I prefer a certification. Thanks!
Thanks for the comment! Hmm, I don't know if there are as many sql server focused certs. But there are plenty of azure ones. docs.microsoft.com/en-us/learn/certifications/exams/dp-300
Hey, what is your opinion on DE bootcamps? I've heard so many mixed things. Would you say it is better to self-study and do the Google certificate?
I imagine they can be helpful. But all courses and bootcamps are up to the person. You won't get a job with just a bootcamp. But it can help. At the end of the day, you will likely need a referral and some example projects to really make it work.
I am switching roles from Data Science to Data Engineering and it is super hard to learn DE because you don't have people teaching a full end to end project like in DS. DS you can learn how to deploy a full working model in thousands of youtube videos.
Why in DE it is not so easy to find full project lesson videos?
Because the area of expertise is much broader than in DS. You need to narrow down the choices by deciding what kind of project you want to do for educational purposes. My tip: go for a batch-only pipeline.
To give you some ideas, this is my current project:
Load tabular data from Google Sheets into PySpark. Do some transformations for data cleansing (renaming columns, adjust data types etc.). Then save in Postgres. Create a View in Postgres containing necessary derived columns. Add Redash behind it for data visualisation, sourcing the data from the Postgres view.
This helps you in learning quite a few topics:
- API sourcing
- Access Management (creating Keys in Google Cloud for Google Sheets)
- Batch Transformations with Spark
- SQL
- Data Modeling (dump everything into one postgres table, or do you need more tables for normalization?)
- Data Visualization
Hope that helps :)
Thank you so much for giving that answer! Yes I would agree. Data engineering has such a broad definition that its hard to really teach a full course. But batch and classic data warehousing is usually a great place to start.
@@FortunOfficial thank you. This is something that we don't really know to follow as a project idea.
Why is it so hard to find a Data Engineering Course that Uses AWS ?
When AWS is the most in demand when it comes to getting Jobs.
That's a good question. I believe there is a big data course but not a direct data engineering course
@@SeattleDataGuy A big data course that uses AWS ?
Where ?
I'm an analyst (diff titles throughout years, but relatively same shit from my experience - biz data analyst, BI dev). That said...I wanted to do deeper level data solutions & now I'm doing self-paced Dataquest data engineering path. I'm wondering how these cert programs compare and if I can take the certs with knowledge gained in Dataquest.
What do you think about the Azure data engineer certificate?
I got that one, and it's a tricky one.
@@notoriousft why?
I would love to know why you felt that way!
I haven't dug into it yet! maybe a future video?
@@SeattleDataGuy Very broad and detailed.
Everything I find online says you need a degree in data analysis, etc. Do these certificates replace the need for a degree? Doing both IBM's and/or Google's for instance would be enough? That would be ideal. I'd sooner take my time really understanding/learning with a one year cert that'll get me a near 6 or near 6 figure job than need 2 more years to change courses mid way.
Certificates can help...but usually only if you already have experience. Most jobs I have seen do require at least a 4 year degree and I have met english majors who have become DEs. But usually it was because they also had an IT background some how.
Hi, I recently joined as a fresh graduate and working in support project as a Data Engineer role. Actually I'm more interested in programming and development projects. Can you suggest me which role is best for programming perspective, Data Engineering or Software Engineering, also considering the future scope in both of them.
Hmm, I am curious have you had any changes in perspective since this comment is old(sorry..just gettting to it)
Could you do a review on these against the aws database engineering cert if they have one?
They do. I will put it on the list.
Great video, timestamps would be appreciated as well.
Oh shoot! forgot that
Watching this video as I am on the 5th course of the IBM certiicate :/
It's all good. Whats your plan to get a job?
@@SeattleDataGuy first step is learning a basis. Next step should be building a project I guess…
What are your thoughts on the Microsoft Azure data engineering associate certification?
I will need to try this out!
@@SeattleDataGuy Yes I was going to ask about Azure! I'm studying for the fundamentals now and would do the DE cert next, since they are #2 in the market, but GCP seems to have a lot of perks. So a video comparing Azure and GCP DE certs would be awesome!
I am currently having exposure to working on AWS in my current project.If I want to get into data engineering role should i opt also opt for AWS certified DE certi ?
The AWS certs are also solid. I didn't make a video about that one as well.
Im in my final year of graduation and don't know much about data industry can IBm courses is best for me to get first job
Have you put together any projects? That would also be a good idea?
@@SeattleDataGuy actually sir i haven't started till now its last 6 months of my academic so im asking for your suggestion that can i go with Ibm like from basics or any other course as you suggest
Do you know what is the equivalent certification for AWS? AWS Analytics? Database? Thanks, Great video
I wonder if junior data engineers need a certificate.
That is a good question. I do think these tend to provide more value for mid-senior engineers.
Thanks 🤍👌
You're welcome!
What with Azure?;-)
When looking at job descriptions, it's a direct NO for me, when I see they use Azure. Idk, I simply dislike many things MS does. For Azure for example I absolutely hate their documentation. It's cluttered, bloated with irrelevant information etc. Also, Azure pushes many MS specific tools, which simply does not match very well with me being a MacOS user.
Azure in general isn't my personal favorite. But I am not 100% against it.
Guess I have a new video idea!
@@SeattleDataGuy right. My comment was a bit too harsh. There’s things I like as well. I find their UI to be very nice and it wasn’t as confusing as AWS when I first saw it.
heyyy first time a comment i make appears in a video :)
Look ma I am on TV! Thanks for all your support. Comments, likes shares are all appreciated?
A stupid question, what is GCP please?
Google Cloud Platform
Also thanks for asking! I am sure someone else was thinking the same thing.
@@SeattleDataGuy Thank you.
it's not stupid please, i really needed to know this too
Good content, Bad Microphone
GOt a new one. Thoughts?
I personally think, era of degree and certification is long gone. Today you just need to have required knowledge and skill sets to get going.
In tech it's always been a little that way. As long as you have experience and the know how people care less. I know people with english degrees who are software engineers, data scientists and DEs. I like certs only after I have worked with a tool for a long time because it helps fill in all the gaps but since you have worked with the tool you already have context.
Not really. In fact, u have to provide evidence of your competency.
Some companies just dont have enough resources to test every applicants thoroughly. Thus, having certs & side projects help a lot.
Degrees are no longer seen as a good evidence tho