Most Annoying Things Data Engineers Deal With

แชร์
ฝัง
  • เผยแพร่เมื่อ 21 ม.ค. 2025

ความคิดเห็น • 60

  • @JashRadia
    @JashRadia  ปีที่แล้ว +1

    Drop your experiences and thoughts here! Thank you for watching❤Explore different architectures and build them with Project Pro: bit.ly/3LGqzYW

    • @devsvlogs
      @devsvlogs ปีที่แล้ว

      Sir cloud engineer keliye space hai kya google pune me

  • @ashuhmm2681
    @ashuhmm2681 ปีที่แล้ว

    Hello sir email se laykar ek problem hai please help

  • @Kickass3131
    @Kickass3131 ปีที่แล้ว +1

    But when it comes to understanding the data, someone normally will inspect it such as a business analyst then create a shared page detailing what the columns mean and type of data. For us this is normally shared to confluence thus saving time to having to explain it to new joiners

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      Yeah data dictionary needs to be perfect for this.

  • @anamikatripathi2394
    @anamikatripathi2394 9 หลายเดือนก่อน +1

    Can you compare Data engineering with software development?

    • @JashRadia
      @JashRadia  9 หลายเดือนก่อน

      They are close but data engineering focuses on building data pipelines of the product vs software engineering on building the product. In some companies, data engineers are known as Software Engineers - Data. As well

  • @rahilsoni1525
    @rahilsoni1525 ปีที่แล้ว

    What's your thoughts about scrum master and their role? is it worthy to be have agile frame work in your organization.

  • @mayankpatni5639
    @mayankpatni5639 ปีที่แล้ว

    As a fresher non IT to IT what to choose full stack developer vs data engineer vs data analyst more job opening more package future growth bcuz in usa people who have 10 yr of experience in web development transit their career to data

  • @aishwaryapriya6682
    @aishwaryapriya6682 ปีที่แล้ว

    Is OOP important for upcoming data engineers/scientists?

  • @jadhavkrishna9566
    @jadhavkrishna9566 ปีที่แล้ว +4

    Can you please make a video on opensource for data engineers please? Love your videos ❤

    • @JashRadia
      @JashRadia  ปีที่แล้ว +3

      Awesome suggestion! Thank you 😊

    • @navaneethneeth6094
      @navaneethneeth6094 ปีที่แล้ว +1

      ​@@JashRadiayayy! Waiting for it

    • @toyncandy6130
      @toyncandy6130 ปีที่แล้ว

      ​@@JashRadia waiting

  • @nikhiljk02
    @nikhiljk02 ปีที่แล้ว +2

    Yes copy pasting a long script from vscode to compute engine is actual pain in the ass . I store the python file in my gcs and then copy to vm machine 😂

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      Exactly right? It hurts 🥲 so much for Technology advancements.

  • @param8592
    @param8592 ปีที่แล้ว

    Hi jash ,
    My coding skills are not so much good and currently i am working as data engieer and i am not using any cloud platform. Could please tell me which cloud platforms is best where we have less coding for pipline and deployment . So i can start learning for that cloud platform azure ,gcp, aws

  • @navaneethneeth6094
    @navaneethneeth6094 ปีที่แล้ว +1

    Hi jash! I got to know that you recently moved to AL/ML engineer with in the Organization. Please let us know if you got any salary hike for this transition. I just want to know from your experience whether we get salary jump when we move to different job profile with market salary standards with in the same company as compared to going to a different company.

    • @JashRadia
      @JashRadia  ปีที่แล้ว +1

      I am sorry I can't share any information wrt my salary, but in general, salary of Data Scientists are slightly higher than Data Engineers not very significantly different.

  • @deepraj5778
    @deepraj5778 9 หลายเดือนก่อน

    Sir please can you tell how can get a job into the Google Pune as AI/ML Engineer ? Does Google hire for fresher AI/ ML engineer or Data science students at Pune ?

    • @JashRadia
      @JashRadia  9 หลายเดือนก่อน

      I haven't seen any fresher opening for this role. Mostly requires 2-3 YOE

    • @JashRadia
      @JashRadia  9 หลายเดือนก่อน

      AI/ML roles so far have been hiring people with 2-3 YOE. There is no secret how to get the job. Just apply using Google careers page.

  • @Dhana.V
    @Dhana.V ปีที่แล้ว +1

    Hi Jash, I have been following you for a long time. I am in Manual Testing. Earlier I was tester in ETL project. Now I have moved to a different team and am working as UI manual testing.
    I don't have coding knowledge and am poor in coding since my college days. I have 3.5 years of experience in a healthcare service company. I decided to try for a new career. should I work hard for the role DE or SDE. Which is suitable for me.
    All Apache tools are open source? How to do open project and add that to resume for the DE role

    • @JashRadia
      @JashRadia  ปีที่แล้ว +2

      Thank you for watching my videos. DE is better if you feel that you're not very strong in coding compared to SDE. As per projects, pick any cloud platform and try to build a sample data pipeline on it. Once you have good technical understanding of the pipeline, then you can focus on data transformation and fancy things that you can show on a dashboard. Put this all in a github profile, make it public and add a good readme file with architecture diagram. then add this link in your resume.
      Some reference architectures:
      cloud.google.com/architecture/big-data-analytics

  • @Yatee
    @Yatee ปีที่แล้ว

    Hi Jash! I am a recruiter and I want to understand what should I do to stay sharp about what to speak and connect with a data engineer or a developer. I want to let my candidate know I know what my client is looking for and other things

    • @Yatee
      @Yatee ปีที่แล้ว

      Also, what I should not do

    • @JashRadia
      @JashRadia  ปีที่แล้ว +1

      Hi, I am not a recruiter so I am not sure how much I can help but I can try. When you connect with a data engineer, it's always better to keep an open mind about the gap between exact requirements and experience of candidates. Sometimes client go overboard with specific tools but it's always better to do your research to find similar tools and then allow everyone with that experience to be a candidate rather than sticking to exact requirements. There are so many tools and tech stack for DE. The knowledge of one took is often transferrable to another one but sometimes recruiters fail to understand that. I personally don't like it when that happens. Hope that helps!

    • @Yatee
      @Yatee ปีที่แล้ว +1

      Brilliant... your videos help me alot!
      Please keep em coming. God bless

  • @DOCTROID
    @DOCTROID ปีที่แล้ว +1

    Literally, The one regarding logic change after everything thing's done, really makes me frustrated at every end of the project, they make these changes...😂

    • @JashRadia
      @JashRadia  ปีที่แล้ว +1

      And they want it done quickly too 🤷🤷🤷

  • @kshitiz7129
    @kshitiz7129 9 หลายเดือนก่อน

    i am not great in coding can i choose data engineer as a career?

    • @JashRadia
      @JashRadia  9 หลายเดือนก่อน +1

      Yeah, you will need practice in coding but you don't have to be great at it like SWEs. Being good is sufficient. But can't completely ignore it.

  • @ram5723
    @ram5723 ปีที่แล้ว

    Do companies value online ms in data science?

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      It's useful if you're coming from a different domain compared to data to open some initial doors. But if you're already in any data field, I wouldn't recommend online ms.

  • @neerajrajput9977
    @neerajrajput9977 ปีที่แล้ว

    sir does fresher get job in data science field as it is said that for fresher there are lot of job avaliable in developer or full stack developer field as compare to data science job.can fresher get a job in data science after completing masters (as i am planning my master from germany in data science)

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      After masters it is easier to get a data science job. It's much harder without a master's degree. In that case, you would need experience.

  • @shreyas3612
    @shreyas3612 ปีที่แล้ว

    Hi Jash.. I'm following your roadmap that you shared for Data engineering. Is this the same at this stage, or if there is any update in some course, please let us know. Thank you.

    • @JashRadia
      @JashRadia  ปีที่แล้ว +1

      Same. No significant updates that I can think of. Thanks for watching!

    • @shreyas3612
      @shreyas3612 ปีที่แล้ว +1

      @@JashRadia Thank you Jash!

  • @Nick-du9ss
    @Nick-du9ss ปีที่แล้ว

    I am a college student what advice you give me to become a great data engineer
    And how can I persue freelancing in this career

  • @18LyricCt
    @18LyricCt ปีที่แล้ว

    Your videos super informative.. could you please help on finding resources for interview focused preparation for python for data engineers..

    • @JashRadia
      @JashRadia  ปีที่แล้ว +1

      Thanks for suggestion. My next video will be covering one of these interview topics.

  • @arrooow9019
    @arrooow9019 ปีที่แล้ว

    Hi jash, I am data engineer working in health care domain,but i am from commerce background. Please tell me whether my education background affects my future job career? Because recruiters looking for engineering background people only.🙏 Thanks in advance.

  • @AR-wx6xd
    @AR-wx6xd ปีที่แล้ว

    Hi jash Am planning to become a data engineer after my masters!I already have 2 years of work experience as data analyst & I wanted to become a data architect. Long term goal is erp consultant. Please give me your valuable opinion on this

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      That's good to know. All the best! What do you need my opinion on exactly?

    • @AR-wx6xd
      @AR-wx6xd ปีที่แล้ว

      @@JashRadia I wish to be technoFunctional in faang organisations. How can I prepare for that ? What roadmap should I choose !

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      @@AR-wx6xd for this you could choose the consulting path or customer engineer path that's common in cloud orgs of these FAANG companies. Here you consult customers or help them recommend best practices of your cloud platform. It's a good technofunctional role. For it's roadmap, the preparation isn't much different than tech roles. It just focuses less on coding.

    • @AR-wx6xd
      @AR-wx6xd ปีที่แล้ว

      @@JashRadia thanks for you time sir!

  • @Delhigram_
    @Delhigram_ ปีที่แล้ว

    working as DA but currently i am following your last year roadmap of God Tier Data Engineering Roadmap for last 6 months. almost finished all courses you suggested form Udemy except cloud. plz make helpful video for big data engineering. hope you see this msg Jash

  • @valhala007
    @valhala007 11 หลายเดือนก่อน

    Nation needs to know.
    No videos, why? 😢
    We need more and more videos from you.

    • @JashRadia
      @JashRadia  9 หลายเดือนก่อน

      Watch out this weekend! 🫡

  • @hemanthvarupupla
    @hemanthvarupupla ปีที่แล้ว

    Data engineering is a good carrier option. Means if i learn now i can do it for next few years

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      Yes. Data engineering is good in terms of future prospects

  • @everythingyouneed5203
    @everythingyouneed5203 ปีที่แล้ว +1

    hey, Jash
    I was curious to ask you whether Google Pune hires interns for internships or apprenticeship?

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      Yes, there are interns here

  • @param8592
    @param8592 ปีที่แล้ว

    Some times I fill this is most annoying steam😢

    • @JashRadia
      @JashRadia  ปีที่แล้ว

      Not really. Wouldn't go that far 😅

  • @cayenne767
    @cayenne767 ปีที่แล้ว +1

    the VM hell is soooo real😅

  • @i_am_bhaveshh
    @i_am_bhaveshh ปีที่แล้ว

    Us bro us😐