Data Architecture vs. Data Engineering Deep Dive

แชร์
ฝัง
  • เผยแพร่เมื่อ 21 พ.ย. 2024

ความคิดเห็น • 23

  • @edeline5574
    @edeline5574 9 หลายเดือนก่อน +3

    Another great video, Bryan! Very informative and helpful. Keep up the good work!

  • @pakpak6590
    @pakpak6590 7 หลายเดือนก่อน +3

    Funny and informative~
    The most important thing is that it saved my assignment.
    Thanks!

  • @user-ox1ud8zn9g
    @user-ox1ud8zn9g 2 หลายเดือนก่อน

    I would add that, after conducting data analysis, the data scientist develops and tunes a machine learning (ML) model or a set of models. They test these models and design the overall ML pipeline to prevent issues like model drift and other undesirable effects. The ML engineer then takes over, building the ML pipeline, including configuration files, and deploying it. They also test the deployment cycle and provide feedback to the data scientist. This process includes monitoring and notification systems as part of the MLOps framework. This description is based on my personal experience, though practices may vary across different industries.

  • @joyo2122
    @joyo2122 9 หลายเดือนก่อน

    The preferred timeframe for completion is always as soon as possible! :D

  • @Pan_Padre
    @Pan_Padre 9 หลายเดือนก่อน +1

    Amazing content as always. I added more words to the comment for YT algorythms.

  • @paukazapalka-x1j
    @paukazapalka-x1j 7 หลายเดือนก่อน +1

    great content, keep it up Bryan, thank you so much!

  • @andyvandenberghe6364
    @andyvandenberghe6364 9 หลายเดือนก่อน +1

    Excellent deep dive! But what if you're designing microservice app solution architectures including OLTP datamodels and data feeds into BI but not beyond that ?

    • @BryanCafferky
      @BryanCafferky  8 หลายเดือนก่อน

      Sounds like an application architecture rather than a data architecture. Regardless, the architecture should be based on the requirements.

  • @KrisKoirala
    @KrisKoirala 9 หลายเดือนก่อน

    This is awesome and I found this very informative, thanks for sharing.

  • @kvin007
    @kvin007 9 หลายเดือนก่อน

    Love your videos! Keep up the good work!

  • @MuhammadKhan-wp9zn
    @MuhammadKhan-wp9zn 9 หลายเดือนก่อน

    I like Brian, your contents always gave me confidence, thank you

  • @NoahPitts713
    @NoahPitts713 7 หลายเดือนก่อน

    really appreciate this breakdown!

  • @JimRohn-u8c
    @JimRohn-u8c 6 หลายเดือนก่อน +2

    Thank you so much for this! As a young Data Engineer who in the future wants to a great Data/Solution Architect I needed this!
    Also, just to clarify, is the Data Architect doing Solution Architecture AND Data Modeling? I’m still confused between Data Architect and Solution Architect.

  • @thybui1368
    @thybui1368 5 วันที่ผ่านมา

    How many languages do you know? (i am not talking about Sql. python or spark) :D Jokes aside, I really like how judgemental you are and your content is very crisp and to the point. Please keep sharing your learning!

    • @BryanCafferky
      @BryanCafferky  4 วันที่ผ่านมา

      Thanks. I'd guess I've learned about 30 or so languages over the years. Now there's a lot of spin off languages like Power BI has several sub languages.

  • @diydrivenGA
    @diydrivenGA 7 หลายเดือนก่อน

    Good content.

  • @babuganesh2000
    @babuganesh2000 9 หลายเดือนก่อน

    Can you make a video about Databricks for Students who are interested to learn on how much it would cost for learning it using pay as you go and what all the techniques we can use to reduce the cost. There are many videos in youtube unless we do hands on nothing goes into head

    • @BryanCafferky
      @BryanCafferky  9 หลายเดือนก่อน

      This video explains how to get the Free Databricks Community Edition. Note: The screens may have changed a bit but it is still available. th-cam.com/video/lcI1W2_KUPo/w-d-xo.html

  • @GhernieM
    @GhernieM 4 หลายเดือนก่อน

    Thanks, you're really good at explainin these topics!