Intro to Databricks Lakehouse Platform Architecture and Security
ฝัง
- เผยแพร่เมื่อ 1 มิ.ย. 2024
- This video is designed for everyone who is new to Databricks Lakehouse Platform Architecture and Security.
By the end of this course, you'll be able to:
- Explain the importance of data reliability and performance on platform architecture
- Define Delta Lake and its features
- Describe how Photon improves performance of the Databricks Lakehouse Platform
Earn the Fundamentals of the Databricks Lakehouse Platform Accreditation:
Link for customers only:
Link for partners only: partner-academy.databricks.co...
Link for Microsoft only:
Learn at Databricks Academy
www.databricks.com/learn/cert...
Get insights on how to launch a successful lakehouse architecture in Rise of the Data Lakehouse by Bill Inmon, the father of the data warehouse. Download the ebook: dbricks.co/41EbhKi - วิทยาศาสตร์และเทคโนโลยี
PSA - I AM NO EXPERT BUT WORKING TO BECOME ONE. ALL YOU GUYS WANT TO DO IS JUMP ON HANDS ON WITHOUT UNDERSTANDING CONCEPTS. WHATS AN ARCHITECT WITHOUT A BLUEPRINT?
Unlike most comment here, You guys did a very good job in breaking down the various differences in datawarehouse, datalake and the new data lakehouse platform. As for people in the comment section that do not understand, try to do research -a.k.a search - on sentence/statement you do not fully grasp. You also have the back -a.k.a replay - button to revisit until you get it. You do not have to watch the video in one sitting. Leave it the next day and come back to it again - its literally new information so reinforce learning is required! Bunch of newbies crying. Talk like you do not know how technology works. Good job you guys gave me a better picture for this stuff! Funny thing is am yet to finish the video on playlist number 3 and minutes 2:30,
The first half was a sales pitch full of buzz words, not a tutorial for new users. I recommend just skipping it and starting at 19:35. In this second part of the video, Unity catalog is described much better.
I agree.
Please avoid reading the paragraph. Explain it so that beginners can understand it.
Good to know I am not the only one confused with the explanations here. Maybe a short Udemy course out there somewhere would be more intelligible and easier to understand than this official content.
😢hardest 28 mins of my life
Thanks bro! So it wasn't just me! 😄 Was feeling dumb and started to doubt myself.
You mentioned the problems in data lake..But Im able to do all these mentioned problems in AWS s3 For example: ACID - Using Athena able to perform, Schema enforcement - AWS also provides schema registry for this, Data Catalog - AWS provide Glue catalog for this.... Then Whats the advantage on top of these..please someone explain
? I think your confused. S3 is just an object storage platform. Databricks is a combination of object storage (Delta Lake), big data analysis/processing (Apache Spark) and their model management service (MLFlow). It also provides a host of other services like compute resources, workbooks and ci/cd pipelines. The advantage of databricks over S3 is that it combines all of these services under the hood and are pre-configured to work together. If you are just comparing the Delta Lake to S3 then no... there is no real "advantage".
@@dukewellington7050 Thanks for the reply, With my understanding, if I want to take care all the mentioned activities theres the way in other cloud systems say to use Apache Spark, we have AWS Glue/EMR, and for ML activities Sagemaker..just examples...So if Im right, there's alternatives but certainly with databricks we can perform all these activities in single phase with may be some more benefits.
It is very abstract
Not a good way to explain the things. 90% of the people are beginners and if you explain them in this way then they will definitely quit their learnings.
Assumes you have some DB admin experience. Try the Microsoft Azure DB (learn) courses; they nicely explain in detail some of the terms used like transaction logs, master record, etc.
@@visceralcinemacan you share the link ? I searched on gg but not sure which course?
Very Fast, Difficult to Grasp. Unless you know Databricks already, diffcult to follow
Like the Databricks presentations but there's an annoying popup showing the next video to watch for the last 30 seconds which blocks the current content in view. There's no way of dismissing this popup by the viewer but apparently can be configured by the content providers. The funny thing is even the recommendation is wrong. It's suggesting me to watch "What is a Data Lakehouse" after watching a "Lakehouse Platform Architecture and Security" video! Don't TH-cam do any user testing on their UX designs?
it is like raining of too much info in just 28 minutes. i would be great if they reduced that and gave more overview on it. really hard to follow for newbies like me
first half is hard to understand
Just a bunch of blablabla
type in video description: "Describe how Photo improves" Photo --> Photon
This was not a very good explanation, very confusing, I didn't learn anything from it.
Same
It is not hands on. Too abstract for most engineers.
First of all, the presenter is lame. As if she is reading notes and without any pauses. there is so much confusion. It was not explained well.
really badly explained