A Deeper Understanding of Spark Internals - Aaron Davidson (Databricks)

[@李佳键-i6r]

So far the best video i watched that explains Spark execution model in high level with a good understandable example. Thanks for sharing!

[@barmalini]

Now imagine if he had had enough time to also explain caching

[@ABHIS2407]

Awesome training. Short, simple easy to understand and full of content. Great work

[@kudvashish1]

Thanks Aaron for the talk

[@slvherliu7962]

excellent video and good job!

[@maddy2u]

Nice video

[@somakkamos]

sound is very very low :(

[@BlackHermit]

Thank you so much Aaron

[@RCMOULI1]

Good video. Do you have any videos how Spark runs better or different compared to Hadoop and for which type of scenarios Spark is preferable than Hadoop.

[@hmartirosyan]

He's not super-active, and doesn't respond to emails ;-)

[@raksadi8465]

In my spark version 2.4.3 job after all my transformations,computations and joins I am writing my final dataframe to s3 in parquet format
But irrespective of my cores count my job is taking fixed amount for completing save action
For distinct cores count-8,16,24 my write action timing is fixed to 8 minutes
Due to this my solution is not becoming scalable
How should I make my solution scalable so that my overall job execution time becomes proportional to cores used

[@TheKavyajayan]

Can you add subs to this? The auto generated ones are not good enough

[@sandipjogdand5834]

its good stuff

[@SonnyTheoTumburManurung]

A bit too fast at talking, but overall still understandable. Very good talk on the important concept.

[@goldstonpreetham1449]

NJ😮

[@ManuPresannakumar]

why the hell the text is written with a type writer/font?

[@micklejickles]

This guy at the beginning. Find a seat man. Ruined it for me.

[@ravieze]

super fast.. very diffficult to understand

[@rajrajabhathor2996]

Just shows how feeble Spark is,,,