Advancing Spark - The Hidden Databricks Dashboard Tool!
ฝัง
- เผยแพร่เมื่อ 11 ก.พ. 2025
- With the announcements of Databricks acquiring Redash there has been a lot of conversation around using Databricks as a dashboarding tool directly, rather than hooking it up to an external BI tool. It looks like Redash is going to bring a whole load of functionality but... what about the dashboards that are already there!
This week, Simon highlights some of the really cool features that are already baked into Databricks notebooks directly, how an Analyst can use them to create a compelling data-driven story, and how we can do some basic dashboarding directly within Databricks itself!
Don't forget to check out our Databricks training courses, currently available remotely for private clients - www.advancinga...
I've been doing databricks demos every day over the last year working for databricks and I did not know a couple of these. Thanks for finding and sharing these gems Simon. You are my hero!
Glad it helped! People are always surprised at how actually decent the data viz is, looking forward to how Redash ups it even further!
Simon
This was great to watch. Thanks for putting this out there. You’ve given me a bunch of ideas on how I can sell Databricks to management as a viable alternative to people abusing SQL Servers every day 😀
That was indeed surprising. Great stuff
Thank you for the video. Nicely explained!
Nice one. Didn't know that existed!!
A topic for future video: What's the importance of creating and updating statistics on databricks tables. Does it really impact the query plan/performance a lot? Is it still needed with the Adaptive Query Plan feature with Spark 3.0?
Good question! Statistics used to be crazy important for getting the right optimiser plan, but there's two things that have changed that. 1 is AQE as you say - which can course-correct a plan if it looks like the wrong one was picked. Number 2 is Delta, which keeps similar stats in the trans log, which is now cached on the cluster. I've not had a look to see if analysing delta tables improves anything given the Delta cache covers it all these days! I'll add it to my nerd list...
Simon
Hi I am stuck please help.i was showing 4 graph in a same cell of the databricks , when I try to add them to dashboard only one graph is visible rest 3 got cropped out. I need to wrote same code 4 times in 4 different cell , can you help me in this
Great job!
Video is informative, Thanks !!! Could you please also make a video on Auto-refresh of these dashboards via jobs ?
Sure - we've got a whole bunch of dashboard videos in the works, so we'll cover automated refresh & scheduling as a part of those!
Simon