How effective is History-based Optimisations on BigQuery

🚀 Excited about unlocking better performance and cost savings with BigQuery? I’ve just shared a new blog and video exploring history-based optimisation, one of Google Cloud’s latest features for improving query efficiency.
This feature uses insights from previously executed queries to optimise performance. So far, I’ve explored its impact on two common types of scheduled queries: full refreshes and incremental models. Using a real dataset, I compared performance before and after optimisation, and the results are promising!
02:21 - Effect on Full Refresh Models
09:53 - Effect on Incremental Models
13:12 - Summary
Curious about:
How to enable history-based optimisation?
The potential impact on query runtime and slot utilisation?
What this means for your FinOps strategy?
If you prefer reading instead, I've also written a blog here: open.substack....
If you’re using BigQuery, this feature could deliver real benefits with almost no effort on your part. Check it out and let me know how it works for you!
#GoogleCloud #BigQuery #DataOptimisation #CloudFinOps #dataengineering
---
Need to modernise your data stack? I specialise in Google Cloud solutions, including migrating your analytics workloads into BigQuery, optimising performance, and tailoring solutions to fit your business needs. With deep expertise in the Google Cloud ecosystem, I’ll help you unlock the full potential of your data. Curious about my work? Check out www.fundamenta... to see the impact I’ve made. Let’s chat! Book a call at calendly.com/r... or email [e-mail]. 🚀📊
Loved this video? I made it using VEED-an amazing online video editing tool that also has built-in recording features (which most others don’t!). It’s super easy to use, and I highly recommend giving it a try. Want to edit like a pro? Click here for an exclusive 50% off discount veed.cello.so/... and start creating today! 🎥✨

[@user-so5fk1mt9o]

Thanks for sharing

[@manoressytobias5281]

So we don't need to setup a bunch of configs? Just let BigQuery figure out where and what to optimize and do it "smartly"?

[@practicalgcp2780]

Basically, but it’s good to understand the impact before and after so you know what type of queries can be optimised better hence adjusting your finops strategy on what to focus on etc.

[@manoressytobias5281]

@@practicalgcp2780 , got it. Our teams are reviewing this now. Thanks, man!