Speed up your MySQL database with the buffer pool
ฝัง
- เผยแพร่เมื่อ 5 ก.ย. 2024
- MySQL has TONS of options you can configure to adjust behavior and performance of your DB. However, there are a few that stand out as being absolutely critical for database performance. One of these is innodb_buffer_pool_size. Tuning the size of the innodb buffer pool can unlock much better performance for your database, especially if you have a large data set and a lot of RAM to put that data in!
In this video, watch Ben as he given an overview of the buffer pool, and shows a demonstration of how adjusting this value can significantly improve your database's ability to handle the workload you want to throw at it.
To learn more about PlanetScale, head to planetscale.co...!
💬 Follow PlanetScale on social media
• Twitter: / planetscale
• Discord: / discord
• TikTok: / planetscale
• Twitch: / planetscale
• LinkedIn: / planetscale
Super helpful, was trying to get my head around what buffer pool is and how i could optimise the performance. Exactly what i needed to proceed. Thanks a ton!!!
Glad to have helped
Hope there will a followup video addressing other innodb_x config options. Preferably starting with brothers and sisters of the buffer_pool_size. There are some rules of thumb, but it is not overly trivial to get them right.
Cool idea 👊
I hope you do more videos explaining some other useful configurations.
Thanks Ben!
That's a great idea!
Wow! A stunner.
Thanks a million.
May I ask, is this possible via PHPMYADMIN? If yes, please, how?
While I have your attention, is there a way to enlarge the max size of mysql database Tables? Again, in PHPMYADMIN interface.
To configure this value to can update it in the my.cnf file, like I show in the video. Looks like IMH recommends SSHing into your server to update it: www.inmotionhosting.com/support/server/databases/edit-mysql-my-cnf/
Another key performance setting if you do not use replication and can afford to lose 1 sec of transactions in case of a server crash is to disable log_bin and set innodb_flush_log_at_trx_commit = 2
Great insight. Maybe this should be another video!
What is the tradeoff when increasing the values of innodb_buffer_pool_size and innodb_buffer_pool_chunk_size? Will it affect the server performance for other operations, such as creating indexes when a new record has been inserted?
Configuring mysql to use multiple puffer pol instances (via innodb_buffer_pool_instances and innodb_buffer_pool_chunk_size) causes mysql to create multiple pools. This can help reduce contention in situations where you have a lot of concurrent connections / queries executing, as the pages get divided up amongst the available buffer pools. The docs have some additional info that might help!
dev.mysql.com/doc/refman/8.0/en/innodb-multiple-buffer-pools.html
thanks in advance for your answer 💯
It’s very workload dependent, you are only reading so you’re showing kind of best case scenario.
If you also have mutations it would evict parts of cache so the result wouldn’t be as great.
Needless to say except that detail it is very very relevant.
Moreover I had opportunity to monitor a hardware MySQL server which were backing up a highly loaded web app before AWS migration and an RDS after one. The MySQL is so underestimated, with right config it was delivering sub ms for majority of queries. Later we had to add redis caching (to compensate for AWS RDS disadvantages) and even redis was for the very list not better than the hardware MySQL. I’d say for majority of cases MySQL was beating up redis. But RDS Aurora wasn’t even close. When we analyzed the most of it was coming from network delays. The back side of cloud services.
It definitely is workload dependent! For example, if you have a large data set but the vast majority of it is never queried, you might only need to size the buffer pool such that the hot pages can fit in memory, and then you'll be fine.
I hope you can make video about mysql router
As PlanetScale we use Vitess (vitess.io/) to handle query routing, high availability, etc. We recently made a video about what happens here so check this one out if interested! th-cam.com/video/9FYedahsJxE/w-d-xo.html
@@PlanetScale thank you
Does PlanetScale automatically configure the option based on your plan, or do you need to adjust it manually?
Correct! One of the many advantages of using a managed service :)
This is a great video
Thank you
Don't get me wrong, it's a great video. But i'm still a little bit disappointed because there is so many parameters to control the buffer cache and i was expecting more. Please remember that a "good" hit-ratio does not mean that your application is tuned.
Absolutely! This was a very simple benchmark. Real-world workloads are going to be much more complex, and you may need to do some deeper analysis to decide how to tune your buffer pool.
If you use PlanetScale, we spin your DB up with it pre-tuned.
Niiiice!
Better make a video of why you removed the free tier plan
They already explained in the blog post
What would you like to know? The amount infrastructure required for even our smallest possible database is quite costly. This video explains it well: th-cam.com/video/9FYedahsJxE/w-d-xo.html
@@HollyGuevaraPS this is no explanation, other smaller companies also continue to have significant expenses with infrstructure and continue to be free tiers. It is a good thing that other companies similar to planetscale continue to offer super free tiers and it was easy to go there,
@@TheMrBazil Which companies? There was a lot of convo about this on Twitter recently and couple founders at other database companies said themselves that their free tier isn't a significant expense to them due to their architecture. I do wish we could offer a much cheaper tier, and it is something we're still discussing internally.
It's still dirt cheap for the value you get. I really don't understand why everyone feels entitled to get something for nothing these days. I'd rather have a viable DB provider than one that's burning money left and right.