Nice explanation bro. One small doubt. While creating a fresh table, how will you know the table size for calculating the number of buckets. Or is it like, we use bucketing only for existing tables?
For new table we need to check and get the table size or data size from source team , if it is going to be fresh data then you have predict and go with less of bucket then later we can increase
![Spark [Executor & Driver] Memory Calculation{தமிழ்}](http://i.ytimg.com/vi/d5_-eIaHSLw/mqdefault.jpg)
Excellent explanation, Thanks :)
Great bro.. Thanks :D
can i apply this same formula 2^n in spark bucket?
Hi bro, Do u have any video for Hive Commands Tutorial..? If yes can u pls share the link..!!
Y can't we directly increase the Bucket size to 64 or more than that? As per your example bro?
Nice explanation bro. One small doubt. While creating a fresh table, how will you know the table size for calculating the number of buckets. Or is it like, we use bucketing only for existing tables?
For new table we need to check and get the table size or data size from source team , if it is going to be fresh data then you have predict and go with less of bucket then later we can increase
can i apply this same formula 2^n in spark bucket?