วีดีโอ

I really like those videos, very informative and interesting. You got a new subscriber.

The animations look awesome!

Common zstd W

HEEELLL YEAHH got me rolling for some reason

Sick graphics !

Such an amazing Video! Thanks

40% reduction in traffic huh? Can I have my 25mb upload limit back discord?

Bc Discord banned in Turkey and Russia 😢

5:18 company of culture with no linux support ;-;

first time I hear about htmx

tldr: They switched libraries and removed unnecessary payload.

Lambdas could have been used .. nowadays every cloudprovider offers this kind of functionality.. Use k8s to autoscale pods amd autoscale worker nodes

Interesting

It's a shame discord is crap now, especially the android app

discord lost all of its turkish users that can also skew data

This is cool, but I’m still upset. I can’t upload 25 MB files anymore.

One thing discord could do to save bandwidth would be to hash all files and checking the hash against a file database before actually sending the file to the server. Firstly it would reduce bandwidth usage and secondly it would reduce storage usage.

1:35 That's not exactly how it would compress, interestingly. The more efficient way is A B C (3, 6, EOF) This looks like "Write A, then B, then C. For the next 6 characters, copy the character that's 3 characters back from the position you're writing." (0 indexed) When you write the [3] letter, you're copying whatever letter is 3 positions back, [0]. Then for [4], [1] is 3 positions back. [5] is [2], and this is key: [6] is copied from [3], data that has not been written when we started copying!

amazing video, probably my favorite beginner system design video that I've watched

Imagine being the new guy on the DB team at Notion...

They got a pizza party and a nice work pal🎉

They could reduce traffic bandwidth by even further with p2p networking. Just send CRC of an image, and then force clients to find the image by themselves with a timeout, if there's no image among the other peers, send one from server. So in a large servers, the more people saw some image, the more you have peers for this image

They banned PDF files? 🤔

Wait, people still optimize their electron apps? Truly a company of cuture.

My understanding is that they are using Scylla now instead of Cassandra since longer than this video was released.

how do you know?

Having a record for each block of the document is crazy, I wonder what was the reason behind this decision.

Can you make another 10 minutes video for each approach you mentioned? More into depth , so it’s easier to remember

Why not noSQL?

yo what software you made this with (icons, animations)?

Wonderful video, please make a video series on system design

thank you for this good explanation

Currently building product with postgres this gives me nightmares 😢

what do you think about CockroachDB?

why not just use cockroachdb instead of manually sharding

Pure gold!

Anyone complaining about the engineers not getting their share... Go start your own company or accept that you're owned by someone else.

By getting banned in Russia, haha!

I was expecting some amazing compression, but this works too

1. use gleam 2. Use Gleam 3. USE GLEAM

5:48 Woooooow, almost like reducing the amount of data you send in the first place is more important than the compression you apply after the fact. Who could have guessed? Truly the most incredible engineering feat of all time.

Some day discord will managed to reduce their bandwidth usage by 100% by making their clients so bloated and with every feature behind a paywall so everyone will just use something else.

Good video. But, I thought youll would talk more than the compression algorithms, aren't they only used for the files? Just a question.

3:18

6:06 yeah i realized that years before. i was like, "why?"

we also faced same situation in MongoDB, We did successfully migration to sharded db using mongo sync tool, We had 3TB of production data and heavy read traff and minimal writes , we did without any downtime for read calls and for write 50s we had to stop the writes to sync all data b/w two clusters, it was long 6 months effort to do it successfull

Great video, thank you

I wish I could improve by 40%

Yeah, engineers won’t be getting bonuses for doing their job.

Really nice video! big bonuses -> large pizza party hahaha