วีดีโอ

The level of detail in this video makes me want to burn all those stupid superficial bs i have been reading all these years. Imma name my 3rd kid after your channel dude ;).... the 2nd one is gotta be martin tho

great detail!

Okay jordan has no life, subscribed! Lol

hi jordan thanks for those vidoes very helpful, but something it's clear for me how does s3 handles the fencing tokens? doesnt the appliation requires another layer for solving this out?

Hi Jordan! Great video. I have a question about probing. Should the application logic check if the hash is available? Since we are creating a hash based on the long URL + userID + timestamp, why would there be any conflict? Should we also think of UUID or Twitter's snowflake or Base 62 conversions to avoid probing? Could you please explain more about the Hashing function?

Excellent stuff and lot of details covered in short time. I always need to watch your videos multiple times to grasp all the intricacies since your content covers so much depth.👏

Hey Jordan, I really like your videos! They are super helpful for learning system design, as a junior I learned a lot from your videos. Also wondering if it is possible to see a design about meeting scheduler, a friend of mine meet this question during her interview, she is not sure about the database design. Curious to see a Jordan solution!

Wouldn't the multipartition lock strategy introduce a lot of latency if too many players are cross-region? Or maybe I'm misunderstanding what the lock is key'd on specifically

subbing, so you better beat the tiktok girl .

Hey Jordan, really love your videos. Could you please attach the sources (if there are any) for videos that have " question specific" concepts like Fair claim implementations in this video, Route recreations in your Uber video etc...

@jordanhasnolife5163 - For consistent Prefix Read problem, how second person will see the question, if there is replication lag ? reading directly from leader?

Jordan, I am confused, if we already have servers based on region why even make a game with multiple regions cant we restrict the gameplay based on region itself like eg: asia region players will play amongst themselves, and so and so (I think valorant executes this)

This was perfect timing!

Hi, Dont we need two phase commit to processes payment and update balance seats?

Hey Jordan, what happens when the user is offline and message was send by someone to a chat id, offline user was part of?

Great video! In a similar theme it would be great to see a Multiplayer Matchmaking Service design.

Hi Jordan, great content! thank you. One questions though, the send message path is clear (user through web-socket and its server put the message in the Kafka and then from there the message goes through Flink to the chat table), but the receive message is not... so Flink talks to LBs and finds the corresponding chat server to connect to the receiver... but how message is sent? where is that component (or arrow)? is there another Kafka for receivers? i just see one arrow to LBs which is for finding the corresponding chat server ... we don't send the message to the LB and it should go through chat-server. appreciate if you clarify that

Hi Jordan, thanks for this video! I dont get why we need to worry about two people adding rows with the same primary "tinyUrl" key, doesnt every ACID compliant db prevent adding two of the same row like that or am I missing something very obvious??

Great content, as always! Thank you Jordan :) A small feedback: it would be nice to maintain a crawl depth with every url in the queue to avoid Crawler Traps (infinite loops).

It would be great to explore how this system can be adapted for other games like Chess. While many components may remain similar, the constraint of write conflicts, storing game state may not be applicable to Chess.

I was asked this question from Amazon a couple years ago... and failed because I hadn't watched this video first. 😞

Great videos. great content. I am relying highly on your videos to prepare and rock system design. But can you please improve the mike situation here.

TIFU by pavloving myself to sleeping to your videos. 😂😂

great depth of core search design discuss with bit comedy ;)

Bro this was next level! Love you bruh

I propose that a separate system for popular users is unnecessary. Posts do not need to be duplicated across feeds, but only across cache servers. We can store a separate cache for feeds and posts on each server as {userid: Array<postId>} and {postId: post content} such that when a post is in multiple feeds on the same server, only the id is duplicated. So for a normal post that is in 20 feeds, we would need to send it to about 20 (maybe slightly less) cache servers. For a popular post in 1 million feeds, however, most of the duplication is intra-server. We would likely need to send that to all 200 feed cache servers, but that is only 10x the load of the post in 20 feeds, not 50,000x as would be expected. Since these popular posts account for only a very tiny fraction of our total posts, this extra load is not going to kill us. Also I feel like a multi leader / leaderless replication system can work for the posts DB. As you pointed out, this would cause data consistency issues, but does it really matter? When the client requests the comments for a post, we can just grab all comments from any node and prune anything with a missing parent client side. Essentially this is just increasing the delay that a post gets to the cache by the replication delay of the DB cluster which is probably not that significant compared to the already delayed nature of caching via CDC / Flink. IMO this is a good tradeoff for the increased write performance that we may need when a popular post gets hammered with comments.

Thank you Jordan I am a new grad, but I got hooked on your videos because of your jokes. Hehe I’m pretty sure I’m learning system design through laughter. i guess i would be first senior new grad engineer :D

Hi Jordan, regarding partitioning the game server. Instead of region, can we use game id as partition key, In this way all the players for a particular game will go the same server

thank you jodron. Best content in the internet for distributed systems. hoping to pass the interview tomorrow. I covered most of your videos :). Passing Good karma to you

leaving the course at 6:03

Its The tech lead

Great video Jordan, had a qq: at 25:23, where we have users table, and user followers table, the event will be triggered in User Followes table first , for eg: all the followers for user id 6, maybe [3, 5, 10] Then after this result reaches Flink, then it would take every followers id, and check if it is verified from Users table So trigger event on these 2 DBs won't be simultaneous . I am imagining CDC to be like Dynamodb streams. Also I didn't completely understand why are we using both Kafka and Flink, can't we send the trigger event on any DB change directly to Flink. I am a beginner, so pardon me for any obvious questions asked

Top tier videos! Can you do Design a Parking Lot?

what happens when your num_reviews and total_stars aren't aligning, lets say you see 501 total stars on 100 reviews where the max star per review is 5.

You don’t actually mention if Kafka is the log or message type vs rabbit

Hey Jordan, your videos are really good. I have a system design interview coming up. I am really learning a lot from your videos. Thanks a lot.

Don't we need a parser/lexer service between kafka and search index that parses the tweets, hashes it to the correct partitions of the search index ?

Hi Jordan, can u pls explain once more thie CDC part, how is it working, from which table to which table it is going to capture the change and what advantage we have. Please 🙏

My boy never misses an opportunity to push something to Kafka. Noice.

which database is of choice when you need SQL database but the dataset is too large and you need to shard the data or the database needs to be distributed?

Hi, Jordan, really appreciate the content, will you consider sharing your notes in as in format, with a huge asterisk that they can be wrong. It's just that I have a couple of interviews this month and want to revise all the designs but going through the all the older videos is time consuming.

It's been one of the most meaningful talks I have watched this year sofar! thank you

The real answer is that I don't care at all about the high traffic scenario. That accounts for 1% of my total events, and those are so popular that 100% of tickets will be sold no matter what. It doesn't matter if the system is fair, of if the UX is terrible, or even if it goes down. That's just the difference between selling all the tickets in 1 minute and selling them all in 10 minutes. Same revenue. The important part is the UX for all the customers buying tickets to less popular events. If you put them off, you might actually fail to sell a ticket that you could have.

Hi Jordan. Nice video, appreciate it. Though I didn't get the point of having master server in front of region servers. Can you clarify please?

hey jordan, please update notes on gdrive, you havent shared latest video slides there

Jordan has yes life

This was an awesome video Jordan, thank you. I finally have a video I can send to my friends when they ask me to "just make a mmo game" and be rich

This escalated too quickly

I talked to someone who does data moving with SQL at Meta but the person is really happy to have the chill work

Great content as always! Btw felt like counting number of times you said ‘of course’ in this video😂 but since I have life I didn’t😝