this server WONT break

แชร์
ฝัง
  • เผยแพร่เมื่อ 19 พ.ค. 2024
  • Thanks again to Supermicro for sponsoring this video and helping us bring this project to life! Check out their AI Storage solutions and more, using the links below:
    AI Storage Solutions: lmg.gg/W10
    Broad Range A+ Servers for Data Center. Cloud. AI: lmg.gg/W10.1
    GrandTwin® Front Access 2U Twin Architecture: lmg.gg/W10.2
    Supermicro WEKA Distributed Storage Solution: lmg.gg/W10.3
    We’ve gone through many evolutions of our main video editing server Whonnock, but they’ve all shared a similar problem - there is only one of them. Today, we change that by deploying a high availability storage cluster powered by Supermicro’s GrandTwin multi node servers and Weka, a distributed NVMe-first clustered file system. It’s fast… very, very fast.
    Discuss on the forum: linustechtips.com/topic/15636...
    Check out Weka, the ultra fast NVMe native file system we’re using: lmg.gg/weka
    Check out axle.ai’s AI powered media asset management software! lmg.gg/axle-ai
    Buy an AMD EPYC Genoa 9534 CPU: geni.us/vBDeNCo
    Buy Samsung 4800MT/S 32GB DDR5 ECC RAM: geni.us/1PdFK
    Buy a Sabrent Rocket 512GB Gen3 M.2 NVMe SSD (Used): geni.us/IXiO
    Check out Kioxia CD6 PCIe Gen4 U.3 NVMe SSDs: lmg.gg/r6rRz
    Purchases made through some store links may provide some compensation to Linus Media Group.
    ► GET MERCH: lttstore.com
    ► GET EXCLUSIVE CONTENT ON FLOATPLANE: lmg.gg/lttfloatplane
    ► SPONSORS, AFFILIATES, AND PARTNERS: lmg.gg/partners
    ► EQUIPMENT WE USE TO FILM LTT: lmg.gg/LTTEquipment
    ► OUR WAN PODCAST GEAR: lmg.gg/wanset
    FOLLOW US
    ---------------------------------------------------
    Twitter: / linustech
    Facebook: / linustech
    Instagram: / linustech
    TikTok: / linustech
    Twitch: / linustech
    MUSIC CREDIT
    ---------------------------------------------------
    Intro: Laszlo - Supernova
    Video Link: • [Electro] - Laszlo - S...
    iTunes Download Link: itunes.apple.com/us/album/sup...
    Artist Link: / laszlomusic
    Outro: Approaching Nirvana - Sugar High
    Video Link: • Sugar High - Approachi...
    Listen on Spotify: spoti.fi/UxWkUw
    Artist Link: / approachingnirvana
    Intro animation by MBarek Abdelwassaa / mbarek_abdel
    Monitor And Keyboard by vadimmihalkevich / CC BY 4.0 geni.us/PgGWp
    Mechanical RGB Keyboard by BigBrotherECE / CC BY 4.0 geni.us/mj6pHk4
    Mouse Gamer free Model By Oscar Creativo / CC BY 4.0 geni.us/Ps3XfE
    CHAPTERS
    ---------------------------------------------------
    0:00 Intro
    1:48 Meet the rack
    6:53 We're gonna build it ourselves
    7:29 CPU
    9:38 RAM
    10:05 Boot Drives
    11:00 Cooling
    11:28 Storage
    12:12 The Switch
    12:42 The Software
    17:35 Why the overkill
    20:14 AI?
    24:29 Deployment
    25:25 Final Results
    27:35 Outro
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 2.4K

  • @Gilanas
    @Gilanas 2 หลายเดือนก่อน +11392

    Next video: "we lost all our data"

    • @CraftBlack
      @CraftBlack 2 หลายเดือนก่อน +89

      😂☠️

    • @NicholasHoffmann1
      @NicholasHoffmann1 หลายเดือนก่อน +235

      Server dies, new server installed. All other servers replicate from the new one instead of the other way round. Poof.

    • @JollyGiant19
      @JollyGiant19 หลายเดือนก่อน +67

      Wouldn’t be the first time 😂

    • @adriannudelman4519
      @adriannudelman4519 หลายเดือนก่อน +7

      Totally agree! 😅

    • @clpzdev
      @clpzdev หลายเดือนก่อน

      😭

  • @09Creeperboy
    @09Creeperboy หลายเดือนก่อน +2124

    “How’s the edit going? I’m holding your file server” was the best line 😂. And then when Jake walked over with a second node….*chefs kiss*

    • @39zack
      @39zack หลายเดือนก่อน +192

      the answer was better "is it on wifi?" XD

    • @zuldero
      @zuldero หลายเดือนก่อน +29

      it is still warm

    • @09Creeperboy
      @09Creeperboy หลายเดือนก่อน +6

      @@39zack yeah, they'd be close😂

    • @nickgwinner3136
      @nickgwinner3136 หลายเดือนก่อน +41

      Gives the feeling of "hey, how's your blood doing? I'm holding your heart right here"

    • @koijoijoe
      @koijoijoe หลายเดือนก่อน +34

      ​@@39zack is it on wifi is so freaking funny to come up with for how fast linus just ambushed him on camera lol

  • @davidthomas9860
    @davidthomas9860 หลายเดือนก่อน +1189

    This is lowkey one of the most interesting videos they have done on this channel in a long time, in terms of tangible, world-changing technology. The utility of that AI search tool is so unfathomably insane

    • @andrewanderson6735
      @andrewanderson6735 หลายเดือนก่อน +2

      yah

    • @MaxMacZone
      @MaxMacZone หลายเดือนก่อน +7

      Seriously this is the stuff I saty on the channel for

    • @cconnors
      @cconnors หลายเดือนก่อน

      Google's Gemini let's you search through all of youtube. You can just ask it for random things and it will find youtube clips of it. Truly a game changer.

    • @0Blueaura
      @0Blueaura หลายเดือนก่อน +1

      yeah i keep holding my head and jaw dropping. we are entering petabyte territories and Ai can finally be of crazy good help!. Now imagine if Ai was trained to help police catch criminals using ai...

    • @lainamitclaire
      @lainamitclaire หลายเดือนก่อน +14

      ​@@0Blueaurano thank you please

  • @willie69420
    @willie69420 หลายเดือนก่อน +580

    "I'm holding your server"
    "Is it on Wi-Fi?"
    Absolutely amazing

    • @laci507
      @laci507 หลายเดือนก่อน +32

      Let's be honest, that is quite a reasonanble thing to ask in that situation, I would do the same

    • @speeder3235
      @speeder3235 หลายเดือนก่อน +6

      bless u mark

    • @MrFluteboy1980
      @MrFluteboy1980 หลายเดือนก่อน +12

      "this, Jen, is the internet"
      "Oh. Why are there no wires!??"
      "It's wireless!!"

    • @JoonasD6
      @JoonasD6 หลายเดือนก่อน +2

      @@MrFluteboy1980 Gotta remember to view that episode every once in a while. Thanks.

    • @lpseem3770
      @lpseem3770 หลายเดือนก่อน

      More importantly, I am totally not grounded with a rack and I want to hug it with my ears. ZAP!

  • @quattro_vp
    @quattro_vp 2 หลายเดือนก่อน +2445

    cannot lose data, until Linus somehow manages to drop it eventually

    • @Daniel-zy1ir
      @Daniel-zy1ir หลายเดือนก่อน +16

      14:05 Linus' face when everything is gone

    • @shaunlavoie6183
      @shaunlavoie6183 หลายเดือนก่อน

      Beat me to it lol

    • @kurtmayer2041
      @kurtmayer2041 หลายเดือนก่อน +5

      i mean they're ssds, a drop should do basically nothing
      ...
      right?

    • @Smitty_Werbenjagermanjenson
      @Smitty_Werbenjagermanjenson หลายเดือนก่อน +9

      if you know about databases, you can absolutely drop data!

    • @user-cz9jf1ec8s
      @user-cz9jf1ec8s หลายเดือนก่อน +6

      I mean hopefully if he drops it only the 1s will fall out since they weigh more than the 0s.

  • @anvecom
    @anvecom หลายเดือนก่อน +919

    My home desktop cannot lose data as well - in the sense that if something were to fail, I'm too broke to afford redundant storage.
    Enterprise reliability is nuts, it's great to watch :)

    • @Bierkameel
      @Bierkameel หลายเดือนก่อน +10

      This not enterprise but small business junk.
      Enterprise storage is dedicated like Netapp, EMC Unity, 3par and many others.

    • @HyviaVideoitaMansenlale
      @HyviaVideoitaMansenlale หลายเดือนก่อน +34

      ​@@BierkameelTell me more

    • @spaceghostmiid
      @spaceghostmiid หลายเดือนก่อน +22

      you'd be surprised at how cheap redundancy can be. i got a 16 tb external i use to backup anything important/excessively large for like 150 dollars. you can pick up a cheap 1tb external for like 30 dollars or less on sale, and that's pretty much all you need to back up your really important shit unless you do video editing/raw photo editing.

    • @Milsparro
      @Milsparro หลายเดือนก่อน +7

      100GB of Google is $2/mth

    • @morosis82
      @morosis82 หลายเดือนก่อน +32

      ​@@Bierkameelthose systems can be implemented with small numbers of nodes also, they are not by definition better than this, but in large enterprises are built at scale and spread across racks or even separate buildings.
      You could do that with this setup too, they just don't need to.

  • @DooMRunneR
    @DooMRunneR หลายเดือนก่อน +55

    As a senior data center engineer in a multi billion dollar enterprise I really enjoy such content (with a bit of envy), while we still have to deal with the old school netapp metro clusters, HPE XP8 or IBMs SAN volume controllers you guys can play with the innovative stuff, even if its totally overkill for your usecase.

  • @jasonkramer8536
    @jasonkramer8536 หลายเดือนก่อน +16

    This is easily one of the most beneficial and practical uses of AI I've seen. Eliminating the tedious work of sifting through thousands of hours of content to find something relevant? Yes, please.

  • @HanTheGreatInventor
    @HanTheGreatInventor หลายเดือนก่อน +222

    I get it now. You need two of everything for proper redundancy.
    Elijah can drop stuff when Linus isn't there.
    Elijah can mess stuff up when Dennis isn't there.
    Good hire, LMG.

    • @ZlotyCK89
      @ZlotyCK89 หลายเดือนก่อน +9

      You need to hire third to get full HA set !

  • @frankie137137
    @frankie137137 หลายเดือนก่อน +529

    My favorite LTT videos are the ones with Jake explaining networking that I do not understand at all

    • @benwu7980
      @benwu7980 หลายเดือนก่อน +8

      There are so many terms or protocols involved when actually dig into 'networking' , they can't really delve too far into them since are (mostly) very niche. Stuff like going with SMB should be explained more in a video like this.

    • @chimpslow191
      @chimpslow191 หลายเดือนก่อน

      Absolutely agree because that is also me

    • @kreuner11
      @kreuner11 หลายเดือนก่อน +1

      Rly not that difficult

    • @frankie137137
      @frankie137137 หลายเดือนก่อน +4

      @@kreuner11 sick dude

    • @frankie137137
      @frankie137137 หลายเดือนก่อน

      @@benwu7980 if I really want to know more about something I can just give it a goog. These videos are perfect the way they are right now. I think they’re really fun. I’m a simple man; if Jake is excited in a video then I’m excited watching it.

  • @RomanRSY
    @RomanRSY หลายเดือนก่อน +138

    I must say, Linus Tech Tips has truly outdone themselves this year! The improvement in content quality is simply outstanding. It's incredibly noticeable how much work you've put into enhancing everything from writing to video production. The videos now are on a whole new level of coolness! Guys, you were good before, but now you're next-next-next level! Kudos to the LTT team for continuously raising the bar and delivering top-notch content.

    • @scientist100
      @scientist100 หลายเดือนก่อน

      He has a full team that coordinates this for him; it does really pay off to have a great team to make content together.

  • @snowblind630
    @snowblind630 หลายเดือนก่อน +10

    See you guys in a year when the server loses data

  • @matthewjalovick
    @matthewjalovick หลายเดือนก่อน +922

    Okay… the server was neat but HOLY COW that sorta AI search program thing at the end was unbelievable. One of the coolest products I’ve ever seen. That’s an actual game changer for folks who have a lotttttt of data and through which it’s not easy to search.

    • @wasituzayer9728
      @wasituzayer9728 หลายเดือนก่อน +46

      Object recognition using machine learning isn't exactly a new concept, but I guess no one did an implementation like this before? 🤷‍♂

    • @nunoaguiar2525
      @nunoaguiar2525 หลายเดือนก่อน +59

      I wish TH-cam had a search like that. Some times I'm searching for something to use as joke or whatnot and only "popular content" appears.

    • @marchtimed
      @marchtimed หลายเดือนก่อน

      @@nunoaguiar2525 a search feature like that implemented into youtube would be huge, people would cry over ai being used, but it would be huge

    • @leonro
      @leonro หลายเดือนก่อน

      ​@@nunoaguiar2525It will take a long time, but I'm sure we'll reach that point in the future 5-20 years with youtube search.

    • @dill3480
      @dill3480 หลายเดือนก่อน

      ​@@wasituzayer9728object recognition was cool, but scene recognition is off the charts

  • @jordanhildebrandt3705
    @jordanhildebrandt3705 หลายเดือนก่อน +311

    That Epyc CPU could hold the entire system memory of a Win 2000 machine in its L3 cache. Can you even imagine how fast it would be if your entire kernel AND workload is in CPU cache, and main memory isn't even being used!? That's wild.

    • @Gift0r
      @Gift0r หลายเดือนก่อน +14

      Yes, BUT.
      It still needs to hold the necessary data and operations as well, otherwise you will run around with your shoe laces tied together.

    • @katrinabryce
      @katrinabryce หลายเดือนก่อน +21

      I think it would hold the entire system memory of a modern FreeBSD or Debian machine, certainly it would for Alpine.

    • @defeqel6537
      @defeqel6537 หลายเดือนก่อน

      Windows 95 used something like 16MB, and could run on less IIRC

    • @morosis82
      @morosis82 หลายเดือนก่อน +31

      If you get the stacked cache versions you can get just over 1.1GiB of L3 cache per CPU. The new AMD stuff is nuts.

    • @katrinabryce
      @katrinabryce หลายเดือนก่อน

      @@defeqel6537 Minimum was 4MB, recommended mimimum was 8MB.

  • @M3t4lstorm
    @M3t4lstorm หลายเดือนก่อน +2

    As someone who built software like Weka for ~8 years, I appreciate how excited you are about these insanely complex systems and the performance they bring.

  • @Respectable_Username
    @Respectable_Username หลายเดือนก่อน +6

    "What could go wrong?"
    "I mean, a lot."
    Ah, it's always a good sign when those words are being said on the _other_ side of the screen 😂
    Glad to see Jake back again! Had been thinking it's been a while

  • @timeimp
    @timeimp 2 หลายเดือนก่อน +1432

    THE INTRO HAS RETURNED. Thank you Dan.

    • @Eli-zb2yj
      @Eli-zb2yj หลายเดือนก่อน +56

      It's not done until it's dan

    • @mdneilson
      @mdneilson หลายเดือนก่อน +26

      I cry happy tears a little every time

    • @doxastoel
      @doxastoel หลายเดือนก่อน +11

      I missed it

    • @timschulz9563
      @timschulz9563 หลายเดือนก่อน +11

      Isn't it in every longer video?

    • @maxanimator9547
      @maxanimator9547 หลายเดือนก่อน +26

      that and Linus' beard, it truly feels like 2018 again

  • @nocloo6829
    @nocloo6829 หลายเดือนก่อน +755

    Videos like this are proof that Jake is a very valuable employee. Guy knows his IT stuff.

    • @AtiqSamtia
      @AtiqSamtia หลายเดือนก่อน +82

      And he gets to play with the newest stuff like toys ;)

    • @ChristopherHallett
      @ChristopherHallett หลายเดือนก่อน +157

      Yep! Yvonne's husband's boyfriend is pretty great at his job!

    • @bloodangel13
      @bloodangel13 หลายเดือนก่อน +51

      And god bless him for trying to make every server in that company Linus proof.

    • @GrugGaming
      @GrugGaming หลายเดือนก่อน +3

      @@ChristopherHallett LOL 😂

    • @chaozzah
      @chaozzah หลายเดือนก่อน +44

      The best part is - he probably didn't know a lot about it, but he figured it out.
      Also, the storage isn't really redundant since it's in the same rack, in the same building, in the same continent :D It never ends!

  • @ciaduck
    @ciaduck หลายเดือนก่อน +5

    It would be interesting to see Ceph running on this thing. CERN uses Ceph for data from the LHC.

  • @clarkcaraway9912
    @clarkcaraway9912 หลายเดือนก่อน +30

    Jake looks fantastic and I'm so proud of him and the effort he has clearly put in. Good on you man.

  • @Kobay350
    @Kobay350 หลายเดือนก่อน +141

    8:25 linus gesturing with the server sent chills down my spine.

    • @fallingmars50
      @fallingmars50 หลายเดือนก่อน +9

      I thought only I was freaking out

    • @chuckpoe5297
      @chuckpoe5297 หลายเดือนก่อน +5

      My arm instinctively twitched as if to reach out and catch it

    • @ashleyobrien4937
      @ashleyobrien4937 หลายเดือนก่อน

      @@chuckpoe5297 this is what you get when money and goods mean nothing to him...he simply doesn't give a dam..

    • @Jouniii
      @Jouniii หลายเดือนก่อน

      fr

    • @squidwardo7074
      @squidwardo7074 หลายเดือนก่อน

      u can even see his arm shaking

  • @danielberglv259
    @danielberglv259 หลายเดือนก่อน +215

    Last time you lost data it was not because of lack of failsafes, but rather the fact that no one was keeping an eye on things. This may prevent failures when something goes wrong, but only if you actually respond to those failures in time. Make sure to have some sort of alert system this time around.

    • @rootgremlin2746
      @rootgremlin2746 หลายเดือนก่อน +36

      This, aaaaand no experiments or fancy *new* tech, it HAS TO alert someone, no use if alerting itself is down

    • @mysteryboyee
      @mysteryboyee หลายเดือนก่อน +13

      They have actual sysadmins now fyi, like not just some of the editors or whatever happen to also be good at this stuff (such as emily for example) but like they've been hiring actual dedicated IT staff

    • @danielberglv259
      @danielberglv259 หลายเดือนก่อน

      @@mysteryboyeeThat may be, but monitoring is something that they should probably cover at some point in a video like this. Redundancy is not just about hardware. And having sysadmins does not change anything besides the fact that they would know to setup ways to monitor the situation, unless they sit on a chair on front of the server rack at all times.

    • @funderburke43
      @funderburke43 หลายเดือนก่อน

      The red flashing light only works until you get tired of it crying wolf, and that will probably happen before a failure

    • @mnxs
      @mnxs หลายเดือนก่อน

      ​@@danielberglv259One would presume that dedicated sysadmin staff would indeed have it as part of their job description to actually do such things. They would be unfathomably stupid not to.

  • @jfmezei
    @jfmezei หลายเดือนก่อน +2

    The concept of cluster voting was developped by Digital Equipment Corp in the 1980s for its VMS clusters. The votes and quorum mechanism did not handle just failure of a node, but more importantly prevented a node that left the cluster from continuing to function (thus proventing it from accessing drives without enforcing locks/synchrinization with the other nodes). (called cluster partitioning). In the case of a 2 node cluster, you could designate a drive as quorum disk and give it votes, so any node in the cluster that still saw that/those drives would get the votes and could then continue. (in VMS clusters, drives could either be served by a node (and accessed from other nodes via network) or be standalone with direct hardware links to each node.
    (Digital developped extention to SCSI (called DSSI) to allow multiple hosts to access the same SCSI bus so multiple nodes coul write directly to the same physical drives). (later on, I beleive SCSI did get that functionality).
    The freezing of a node to prevent partitioning is very clitical to prevent a node that lost its connection to the other nodes from continuing to write to disks or perform tasks without the synchronization with the other cluster nodes. (in a cluster, there was a single lock database so when a process on a node too a lock on a file (or area of file) or a resource, that lock would exist on all nodes so processes on other nodes would not get that lock until first one released it).
    From a failover POV: You can have 2 nodes doing work since the locking is synchronized, so when one node fails, the other one continues and new network connectiosn all go to the second node instead of being split between the two. The other way is to have node 1 take and get lock and do all the work. Node 2 requests the lock but is put on hold because lock is unavailable. When node 1 goes down, node 2 gets the lcok and then processes all the work.
    Tandem NonStop (used for mission critical stuff such as Interac/credit card) has different fault tolerance. In the same chassis, a process would run on a single CPU/RAM, but a copy would run on a designated CPU/RAM, but basically have it writes to disk/network disabled. Both processes got the same data from network/disk. So the backup was a copy of the main one, and shoudl main one go down, the backup tok over right where the backup failed since the backup had identical RAM, process state and conections to network etc.
    However, while VMS clusters could be spread across multiple buildings (and up to 96 nodes), the Tandem Nonstop was within a single chassis in 1 computer room. so fault tolerant within chassis, but not disaster tolerant.
    A mere smb file server just blindly executes writes/reads from any node to any area of disk/file and when you have different windows instances accessing the same time, the last one writing to it wins.

  • @Bellenchia
    @Bellenchia 16 วันที่ผ่านมา +1

    Having an engineer like Jake around can make a world of difference for your company

  • @caseyberger15
    @caseyberger15 หลายเดือนก่อน +71

    I’m so glad you finally made this video. I have always wondered how the editors find relevant archive footage. You’re telling me it was just from memory this whole time?!

    • @LinusTechTips
      @LinusTechTips  หลายเดือนก่อน +75

      Lol pretty much.... For most of our history we've been a very small company. A dedicated person to ingest and apply metadata was not realistic. - LS

    • @dougle03
      @dougle03 หลายเดือนก่อน +6

      Probably mostly your memory Linus...@@LinusTechTips

    • @KingLarbear
      @KingLarbear หลายเดือนก่อน +5

      ​@@LinusTechTipsthat sounds like a hard thing to do

  • @ohareport
    @ohareport หลายเดือนก่อน +240

    THE MAGIC OF BUYING TWO OF THEM:
    like all proper nerds of this vintage, the idea of anything being dual is just ruddy exciting: dual cpu, dual hard disk, dual gpu, dual dual server with dual dual dual dual psu…

    • @invisi1407
      @invisi1407 หลายเดือนก่อน +26

      I can't read that first line without thinking about Alec from Technology Connections. 🤣He's said that so many times in his videos. :D

    • @WackoMcGoose
      @WackoMcGoose หลายเดือนก่อน +8

      @@invisi1407 I think he's the one that originally began calling it "the _magic_ of buying two of them"? Unless he's quoting it from an even older show...

    • @someoneelse5005
      @someoneelse5005 หลายเดือนก่อน +1

      Technology Connections gonna sue LTT at this point

    • @utsav5581
      @utsav5581 หลายเดือนก่อน

      watc interet anarchist

    • @invisi1407
      @invisi1407 หลายเดือนก่อน +1

      ​@@WackoMcGooseI think that was just all Alec. :D If you google the sentence, the whole first page is basically references to T.C. :D

  • @zizimyui6605
    @zizimyui6605 หลายเดือนก่อน +1

    so much energy you got there, mate.
    Thanks

  • @DctrGizmo
    @DctrGizmo หลายเดือนก่อน +1

    That software they use to search for videos is insane! It's pretty impressive at how accurate their searches were and how the thumbnails matched.

  • @ethanlieske9678
    @ethanlieske9678 หลายเดือนก่อน +87

    To Add to the split brain talk, you need an odd number of nodes to guarantee they can reach quorum. Running only 3 nodes also creates issues when there is a failure as you now can't reach quorum and need to immediately get the node back up. When running 5//7/9 nodes outages are not nearly as urgent .

    • @jono6379
      @jono6379 หลายเดือนก่อน +1

      So why go with 8?

    • @ethanlieske9678
      @ethanlieske9678 หลายเดือนก่อน

      @@jono6379 modern voting algorithms should handle even node counts above 2 fine , though I have always built clusters in its sets out off habit.

    • @Bassalicious
      @Bassalicious หลายเดือนก่อน

      @@jono6379 1 failure -> 7 node quorum, 2 failures -> 5 node quorum? Am I understanding this correctly?

    • @samuelkent7482
      @samuelkent7482 หลายเดือนก่อน +1

      My guess is when you have more servers, the load on each is decreased, such that occasionally one can take a backseat. So with an even number of servers, by this logic, the failure of one server would not compromise the process and it would function as normal since the “extra” would not be needed right away and thus have more time to get resolved and back up and running. Networking allows the servers to handoff tasks to neighboring servers in the network. This is also why it was mentioned in this video that “two entire servers” can go down and not cause an issue and nobody would even notice. Also, the odd number discrepancy to check for biases, that’s usually an ideal for if you have multiple tasks computing at once that put the network of servers at full load, but otherwise an even number will still work fine as one is backup.

  • @MoldyMcdonut
    @MoldyMcdonut หลายเดือนก่อน +110

    You're killing me linus 8:27 like holy you made my heart drop.

    • @UnExile
      @UnExile หลายเดือนก่อน

      Stop kissing his ass.. hi Linus 😂

    • @PurpleCh4lk
      @PurpleCh4lk หลายเดือนก่อน +9

      @@UnExile huh?

  • @Ecofg
    @Ecofg หลายเดือนก่อน +3

    I remember the first video from Linus Tech Tips that got me hooked to the channel - the first Petabyte project. Even after all these years it is still as entertaining as it ever was to watch these guys do what they enjoy. Thanks to Linus Media Group, I am now pursuing a career in IT. I feel grateful to have come across this channel because it has formed who I am as a person now. Keep up the good work.

  • @jpulley
    @jpulley หลายเดือนก่อน +4

    That axle AI is crazy! Can't wait to see more historical clips showing up in new videos!

  • @sebastienpiechurski5686
    @sebastienpiechurski5686 หลายเดือนก่อน +50

    Great to see professional server stuff shown to the public. One small correction though: even though the ConnectX-6 cards have 2x200G ports, the card itself is limited to a total of 200G by its chip, and both ports have to share the total bandwidth.

    • @RumenBlack
      @RumenBlack หลายเดือนก่อน +2

      They did mention the total bandwidth limitation on those cards.

  • @danieltober8574
    @danieltober8574 หลายเดือนก่อน +4

    really enjoying the intro being back!

  • @Denstoradiskmaskinen
    @Denstoradiskmaskinen หลายเดือนก่อน +1

    Love the server hardware videos.. keep em coming! Supermicro web browsing, just for fun do exist

  • @NetherLad
    @NetherLad หลายเดือนก่อน +55

    Dad, and son nerding out over servers. Warms my heart

  • @ianhoyt2638
    @ianhoyt2638 2 หลายเดือนก่อน +171

    It makes me so happy seeing the intro in so many new videos. It's the best intro on youtube, and screw viewer retention, I will watch it!

    • @sakurazero3641
      @sakurazero3641 หลายเดือนก่อน +6

      My words brother. It should be herecall the time it is legendary

  • @kevincaparas013
    @kevincaparas013 หลายเดือนก่อน +2

    26:52 "Is this on Wi-Fi?"
    -Mark 2024
    🤣

  • @th3dilli
    @th3dilli หลายเดือนก่อน +1

    I love the server videos, so much crazy tech being used is amazing to watch

  •  2 หลายเดือนก่อน +137

    THE INTRO IS BACK PEOPLE!

    • @UnifiedInfo
      @UnifiedInfo หลายเดือนก่อน +12

      So are the quality viewers lol. Been drawing me back in last week or so

  • @SilentDecode
    @SilentDecode หลายเดือนก่อน +30

    I REALLY want a Floatplane extra for this which dives DEEP into this stuff. I don't care if it's 3,5 hours long like the FP Exclusive of Kyle. THIS. IS. AWESOME!

  • @MrHaggibear
    @MrHaggibear หลายเดือนก่อน

    The one thing I really take away from this one: "New-new-new-new-new-new-new-new-new-Whonnock goes REAL BRRRRRRRRRRRRRRRRR!"
    The amount of knowledge and expertise involved in these projects exceeds my level of computing soooo far at this point^^ Still fun to watch!

  • @haves_
    @haves_ หลายเดือนก่อน

    20:40 OK that is definitely the best feature so far, this era of information there are lots, but to actually get one that is relevant is the true power.

  • @KingAzaz
    @KingAzaz หลายเดือนก่อน +52

    I absolutely love these server oriented videos! Please never shy away from doing more! I almost wish you guys had a specialized channel for this kind of stuff and just let Jake geek out. Great stuff, LTT!

  • @giannolamichael
    @giannolamichael หลายเดือนก่อน +19

    I just decommissioned something similar at work about 2 months ago these are awesome and super reliable. The ones we decommissioned were used for high availability to radiology records in a major hospital, ran for 7 years with no issue and was only replaced for a standard life cycle upgrade of the system!

    • @davidgoodnow269
      @davidgoodnow269 หลายเดือนก่อน +1

      I love auctions!

    • @squidwardo7074
      @squidwardo7074 หลายเดือนก่อน

      So when you upgrade is that the only time it goes down?

    • @giannolamichael
      @giannolamichael หลายเดือนก่อน +2

      @squidwardo7074 in our case yes. Because of the high availability of data it would take in our case 6 simultaneously failing servers to cause an outage. Or 2 simultaneously failing access switches with 2 simultaneously failing links for each server connected to each switch

  • @Xenosource
    @Xenosource หลายเดือนก่อน

    Haha, that's amazing. Congrats LTT, Supermicro, and Weka for this killer demo!

  • @whatwhat-777
    @whatwhat-777 หลายเดือนก่อน

    I am a small homelabber, and I love only these types of videos from LMG....I watch all of their server room/ servers/ storage kind of videos.
    I first thought they were gonna use Ceph but looks like Weka is super cool too.

  • @smarouchoc7300
    @smarouchoc7300 หลายเดือนก่อน +19

    this is a great video to show how AI could be useful in an SMB - Small to Medium Business, not the shared drive :D I kinda wish you hadn't buried it 20 minutes into the video, but you had to, so we could see the technology that makes it reasonable to do. This is actually one of the most relevant videos of yours for me in what I do in my professional life. Good work.

  • @StjepanTreger
    @StjepanTreger หลายเดือนก่อน +16

    ...the ending is pure gold: "..see all the lights, they never stopped blinking." :D such a powerful statement, so true for any debugging process no matter who you are!

  • @north.
    @north. หลายเดือนก่อน +2

    The camera man took my tip I am so happy :)

  • @Exilum
    @Exilum หลายเดือนก่อน +3

    Seeing the software made me really wish for someone to build a consumer storage classifier. Like just that part, you could point it to a file in your regular file system, give it somewhere to store all the generated information, and be able to manage all your pictures and videos.

    • @LutraLovegood
      @LutraLovegood หลายเดือนก่อน

      Last time I checked you technically could use a business solution, but it wasn't cheap. Maybe there are cheap consumer options now though.

  • @thefifth1105
    @thefifth1105 2 หลายเดือนก่อน +124

    LOVE THE RETURN OF THE INTRO

    • @ilhamkazimzadeisyourproducer
      @ilhamkazimzadeisyourproducer 2 หลายเดือนก่อน

      Is returned? I guess I was watched a lot of old videos of linus 😅😅

    • @vffa
      @vffa หลายเดือนก่อน

      ​@@ilhamkazimzadeisyourproducer I don't get it either. Isn't that the normal intro?

    • @MoPaTography
      @MoPaTography หลายเดือนก่อน

      ​@@vffaa few months ago/last year supposedly their TH-cam metrics said they were losing viewer attention during the intro, so they stopped adding it in. It was mentioned on the wan show.
      However personally I feel it gives the LTT a character like a proper TV show. I love it!

  • @jonnathan780
    @jonnathan780 หลายเดือนก่อน +16

    Genuinely need so much more of jake and this awesome nerdy server content.

  • @thierrydekeyser8543
    @thierrydekeyser8543 หลายเดือนก่อน

    Thank you Jake, for calling me awesome!! :D

  • @icosli5798
    @icosli5798 หลายเดือนก่อน +1

    These networking server infrastructure videos are my guilty pleasure

  • @thefifth1105
    @thefifth1105 2 หลายเดือนก่อน +26

    Now, for true redundancy, do a nightly mirror/backup over fiber optic or microwave link to an identical setup in the labs building. Call it Whonnock 10_2. God forbid another UPS or power bus catch fire in the server room. Or Linus pull 3 servers for a fail over demo by mistake.

    • @DG8RS
      @DG8RS หลายเดือนก่อน +12

      Yep. The first thing I thought is "WHY IS IT IN THE SAME RACK?!??!"

    • @Aizakou
      @Aizakou หลายเดือนก่อน

      Finally somone pointing this out, i thought i was the crazy one here

    • @garethd3741
      @garethd3741 หลายเดือนก่อน +3

      Using Ceph you can define your failure domain and run a cross datacenter cluster.
      The failure domain is scalable, so right now I run a disk level failure domain at home, but in a bit I'll move to host level failure domain (once I add a few more hosts)

    • @macking104
      @macking104 หลายเดือนก่อน +1

      Not good enough..l they need backup in another part of Canada or US. That area will someday have a big earthquake off the coast and that will sever fiber optic lines and cause major power outages, etc…

    • @brad2064
      @brad2064 หลายเดือนก่อน

      Need multiple geographically diverse fiber links also, preferably to a mirror site in another city/region.

  • @slamburger
    @slamburger หลายเดือนก่อน +7

    That time jump at the beginning hooked me like a fish and I watched the whole video
    I love infrastructure content and other business related IT! I could watch it all day.

  • @RonakDhakan
    @RonakDhakan หลายเดือนก่อน +2

    This is the kind of stuff that is exciting for me in IT. Although I would not go this extreme and aim for maximum value for money, it is fun to watch.

  • @ArthurBugorski
    @ArthurBugorski หลายเดือนก่อน

    I'd love a video on the evolution of Whonnock over time. I think that's good for learning how to evolve our home server storage over time.
    Fun fact: one of the Whonnock videos was the first LTT video I ever saw.

  • @insu_na
    @insu_na หลายเดือนก่อน +15

    Also check out Ceph I'd say. It's neat.

    • @Waitwhat469
      @Waitwhat469 หลายเดือนก่อน +5

      ever storage video I want them to check out ceph. Rook ceph is super powerful imho.

  • @Idiomatick
    @Idiomatick หลายเดือนก่อน +6

    This really sounds like an unsinkable ship! Good job guys!

  • @MoPaTography
    @MoPaTography หลายเดือนก่อน +2

    God I love the intro coming back to LTT videos! That cut from the intermission bleep to the intro had me lmao 🤣 1:38

  • @jeremybarber2837
    @jeremybarber2837 หลายเดือนก่อน

    Holy frick... that AI scanning is hella dope. Excited for the road ahead for ya'll.

  • @linuxares
    @linuxares หลายเดือนก่อน +18

    Some C-suite at Supermicro when Linus and Jake pulled the servers.
    "Why do we work with these guys?"
    Then again, it proves how good the setup is!

  • @jonathanstyles9601
    @jonathanstyles9601 หลายเดือนก่อน +24

    Obligatory ceph mention

    • @MattSitton
      @MattSitton หลายเดือนก่อน

      Yeah ceph is great I have a 3 node deployment of it that's been going strong for years

  • @jpulley
    @jpulley หลายเดือนก่อน +1

    Jake is the kind of employee that brings real value to an organization. Vote party for maximum raise at performance review time! 👏🏾👏🏾💯🔥

  • @NavneetRao
    @NavneetRao หลายเดือนก่อน

    15:43 Jake is referring to the fact that the latency accounts for the fact that they are using DPDK (Data Plane Development Kitty) to facilitate RDMA (Remote Direct Memory Access): basically running RDMA through software, and accounting for the latency as a result (I.e, in the userspace rather than at a kennel level). This is pretty fantastic!

  • @alexmartinelli6231
    @alexmartinelli6231 หลายเดือนก่อน +21

    Oh wow! It's an actual use for large language models and training that's ethical, reasonable, and useful! Incredible!

  • @NathanAtkinson590
    @NathanAtkinson590 2 หลายเดือนก่อน +44

    3 years from now: How we lost all our data

    • @kg4wwn
      @kg4wwn หลายเดือนก่อน +2

      So we let Elijah plug in a network cable and ...

  • @SKRUBL0RD
    @SKRUBL0RD หลายเดือนก่อน

    the truly nice feature to high availability is not even just the redundancy but also the fact that when you want to make upgrades or any kind of changes or even just performing a lot of software updates you can pull each machine 1 by 1 and do them in a localized setting so as to not create bottlenecks otherwise for everyone trying to read/write data constantly. something that Valve Corp hasn't even learned as in 2024 there are still a lot of downtime across all services on Steam every Tuesday.

  • @durdy911
    @durdy911 หลายเดือนก่อน

    That was an amazing video for me. Amazing solution from hardware to file system to performance and even AI

  • @noswear2346
    @noswear2346 หลายเดือนก่อน +8

    Jake and server upgrade video ? My favorite ngl more jake pls

  • @oourdumb
    @oourdumb 2 หลายเดือนก่อน +13

    "They don't know what HA means"
    Me.. working in IT for 25 years: "HA means nothing if its not distributed and works as a failover cluster in a DR event"
    TLDR; It's still not secure, it's not protected against floods, fires, or other disasters. It still lives in a closet. The system needs to be distributed physically before it can be called HA.

    • @nickfarley2268
      @nickfarley2268 หลายเดือนก่อน +4

      If the LTT office floods I don’t think off site high availability storage will help because LTT does not have a redundant video editing team.

    • @oourdumb
      @oourdumb หลายเดือนก่อน +4

      ​@@nickfarley2268 That's not true, the team could just be moved to a temporary location with remote access to the files... that's the whole point of a DR plan. In the event his whole team dies during the flood, sure... you're right, but that would be quite a flood :)
      A strong power surge could take down his whole "high availability" setup... not exactly HA.

    • @maxhennessy6676
      @maxhennessy6676 หลายเดือนก่อน +1

      @@oourdumb True but it also comes down to cost Vs risk this is a big calculation a business must take.

    • @gonzalomartinez3237
      @gonzalomartinez3237 หลายเดือนก่อน +1

      Excellent comment. Really excellent.
      The serious stuff for HA is not interesting for a general audience. Is pretty boring, even for us IT professionals.
      Is not "cost vs risk", it doesn't have the features for being redundant and secure. Is like building "the world's most powerfull PC" with $200, and then argue that well... it has prioritized costs...
      A recomendation? Just do it right, and if it is not right for a video, don't make a video about it, period.

    • @oourdumb
      @oourdumb หลายเดือนก่อน

      @@maxhennessy6676 sure, but that doesn't make it HA... that's my point. You can't say "it's a discount HA", since there is a real name for it... just a failover cluster. Even if it load balances, still not HA. HA has many requirements and physical distribution is one...

  • @CaelanDeJager
    @CaelanDeJager หลายเดือนก่อน

    It would be kinda sick to see an educational series on IT engineering and deployment given all of the amazing professionals working on projects like this on the front and back end.

  • @michaelwarburton6173
    @michaelwarburton6173 หลายเดือนก่อน

    First time hearing about Weka. Literal game changer. Very impressive.

  • @jprsfragoso
    @jprsfragoso หลายเดือนก่อน +12

    Linus: "Here it is, the final form"
    _Less then 1 year later_
    Linus:

  • @iceman11766
    @iceman11766 หลายเดือนก่อน +13

    Whonnock 10
    Last whonnock ever, until whonnock 11

  • @AndreasTyrosvoutis
    @AndreasTyrosvoutis หลายเดือนก่อน

    Great video. Bleeding edge software stack with Weka and the video AI stuff. Amazing.

  • @rozaj2002
    @rozaj2002 หลายเดือนก่อน

    I have no idea about servers or storage but i still enjoy watching these

  • @MrPruske
    @MrPruske หลายเดือนก่อน +6

    12:41
    I laughed way harder than i should have at that linus pillow

  • @Emell09
    @Emell09 2 หลายเดือนก่อน +15

    Thank you for including the intro again :D all i got to say atm :P

  • @richardwiech
    @richardwiech หลายเดือนก่อน

    So glad the intro is back!

  • @Respectable_Username
    @Respectable_Username หลายเดือนก่อน

    One thing I love about these server videos is that, unlike the high end PC builds you make, I might actually interact with one of these! Obviously not of my own, but as a professional software engineer deploying stuff for an employer. Even just making decisions based on what hardware bottlenecks will appear for different types of services! And the best part is not having to spend your own money on the outcome 😂

  • @JackOEllingham
    @JackOEllingham 2 หลายเดือนก่อน +86

    Jake with a full beard is a much better look for him!

    • @alexdavis9324
      @alexdavis9324 หลายเดือนก่อน +9

      Jake looked much better overall in this video. Our boi is growing up

    • @AliceAWilson
      @AliceAWilson หลายเดือนก่อน +1

      nah facial hair looks worse on all men.

    • @peterparker-zy9oe
      @peterparker-zy9oe หลายเดือนก่อน +12

      @@AliceAWilsoncan't be further from the truth

    • @graham1034
      @graham1034 หลายเดือนก่อน +3

      Now Linus just needs to grow one and all will be well with LMG

    • @UnjustifiedRecs
      @UnjustifiedRecs หลายเดือนก่อน +1

      Yeah, his tache was gross 😂

  • @blancfilms
    @blancfilms หลายเดือนก่อน +5

    I love when LTT does server stuff. Keep em coming PLEASE

  • @SilentKaliSmoker
    @SilentKaliSmoker หลายเดือนก่อน

    I don't know why, but I forget how much networking/nas that Jake knows. When he's the one setting most of it up. Good job Jake.

  • @bloudman1
    @bloudman1 หลายเดือนก่อน

    I'd like to play with that kind of stuff and it is super cool to see that on video properly explained !
    I think even someone not working in IT can understand and that's cool !

  • @Nokenify
    @Nokenify 2 หลายเดือนก่อน +3

    You should try an IBM server sometimes!

  • @iopfarmer
    @iopfarmer หลายเดือนก่อน

    The last 10 minutes with the AI labeling proces is super interesting to me. thks

  • @Luka_Pix
    @Luka_Pix หลายเดือนก่อน

    one of my favorite video in a long time insane technology right here

  • @stowgood
    @stowgood หลายเดือนก่อน +8

    I love the not jank era of Linus tech tips. This is more like a proper corporate setup than home lab setup.

  • @SandstormCloudwave
    @SandstormCloudwave หลายเดือนก่อน +7

    Why don't you ceph?

  • @exmodusgaming
    @exmodusgaming หลายเดือนก่อน

    Best video ending ever, please tell us we are awesome more often. I love being an awesome viewer!

  • @conanscomputer
    @conanscomputer 2 หลายเดือนก่อน +23

    Let’s get some popcorn and watch Linus drop it

  • @brinsonmcbride
    @brinsonmcbride 2 หลายเดือนก่อน +7

    Jake is looking great. Looks like he’s been hitting the gym quite a bit

  • @RGCFlick
    @RGCFlick หลายเดือนก่อน

    I’ve been waiting for this video since the lab tour update. Would like a more detailed video on the setup / Proxmox install / etc

  • @tomiw69
    @tomiw69 หลายเดือนก่อน

    Creazy setup. Many much bigger companies can just dream about something like whonic 10

  • @wildorb1209
    @wildorb1209 2 หลายเดือนก่อน +6

    They got WEKA?!? I'm so jealous! I've always wanted to use this but you just can't run it for the homelab!!!! P.S. How do you backup a weka-system?

    • @anonymousgooglereviewer9890
      @anonymousgooglereviewer9890 หลายเดือนก่อน

      It supports snapshotting and backing up to object storage

    • @Bpinator
      @Bpinator หลายเดือนก่อน +1

      Weka is cool but you can run ceph in a homelab

  • @guardianol
    @guardianol 2 หลายเดือนก่อน +3

    Grate video

    • @Emell09
      @Emell09 2 หลายเดือนก่อน +1

      how have you watched it?? it came out 4 min ago and is 27 min long

    • @Bharatsanjeev-vm7ji
      @Bharatsanjeev-vm7ji หลายเดือนก่อน +3

      @@Emell09 bro booked the slot 1st then he watched

  • @Maadhawk
    @Maadhawk หลายเดือนก่อน

    Supermicro be doin crazy things, crazy awesome.