Insane Storage Server - Fully 10 Gigabit Network, $1,500 Switch
ฝัง
- เผยแพร่เมื่อ 15 มิ.ย. 2024
- With the new office coming soon, we knew it was time to change to a new storage server for daily use...
iFixit link: ifixit.com/linus - Use offer code LINUS03 to save $10 off a purchase of $50 or more!
Fractal Design link: linustechtips.com/main/topic/2...
Pricing & discussion: linustechtips.com/main/topic/3...
Support us: linustechtips.com/main/topic/7...
Join our community forum: bit.ly/ZkLvE7
/ linustech
/ linustech
Intro Screen Music Credit: Title: Laszlo - Supernova
Video Link: • [Electro] - Laszlo - S...
Outro Screen Music Credit: Approaching Nirvana - Sugar High / approachingnirvana - วิทยาศาสตร์และเทคโนโลยี
I just got recommended this. Wow, times have changed.
I wonder if 2015 linus would believe 2019 linus that he ended up hiring a guy who crashed the shit out of dune buggy's to help him watercool it
Intel sponsor them! For the the processors!
IF He does get both of the processors he wants for his rendering behemoth, it'll be worth more than $10,000...More valuable than most college student's means of transportation.
Man, weird coming back to this video. This was right around the time I first found LTT. Surreal dude
Saw this on Vessel...
Watching it again because Vessel is shit.
"The 15 houndred dollar network switch ouch". Haha, cisco people are probably laughing at you right now because they pay $2,000+ for an average switch
Been watching for a couple months now and this is the one that made me subscribe. Fascinating stuff, super informative, and entertaining. I'm glad to see you guys expanding and excited to watch the details.
I love it!! You are taking our learning to the next level.
Thanks
I watched this on Vessel, but I'm watching here because the quality on Vessel is crap.
Switch it to HD at the bottom it is standard set to auto.
MrRyanDew I did. Still looks like it's running a high bitrate 480p or low bitrate 720p
true story man. vessel sucks
TH-cam is better than vessel
Watching videos on vessel with my 4k display is just so painful.
A "fast as possible" on some of these concepts would be awesome!
Been hoping for some more server stuff! Can't wait to see more! Keep up the great work guys! :)
You guys are moving up! that's awesome to hear :)
Funny to watch this episode.... '' ouch a 1500$ network switch'' ...
Just watched the 100,000 $ workstation XD
Just saw his $35K one :D
I'm curious to know if there will be an office tour of the new office?
Little Pinoy the new office is just in a warehouse state right now I'd wait a month or two until they properly prepare it and move there. Linus posted an instagram picture having painting the warehouse.
***** oh right, thanks for that :)
Hopefully
Little Pinoy He said in a wan show that they will
TTate oooh (Y) can't wait, i wouldn't have known since i don't usually watch their wan show. anyways thanks for that
I am so jelly now! That setup is crazy good!
Yes, you DO want to see a 2020 Linus react to this video lol
did this video just appear for anyone else?
i didn't even understand half the stuff in this video, but enjoyed it anyway.
The network rendering box sounds really neat, would love to see a video on that!
Can't wait for the next one of these. Love stuff like this!
Just don't accidentally open the tap on it.
+Eric N This comment makes me crack up every time I see it :D
.... Starting to notice a trend here.
I'll watch stuff on Vessel (Across many channels, not just this), and then at some point later I find myself excited to see new content on TH-cam only to realize 5 seconds in that hey, I saw this before. On Vessel.
That could get annoying........ And with the current state of Vessels browsing experience there's no way in hell I'm unsubbing here just to avoid confusion, it's too hard to tell what's been watched or not, and no real chronological view of your subscribed channels uploads on Vessel.
Oh well. We'll see how this works out.
Mythricia Hey not to bother but did you notice a difference in video quality between youtube and vessel when i wathced on vessel it looked cloudy like the contrast was high. but vessel also seemed sharper then youtube.
Orrrr no vessel but youtube.
Both doesn't go well.
money talks nigga, he signed a contract, saying we give you money from our subscriptions and you put your content up on vessel earlier 3, 2 or 1 days. They go to youtube tell your subs to go there. Vessel cost $3 a month.
***** So its not just me though my only problem is the contrast. Vessel really needs updates including manual resolution control any control really but I have a free year so...
Mythricia but on here we watch in 4k, vessel currently does not support 4k :/
I'm not a tech expert neither someone who knows enough about what you're saying, but I like your videos because of the humour and the way you make them. Keep up the good work.
THIS IS EXACTLY WHAT I NEED TO KNOW. I love these kinds of videos. Please do the render machine as I want the exact same setup.
I want to see your Render Box! Convice Intel!!
That Asrock board + data recovery = a very expensive motherboard....
+Joseph Chong Im typing this comment on an Asrock machine. I like them a lot
+Joseph Chong Asrock are on par with Asus, which isnt surprising considering as Asrock are a shoot-off company of Asus.
+Ibeechu In defence of Asrock, this wasn't a server-grade board, however much that matters which I assume is a lot.
Agreed. I've only ever had an Asrock board die on me. and bare in mind I still have 775 boards from many years ago
YES. I LOVE EXTREME NETWORK STORAGE AND NETWORKING VIDEOS :) Awesome stuff!!!
Checked out iFixit and they're great! Thanks man!
Here after the new JBOD monster
You give me nosebleeds anytime I watch your vids.
Dude, that rendering beast sounds EPIC!
Seagate and "Reliability" in the same sentence? Doh!
Ikr
Why are you using an 8 core xeon and 32GB of RAM for a file server with 8 maximum users? a Celeron and 4GB would be more than enough for that...
I can only assume its because you got them for free? I honestly can't see why anyone would waste those components on a file server without expecting 100+ constant users.
Sam Cooper The number of users is not the determining factor, it's data and transaction volume. And if you've got two users hitting the server over independent 10 gig-e ports and transferring a good 1-2 GB/s, you'll see those cores saturate more quickly than you'd think.
It's also going to be about file size. They are transferring huge files, I presume. Doing so, especially in a distributed (as in raid) environment, and with potential fragmentation adds a significant load if you want your data to be as quick as your interconnects.
totoritko No you won't - the NICs are doing TCP offloading. The core speed/count is hardly an issue.
Dan Wier
This is why there is cache on the controller... Further, I highly doubt that any single client to this server has the local storage to support saturating 10 Gb links.
like you said man, he just put together whatever the sponsor gave him, here it is.(10gbit for fast speed and then later he says don't need speed but readability when the hard drive part came up)
A render box SOUNDS SOOOO COOOL! I will be so jelly if you pull it off!
6:26 classic linus. Great stuff though, hope to see more server and networking related videos!
I would love to know how much and how these guys get paid in the LMG
You went through all that trouble and didn't use a ZFS supported OS? What the fuck is up with RAID 6? No matter how careful you are about component selection or how many redundant drives you have, you can NOT prevent data corruption which normal RAID will do NOTHING about, that's NTFS for you.
The only sure fire way of protecting your data 100% of the time is with ZFS and a distro such as freeNAS. You guys seriously need to consider ZFS if you're adamant about data protection and integrity.
I doubt losing a few bits in a video really affects anything noticeable. You're just regurgitating what Wendel said on The Tek, where he was more focused on integrity of more vital things such as documents and source code.
I do agree with you, not completely though. ZFS is a great file system to consider for large raid arrays and paired with FreeNAS, its off to the races. But, you have to understand that there is no sure fire way to protect your data a 100% of the times. The best you can do is to reduce the probability to a certain extent that it is VERY unlikely to happen.
ZFS is great because it warns you if a drive is going bad and gives you enough head time to fix it.
Also, RAID-Z. RAID-Z 3 allows you to lose up to 3 drives before suffering a complete data loss. Which believe it or not comes in handy when rebuilding large arrays.
100TB FreeNas will need at least 100Gig of Ram... jeeeeessssuuuuusssss!
Benjamin Puna He has a 128gig kit.
Kony Hawk Pro Slaver I would agree with you, except in a RAID array, you either lose nothing or everything. So its not about losing a few bits rather about losing everything.
Coming from a network / server background i really really enjoyed this video. Would like to see more like this!
Oh I definitely want to see that rendering box build. It sounds awesome just listening to it.
I have noticed this in many videos, THERE ARE NO ANNOTATIONS!! No one is putting the links over the video, not an issue, just for those who want to see the content easily, it should be fixed!
Due to YT rule changes, they can no longer put annotations in for sponsorships like they used to.
Chubbysumo really? ahh! So why do they still produce content with the 'presenters' talking about sponsors, and pointing to a screen location? Or has the content been made a while ago?
Ryan Games I do find that annoying even when it is a link to their own videos as it just makes the video look unfinished
yumri4 same
Ryan Games The content was probably made awhile ago. its a policy that directed at people exactly like Linus that were sidestepping google getting their cut by plugging their own ad in the video, along with providing sponsor link annotations.
As an Infrastructure engineer this entire setup made my skin crawl. Rebuild time on a contiguous volume that size with 6TB drives will be miserable, I hope you split them into smaller volumes for the sake of decreasing your failure domain. When you lose a drive the chance of losing another is even higher, RAID 6 is good, but when you have large volumes and disks like that you have to read more sectors to rebuild based off of parity bits. The chances of another drive failing during the LONG rebuild that a 6TB 7.2k NLSAS drive has should be something to consider. The Write speed to that array will be pretty mediocre as well. I also hope you guys have plans for tape backups for that array because RAID is not a backup.
Using FreeNas is cool and all (we use it at my office for niche things) but I would recommend testing throughput before you go prod, its requirements for multi large file transfers at a time is pretty hefty. It needs a TON of RAM to work well. That being said for archiving and dedup it works pretty well. I would also consider adding Windows Storage Spaces to the equation if you plan on being a windows shop.
Finally I would reconsidering naming things like that, especially if you plan on growing larger. It just doesn't scale, something like LTT-Stor01 would scale much better and when you do need to call a consultant in at some point it will make every ones life much easier.
Just my .02 as someone who does this sort of thing for a living, I have no idea if you guys will even see this. Regardless good luck on your office move!
man, so random to write you here but i really liked this comment. i know it's been 4 years, but i ended up on this video as i am having some concerns about my little production company's server situation. we have a 60tb server we use for edit, however it's not so fast - also, it's just a synology nas. i don't know what the next step is, and i would love to ask a guy like you for advice! it's hard to come by proper guidance in these matters.
LUKE! The server room is on FIRE!!!
Rendering box idea sounds awesome ;) Id love to see that
what happened to that video of you selling out to vessel?
I noticed that as well...
PR move. So many dislikes. Linus is a stats man, only the good stats though. The trolling on that upload was the stuff of legend.
Damn I wish I could see. I'm reading about Vessel right now, it seems like a total joke. They are asking us to pay US$3 (I live in NZ) to get videos 72 hours early!? wooohooo. And they'll STILL roll ads. I disable my adblocker for TH-cam to support the creators I watch and yet they seem to be getting more greedy and willing to fill the pockets of that ex-Hulu guy in order to make a few extra dollars. No thanks..
You're right. I don't see it up anymore. Hmm....
Is on vessel xD
my dad's work sever, two 8 core xeons and 768gb of ram.
no joke
it also it has fusion io drives, look them up.
Yeah ok.....
Fuck You.
My dad works at Nintendo too
Haych nah nintendo uses wiis for there servers
Egguar Baggins indeed lol
Finding "laundry storage box" reviews in the video recommediations - so - best Linus Video ever...
Dude, this is one sick setup.
I work in networking, and $1,500 isn't much for a 10Gb switch....
its a shitty switch
Victor P You should wash your hands after using the bathroom to keep your switch clean.
Dave L The switch wouldn't get near any I've implemented that's for sure. It's crap.
TKSnatch Any idea why? Firmware? Poor quality electrolytic capacitors? Cooling issue?
@dave l shut up helpdesk !
So I'll be honest, I haven't noticed a difference in the LTT youtube channel since they announced their move to that other website. I think that's because they've been uploading vids slightly earlier on that site before they made the actual announcement. The people who are actually watching vids over there seem to be LTT forum users. Looks like people were getting upset over nothing.
Why were people acting like LTT was abandoning youtube and stabbing their subscribers in the back?
No one is going to notice a difference since videos will still get uploaded everyday. 1 weeks 1 video a day then wait a week and feels like normal on youtube since other week videos are getting added for release everyday. If that made sense
orangeapples Because a disturbingly large number of people are complete and utter morons...
Even when I and several others explained simply to them that LTT had doubled vid production in order to maintain their 1 a day youtube schedule while uploading the extras to Vessel at that time in order to ensure a seamless transition they still acted offended. On top of that Linus explained this personally on both the announcement vid and prior on the wan shows (which I understand everyone doesn't watch) so the misconception never should have happened, my only explanation is that those individuals are mentally challenged, being deliberately obtuse or simply didn't watch the vid before raging and are thus childish fools.
regardless as we tried to explain to said individuals of little mind if you forget that vid ever existed then NOTHING has changed.
True. He shouldn't have made that vid, a simple announcement on WAN Show would have been enough. Lots of people won't notice it. I don't mind.
Yeah there is a big fuss going around
(this is not aimed at you but i describe a few things in this)
Many of you complain that Linus is moving to Vessel. The problem is that you are making a false complaint about what Linus is doing. Linus is not moving away from his conventional video platform (TH-cam) but instead letting us view his work one week earlier then we would normally see it. There are positives and negative points to the videos being queued on Vessel. I will address the positive and negative side of the process of queuing videos on Vessel.
I will start out by saying that you have probably noticed that when i talk about Vessel and Linus putting up videos I do not refer to it as a "move" but merely a queue for the videos to go on TH-cam. Many of you guys feel that Linus is leaving the TH-cam space. This could not be any more false then what it is. Linus is not leaving or moving to a new service. Linus is merely giving us a chance to see his videos one week in advance. Many people in the Linus Tech Tips (LTT) community should or have known that many of the videos his team makes now do already sit in a queue waiting for there release date and to be posted on TH-cam. By queuing them into Vessel first he is essentially giving you a one week early look to what his team has made. Linus has mentioned that any item or events that are time sensitive (if waited a week would be old news) will go straight to TH-cam and Vessel. This is great for people that are in the situation to were they can not watch the stream due to internet problems, and do not have a Vessel account. This also means that you will not need a Vessel account to get the event coverage you want.
In addition to the above paragraph many of you complain that Vessel is a horrible service and many of you can not load the videos without stuttering or the video freezing. I will admit when i use Vessel it sometimes will never load or the graphical user interface kills me to look at and navigate. Vessel is by no means perfect to use or as easy to use as TH-cam. The thing Vessel does do good at though is supporting Linus and his employees. Vessel will allow us to enjoy the growth of production quality we have come to love from his team. Vessel will open new doors in the growth of Linus Media Group that we will come to love. If you have problems with Vessel or do not like it then do not use it. Just do not complain about it to Linus because I want to see is team grow and produce more things like scrap yard wars.
The last point i have is what many people hate and that is change. When change takes place we only focus on the negative parts of the change but not the positive because we have become so accustomed to the old ways we feel that we should not have to do something different even if it is better. We want it the way we have been doing it because that is what we are comfortable with. How does this relate? The problem is that this paragraph does not relate to what Linus media group has done on the TH-cam side of things. Linus post every day still (Same), Linus has a release schedule (Same), Linus post event coverage right after an event (Same), Big products like top of the line graphics cards post on TH-cam as soon as NDA is off (Same), and in all his new videos and old he has annotations to other videos on TH-cam for TH-cam (same).
In conclusion I believe that Vessel will give Linus Media Group the ability to grow into something bigger than what they are now. Also if you feel this is a change to Linus Tech Tips on TH-cam you are just wrong.
That network rendering box sounds badass!
Really looking forward to it, that sounds insane! :D
This is porn for me. :o
And finally a sponsored deal I very much like to use (ifixit toolkit).
Why am I so poor :(
get a job, earn some money
afiq 000 #FUCKINGSAVAGE
.... because the top 1% wants it that way. In the days of kings and pharos, the top monarchs had their slaves. it's NO different in this day and age. The minute anyone is born in this age, they are born into debt and poverty. Even if you want an education, that only means MORE DEBT. This is a shit planet of slavery and bloodshed. Do the research.... Learn as much as you can. the fact that you are asking this questions means you are miles ahead of the game. good luck in the journey towards awakening.
Holy shit! What a surprising, awesome video! Very exciting, serious tech tips going on here. Great overview. I'd like to know more details about each component i.e. tell us about that server form factor.
Love how you named the servers after places in BC.
Oh man......somebody please donate a 24 or 48U rack and some wire management to LinusMediaGroup. Heck, I WILL. Good God man.......I know you're moving offices, but dang. Its obvious you guys aren't server people.
Kristopher Phillips 100% agree there, I was crying tears of sorrow when I saw that mess of a bathroom. I have seen many messy server rooms in my life, but as far as production deployments go, this one takes the cake.
10 GB?! lolz I work for a company that is building a data center for the CSA - it's backbone is 10 GB... we deal with satellite images. you'll NEVER use 10 GB, son - never! 10 GB is HUGE and cost of gear when you get in that range is costly - the Cisco ASAs we have in the topology are about $280+k
Steal a part and ill give ya $500
10Gbit internal and external is different. Maxing 10gbit internally streaming RAW 4k is easy. Especially with many editors. Maxing 10gbit externally is a little more difficult. And expensive at that.
Suicidal_Tissue you don't know what you're talking about, son.
You clearly don't know what you're talking about. You state that you work for a satellite company when you can't differentiate between 10GB and 10Gb. And yes, it is fairly simple to peak a 10Gb link, my streaming and working directly with RAW 4K footage.
10Gb backbone _is_ ridiculously expensive, but LAN? Not so much. Fairly decent 10Gb switches are around £1k, and desktop NICs are around £350.
If you've got four editors streaming ProRes or RAW at 4K over that network... yeah, you're gonna max that out very quickly.
I'm moving my home network to 10Gb because I use iSCSI mounted drives on a storage server instead of internal drives, and 1Gb can be a massive bottleneck.
Network rendering box? Heck yeah!
I hope you guys are still going to make a kitchen set to do all your unboxing and reviews. It's one of the main reasons I love this channel.
Get those Seagates out of there before they all fail.
And all this just to make videos???
Ya
Unforevable The time people put into creating content is a lot more than it actually seems :)
You'd be surprised how bananas the storage requirements for 4k lossless video are. Source files, projects, rendered files, extras, etc etc can pile up terrifyingly quickly.
WhoWatchesVideos a 2 hour long 4k raw footage clip is a couple hundred GB. I know this first hand.
Not just that do not forgot that they have to run a server as well.
Loved the video! It would be awesome if you guys did a value-oriented freenas build.
Need more of these videos
360p still watching it~ LTT has gone a long way :D great to see you guys becoming successful!
Nice Linus, I use the XS714T at my home/work office and it works great. We also use a fully 10 gigaport network and let me tell you it's really great. I use 10x 4TB WD Purples for my drives, and I'm using the same board.
I love getting into networking and high capacity storage stuff, i'm such a junkie for it. I'd really like to see a full set-up and walk through guide for everything if you guys find the time.
Very nice, and using an etherchannel was a very good Idea. By combing two physical links into one logical link, you practically double your bandwidth.
This whole video was spent with my jaw dropped, so much cool tech. You have to do a render farm video and show some crazy fast rendering being done.
Hell yes! I want to see a massive rendering server!
GOD DAMMIT LUKE! THE SERVER ROOM IS ON FIRE AGAIN!
RENDERING SERVER
Sweetest, most epic, amazing idea ever
Would love to see the Render Server idea come to fruition!
It woud be Great to See this Server
A network rendering machine sounds cool. I'd be really interested in seeing some benchmarks showing the time difference in video rendering.
I would love to see a live walk around tour of the whole networking setup of the new office
Now THIS is interesting!
Would love to see that render farm get built too!
Really interesting to see the network setup you guys have! Keep them flowing. Intel do the deed!
llready saw it! :P
Thanks, Vessel!
hope the new office means more content!
Love those kind of videos.
Nice stuff. We just installed this same switch for Troll VFX, the makers of Iron Sky.
It's good.
PLEASE DO IT! that would be an awesome video to watch :)
Love this configuration oh my god I can cry for not having a storage server
As someone who deals a fair bit in data storage and enterprise setups, this is plain flat out awesome!!!! and well also is mucho mucho money! so I commend you! Congrats!
Holy cow!. I hope this will be worth it for you Linus!
a rendering box, wow, i seriously need that!
Thanks, was looking for something like that router. @home :-)
I would LOVE to see that rendering box. I do similar configs at work for rendering but would love to see how that horsepower affects render times.
Awesome Linus keep it up :)
Good stuff dude!
Linus, the server room is on fire.
Given that I'm a much more gaming oriented computer enthusiast, I've never really looked into this kind of server stuff before, but this video has got me greatly interested in learning about this kind of stuff.
I've never set up a server. Seems like a good skill to learn if you want to get into networking.
Network Rendering Box Sounds awesome
Saw it on Vessel days ago.
jeez dat sickss , 6tb x24 would go insane
That ifixit security bit driver set is also sold at harbor freight for about 5 bucks. I have several for tearing down phones.
Linus you should make more server videos they're really interesting.
thanks for sharing
"The server room is on fire" That intro..... can't stop laughing, it was amazing!