If you'd like to weigh in on this video publicly I will now attempt to trick you into following me on Twitter. Here's the original tweet: twitter.com/smartereveryday/status/1043578289288355841
im so happy u and linus did a colab together ive been watching both yall for such a long time and im happy your hard drive issue is somewhat figured out man
When even Linus himself gasps and cringes over someone else dropping tech, you know it's serious. Love, love, love this collaboration between two of some of my favorite TH-camrs!
Linus mostly drops tech that costs him or a supplier money, you don't really see him dropping hard drives as that leads to data loss which money can't always fix.
Hahaha, I remember that!! Who else misses the kitchen set? I remember it was the maximum RGB video where he green screened the kitchen in the background... that tugged on my heart strings.
When you finish getting your data into that server, take those loose drives you have and put them in another location. Off-site storage protects you from fire, flood, theft, etc.
YES! For mission-critical data ALWAYS fallow the 321 rule. At least 3 copies of the data on at least 2 forms of media (i.e. one could be on flash memory and the other could be on tape backups.) at least 1 of which is off-site.
@@JessieTrinket This - so much this. I'm having heart palpitations just thinking of what happens if that server has a power surge or a house fire. Offsite duplication please!
I liked how it was actually fairly well thought out despite being a very non-technical solution, but then in demonstrating it he happened to pick a drive that was stored in the wrong place -_-
I work in professional IT, Destin is literally exactly how every Engineers tech setup is. It's so funny, because literally he's like the perfect example of what I know engineers for lol.
Hey look; if you guys did your job and made it easy for us from day one... Joking; we know we're bad, but we only have so much brain space, and any we use on organising bits we can't use for fiddling with stuff.
@@williamchamberlain2263 I haven't checked this comment in so long, but I love engineers. It's like you guys know we are going to come in and give you "the look" and I know I'm going to come in and find things I wouldn't necessarily do to a PC on yalls PC. It's a fun and healthy relationship :D
@@ImaITman I must be the odd engineer out -- all my coworkers tell me I am -- but I have all of my data, files and info well organized and backed up. I've had to be organized ever since my first computer with 1.5gb of hard drive space, which windows took up a third of, and I had to be selective and deliberate with what I installed or saved on that bad boy.
I am a server admin and I can tell you we have LAMINAR FLOW in the form of hUuUuUuUge amounts of data constantly and beautifully flowing in at all hours of the day.
I work for one of the companies mentioned. They are currently testing a 256 PB SSD which is about the same size as a standard hard drive. I have a degree in computers and I don't even understand how the address space works. 100TB server is soooo 2018. ;-)
@@BrianBell4073 Ehmm... no. I call bs on that statement. Should this be true, it would have ~2,500x larger capacity than the current record holder. What about the integrated processor? 256 TB sounds more realistic... But let me ask you this- on this 3.5 inch ssd, which data transfer interface is in use there?
@@Morus433 It is Petabytes. It is still in testing. They are having issues with molecular interference. Intel have suffered similar issues with chips which they put down to quantum interference. Could be the same, could be different. I'm not Sheldon. Like I said - with a degree in computer science I don't even understand how you would configure address space on that size of memory using any currently available OS. Data transfer is different. It can be the weakest link but it won't impact actual storage. I'm guessing that they aren't using a serial cable though. ;-)
8:25 "A lot of my life has been protecting this-" *[Drops drive on floor]* *[Trips over drive on floor]* Make sure that Server is securely mounted, now! By which I mean, Destin-proofed! 😉
It kinda feels like Destin still has 100TB worth of hard drives hidden in a closet that he wouldn't tell Linus about. Because he would feel ashamed :D The typical hording thing...
I feel like they agreed upon something like that as Gavin has mentioned he goes through Terabytes of storage considering 85% of their videos are recorded through those amazing phantom cameras. If you know Gavin Free from the slow mo guys, he likes secret projects so this might be a thing that he just springs on us one day.
Although they seem to get along, to me it feels superficial. I don't see those sparkling eyes from Destin like he has in his usual videos with guests/experts. Linus also seems a little bit distant. So I'd say this is the first and last collaboration. Maybe I'm wrong and they had that spark. In that case they will find a reason to come together. I don't see that happening.
I love Destin's face when you can tell he is learning something. I grin like the biggest idiot when I learn something I think is cool. Edit: 8:58 Destin reminds me of my friend, when I'm doing things (home improvement stuff, car work etc) that seem mundane to me, but it blows his mind.
The drives are about $400 each, and there are 15 of them. That's about $6000. The enclosure goes for somewhere between $2700 and $4800. The software is about $130. That totals somewhere between $8,830 and $10,930. I just had to figure it out and put it up here.
@@khoonibilla with multiple doner rigs and a few 10 gig networkimg cards je could ingest the data in a few days but as is if hes doing them one at a time its going to take a few weeks.
After all the formatting and software, it'll be closer to 130TB's. Let's suppose the stash of 25TB's of HDD's that Linus was holding, was mostly full, and around 15TB's. He would've had around x8 stashes of 20TB's.... or at least 120TB's right there on his bedroom floor. That's just an estimation. Short answer is; it probably was not enough. Even if it was, it would barely be enough. And there would be NO SPACE for any additional content, which is pretty much the point of building a Personal Server for his Channel. It would've been better if he used a larger PC Box, with more ventilation, and stuck to a high-end Intel processor (for the advanced options). But most importantly switch out the 3.5inch HDD's instead for small 2.5in SSD's. He could get a lot faster performance, less power, less heat, less noise, and much better security/stability. The only downside would be the price going up from say USD $5k-$10k closer to USD $15k-$30k. But honestly, that's cheap for SmarterEveryDay considering the ramifications of having memory storage for the business. I think Dusten needs to upgrade his Camera's flash storage from 256GB to at least 1TB, and switch over to a Flash-only workspace. And he would need to be selective with the footage he captures, then saves, then selectively archives. Otherwise, no amount of server is going to be enough. At least he has the Excel spreadsheet, which shows he has some idea of forward-thinking to not make easily avoidable mistakes in memory management.
@@CrazyStranger11 Depends on write levels, not read levels. And they're much better these days than say 5 years ago, that its a much smaller factor to consider. Based on what I think Dusten will use his server for; store once, backup, and read for editing... there's not going to be much stress on the SSD's. And more modern software can even identify SSD's with some defective portions, and re-format it, so that you still get full use out of the drive with the working portions. Hard-drives can also do this, but to a much smaller extent, and not as quickly or reliably. So, honestly, there's no excuse for him to not upgrade to an all SSD solution. Even price isn't a factor for the business at the current time.
the look of amusement from Destin when the drives were formatting and clicking is the reason why hes one of my fav youtuber, so real, always fascinated and impressed by the world we live in.
That's cute, I paid $2000 for my very first PC back in the early 90's. A 386dx2-33 with a 100MB HDD. It had 4 or 8MB of RAM I believe. The HDD alone was over $500.
My oldest bit of flash memory still kicking around is a 64MB CF card. I got it so I could store MP3s on my WinCE pocket computer, and I was impressed that it was just a little over $1/MB. About $80 shipped, IIRC.
To be fair, I think he thought it was wall mounted separate from the wooden brace and that wood beam from the brace was just an additional support. At least that's how I would've thought it worked and probably would've dropped the server as a result
Somehow this is the first video I think I've seen from you. Thank Linus for that, subbed... :) PS. That indeed was a data storage mess, glad you got it sorted...
impressive how well organized it was though, probably easier than most to move to the server and keep straight. do you have a similar level of server for your videos?
Note: people often do a burn-in to stress the drives before actually trusting them, even when they are in a RAID array or other redundant storage system, because the drives that are going to die early can often be detected during or after a burn in (The S.M.A.R.T health diagnostic data often reveals issues after a good burn-in). It's also good to have extra drives on hand to swap out when one of the working drives dies, so you don't have to order a new one and wait to arrive.
Wow, this video shows me how insane Linus's upload schedule is (helps to have many dedicated editors, massive server, amazing comp's, etc). Destin is talking about introducing Linus to the Saturn rocket dude and Linus published that video 2 whole weeks ago O_O. Felt strange hearing Destin talk about his future which was 2 weeks into youtubes past on a video that came out today xD.
Destin has been behind on his date specific content for a little while now; he apologized about it in the NASA video three weeks ago. I suppose this video shows why!
@Garbage Trash the way I understand it is that quantum computers will easily outperform traditional computers. But the downside is that there is only a handful of people in the world who even know how to utilize the hardware to some of it's full potential.
Linus: OMG you tripped over the hard drives! Also Linus: I almost made an apple computer explode in my face because I cant check power sources properly.
It's pretty awesome that some of the best youtubers have got these sorts of cross-channel projects and communication, and a sense of global-village community. It shows everyone that what we share, is bigger then the things that divide.
Destin - When I first started watching this, my initial thought was that Linus was going to be installing a standard Linux off the shelf free NAS, and I was totally ready to protest loudly that you NEED to be running UNRAID. I was VERY happy to hear that's what you were getting. I definitely recommend with that amount of data that you use the double parity drives. Just as a real life case - In 2014 I had a house fire, and I was required, and fully able to recover ALL of my data from my UnRaid by copying the data off of each separate drive using a windows machine while sitting in the hotel we lived in for a month after the fire while they found us other temporary housing. You will NOT be disappointed with UnRaid, and I am amazed that we have finally found something that you're not an expert on! :-) It wasn't mentioned in the video, but another advantage of the UnRaid concept is that the drive capacities can be upgraded one at a time as technology improved. I started mine many years ago with 5 or 6 500gb drives, and now have six 8tb drives, with two of them being parity. If you do any more videos with Linus, I'd LOVE to hear his suggestions on SUPER CHEAP ways to back up UnRaid systems to cloud storage because after having a house fire, I can assure you that RAID is NOT a substitute for offsite backups!!!
Seconded, they didn't touch on that enough, but he still needs to back it up (offsite), and a box full of drives really isn't ideal. 3 copies people!! work, backup, offiste. If you aren't following that then don't cry when it all goes poof.
That's all well and good, but you still need backups of the data on that server. RAID is not a backup. RAID will not stop accidental deletion or data corruption. The server could be stolen or damaged beyond recovery. RAID only protects against drive failures. You also need to be sure the RAID software is configured to alert you in some way, purhaps email, when a drive fails. And they will fail.
@@Lazdinger Correct. I guess I got the impression he'd reuse the drives from the camera. I've seen folks do exactly that. Move everything to a server and reuse the memory cards.
what you're saying is something linus is 100% aware of. he once had his WIP project editing server fail (the raid manager failed, not the drives), causing him to very nearly lose weeks worth of editor's work. they did have all the unedited footage and raw data, but they didn't have a solution for in-progress edits. additionally, he's started *running out* of space on his 1000TB archival server, and has now started moving data to archival tape. this man is the data hoarding guru, he knows all about offsite storage, including experiments with how much google will allow you to cram onto their cloud storage. in destin's case, just the move to a raid server is a huge step up. he can also now compress everything onto those drive and toss them in a storage locker if need be.
I’d like one of those clocks Destins’ got in the background. I find myself watching it every video. Took me a minute to figure out what it was. Also, I went to a seminar on interpersonal communication in which the “reverse control” bike was used to demonstrate how difficult it is to change engrained thought patterns. Had a placard on it with “Smarter Every Day” stamped on it and everything. Love this channel.
Destin, you don't need a 160TB server... It will easily be filled twice over with all the drives you already have, not to mention what you will have in the future.... But I have not seen Linus have that face at 2:55 all that many times before. I think Linus has found another petabyte project....
@@quizarorobzaqu8558 Frankly speaking, an LTO tape drive system has fairly long reliability. And is far cheaper per GB then any other storage solution. SSDs are though plain utter burning of money for pure storage. SSDs can though be a decent caching solution for a larger array of HDDs, if one edits video directly from the storage server, but otherwise it isn't a truly needed solution. Especially when a hard drive array can reach sufficiently high read/write speeds and IOPS to be sufficient for such an application already.
It's interesting because I think he's a real-life rocketry engineer of some sort. I suppose not all engineering requires in-depth knowledge of computers.
@@durvsh not the case, I'm a Mechanical Engineer yet I know more about PC than Computer Engineers themselves An enthusiast knows more about the surface level and have a wider focus while the experts know more about the inner workings and have narrower focus Basically Dustin doesn't have any interest in PC, hence why he has limited knowledge about them not because he can't understand it
@@topg2820 Computer Engineer is a very wide term. There are many different fields and specialisations and there are some which don't have to deal with PCs at all. And then there are people who have literally designed the standard that our PCs use. To claim you know more about PC than them is brave at the very least.
*sees Destin and Linus in a video together* *SEVERE HYPERVENTILATION* Honestly love when science and technology meet, this made my week. Can't wait for the next video!
I had a weird experience watching this video. I was studying for my Operating Systems Final, and going over the different levels of RAID, and I decided to take a break. I then watched this video, which in hindsight I should have figured would have something to do with data storage, featured an explanation of RAID. I cannot escape my final.
"You don't even care you probably don't watch SmarterEveryday, Lets just fix my problem" shots fired. Probably the funniest thing I heard. Also you 2 had me laughing for most of the video. Fantastic duo.
Destin: "This is a trick I learned about computers. So, I have a pen and paper...and sometimes I write things down..." Linus: "No, I remember the IP. This is the better way." Oh Destin... XD
@@caalca05 , Actually...not completely true. MOST consumer networking uses 192.168.x.x, but there ARE some vendors who use 10.0.x.x and other IP blocks.
I feel like you guys would be best friends forever. Like you both have a passion for what you do and for learning that isn't very common in this day and age. We need more of this wholesome bro greatness
No lie, two of my favorite channels! Smarter everyday (or it's ok to be smart) plays in the am with my two kids while waiting for the school bus and I listen to alot of LTT while servicing my customers. I totally recognized the voice! Lol
If you'd like to weigh in on this video publicly I will now attempt to trick you into following me on Twitter. Here's the original tweet:
twitter.com/smartereveryday/status/1043578289288355841
SmarterEveryDay Careful with Linus, he is no expert.
Hey Destin you better RGB that server, it will increase capacity and data throughput.
IO, yes. Son of Ja, No.
Plz plz make a video with "ELECTROBOOM" he is also one of my favorite tech youtuber like u.
I LOVE TO SEE YOU TOGETHER.😋
im so happy u and linus did a colab together ive been watching both yall for such a long time and im happy your hard drive issue is somewhat figured out man
Linus is literally the IT department of youtube
@Galaxy TS2.... Who can't tell the difference between community feedback and corporate feedback....
@@wizicozypher ......what has feedback got to do with anything in this context.....
love it! :L
lol
That es extremely accurate
Top 10 Collabs we never saw coming (2019 colorized)
HardwareCanucks and Linus
RIGHT? lolll "COLAB WITH LINUS ?!?!?! wow!!!!!!! nice!!! love you both o/"
the colorized meme doesnt really fit
I predict there will be more... everyone loves it when smart people come together.... So where is my invite?
Man Vs wild and Linus .
linus:"gasps, you dropped it..."
linus internally: that's my job
LMAO
HAHAHA
LOL
Just be glad that the server was delivered by someone else but Linus. When Linus drops something off he really DROPS it off!
Lol
Destin: has a spreadsheet of all his drives
also Destin: has never added up the capacities before buying a server
15 drives is not enough. should of gone 30
Before being given a server through Linus' sponsors**
"YOU DROPPED IT"
- Linus Sebastian , 2019
мой пездюк ©
That's his job!
It's alright, it's on carpet
When even Linus himself gasps and cringes over someone else dropping tech, you know it's serious.
Love, love, love this collaboration between two of some of my favorite TH-camrs!
YES! Me too. :)
Time stamp?
@@kappasike For which time?
Linus mostly drops tech that costs him or a supplier money, you don't really see him dropping hard drives as that leads to data loss which money can't always fix.
@@kappasike 2:46
I feel like my work friends and my college friends just started hanging out together...
Yeah dude I never thought of the possibility of them ever meeting
Yeah it was something I didn't knew I needed (sandals and socks meeting the laminar flow)
Especially since this might've been close to LTX
Who's the work friend and who's the college friend?
AHHAHAHAAHA
For me, it's like my work friend and that random homeless dude on the corner I see on the way to work just started hanging out.
Linus seems to have forgotten the era when he stored piles of hard drives in a bathroom...
I remember when he stored a server in a sink under the faucet.
@@00Klingon he might have forgotten but we didn't
Repressing painful memories, completely understandable.
Hahaha, I remember that!! Who else misses the kitchen set? I remember it was the maximum RGB video where he green screened the kitchen in the background... that tugged on my heart strings.
@@00Klingon I remember when he washed an M-board under a tap with *Dawn©* Handsoap.
When Laminar Flow meets Sandals and Socks
This was something I didn't knew I needed until now
Aap 'Akash Banerjee' waale Chaitanya ho na??😅😅
...know
For real. 2 of my longest subs and they collab, love it.
Chaitanya Singh a lot of ego in this video.
Chaitanya Singh jimmy neutron meets Timmy
When you finish getting your data into that server, take those loose drives you have and put them in another location. Off-site storage protects you from fire, flood, theft, etc.
YES! For mission-critical data ALWAYS fallow the 321 rule.
At least 3 copies of the data
on at least 2 forms of media (i.e. one could be on flash memory and the other could be on tape backups.)
at least 1 of which is off-site.
Hmm that's a really good idea which I'm not aware of, until now!
@@JessieTrinket This - so much this. I'm having heart palpitations just thinking of what happens if that server has a power surge or a house fire. Offsite duplication please!
I was about to suggest exactly that!
Trithis 2 forms of media is overkill
Today: where is drive A27?
Tomorrow: where is server A27?
Krangz *Grasping for air after a long day running in a freaking warehouse *
lol
TheLegend27
*In a galaxy far, far away....*
Sir, we lost our ping to Internet A27!
Did you try rebooting the router?
Oh, yeah!
Why are people unable to type proper sentences, these days?
02:43 A27
bottom bin, lower row of drives, 2nd from the right next to C46
It says he found it later after filming, but great catch! Wouldn't have found it myself!
Wow anal.
@@itsnetts Yeah, but it's weird that they said "elsewhere" when it was in the drives
@@AirNeat I thought he meant that he thought it was elsewhere?
Saw that right away
I love Linus's genuine dismay at the drive collection...
Genuine? Everything he does seems overly emphatic to me. But maybe it's just me.
@@MrJef06 yeah..it was really cringe-eeeee
the person is acting..and tragically bad at that
It made me and my co worker who are both IT guys physically cringe.
_[cue weird commercial PSA, do not fret though, the "This is cringe" replies will continue after this interval, because Internet]_
Destin: "I called in an expert, his name is Linus"
Me: Don't let him hold anything unless you want to buy a new one.
Almost drops the server.
Ironically, Destin's the one dropping stuff.
Drop expert
Almost like the Newton apple tree story!
Vital Jokers what’s up with that? I also have chronic issues dropping everything. Hate it.
lmao. :P
Your initial setup was weirdly chaotic and organised, obviously physical chaos, but that spreadsheet is more organised than my life
I liked how it was actually fairly well thought out despite being a very non-technical solution, but then in demonstrating it he happened to pick a drive that was stored in the wrong place -_-
It's more proof that he's smart. He didn't know about setting up servers, but he used what he did know and have and made the best of it.
I work in professional IT, Destin is literally exactly how every Engineers tech setup is. It's so funny, because literally he's like the perfect example of what I know engineers for lol.
Hey look; if you guys did your job and made it easy for us from day one...
Joking; we know we're bad, but we only have so much brain space, and any we use on organising bits we can't use for fiddling with stuff.
@@williamchamberlain2263 I haven't checked this comment in so long, but I love engineers. It's like you guys know we are going to come in and give you "the look" and I know I'm going to come in and find things I wouldn't necessarily do to a PC on yalls PC. It's a fun and healthy relationship :D
@@ImaITman
I must be the odd engineer out -- all my coworkers tell me I am -- but I have all of my data, files and info well organized and backed up. I've had to be organized ever since my first computer with 1.5gb of hard drive space, which windows took up a third of, and I had to be selective and deliberate with what I installed or saved on that bad boy.
@@kindlin You are! As a real IT guy in life, and an honorary one on the internet I applaud your oddness!
I am a server admin and I can tell you we have LAMINAR FLOW in the form of hUuUuUuUge amounts of data constantly and beautifully flowing in at all hours of the day.
Laminar.
Flow.
HNNNNngggg....
E
@@WillZ0111 Laminar flow? Electrons move fluids? Good joke, but not real life.
@@old_spice8054 they move the motor, that rotates the fan that moves fluids :P
The crossover fans of both would be interested in some more in depth content and a follow up on this video, I assure you!
Agreed!
As a crossover fan - yes
My brain went crazy trying to figure out if this was a SmarterEveryDay video or a LinusTechTips video.
This. No doubt.
Good call!
You could make a playlist of Linus just building 100TB+ servers for TH-camrs.
I work for one of the companies mentioned. They are currently testing a 256 PB SSD which is about the same size as a standard hard drive. I have a degree in computers and I don't even understand how the address space works. 100TB server is soooo 2018. ;-)
@@BrianBell4073 Linus tech tips wants to know your location
@@BrianBell4073 Ehmm... no. I call bs on that statement.
Should this be true, it would have ~2,500x larger capacity than the current record holder.
What about the integrated processor?
256 TB sounds more realistic...
But let me ask you this- on this 3.5 inch ssd, which data transfer interface is in use there?
@@Morus433 It is Petabytes. It is still in testing. They are having issues with molecular interference. Intel have suffered similar issues with chips which they put down to quantum interference. Could be the same, could be different. I'm not Sheldon.
Like I said - with a degree in computer science I don't even understand how you would configure address space on that size of memory using any currently available OS.
Data transfer is different. It can be the weakest link but it won't impact actual storage. I'm guessing that they aren't using a serial cable though. ;-)
@@BrianBell4073 Now tell the people what a thing like that would cost :D (dont come with Prototype R&D models ;))
"You need it more than anyone we've deployed it to so far"
*Gavin intensifies*
Has anybody seen Gavin? GAVIN!
i read this as linus said it lmao
Destin: “So let me show you a trick...”
Linus: “Nah I’ll remember the IP”
192.168.0.???
@@nathanbanks2354 Don't make me DDOS localhost
@@theRPGmaster But wait doesn't that mean you'll DDOS yourse--
8:25 "A lot of my life has been protecting this-"
*[Drops drive on floor]*
*[Trips over drive on floor]*
Make sure that Server is securely mounted, now! By which I mean, Destin-proofed! 😉
Destin-Proofed + Linus-Proofed = Mil Spec for outer space.
2:40 I found A27, box closest to the camera, row closest to the camera, number 2 from the back
You mad lad
This is why I love the internet
Noice
Beat me to it...
now that is the solution to the indexing problem. YTCSFS (TH-cam CrowdSourced FileSystem)
Bless Linus and his personality for TH-cam.
Linus is literally the IT department of youtube
"infinity war is the most ambitious crossover even in history"
Destin: Hold my 8k footage.
Love this comment
Linus: *Drops it*
maan, exactly, the best x-over
Two of my favorite youtubers teaming up, bless
Yo justo estaba por comentar eso!
I just was going to post this!
Same, felt a little awkward though.. but then again, Linus is always awkward anywhere outside of his warehouse
I was just about to say this
YOU GOT TECHTIPS IN MY SED! YOU GOT SED IN MY TECHTIPS! Mmmmmmm
I am still gobsmacked at two of my favorites hangin' out.
It kinda feels like Destin still has 100TB worth of hard drives hidden in a closet that he wouldn't tell Linus about. Because he would feel ashamed :D The typical hording thing...
He's going to need a spreadsheet to keep track of which videos are on which file server.
It's locked in a nuke proof safe somewhere in his bunker
@@MatthewStinar you could just label content by folders with youtube vid names
Linus be like..... if I'd of known I'd of ordered you the next size up of server.......
2:58
The moment of panic you can see in Destin's face and hear in his voice is priceless
"I literally go to the spreadsheet." Now THAT'S a good filesystem! SpreadsheetFS
Don't tempt me to write one. I just wrote a filesystem driver in FUSE a couple of months ago..
*Next video*
230TB server with Linus. - Slo mo guys.
You mean 230PB
I feel like they agreed upon something like that as Gavin has mentioned he goes through Terabytes of storage considering 85% of their videos are recorded through those amazing phantom cameras. If you know Gavin Free from the slow mo guys, he likes secret projects so this might be a thing that he just springs on us one day.
Gav already did a video on LTT, I assume he got something out of that.
@@jjpark98 He already filmed and released a collaboration with LTT a month or so ago.
2:20 ah yes the classic DFS = Destin File System. The latency and throughput might need some work but the end result is undeniable.
Latency 5-10minutes :D
I thought "dragonfire shield" lol
TH-camrsverse
Linus new company "TH-cam's Storage Solutions"
the start of the Exabyte Project
TH-camr storage solutions
and the motto:
When we run into real trouble we'll ask Wendel!
Cute that you think 160TB is a lot of storage. 😁
@@unlokia Puts the petabyte project on the table
Explaining how unraid works and simplifying the math to a rocket engineer.
Jason Hardman makes a lot of sense, huh? 😂 I look forward to Destin exploring the inner workings and then explaining it to us 😎
I was definitely expecting to hear him say,"Wait hold on, so..."
It was meant for a viewers tho
Everyone had their specialties. I know physicians who don't have a clue about many things their staff is skilled in.
I believe he was simplifying it for the viewers.
Before watching the video: "How are Destin and Linus going to get along?"
After watching the video: "I need more Destin and Linus videos."
Are you a mind reader or something? ‘Cause you just read my mind.
Adamant Arnav Same
Although they seem to get along, to me it feels superficial. I don't see those sparkling eyes from Destin like he has in his usual videos with guests/experts. Linus also seems a little bit distant. So I'd say this is the first and last collaboration. Maybe I'm wrong and they had that spark. In that case they will find a reason to come together. I don't see that happening.
@@KenpachiZaraki601 agree.
Been following both channels for a while, cool to see them come together for a video.
Destin: These are my hard drives
Linus: Dear god...
Destin: Theres more
Linus: NO
I can imagine Linus voice in my brain.😂😂🤦🏻♂️
Hello soldier
I have done nothing but teleport bread for three days
160 TB
Linus be like: “huh this is child’s play, got myself loads of these back home”
@The TacomaKid Linus, yah we got a Petabyte server at home.... and we're also already run out of room......
Meanwhile hdd miners with > 10PB are laughing their asses off :P
its 180 tb with the 12tb drives
Just saw Gavin's colab. Poor Linus
petabyte project isnt enough for that guy. slow mo uses so much data
I love Destin's face when you can tell he is learning something. I grin like the biggest idiot when I learn something I think is cool.
Edit: 8:58 Destin reminds me of my friend, when I'm doing things (home improvement stuff, car work etc) that seem mundane to me, but it blows his mind.
at 6:14 you can see it on his face he doesn't know what Linus just said. Pretty sure most of us react the same way
The drives are about $400 each, and there are 15 of them. That's about $6000. The enclosure goes for somewhere between $2700 and $4800. The software is about $130. That totals somewhere between $8,830 and $10,930. I just had to figure it out and put it up here.
Spot on. I quote $11,155.54 with shipping, warranty, setup, etc. on 45 Drive's site.
and thats not even good enough, now I am worried with all the drives he had, how long it will take for him to fill it up, it clearly wasnt enough
@@khoonibilla with multiple doner rigs and a few 10 gig networkimg cards je could ingest the data in a few days but as is if hes doing them one at a time its going to take a few weeks.
@@gld_ow I heard the drives were free. Don't know about the enclosure. Any way you look at it, life is good for Dustin.
We have to know, was 160TB even enough? And how much do you actually have left over?
Tell us Destin
After all the formatting and software, it'll be closer to 130TB's.
Let's suppose the stash of 25TB's of HDD's that Linus was holding, was mostly full, and around 15TB's. He would've had around x8 stashes of 20TB's.... or at least 120TB's right there on his bedroom floor. That's just an estimation.
Short answer is; it probably was not enough. Even if it was, it would barely be enough. And there would be NO SPACE for any additional content, which is pretty much the point of building a Personal Server for his Channel.
It would've been better if he used a larger PC Box, with more ventilation, and stuck to a high-end Intel processor (for the advanced options). But most importantly switch out the 3.5inch HDD's instead for small 2.5in SSD's. He could get a lot faster performance, less power, less heat, less noise, and much better security/stability. The only downside would be the price going up from say USD $5k-$10k closer to USD $15k-$30k. But honestly, that's cheap for SmarterEveryDay considering the ramifications of having memory storage for the business.
I think Dusten needs to upgrade his Camera's flash storage from 256GB to at least 1TB, and switch over to a Flash-only workspace. And he would need to be selective with the footage he captures, then saves, then selectively archives. Otherwise, no amount of server is going to be enough. At least he has the Excel spreadsheet, which shows he has some idea of forward-thinking to not make easily avoidable mistakes in memory management.
@@ekinteko SSDs have a shorter shelf life than HDDs. HDDs are much better for long term archival storage.
@@CrazyStranger11
Depends on write levels, not read levels.
And they're much better these days than say 5 years ago, that its a much smaller factor to consider. Based on what I think Dusten will use his server for; store once, backup, and read for editing... there's not going to be much stress on the SSD's.
And more modern software can even identify SSD's with some defective portions, and re-format it, so that you still get full use out of the drive with the working portions. Hard-drives can also do this, but to a much smaller extent, and not as quickly or reliably.
So, honestly, there's no excuse for him to not upgrade to an all SSD solution. Even price isn't a factor for the business at the current time.
@@ekinteko or he buys 1 more 130tb server
the look of amusement from Destin when the drives were formatting and clicking is the reason why hes one of my fav youtuber, so real, always fascinated and impressed by the world we live in.
Linus:THIS IS AN EIGHT TERRABYTE DRIVE?!! AND IT'S.. LITTERALLY DUCTAPED TO TWO OTHER DRIVES!
Destin: That's how I roll man
Throwback to when we used to pay $100+ for an 8GB flash drive
That's cute, I paid $2000 for my very first PC back in the early 90's. A 386dx2-33 with a 100MB HDD. It had 4 or 8MB of RAM I believe. The HDD alone was over $500.
@@eternalreign2313 it was probably a beast of a pc back then to be fair.
I remember paying close to $800 for a 1 Gig hard drive (5 inch no less) to replace the dying 500 meg drive
My oldest bit of flash memory still kicking around is a 64MB CF card. I got it so I could store MP3s on my WinCE pocket computer, and I was impressed that it was just a little over $1/MB. About $80 shipped, IIRC.
Had to pay $100 for 1gb back in 2003
For those who know Linus, He almost dropped the server. At it again!
To be fair, I think he thought it was wall mounted separate from the wooden brace and that wood beam from the brace was just an additional support. At least that's how I would've thought it worked and probably would've dropped the server as a result
@@jjpark98 same here, I mean at least put a caution sticker/note up
This is an awesome collab, it's cool to see my favorite people from different tech spaces interacting lol.
*It's 2:00 AM here Im bout to sleep*
TH-cam: hey...160 TB server with Linus
My brain: you must be dreaming.
TH-cam know my weakness.
That is not enough... Please, sir can I have some more storage space...
Sahi bola same condition Meri Bhi hai
It's 1am and I have to watch kids all day. I should not be reading your comment.
Somehow this is the first video I think I've seen from you. Thank Linus for that, subbed... :)
PS. That indeed was a data storage mess, glad you got it sorted...
Fancy seeing you here Mr Deals!
impressive how well organized it was though, probably easier than most to move to the server and keep straight. do you have a similar level of server for your videos?
Not a collaboration I would have ever seen coming, but glad it did!
Note: people often do a burn-in to stress the drives before actually trusting them, even when they are in a RAID array or other redundant storage system, because the drives that are going to die early can often be detected during or after a burn in (The S.M.A.R.T health diagnostic data often reveals issues after a good burn-in). It's also good to have extra drives on hand to swap out when one of the working drives dies, so you don't have to order a new one and wait to arrive.
Linus: *Gets annoyed at people not making a server with him*
SmarterEveryDay: *Hold my bear*
this may be one of my favorite "typos" ever
Destin's married, to a female, so I don't really think he's into holding bears.
*hold my 30ish separate drives sitting in a bin under a table*
I don't think Linus is strong enough to hold a bear.
@@MiniDemonic only if its a tunnelbear. (Ok, i leave...)
marvel: avengers infinity war is the most ambitious crossover
me: smartereveryday and linus tech tips
marvel: avengers infinity war is the most ambitious crossover
SmarterEveryDay & LinusTechTips: Hold My Data Storage...
2:14 I'm already feeling smarter because now I know a new way to misspell "spaghetti".
sketti
LMAOOOOOOOO
“That was only like 20TB” something I have never heard
Wow, this video shows me how insane Linus's upload schedule is (helps to have many dedicated editors, massive server, amazing comp's, etc). Destin is talking about introducing Linus to the Saturn rocket dude and Linus published that video 2 whole weeks ago O_O. Felt strange hearing Destin talk about his future which was 2 weeks into youtubes past on a video that came out today xD.
Destin has been behind on his date specific content for a little while now; he apologized about it in the NASA video three weeks ago. I suppose this video shows why!
Cool story bro
@@ChandlerFerry and you realize the tweet he sent was september of last year. 10 months ago
still waiting on the SmarterEveryDay version of that!!!!!
@@ChandlerFerry he's been unloading all his drives since then^^
wait...
what?
LTT and SmarterEveryDay???
Technology and Science!
Destin drops a drive: "it's alright"
Linux: "noooooooooo"
Linus. FFS.
@@pseudotasuki
I assume it was auto correct.
@@PiousSlayer True. On a QWERTY keyboard those keys are quite close to each other.
Linus knows the pain of the drop
Linus should be used to it. It's not like Destin dropped a 10k CPU
I have to at least respect that you've got your drives catalogued in a spreadsheet.
"Quantum computers? Really?"
I guess that's what Destin looks like when he knows he's got a new video planned?
@Garbage Trash the way I understand it is that quantum computers will easily outperform traditional computers. But the downside is that there is only a handful of people in the world who even know how to utilize the hardware to some of it's full potential.
@Garbage Trash Maybe we need fully fledged AI to solve quantum computing. 🤔
Rick Castle . I think he was also surprised that Linus' "tech entertainment" channel covered something like that.
When LTT drops a video at the same time as Dustin and Dustin is in collab with LTT
Bruh
His name is Destin...
@@S2K_F20C I thought it was Dursten
Linus is dropping plenty. Not just Videos that is
Y'all...it's Dystine
No his name is Dustin from moreintelligentevery24hours
This is the best video I've seen since Louis Rossman and Linus reassembling an iMac Pro
Linus: OMG you tripped over the hard drives!
Also Linus: I almost made an apple computer explode in my face because I cant check power sources properly.
Sometimes learning isn't all painless...
@ 4:54 When a parity bit becomes a parody bit.
Very clever! Nicely done, sir, or madam.
Took me a while to realize it was 'parity'
This video made me happy. Especially watching Destin getting exited over hard drives clicking lol. I love you man.
It's pretty awesome that some of the best youtubers have got these sorts of cross-channel projects and communication, and a sense of global-village community.
It shows everyone that what we share, is bigger then the things that divide.
@@chublez They're like pulling as much money for their project. Simply they're self funding scientist/engineer
wow iv watch both of you for years and never knew you did this together.
This Linus guy sure knows how this things works. He should startup his own youtube channel. Idk.
You cracked me
@carbon dude, why so douchey?
carbon He is a specialist...
@carbon you should see him with liquid cooling lol, they have broken so much hardware because they’re lazy
Maybe he should name it Linus Tech Tips!
Destin - When I first started watching this, my initial thought was that Linus was going to be installing a standard Linux off the shelf free NAS, and I was totally ready to protest loudly that you NEED to be running UNRAID. I was VERY happy to hear that's what you were getting. I definitely recommend with that amount of data that you use the double parity drives. Just as a real life case - In 2014 I had a house fire, and I was required, and fully able to recover ALL of my data from my UnRaid by copying the data off of each separate drive using a windows machine while sitting in the hotel we lived in for a month after the fire while they found us other temporary housing. You will NOT be disappointed with UnRaid, and I am amazed that we have finally found something that you're not an expert on! :-) It wasn't mentioned in the video, but another advantage of the UnRaid concept is that the drive capacities can be upgraded one at a time as technology improved. I started mine many years ago with 5 or 6 500gb drives, and now have six 8tb drives, with two of them being parity. If you do any more videos with Linus, I'd LOVE to hear his suggestions on SUPER CHEAP ways to back up UnRaid systems to cloud storage because after having a house fire, I can assure you that RAID is NOT a substitute for offsite backups!!!
Seconded, they didn't touch on that enough, but he still needs to back it up (offsite), and a box full of drives really isn't ideal. 3 copies people!! work, backup, offiste. If you aren't following that then don't cry when it all goes poof.
Goddamn TH-cam finally your recommendations are working, this is the stuff I want!
Failed for me lol. SmarterEveryDay and LinusTechTips are my two favorite channels and it didn't even attempt to recommend this video
Give it another week...
True
John Chrysostom they didn’t... they said Goddamn
@@TheBeardedBoofhead he's a god botherer
Love both your channels. So happy seeing you two do a video together.
That's all well and good, but you still need backups of the data on that server. RAID is not a backup. RAID will not stop accidental deletion or data corruption. The server could be stolen or damaged beyond recovery. RAID only protects against drive failures.
You also need to be sure the RAID software is configured to alert you in some way, purhaps email, when a drive fails. And they will fail.
stevek917
That’s a good point. But he would still have the original hard drives, no?
He already has backups, buddy. What do you think he's going to do with all those drives? Throw them away?
@@Lazdinger
Correct. I guess I got the impression he'd reuse the drives from the camera. I've seen folks do exactly that. Move everything to a server and reuse the memory cards.
what you're saying is something linus is 100% aware of. he once had his WIP project editing server fail (the raid manager failed, not the drives), causing him to very nearly lose weeks worth of editor's work. they did have all the unedited footage and raw data, but they didn't have a solution for in-progress edits. additionally, he's started *running out* of space on his 1000TB archival server, and has now started moving data to archival tape.
this man is the data hoarding guru, he knows all about offsite storage, including experiments with how much google will allow you to cram onto their cloud storage. in destin's case, just the move to a raid server is a huge step up. he can also now compress everything onto those drive and toss them in a storage locker if need be.
@@wyattroncin941
Thanks. Good to know.
this is what my father did with his VHS collection what Destin is doing with His drives ...
*History repeats it self*
He made a VHS server?
crudkick nope , I presented him with the better storage solution
external hard drives
"I have a pen and paper and sometimes I write things down"
** writes username and password and sticks it to the monitor **
Solipsystem Michael Scott moment
I’d like one of those clocks Destins’ got in the background. I find myself watching it every video. Took me a minute to figure out what it was. Also, I went to a seminar on interpersonal communication in which the “reverse control” bike was used to demonstrate how difficult it is to change engrained thought patterns. Had a placard on it with “Smarter Every Day” stamped on it and everything. Love this channel.
I love when my 2 favorite TH-cam channels do a video together! it's like worlds colliding!!!
Destin, you don't need a 160TB server... It will easily be filled twice over with all the drives you already have, not to mention what you will have in the future....
But I have not seen Linus have that face at 2:55 all that many times before. I think Linus has found another petabyte project....
Yeah he needs a lot more space maybe even a tape system?
@@andrewyork3869 meh not durable. Hdd or hdd in a server stack.
@@andrewyork3869 ssd*
@@quizarorobzaqu8558 It's actually durable. But like super slow
@@quizarorobzaqu8558 Frankly speaking, an LTO tape drive system has fairly long reliability. And is far cheaper per GB then any other storage solution.
SSDs are though plain utter burning of money for pure storage. SSDs can though be a decent caching solution for a larger array of HDDs, if one edits video directly from the storage server, but otherwise it isn't a truly needed solution.
Especially when a hard drive array can reach sufficiently high read/write speeds and IOPS to be sufficient for such an application already.
Today I learned that Destin knows very little about computers.
Never seen someone treat hard drives as CDs.
It's interesting because I think he's a real-life rocketry engineer of some sort. I suppose not all engineering requires in-depth knowledge of computers.
@@PTNLemay well there's a reason computer engineering is a separate field.
@@durvsh not the case, I'm a Mechanical Engineer yet I know more about PC than Computer Engineers themselves
An enthusiast knows more about the surface level and have a wider focus while the experts know more about the inner workings and have narrower focus
Basically Dustin doesn't have any interest in PC, hence why he has limited knowledge about them not because he can't understand it
Well if you remember he had another company build his PC for him to handle his video rendering demands in more manageable time.
@@topg2820 Computer Engineer is a very wide term. There are many different fields and specialisations and there are some which don't have to deal with PCs at all. And then there are people who have literally designed the standard that our PCs use. To claim you know more about PC than them is brave at the very least.
Very cool! Can't wait to see the next video. Been following both of you guys for a long time. Great stuff for sure! Keep up the awesome work! 👍
And here I am, expanding my 128 GB flash storage with 3 TB drive...
So look at me storring my data on S3 with my own CMK.
*sees Destin and Linus in a video together*
*SEVERE HYPERVENTILATION*
Honestly love when science and technology meet, this made my week. Can't wait for the next video!
Totally with you here, these guys are my TH-cam heroes 👍
I read SERVER HYPERVENTILATION
I had a weird experience watching this video. I was studying for my Operating Systems Final, and going over the different levels of RAID, and I decided to take a break. I then watched this video, which in hindsight I should have figured would have something to do with data storage, featured an explanation of RAID. I cannot escape my final.
OS Final : "I an inevitable"
You cannot escape it, but you can beat it and leave it behind you in the dust ;)
Didn't expect a collab with the creator of the Linux kernel and founder of Linus Repair Group, LLC based in Manhattan NYC
Has no one noticed Linus is wearing a Numberphile t-shirt?! So many friends in that room!
He’s also apparently friends with CGP Grey which blew my mind.
Maybe they are next ;)
That's an LTT T-shirt that he sells.
Yeah, that's the LTT Constellation t-shirt.
"You don't even care you probably don't watch SmarterEveryday, Lets just fix my problem" shots fired. Probably the funniest thing I heard. Also you 2 had me laughing for most of the video. Fantastic duo.
2:46 - Linus: "AAAAH you just dropped it!"
Destin: " I learned it by watching YOU, OKAY?!"
Hahahahaha dangggg for a second I thought it was legit
Can you give an update on how long it took to transfer all your drives to the new server?
Linus showed up. Suddenly, Hard drives and servers started dropping 0.0
Lol
Destin: "This is a trick I learned about computers. So, I have a pen and paper...and sometimes I write things down..."
Linus: "No, I remember the IP. This is the better way."
Oh Destin... XD
All local IPs are the same, just the last digits change
@@caalca05 , Actually...not completely true. MOST consumer networking uses 192.168.x.x, but there ARE some vendors who use 10.0.x.x and other IP blocks.
I feel like you guys would be best friends forever. Like you both have a passion for what you do and for learning that isn't very common in this day and age.
We need more of this wholesome bro greatness
Two of my favourite channels in one place, Love it!!
"I hope this video earned your subscription"
Destin, each and every one of them does it, I love your channel ❤️
This is a smaller video than some other ones, but the amount of memories in those drives almost makes it the biggest one of all
cheese much
And right of the heels of the jellyfish video, nice.
No lie, two of my favorite channels! Smarter everyday (or it's ok to be smart) plays in the am with my two kids while waiting for the school bus and I listen to alot of LTT while servicing my customers. I totally recognized the voice! Lol
Linus and Destin together... What Is This, a Crossover Episode?
Destin and Linus, was NOT expecting this. Positively surprised.
Linus - "I love this video so far! The shenanigans are real!"
Destin - "Are you being sarcastic?"
Linus - "No I love it, this is great!"
Me too 😂😂😂👌
this video is where I first saw Linus and now I'm a big fan of him because I've always been interested in computers