That ant he found is a queen, shes going around looking for some soft moist dirt or wood that she can make her nest in and start a colony. The footage isnt that great but my guess is that its from the Camponotus genus
@Brian Egendorf I mean. It's whatever the sponsors will send over. If it was up to him he'd be rocking an exobyte in his server and giving out petabytes.
@Brian Egendorf Well keep in mind the method of storing the data can affect how much data is used. You can substantially decrease the amount of data required with no noticeable loss of quality or usability. Storing data for archival properly can do this.
@@Steamrick Yea I remember watching them struggle with that lol. But per second the phantom is still hogging more storage. plus LTT putting out a lot more videos of course
Yeah, per second it's pretty much impossible to beat a professional slow-mo camera. Unless you count the complete sensor input from the Large Hadron Collider or something like that, I guess.
@@Jonasdrady That's what TH-camrs used to do, but they're learning that they may actually need that original footage in the future, so now they try to keep it all.
Ha Linus didn't think of raw file storage, he may not use his cameras "like a pro" therefore never realized. Okay a frame rate... Per second. So 60,100,200... Raw is 3x (or more) the frame size due to the meta and fact it's unprocessed. So I'll do this as stills... A 6mp camera takes a stand image of 1.2mb. A pro of the same 7mb. So if you're slow Mo shooting at 100 frames a second. That's 700MB a second. So let's get 1 minute. 4.2gb. A hour 252gB. In law we use a term "bound to fail" storing data is required and useful to a degree, but planning is required.
Yeah same here. At first, I actually thought this was an LTT episode. I was thinking to myself "damn this video is super chill and relaxing, they should do videos like this more often".
I've heard that if you say "Linus Tech Tips" three times in front of a mirror, Linus will appear in your house that night and install a 130TB storage server in your attic.
That would be so rediculously expensive probably only worth it if he keeps the channel going for like at least 5 more years so maybe he's thinking about it
@@calebcarr3986 but he used much of the space of often used footage and this I assume is a one time thing if he makes a total switch to a server only system and i am way to high to really explain myself
"What is the largest file you can conceivably dump on here?" "You can record directly to the mag for as long as it takes to fill it so... one TERABYTE is the largest file I can make" Linus, and most PC enthusiasts: O_o.... Wow..
@@livedandletdie I'm far from being a tech savvy person, but doesn't that mean that these cameras have one hell of a lot of power to be able to produce, transfer and store 1.5GB of data per second??
Linus: "Here's your new 130TB storage case" Gav: "I have a 112TB PC. I thought the name 45drives meant actual expansion with at least 450TB" Linus: "Oh, BLEEP."
1:59 is that magic moment where Linus hears "200 terabytes," and realizes that he is not only in trouble, but WOEFULLY underprepared. This is the moment that Linus' mind immediately goes "Mistakes were made, and now it's on camera." I live for these moments.
I did comment else where about this disaster. You would have thought he would have considered real photography (videography) as he has similar cameras, or are they just not used correctly... Not that he needs raw data. I saw 130tb in a old tech "sever" that would have never touched this issue at all. Here is a 2month solution... It's the wrong solution and done the wrong way. I'd you look back Linus is not a real tech and do see his server and storage stuff & set up. I'll say no more I find the video Linus makes for entertainment purposes only (and other) just that. It does appear good though...
@@guywhoknows he literally uses this setup himself and he uses more data than the slowmo guys, he's just playing it up because it's funny how much data they are using. If you want to locally store this much data, this is the right approach.
@@lusteraliaszero I would disagree with the approach. It is kind of right for SME or general domestic. When your talking uhd raw data is massive, even HD. The correct "good sense" would be a main data server with an attached array. Like a SAN. That way you can add to the array and only add storage to the network rather than adding servers with drive space rather than a storage array. For example a small sever with few drives attached to a 48 bay array. Even if you use only 8 bays, there are another 40 to add. Dumb arrays are cheaper IMO and would be good sense. But you could attach USB drives to the server and swap out data.. if you don't mind waiting. Perhaps data management as in policy is required.... Why keep raw files?
Rory Witham having done some research on why some you tubers keep raw files... it’s so they have original quality video on hand should they reference something and desire to play the clip without trying to get the file from TH-cam itself.... pretty sure Gavin says that
There's the advantage of unRaid over other software raid systems, you can upgrade it drive by drive, since it supports mismatched drive sizes without wasted space. Only catch is the parity drive (or drives) have to be as large as the largest disk in the array.
WD Reds go up to 12TB. Seagate Ironwolves and Toshia NAS go up to 16TB. So yes. But if I was going to buy 15 of them to upgrade, I would also buy another server box to put them in and keep the existing one. Above 10TB, the price per TB goes up a lot, so it is probably cheaper to buy more drive bays.
@@katrinabryce I would buy the highest possible hard drive capacity, because this can save you additional costs and space with a smaller case. generates less heat, and consumes less energy, especially in the summer when the air conditioning additionally has to dissipate the heat loss. Not everyone pays only 13 cents KW h in Germany, for example, you pay 36 cents / kwh. and it costs about $40 per year to run a single hard drive, and that's $ 400 for a 5-year deployment. This means that if you can save 3 hard drives, saves the additional $ 1200 on electricity costs.
@@fnordist Your math is a little off. $40 x 4 years is $200 not $400. Also your $40 per year number is like double the 100% read/write energy cost. These are going to run around 4-48kwh per year per drive. Given they are going to be idle or standby most of the time, I would estimate 15-20 kwh per year. Call it $5-8 (@0.36/kwh) and additional $2 to cool it. That will give you more like $150 over 5 years for 3 drives. With cheaper power, very low activity, and an environment you don't have to cool; the drop to $10 for 5 years. My prices are a little on the low side because they don't take into consideration the efficiency of the power supply, but if you want to consider the system as a whole. If it uses 450w at full load taking out the three drives is only going to give you a 3-4% power savings.
Dave L unraid doesnt works like that . Most of the drives will be in sleeping state . When ever the drive need to be accessed . It would be active again . Thats the benefits of unraid. For 1 petabyte if he choose 16tb ironwolf drive 64+3 parity drive . Those drive are rated for 1W for standby and sleep and 9.6W during working .. so during standby conditions it would consume additional 64W during standby ,.. if he opts for 5 petabyte then it would be 320W during standby .. It would serve atleast 5 years for him 😅
I really like both Destin and Linus, I didn't like that video. I hope I'm wrong, but it felt like they didn't enjoy each other's company. Their collab felt tense to me, for some reason. Hopefully I'm wrong and just misread the situation.
It all camera data based. These new 4K and 8K cameras open up a whole new segment of data storage. The good news is that that type of storage is now within the realm of the common man. In a time not too long ago only a multi-million dollar corportation could have been able to afford that kind of storage capacity. Aren't you glad you live in these times.
@@blackgrim5151 I work for 45Drives, I can tell you that for certain projects storage is indeed given. Think of it as money they would normally spend on marketing to get their product in front of peoples eyes, they instead just give away some product and it has the same exact end result but it actually ends up being cheaper because they make the drives for much much cheaper than they sell them for :)
@@blackgrim5151 all they have to do is give a few well-known people with a huge audience the product to get their name out. like what Mitch H said. they are in a way investing in linus for advertising. who sponsored iJustin, dustin and gavin for the server? 45drives. so if I want to buy a server who do I find? 45drives. you get the picture right? To get their investment, they need to embed their brand into someone's head. When someone hears about servers they will automatically think about 45drives, which directs customers to them and that is where they get their returns for the spending.
@@andy_byrd Jellyfish and 45drives have totally different philosophies on how we do business. Us at 45 Drives are completely open with pricing, software etc. We have a github for anyone to comb through and use as they wish and use all open source software. Jellyfish however won't even tell you where the breakdown of costs come from. Jellyfish is for sure a decent product to use for direct attached storage for specific workloads, whereas our storinators are literally a jack of all trades. We don't recommend UNraid these days we have moved on for our recommended use cases. We use a combination of FreeNAS, CentOS + ZFS and for our clustered storage solutions we use Ceph. Cephfs is hands down the best distributed file system out there right now and our clusters can handle anything from Object storage, to file system storage, to block based storage. Not only that we can do all at once. If you want to run an object gateway like a S3 bucket, combined with SMB/NFS shares running on CephFS, as well as iSCSI block devices you can go to town! Essentially Jellyfish is decent at one or two specific things, whereas we do it all.
i dont know to much about ants but i think it might be a queen because of the size of her back compered to her head also wear i live ants this size are pretty common as their are more then 1 species of big ant wear i live by the way its in the south of israel
@@LlamasAreBest nah, this small version is right up that alley, that's why this BS thing marques and justine bought is so bad, it's overpriced by something like 500%.
@@Markus-zb5zd A comparable Jellyfish costs $45,000! Unbelievable... (assuming configuration: tower, 200TB (132TB usable), two 10GB ports (one NIC), no other upgrades, or even a support plan)
army6669990101 well he uses RAW footage. Uncompressed. So each frame is a separate picture. Unlike a compressed video like mp4 mov ect that layers similar pictures as one.
Not really that impressive. If you're actually dealing with 500TB + of info a year, you start to get away from servers, and start looking at SANs. I think the latest SAN storage devices we get for cheap hold 240TB per. You can buy this off the shelf easily.
"Hey, we should hook those slo mo guys up with one of our file servers. They produce hundreds of terabytes of video a year." "Great, which server should we give them? The new 60-drive unit? The classic 45-drive unit?" "No, let's give them our smallest one, the 15-drive unit, which will only last them a few months." "Brilliant!"
This thing costs money. If they got it from sponsorship, probably they think they were getting back a whole lot from this project, so they gave the smallest one.
They can't be serious about this lasting half a year. Do they just not delete superfluous footage? Why the fuck would you keep *days* worth of slow-motion footage?
Probably because he filled it with the old footage (according to himself in the end of this video) he had stored on external drives (and a few small NAS').. If he deleted the files that now is copied to this (organized and easily available one), then the he technically have a lot of free storage space again..
15:40 FUN FACT that was actually a queen ant, they have their nuptial flights in April and July (depending on the species) where all the male drones and virgin female queens take flight and mate. It was hard to tell from the video but it looked like that queen didn't have wings, which means it had successfully mated and was looking for a place to lay her eggs and form a new colony.
You should consider AWS Snowball. They send you an 80 TB computer, you fill it up, and then mail it to them for storage, which you can then download from the internet later if you want. You can also get a 100 PB truck complete with its own security detail.
@@sturmbreakers7817 for me its same most of WD drives has failed while my 10 years old Seagate 1 TB barracuda still works fine ! Also 2.5' external Seagate/Samsung/Maxtor m3 drives are more reliable than WD drives with stupid PCB sata to usb3 adapter soldered on, while on Seagate 2.5 external drives its just simple - cheap adapter so i can just take it of and attach drive to my pc or external dock or put drive in console ! While back i bought 4TB WD drive and it failed in 4 months, now i have 4 TB Seagate drive working fine for 3 years now !
Linus: Took two years for RED Cameras to fill a Petabyte of Storage Gav: Hold my Phoenix *two hours later* Gav: Petabye is full. Linus: *Surprised Pikachu Face*
Gavin is just that one amazing guy you know who tells you "I just wing it." when you ask how they got there. That old storage setup was him shrugging and saying, "I guess."
1:07 this comedic timing is so good, i was expecting a fancy vlogger montage and i forgot i was watching gavin, nothing but the essentials in his videos :D
@@Steamrick bear in mind that has been running a hell of a lot longer, and they film a lot more frequently than gav does too. They've been working hard to fill that petabyte, gav probably filmed dan getting hurt a couple times
Those red drives use Shingled magnetic recording (SMR), instead of traditional Perpendicular magnetic recording (PMR). In PMR drives, each track has its space on the spinning platter - as you would expect. In SMR drives, the tracks are shingled, as the tiles on a roof. When you write new data, all data already written need to be moved. So the SMD has a small traditional area, where new data are initially written. When the drive is idle, it moves the data from the PMR area to the SMR area. It take hours and days to properly fit the data. The SMR drives are very good for storage, as they cost half price for the same size. But if they are mistakenly installed in a PC, or a RAID, they can make for a disastrous data loss.
03:00 WD Red drives are only designed to be used in arrays of up to eight drives. They are not the correct choice for this application. You want an enterprise drive, which has better vibration resistance, and also a very important feature for RAID. It's called TLER by WD, for Time-Limited Error Recovery. Without this feature, if a sector cannot be read right away, the drive will spend time re-reading until it gets all the data, and if that sector continues to be troublesome, it will be remapped to one of the many hidden spare sectors on a modern drive. This can take upwards of a minute for a really damaged sector. To a RAID controller, that's a failed drive, and it will be kicked from the array. With TLER, the process of trying to rehabilitate the sector is delayed. Instead, the drive returns an error after just a few seconds if there's a problem, which tells the RAID controller to get that data from redundancy, without failing the drive out of the array. Eventually that sector on the drive will be either normally readable again, or remapped to a spare sector. WD Red drives do have TLER, but they do not have the vibration resistance you want with a case containing 45 hard drives. The correct WD model to use with this application is the WD Gold.
Linus is the guy who knows some stuff, but isn't a professional when building extreme file servers. He's only a decently educated entertainer, not a file server master. If gavin wanted a true master, he, and i shit you not, should have gotten pornhubs help. As they have over 4400 petabytes of storage, and still counting. TH-cam has more but they're never willing to help people.
1. That must be function on all consumer drives! I got sick dealing with those idiotic freezes of whole OS when it tried unsuccessfully read and relocate bad sector. SMART still reported 0 reallocation s. 2. What is the point of reallocation unreadable sector on fly?? Data is lost, mark it bad and report to host. Let host decide when recovery should happen, if it is needed!
Back when 500GB drives were the biggest you could get essentially, I bought 5 or 6 of them and they ended up being sequential serial numbers. I had a RAID5 I think setup at the time on my PC and I had 2 drives crash at the same time and then a third before I could get the replacement drives. I lost 10 years of my music collection and gave up on having a music library I was sooo sad.
Was a total blast working on this together... which is good because I guess we need to build another one... NOW
New petabyte project.
We ran out of storage again, so we have to temporarily add these 512tb SSDs for more space.
Next video can explain how he backs it all up. He does backups right?!
At this rate, Gavin's going to need a server room.
Linus Tech Tips PETABYTE
Huge amount of tech being set up for Gavin.
Gavin - "Whoa, big ant!"
Your comment made me laugh harder then when it happened in the video. LMAO
Gotta entertain yourself while he’s setting it up.
That ant he found is a queen, shes going around looking for some soft moist dirt or wood that she can make her nest in and start a colony. The footage isnt that great but my guess is that its from the Camponotus genus
That made me laugh, just because it's a really small ant. We have things called "inch ants", named for their approximate length.
@@Jaybiiird AntsCanada? Also to be fair, it was a massive ant.
i've literally never seen Linus say "I don't know" up until this video.
I'm shook.
That astounded me. Almost as shock-inducing as *beeeeeeeeeeeeeeeeeep*
He has said it before... There are a few videos where he's mad or where they look at bizarre/enterprise tech.
He just don’t want to think about it that late of a night.
The magic of Gavin's question asking at work.
I bet he actually just didn't feel like explaining it.
linus: *tips the case over slamming it onto the table*
also linus: "looks like the courier kicked this"
I cant like this comment, it would be a shame
Then Gavin "That's not the way I would have done it"
Then Linus "Me either. Usually I drop it completely"
@@RipleySawzen WHERE I CAN GET GAVS COOL SPACEX SHIRT 8:44 ???
It's Linus, what do you expect?
The dent was on the opposite side of the drop.
"So, you'll have 130TB of storage, that'll last you, what, a few years?"
"Ummmm, end of summer"
"oh, my, God"
Linus needs to give some further tips on RAW video versus intermediate (archival) codecs versus delivery codecs.
What's funny is that he uses way more than that himself so its shouldn't have even been a surprise
Steve Thea thank you very cool
@Brian Egendorf I mean. It's whatever the sponsors will send over. If it was up to him he'd be rocking an exobyte in his server and giving out petabytes.
@Brian Egendorf Well keep in mind the method of storing the data can affect how much data is used. You can substantially decrease the amount of data required with no noticeable loss of quality or usability. Storing data for archival properly can do this.
Linus: our red cameras take up a lot of storage
Gav: hold my frames
Actually, LTT made a video a few months ago about how they have completely filled up their petabyte (1000 Terabyte) server.
@@Steamrick Yea I remember watching them struggle with that lol. But per second the phantom is still hogging more storage. plus LTT putting out a lot more videos of course
Yeah, per second it's pretty much impossible to beat a professional slow-mo camera. Unless you count the complete sensor input from the Large Hadron Collider or something like that, I guess.
@@Steamrick Which is by the way, 25 petabytes per year, and less than 1% of it ever gets looked at.
@@Steamrick technically it's 1024TB in 1PB
linus: techtalk techtalk techtalk techtalk
gavin: “damn”
best part is gavin understands it all. his brain is just fried because he was apparently awake for 19 hours from this video.
@@Zambrano2199 I could imagine Dan here just dazed
Linus: Hack hack hack. Sorry....
damn thas crazy
@@chrismofer 2
I'd pay good money to see the completely uncut uncensored version of this
😂
You'd think it would be the CIA requesting this, but I guess not.
@@ashtonhoward5582 We need something to play in the break room
You guys have 150TB and it only lasts for 3 months
Me: has 200gb lasts for 5 years now
I think you have already seen it...
i love the look on linus's face when gavin tells him his biggest file size was 1 TB
The biggest that would be possible*
"I'll make it last 8 months" after the edit "it's been 90 days and it's almost full".... Calling Linus for another one will we?
I think what Gavin needs is Petabyte Project pt 2
@@Rich-gd4fc yes the slow-mo guys could legitimately use the most storage you could throw at a server.
Why doesn’t he delete the files after he’s made the video
@@Jonasdrady That's what TH-camrs used to do, but they're learning that they may actually need that original footage in the future, so now they try to keep it all.
Between Destin and Gav, Linus is slowly dying inside.
all those tapes.
Been online for 90 days..... already almost full...... "Yea i'll make it last 8 months"
Just like his flipflops
shinigamidragoon Well he does film almost 12 months of released footage in those 3 months so it might last him 8-12 still
Tech guys are always dying inside
its rare that gav looks like the cool guy in a room.
😂😂😂😂
Why is this so true😂😂😂
No Linux tech tips more rude
OOF
Gav is always the cool guy in the room
2:00
"Maybe 250 Tb"
Linus: *immediate lip bite as he realizes the severity of the situation*
Yup, he looked shook upon hearing how much data Gavin and Dan are consuming.
@@Johnlanzer afaik linus is consuming even more.
@@lusteraliaszero Don't tell him that or he'll lose his mind over how much hard drives and custom made server farm will be needed.
Gavin is the Chrome of hard disk storage.
@@Johnlanzer Yeah, Contary to popular beleif Linus is very responsible.
Hard drives: how much storage you want
Gavin: *yes*
All of storage. Now. You have 3 months to write this data to disk.
Linus's energy with Gavin's editing is such a weird video vibe and I honestly want more
I think it's Gavin's sense of humour too :)
Linus: *technical jargon abounds*
Gavin: ... "damn"
Blake Rook Official damn..
ahahah this is too funny
Did he say it got filled in 3 months....😂😂 Poor linus he worked so hard😂
it was actually only online 90 days before it was almost completely filled 😂
@@Vykori Uhhhh... 90 days _is_ 3 months.
@@DasVERMiT Wow you're right. I'm stupid. I was thinking about it like hours, 90 minutes is 1.5 hours. 🤦♂️
@@Vykori seems like linus needs to make a new sever for gavin lol
Well Linus has a Petabyte, and I'm pretty sure he has almost filled it.
Anyone else notice the folder inside SLOW-PHATTY is called CHONKY? 14:28
and the text file they put in it is anus....... slow-phatty/chonky/anus.txt
@IbukiHimari Um actually ashamed yo say I laughed at that 🤣🤣.
That's a typical Gavin right there.
@@CameraManBlaise They hate us cause they anus
IbukiHimari would you like to open it?
Gavin: I need more Storage
Linus: How Much
Gavin: 1 Petabyta
Linus: How long until you fill that
Gavin: 1 Month
Are you freelee?
Correction ...
Linus: How long until you fill 1 petabyte?
Gav: 1 camera
Ha Linus didn't think of raw file storage, he may not use his cameras "like a pro" therefore never realized.
Okay a frame rate... Per second.
So 60,100,200...
Raw is 3x (or more) the frame size due to the meta and fact it's unprocessed.
So I'll do this as stills...
A 6mp camera takes a stand image of 1.2mb.
A pro of the same 7mb.
So if you're slow Mo shooting at 100 frames a second. That's 700MB a second.
So let's get 1 minute. 4.2gb.
A hour 252gB.
In law we use a term "bound to fail" storing data is required and useful to a degree, but planning is required.
We need to get Gavin a hundred yotabytes just to last him a year!
I am pretty sure a peta is eq to 1000 tera and not 130 tb
I love Linus's pure disgust at the file sizes gav works with on a daily basis 😂
It's really weird to watch what's essentially an LTT video without the aggressive editing and music. So much more chill, just an odd experience
Yeah same here. At first, I actually thought this was an LTT episode. I was thinking to myself "damn this video is super chill and relaxing, they should do videos like this more often".
Ya I like it
Linus hyper au naturel. I kinda liked it...
The good old days of LTT before the warehouse offive :(
It's like switching from the US version of Kitchen Nightmares to the UK version.
I love that all of the other TH-camrs said it they’d never need anymore storage after this
...and then there’s Gavin
I've heard that if you say "Linus Tech Tips" three times in front of a mirror, Linus will appear in your house that night and install a 130TB storage server in your attic.
wtx quality content
What if you don't have an attic.....
@@jakobfindlay4136 He'll use your closet/ crawlspace
I've said that like 300 times now, but still have not even a single 130TB storage server in my attic. :( It was worth a "few" tries though!
Don't put servers in attics.
I love Gav doing the math on how long until he fills the server and seeing Linus's mind melt.
So when is the petabyte project slow Mo edition going to begin I wonder?
I was thinking they should have done that instead, but this is still good
That would be so rediculously expensive probably only worth it if he keeps the channel going for like at least 5 more years so maybe he's thinking about it
@@TerraCAD nah, thats only another like 18 - 24 months of runtime if he goes at the same rate as the previous 3 months
@@calebcarr3986 1000=6.7(rounded) x 150 so 6.7x3= 20.1 meaning it should last 20.1 months. you nailed it lol
@@calebcarr3986 but he used much of the space of often used footage and this I assume is a one time thing if he makes a total switch to a server only system and i am way to high to really explain myself
Gavin: I got the new 10 trillion frames per second camera
Linus: I invented the new 800 petabyte server for you, it will last 2 weeks.
8.5 quintillionpentabytes should last him 1month
Damn
Don't worry, un a few years linus will be making Yottabyte servers that last a couple weeks
Its like the Internet Cold war with who can fill up the most storage space
@@jonbrandre3006 WD get to work 😂
"What is the largest file you can conceivably dump on here?"
"You can record directly to the mag for as long as it takes to fill it so... one TERABYTE is the largest file I can make"
Linus, and most PC enthusiasts: O_o.... Wow..
Would wow ten times as hard when he says how long that takes to do
(Not long)
Let's see it's 1.5GB per second of footage. So yeah it's weirdly fast. 90GB/Minute of footage, so 900GB for 10 minutes, which is incredible...
.
@@livedandletdie I'm far from being a tech savvy person, but doesn't that mean that these cameras have one hell of a lot of power to be able to produce, transfer and store 1.5GB of data per second??
@@wisefelipe That's why they're so bloody expensive.
"We don't leave the 8K cameras running continuously"
What about that time you filmed a yule log, Linus
The Red breaks the clips into 4gb chunks.
@@thatvideoguy93 The files break into chunks, but the camera keeps running.
That was to create a test
Linus: "Here's your new 130TB storage case"
Gav: "I have a 112TB PC. I thought the name 45drives meant actual expansion with at least 450TB"
Linus: "Oh, BLEEP."
Linus: How much storage do you need?
Gav: Yes
Linus* ;)
All, every of the storage ;-)
Linus was shocked you used that much storage. That was an excellent shot!
I think he is the only person that Linus has ever gotten along with during one of these. Usually they are asses to one another ( linus' guests )
Obvi its weird to see Gavin and Linus on the same screen but its even weirder to see Gavin not wearing Roosterteeth merch
you do realise he's wearing an Achieve shirt right?
you know, Achievement Hunter Merch.........which is RoosteTeeth merch.................
@@blaintintnoob he wears a SpaceX shirt in the main part
@@blaintintnoob not for the majority of the video, Einstein.
@@blaintintnoob Oh yeah I guess he is in the little end cap thing lol! I missed that thanks!
Why do people gotta be so salty when responding to people?
1:59 is that magic moment where Linus hears "200 terabytes," and realizes that he is not only in trouble, but WOEFULLY underprepared.
This is the moment that Linus' mind immediately goes "Mistakes were made, and now it's on camera." I live for these moments.
idk if he's underprepared, afaik 200 terabytes is also peanuts to LTT
I did comment else where about this disaster.
You would have thought he would have considered real photography (videography) as he has similar cameras, or are they just not used correctly... Not that he needs raw data.
I saw 130tb in a old tech "sever" that would have never touched this issue at all. Here is a 2month solution... It's the wrong solution and done the wrong way.
I'd you look back Linus is not a real tech and do see his server and storage stuff & set up.
I'll say no more I find the video Linus makes for entertainment purposes only (and other) just that.
It does appear good though...
@@guywhoknows he literally uses this setup himself and he uses more data than the slowmo guys, he's just playing it up because it's funny how much data they are using. If you want to locally store this much data, this is the right approach.
@@lusteraliaszero
I would disagree with the approach.
It is kind of right for SME or general domestic.
When your talking uhd raw data is massive, even HD.
The correct "good sense" would be a main data server with an attached array. Like a SAN.
That way you can add to the array and only add storage to the network rather than adding servers with drive space rather than a storage array.
For example a small sever with few drives attached to a 48 bay array. Even if you use only 8 bays, there are another 40 to add.
Dumb arrays are cheaper IMO and would be good sense.
But you could attach USB drives to the server and swap out data.. if you don't mind waiting.
Perhaps data management as in policy is required.... Why keep raw files?
Rory Witham having done some research on why some you tubers keep raw files... it’s so they have original quality video on hand should they reference something and desire to play the clip without trying to get the file from TH-cam itself.... pretty sure Gavin says that
2:51 "You go hygiene."
lol, i love it when androids try to mimic human behavior.
I think he meant to say hibernate
Always go for the 60 drive unit because the drives make it really expensive.
And you can just add drives as you go.
more organs means more human
@@poochyenarulez he deleted his page file so no
3:48 I am calling drive bays "hard drive holes" forever now.
Linus: So this will give you 130 TB - 140 TB of storage
Gav: Can I upgrade it?
Linus: ...
There's the advantage of unRaid over other software raid systems, you can upgrade it drive by drive, since it supports mismatched drive sizes without wasted space. Only catch is the parity drive (or drives) have to be as large as the largest disk in the array.
WD Reds go up to 12TB. Seagate Ironwolves and Toshia NAS go up to 16TB. So yes. But if I was going to buy 15 of them to upgrade, I would also buy another server box to put them in and keep the existing one.
Above 10TB, the price per TB goes up a lot, so it is probably cheaper to buy more drive bays.
@@katrinabryce I would buy the highest possible hard drive capacity, because this can save you additional costs and space with a smaller case. generates less heat, and consumes less energy, especially in the summer when the air conditioning additionally has to dissipate the heat loss. Not everyone pays only 13 cents KW h in Germany, for example, you pay 36 cents / kwh. and it costs about $40 per year to run a single hard drive, and that's $ 400 for a 5-year deployment. This means that if you can save 3 hard drives, saves the additional $ 1200 on electricity costs.
@@fnordist Your math is a little off. $40 x 4 years is $200 not $400. Also your $40 per year number is like double the 100% read/write energy cost. These are going to run around 4-48kwh per year per drive. Given they are going to be idle or standby most of the time, I would estimate 15-20 kwh per year. Call it $5-8 (@0.36/kwh) and additional $2 to cool it. That will give you more like $150 over 5 years for 3 drives. With cheaper power, very low activity, and an environment you don't have to cool; the drop to $10 for 5 years.
My prices are a little on the low side because they don't take into consideration the efficiency of the power supply, but if you want to consider the system as a whole. If it uses 450w at full load taking out the three drives is only going to give you a 3-4% power savings.
@@barongerhardt which idiot has a 120 TB server if the server is not at least 60 percent busy? With such a low utilization cloud storage is cheaper.
He need PETABYTE storage NOT in Terabyte..
whats the electricity bill for 1 petabyte of storage?
Exa byte
Dave L unraid doesnt works like that . Most of the drives will be in sleeping state . When ever the drive need to be accessed . It would be active again . Thats the benefits of unraid. For 1 petabyte if he choose 16tb ironwolf drive 64+3 parity drive . Those drive are rated for 1W for standby and sleep and 9.6W during working .. so during standby conditions it would consume additional 64W during standby ,.. if he opts for 5 petabyte then it would be 320W during standby .. It would serve atleast 5 years for him 😅
I want to see a video of that build!
Typical Person i wish i could see that in real life 😅
I've been waiting for this video ever since Linus made Destin a server!
at least this time he knew it wouldnt be enough lol
I really like both Destin and Linus, I didn't like that video. I hope I'm wrong, but it felt like they didn't enjoy each other's company. Their collab felt tense to me, for some reason. Hopefully I'm wrong and just misread the situation.
>Gavin building the biggest server he's ever owned
"Wow, that's the biggest ant I've ever seen!"
"Weird another 8 second bleep"
Like that doesn't happen all the time on AH
BTop Live i read it as soon as they said it lmao
*bird noises*
"do you actually have a file called 'anus' ?"
"...would you like to open it?"
Me: wow 10 TB that's a ton
They: wow 130 TB that's not too much
NorteX and I thought my 1TB SSD was a bit overkill...
@@ElZamo92 We've build a 6PB cluster for a customer last year. They brought in hard drives by the pallets :D
Thomas Vleermuis lol
Every second on their video (raw from the camera itself) is 24gbs
It all camera data based. These new 4K and 8K cameras open up a whole new segment of data storage. The good news is that that type of storage is now within the realm of the common man. In a time not too long ago only a multi-million dollar corportation could have been able to afford that kind of storage capacity. Aren't you glad you live in these times.
Segate clearly got fed up of giving away thousands of dollars of hard drives to Linus' mates
but still linus have to pay for all of that drives right? There no way seagate just give maybe 1 mil worth of drives free of charges to linus
@@blackgrim5151 I work for 45Drives, I can tell you that for certain projects storage is indeed given. Think of it as money they would normally spend on marketing to get their product in front of peoples eyes, they instead just give away some product and it has the same exact end result but it actually ends up being cheaper because they make the drives for much much cheaper than they sell them for :)
@@blackgrim5151 all they have to do is give a few well-known people with a huge audience the product to get their name out. like what Mitch H said. they are in a way investing in linus for advertising. who sponsored iJustin, dustin and gavin for the server? 45drives. so if I want to buy a server who do I find? 45drives. you get the picture right? To get their investment, they need to embed their brand into someone's head. When someone hears about servers they will automatically think about 45drives, which directs customers to them and that is where they get their returns for the spending.
@@mitcHELLOworld That's a smart move.
@@Syn741 Also, a few hundred drives is not that much to their production volume. Especially, not for the return.
6:40 that "daaamn" obviously meant, "I didn't understand one word you just said but it must be epic"
"this will last until.....the end of this video"
Sorry, 130TB is a drop for the Slow Mo Guys...
*2020!*
Litterally a couple seconds after that
"90 days have passed, it's almost full"
Oh c'mon now.
Me: I need a lot of storage...
Linus: Anus
Linux
Winuix
I think its pronounced ASUS
Anustechtips
@Nicolas RAGE you tried for yourself ? Hahahaha
"Infinity War is the most ambitious crossover"
Linus: Hold my Ryzen
January 2020: Time for a sequel yet?
anyone who watches LTT, or SlowmoGuys, knows he needed the 45 drive server
I will never get tired of Linus making the exact same server for his youtube buddies. All those hijinx!
How long till Gavin and Dustin get Jellyfish servers to replace their unraid ones?
@@andy_byrd any difference?
@@andy_byrd instead of a 30k jellyfish he should get a petabyte server
@@andy_byrd Jellyfish and 45drives have totally different philosophies on how we do business. Us at 45 Drives are completely open with pricing, software etc. We have a github for anyone to comb through and use as they wish and use all open source software. Jellyfish however won't even tell you where the breakdown of costs come from. Jellyfish is for sure a decent product to use for direct attached storage for specific workloads, whereas our storinators are literally a jack of all trades. We don't recommend UNraid these days we have moved on for our recommended use cases. We use a combination of FreeNAS, CentOS + ZFS and for our clustered storage solutions we use Ceph. Cephfs is hands down the best distributed file system out there right now and our clusters can handle anything from Object storage, to file system storage, to block based storage. Not only that we can do all at once. If you want to run an object gateway like a S3 bucket, combined with SMB/NFS shares running on CephFS, as well as iSCSI block devices you can go to town! Essentially Jellyfish is decent at one or two specific things, whereas we do it all.
@@andy_byrd 😭
"Should we get slo mo footage of the big ant?"
[AntsCanada would like to know your location]
this sounds like a crossover oppertunity
i dont know to much about ants but i think it might be a queen because of the size of her back compered to her head also wear i live ants this size are pretty common as their are more then 1 species of big ant wear i live by the way its in the south of israel
@@shikmanyam sounds more like a soldier ant
@@shikmanyam It was definitely a queen ant here in the video, I recognize it. Campo. Penn...
I used to go to summer camp with Ants Manitoba before he blew up.
You guys have 150TB and it only lasts for 3 months
Me: has 200gb lasts for 5 years now
I got 1 tb hardisk and already full in 2 month
User Bots . I’m sorry. That was a month ago. I got a 2tb hard drive and it is almost full with videos in 1month.
I thought I never needed more than 32 gb but I got full quickly
Ive gone through 7terabytes in one year
I had 8 gigs on my old phone, which I had for about 2.5 years
_"It's just one of those little tweaks that makes life so much simpler."_
Yeah, you just have to be willing to drop 5-10 grand.
Drop? Like Linus? I'll show myself out...
to be honest having no idea, i would have assumed it would have cost much more than that
Lol. It’s way more.
@@LlamasAreBest nah, this small version is right up that alley, that's why this BS thing marques and justine bought is so bad, it's overpriced by something like 500%.
@@Markus-zb5zd A comparable Jellyfish costs $45,000! Unbelievable...
(assuming configuration: tower, 200TB (132TB usable), two 10GB ports (one NIC), no other upgrades, or even a support plan)
Gets 130TB of raw storage.
Gav:But what about expandability? I need an upgrade path Linus!
Linus: Say sike right now.
Okay, 'anus.txt' is a pretty great file name, but was that folder seriously called 'CHONKY'.
I have to admit, I laughed way more at SLOW-PHATTY/CHONKY/anus.txt (an empty anus.txt) than I should've.
@@Cheesyxable Same xD
@@Cheesyxable lol same
Anyone notice that the anus.txt file is 2 years old... there's no way Linus was saving his anus for a rainy day or something like this
I was half expecting him to say “Are you familiar with raid? It’s just like our sponsor Raid: Shadow Legends”
Bruh that is fucking genius I'm actually scared.
Destin: I need some help
Gav: It will last 8 months
Linus: 6 months to organize, 3 months to fill it up
The face of utter devastation on Linus' face when he realizes that 130TB isn't going to last long.
one of the best collabs if im being perfectly honest
But Linus really isn't that funny i just thinks he feels he is.
I like both of these guys but they're both acting kind of awkward around each other. No chemistry.
3 Months running. Almost filled 130TB worth of archive. JESUS.
I assume some of that is from older stuff he had stored all over the place. He did say that he put his most commonly used files on there.
@@Steamrick Yeah, I thought so too. Still It hurts me to think that a single individual can fill 130TB worth of data in 3 months.
army6669990101 well he uses RAW footage. Uncompressed. So each frame is a separate picture. Unlike a compressed video like mp4 mov ect that layers similar pictures as one.
@@army6669990101 I could easily fill that if I could afford it. I've got 40TB now and I filled that up in less than a month.
Not really that impressive. If you're actually dealing with 500TB + of info a year, you start to get away from servers, and start looking at SANs. I think the latest SAN storage devices we get for cheap hold 240TB per. You can buy this off the shelf easily.
Top 10 Anime Crossovers
yeyeyeyye
More like anime crossover ep.2
Just build a petabyte project and be done with it for 2 years.
*The hunger for more storage never ends Lad!*
4 months*
With how much storage Gav needs, he may want to look into 5D storage, also called Superman Memory Crystal.
@@to12 Lol
@@to12 *but a wise man would know that 5D storage a.k.a Superman Memory Crystal get's weak when exposed to Extradimensional G.Crypt a.k.a Kryptonite.*
Let's be honest: Slow Mo Guys Petabyte project coming soon.
They should just take some brains and make bio data storages... pretty sure it will get full in 3 months tho lmao
exaexabyte
Yep.
@@icantth1nkofanam40 Biggest I know of is an Exabyte which is I think 1000 Terabytes*.
*Correction, Petabytes
@@minecraftawesomeness 1000 Petabytes*
So how many hours of footage can it store
Slow mo guys: 1 minute
1 whole minute!
Every 60 seconds in Africa, 1 minute passes
1 fucking minute!
@@PrabhablyAGoodTH-camr this is false, I live in Africa.
I think they should be able to store 2-3 hours of footage.
I know it is a joke, but i was curious.
"Hey, we should hook those slo mo guys up with one of our file servers. They produce hundreds of terabytes of video a year."
"Great, which server should we give them? The new 60-drive unit? The classic 45-drive unit?"
"No, let's give them our smallest one, the 15-drive unit, which will only last them a few months."
"Brilliant!"
*days
Pointless effort tbh
This thing costs money. If they got it from sponsorship, probably they think they were getting back a whole lot from this project, so they gave the smallest one.
They can't be serious about this lasting half a year. Do they just not delete superfluous footage? Why the fuck would you keep *days* worth of slow-motion footage?
@@TheHadMatters They keep all the footage for archival purposes
"I'll make it last at least 8 months"
"So it's been 90 days and it's almost full"
Probably because he filled it with the old footage (according to himself in the end of this video) he had stored on external drives (and a few small NAS').. If he deleted the files that now is copied to this (organized and easily available one), then the he technically have a lot of free storage space again..
@@C0MPUTERPHILE Oh yeah for sure, I just find it amusing, haha.
I want a uncut, uncensored version lmao
My brain froze for a minute... I was passing by and read Slow Mo Guys, but saw Linus thumbnail and just locked up.
Maybe you need the storage server from the Petabyte project if you need that much storage.
Definitely would have been a better setup for Gav. Even then though, he would fill it up in under a year. That's insane.
@@Logitekz 2 /12 years I read in other comments
Lawjee Gavin will fill a petabyte on average in 21 months or around 1.8 years
SEVERAL SUCH STORAGES is needed for them...
15:40 FUN FACT that was actually a queen ant, they have their nuptial flights in April and July (depending on the species) where all the male drones and virgin female queens take flight and mate. It was hard to tell from the video but it looked like that queen didn't have wings, which means it had successfully mated and was looking for a place to lay her eggs and form a new colony.
You should consider AWS Snowball. They send you an 80 TB computer, you fill it up, and then mail it to them for storage, which you can then download from the internet later if you want. You can also get a 100 PB truck complete with its own security detail.
Linus looks like the kind of guy who would never swear.
Nah he definitely swears. He deeeeefinitely swears
I swear :"D
you dont say😂😂
he's still not allowed to.
IT types swear like sailors typically, from my experience. Lots of bs they deal with
2days later...... we’re getting a jellyfish.
*Angry Linus Noises*
This is a Linus Tech Tips video without music.
And sponsors.
2:35 Linus has been doing this so long, even when he is so tired, he can't describe the most basic human functions,
he can do a product demo.
"Typically they're rated for anywhere from three to five years"
-Linus
"Don't quote me on this"
-Also Linus
@@repzo5551 bruh lol
Lol i guess seagate was fed up with always providing linus their 12 terrabyte baracuda drives so WD takes over
Probably for the best, I've had a lot a bad luck with Seagate.
Or may be seagate was back with their high drive failure
All mine that have failed are WD and Seagate still going strong 5+ years
@@sturmbreakers7817 for me its same most of WD drives has failed while my 10 years old Seagate 1 TB barracuda still works fine ! Also 2.5' external Seagate/Samsung/Maxtor m3 drives are more reliable than WD drives with stupid PCB sata to usb3 adapter soldered on, while on Seagate 2.5 external drives its just simple - cheap adapter so i can just take it of and attach drive to my pc or external dock or put drive in console ! While back i bought 4TB WD drive and it failed in 4 months, now i have 4 TB Seagate drive working fine for 3 years now !
after working with both seagates and WDs, WDs are a much better design and have a lot less failure rating seagates have head failure a lot more.
Linus: Lists tons of specs no one understands
Gav: dAmN
Some of us do understand
@@rollover36 His facial expressions didn't look like he did...
@@Hoch134 if u know anything about computers that was like the alphabet
This video captures the energy of back-of-the-class shenanigans.
Is Linus' new side job now installing servers for other channels?
Daniel Wang yes he has a petabyte server for years now and he also has the experience and contacts to build them
i guess its a way to get his name and chan out to new viewers, and this is a good collab that benefits both parties involved.
Apparently so
@@mareli82 I'm sure that if Linus was thinking about profitability, TH-cam views would be the least of his concerns when making these connections.
And then having them replaced with Jellyfish servers
Linus: Took two years for RED Cameras to fill a Petabyte of Storage
Gav: Hold my Phoenix
*two hours later*
Gav: Petabye is full.
Linus: *Surprised Pikachu Face*
This is excessive memeing
@@kaldo_kaldo It's just shit.
Too much
The slo mo cameras are called Phantoms I believe!
Gavin is just that one amazing guy you know who tells you "I just wing it." when you ask how they got there.
That old storage setup was him shrugging and saying, "I guess."
3:57 - “there’s no data protection on them or anything?”
*The EU wants to know your location*
1:07 this comedic timing is so good, i was expecting a fancy vlogger montage and i forgot i was watching gavin, nothing but the essentials in his videos :D
Next year
130 Perabytes Storage Server on Linux with Linus and Antony
After next year
Exobyte Storage Server on Linux with Linus and Anthony
@@JacketCK *Server on Linux with Linus, _Linus_ and Anthony.
probaly petabyte project 2 :)
kylian wesbeek petabyte project 2 is here just thought you would like to know
Somehow it triggers me that Linus doesn't have file extensions displayed for all files.
I can't live without that.
It's Gav's laptop.
@@Draugo He accessed his network like a Home Network from Gav's laptop I think.
@@v1d300 Nope, the address is "This PC -> Documents" which means it's the local documents folder.
Honestly, they should have looked at tapedrives for this guy as a "cold storage"...
Such a chilled out collaboration from two great TH-camrs, such a pleasure watching and sharing the jokes..
10:29 I love that Gavin is able to amuse himself so easily. It is a simple yet enviable ability
Just download the storage I’m sure the websites aren’t sketch
Gavin will eventually need his own data center with cooling, UPS backups and Hyper Converged Infrastructure that can hold several Petabytes. Yikes!
"Gavin Gives Linus An Existential Crisis."
Soon Gav will have a climate controlled shipping container packed full storage racks holding dozens of these...
No, they'll put it in his cold mailbox
@@edg4rallanbro753 this cold mailbox idea of Gav is getting better day by day.
actually amazon already offers this service
When you think 130 tb is comically high for a career and realize it's comically low.
Yeah... over on the LTT side of things, their Petabyte storage server is out of space. That's about 8x the capacity of the one in this storage.
@@Steamrick Yeah but they filled it up in like 2 years.He filled it up in 2 montha
@@kernelpanic2887 I mean... 3x8=24. So they both filled at the same speed
@@Steamrick bear in mind that has been running a hell of a lot longer, and they film a lot more frequently than gav does too. They've been working hard to fill that petabyte, gav probably filmed dan getting hurt a couple times
Several of the cloud providers are counting their storage in exabytes these days. That's millions of terabytes.
Those red drives use Shingled magnetic recording (SMR), instead of traditional Perpendicular magnetic recording (PMR).
In PMR drives, each track has its space on the spinning platter - as you would expect. In SMR drives, the tracks are shingled, as the tiles on a roof. When you write new data, all data already written need to be moved. So the SMD has a small traditional area, where new data are initially written. When the drive is idle, it moves the data from the PMR area to the SMR area. It take hours and days to properly fit the data.
The SMR drives are very good for storage, as they cost half price for the same size. But if they are mistakenly installed in a PC, or a RAID, they can make for a disastrous data loss.
You know he made a Techquickie video about this right?
03:00 WD Red drives are only designed to be used in arrays of up to eight drives. They are not the correct choice for this application.
You want an enterprise drive, which has better vibration resistance, and also a very important feature for RAID. It's called TLER by WD, for Time-Limited Error Recovery. Without this feature, if a sector cannot be read right away, the drive will spend time re-reading until it gets all the data, and if that sector continues to be troublesome, it will be remapped to one of the many hidden spare sectors on a modern drive. This can take upwards of a minute for a really damaged sector. To a RAID controller, that's a failed drive, and it will be kicked from the array.
With TLER, the process of trying to rehabilitate the sector is delayed. Instead, the drive returns an error after just a few seconds if there's a problem, which tells the RAID controller to get that data from redundancy, without failing the drive out of the array. Eventually that sector on the drive will be either normally readable again, or remapped to a spare sector.
WD Red drives do have TLER, but they do not have the vibration resistance you want with a case containing 45 hard drives. The correct WD model to use with this application is the WD Gold.
Linus is the guy who knows some stuff, but isn't a professional when building extreme file servers. He's only a decently educated entertainer, not a file server master.
If gavin wanted a true master, he, and i shit you not, should have gotten pornhubs help. As they have over 4400 petabytes of storage, and still counting. TH-cam has more but they're never willing to help people.
But it seems like they are sponsored, so they received whatever WD sent them
They talked to WD, explained the application and used whatever drives that were sent. Clearly they are nowhere near 45 drives in that chassis.
1. That must be function on all consumer drives! I got sick dealing with those idiotic freezes of whole OS when it tried unsuccessfully read and relocate bad sector. SMART still reported 0 reallocation s.
2. What is the point of reallocation unreadable sector on fly?? Data is lost, mark it bad and report to host. Let host decide when recovery should happen, if it is needed!
"want a hand?"
-Literally says 'hEaVy' on the box
"You go do hygiene" -A Canadian
Eh
Mouth hygiene :D
Back when 500GB drives were the biggest you could get essentially, I bought 5 or 6 of them and they ended up being sequential serial numbers. I had a RAID5 I think setup at the time on my PC and I had 2 drives crash at the same time and then a third before I could get the replacement drives. I lost 10 years of my music collection and gave up on having a music library I was sooo sad.
Ok now that it is full, do another video with Linus. :P