Data Recovery PTSD: Prep for 45 Drives Offsite Backup
ฝัง
- เผยแพร่เมื่อ 24 ส.ค. 2022
- It may have caused him nightmares, but Wendell is a man of action! To defeat the loss of data, or at the very least prevent it for Linus, poor guy almost lost a lot of data; Wendell has teamed up with 45 Drives to create an offsite storage server to act as a back up site for his friends!
Having 30 14tb drives, in a single Q30 chassis Storinator running ZFS is cool. But going underground into a cellar to set it up is even cooler! Literally, it'll be cooler and save on AC cost.
**********************************
Check us out online at the following places!
linktr.ee/level1techs
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
-------------------------------------------------------------------------------------------------------------
Intro and Outro Music: "Earth Bound" by Slynk
Other Music: "Lively" & "FollowHer" by Zeeky Beats - วิทยาศาสตร์และเทคโนโลยี
![[LIVE] : ONE ลุมพินี 68 | คู่เอก "พระจันทร์ฉาย vs โจนาธาน"](http://i.ytimg.com/vi/F3IM3w-XchI/mqdefault.jpg)
lol love the intro-it's the same reaction every year when Linus uploads another 'we lost all our data' video like clockwork :D
Do you get early access 👀
@@MiesvanderLippe People paying on Patreon get early access
I'm sure Wendell will rent you out some of the U's for a few Pi and terabytes! 😂
Who's Linus?
@@Zaf9670 I'd love to work with 45Drives and Wendell on a remote offsite backup server ;)
Only a god tier nerd could have made that intro. He gets the lifeblood of a true technical problem solver! Kudos
I love that the intro was basically a list of TH-camrs that have to call Wendell for help.
I’m engaging based on the tremendous edit of the intro alone
The funny thing is that "backups" is something that most consumers, independent freelancers and IT beginners do with their stuff , but that big studios stop doing when they are under pressure. At some point time and costs become the priority, until one day you listen the typical words:
- Guys, it's definitely lost, we need your backup
- uh, what backup? ...
Props to the editor, had a good laugh with this one!
Loved this intro.
I wonder, when Wendell calls support, do they end up asking him how to fix the issue? 🤔
Isn't that how it usually goes, when tech people call tech support?
Wendell is the chuck norris of tech support
Wouldn't it just be him at the other end of the line?
I would love to see a deeper dive video about that restoration project you did for Linus! How about a cross-over episode?!
the best videos are when wendell is having fun... this is amazing
I love that fact that Editor Autumn put in the body armor disclaimer for the LOLs, but also rather depressed at the fact that the internet is so out of control that she probably felt obligated to put it there, just because there's some Jack Blade that would actually try and use it as body armor.
LOL that intro was amazing! Can't wait to see the rest of this series!
Loved that intro Wendell, props to the editor, who is not amber but I don't recall the name, sorry, but I'm thankful of your job great grand master editor : ).
Greetings from CHIAPAS MEXICO.
Thank you! I had fun making it! ~Not Editor Amber(aka Autumn)
Keep an eye on those Exos drives. My 16tb Exos have given me nothing but problems. I've had to replace 5 in less than 2 years. Thankful for warranty and ZFS but it makes me nervous. Definitely have SMART running regularly. Started ordering WD Red Pros to replace and stagger them out with in the mirrors.
Do you know if the iron wolf drives are any good?
We will know soon enough
@@gettingmitches1323 Exos are the "better" line since they're enterprise storage and not consumer storage, even though they can end up cheaper on the market just because. But (aside from anomalies) high-capacity most drives are pretty similar at consumer scale, so pure cost and warranty and *having backups* matter a lot more.
Amazing intro! :D Now I’ll watch the rest!
5:22
Me: Don't hurt yourself!
5:30
Me: Oh snap...
Looking forward to the upcoming video series! Massive appreciation for the videos
Next level editing in this video. Thoroughly enjoyed it.
I hope you do a video on the ltt data recovery
Soon (tm)
This is REALLY Exciting. I am really happy that you are offering this to other tech youtubers. Keep up the great work.
It's a small thing for you, but thanks for having the intro/outro and other music credited in the description! It makes searching for the fantastic music selections a lot easier!
Also cool intro, nice editing work
Need more videos on this!! esp the fibre between sites
Very cool man, Good luck with your Mad Lab. Please show more when you can.
Great video Wendell! Awesome idea to help with offsite storage needs for other friendly content creators. Would love to see them visit the storage site and drop in drives.
I love the unique intros. Never change Level One.
Came for offsite backup. Stayed for the intro. 😱/10 would cower in fear again.
Hmm. Does Wendell understand that concrete walls have a thermal conductivity of 2.25 W/mK (1.25 W/mK @ 20°C)? While plywood is a (relatively) poor thermal conductor, at 0.13 W/mK? And he insulated with foam, which conducts heat at 0.022 W/mK. So, Wendell covered the concrete walls with plywood --- which is 10X worse at conducting heat --- and foam --- which is 100X worse at conducting heat. I guess, to greatly _impair_ the concrete walls' ability to conduct heat _out of the room???_
A large _Igloo cooler_ would have been cheaper. And it would have _trapped heat_ better! Those panels _have narrow gaps_ --- through which some heat will escape! :-)
Graphite is a good thermal conductor. And it _naturally_ comes in _black_ --- to absorb plenty of _radiant heat_ --- instead of depending on (mostly) convection and conduction. Think "the opposite of a thermos." The walls inside a thermos are _reflective._ He wants to _remove_ heat, rather than _trap_ heat.
I'm sure Wendell has a really good reason for defeating the thermal properties of the root cellar. But, I am just not seeing it. Mea culpa.
Basement cellars are damp and heat from servers the area will create a lot of humidity.
Love the lab! Congrats.
The intro is bloddy brilliant and so well made! :D
Cool project. I am qurious how this diy approach compares to cloud solutions like backblaze in terms of cost
The intro is Amazing!!!!!! I loved it
Cellars are awesome. But after i saw my UPS (lowest point in my rack) failing to swim due to the lead in it, i would prepare for possible heavy rain events in the future. The last 70 Years this house exists, there was never a problem with water. But the last three years, out basement was flooded 4 times.
My servers are still in the basement, but now they stand higher up.
yeah but he insulated the walls. look at m0rn1n6st4r's comment after ur's
@@twopair8610 what has insulation to do with rainwater shooting over the gutter and running down the stairs (if the black door is really the entrance)? Looking at the news lately i see a lot of very dry weather and then sudden heavy rain.
My comment aims to keep in mind, that if someone plans to deploy a server in a basement, you now should think about water too.
If it is of no concern where you are, then everything is fine.
@@derstreit you gotta protect against water but the cellar is cool because its underground and badly insulated. he put it in the cellar cause its cool then insulated it from the source of cooling with wood and foam but ya gotta keep things dry too. does wood and foam help keep things dry?
Awesome video. Would love to see more infrastructure content showing your companies server rooms etc.
We did the hose to build a server room vid. That worked out ok
45drive should sponsor more gears .. the intro alone so good.
I LOVED the comedy that was added to the video.
10/10 video, it has created maximum hype for the future
Thank you for being my gateway drug to server building and maintaining, there is a nice joy in being a computer janitor.
Excellent root cellar space. Awesome indeed. And engaging as ever. Be well.
Absolutely taking the piss at the LTT screwdriver lol 😂 Hope that was intentional.
Well that intro was totally unexpected!!!! Still giving me chills!
Can’t wait to see the Off-Site backup Collab videos with everyone like Linus, Steve, Jay, Marcus, Jeff Gearling, etc.
Not gonna lie, I've been off this industry for a decade now and pretty numb about it, but seeing Wendell's excitement on this video really got me excited.
wendell is funny af and teaches you stuff, great combo
Getting nightmares from that intro.. love it!
From the start I was waiting for Wendell to travel by telecom rack. I am glad I wasn't disappointed.
Wendell, please start your own ZFS send/receive backup service! We need to have someone to trust with our (tera)bytes
I LOVE THIS VIDEO!!! AWSOME
The like button was not enough, this is one of the reasons I continue to watch this channel. Excited to see how this develops.
what a great video, might be my favorite yet. Wendell is evolving and growing the business and really becoming the best advanced tech channel.
jeff geerling is OK too, you two should collab :p
Thank God Wendell is a named red shirt in star trek or he would not make it to the 1st comursal break without being killed by a alien 5 seconds after leaving the enterprise. Lol
when he smacked that server rack with a biggest grin on his face, I was done :D
Got a bit anxious seeing 14TB Exos and thinking it could be the ST14000NM0138 ones...
Make sure there is ventilation, foam could grow mold, maybe a small dehumidifier
bruh he insulated the walls see m0rn1n6st4rs comment. after ur's.
Love it!
14:38 👀👀 😱😱 Wendell you have been around Linus too long.. 😆
I really miss working with hardware. And I miss the flexibility of getting to design our own solutions, building it, and watching it work.
I'm wondering if the cellar is cooler BECAUSE the walls are cooler ... So, insulating the room from the walls may not be exactly what you want to do...consider water circulation like a augmented heatpump. Just a thought.
I think you're correct, but I also think humidity is bad for computer components, long term.
I was thinking of a geothermal heat pump. Water or glycol circulates through subsurface earth where temp is around 54 Deg then through a heat exchanger. Could do the same thing with water cooling on computer, put heat exchanger on the wall somewhere, then run some piping out in the yard buried in a loop ... Would eliminate most of the heat generated in the house by sending it into the yard...haven't heard of anyone doing it, but it's something to think about.
“We won’t run out of storage space”
- Famous Last Words
Won't run out, because they're constantly adding more.
9.28 I was shouting at the screen - DON'T DO THAT!, then Wendell says, "drives don't like it when you do that - you shouldn't do that" lol?.....(sigh)
The intro is amazing!
nice, my nas is getting to a sieze that haveing a backup of it is getting expensive. I am starting to prioritize what gets backed up and what is less protected.
Wish I had someone like Wendell I could work with for an hour everyday just to learn from.
Desktop wallpaper right there 0:35
My office couldn't be doing a whole lot better. We've basically got this setup. Waiting on another server from 45 Drives to complete it.
In a previous role, I set all of this up for an MSP as a service they could offer. Ship snapshots off to a centralized system in a data center. It was glorious to build out. And we did it with garbage! :D
def put up 5/8 drywall to protect from fire on those walls and ceilings :)
@8:42 Dual redundant power supplies? That’s 4 power supplies.
Someone backup Wendell -- We can't lose him to the algorithm.
Awesome video
I want that analog phone in the background
The title gave me flash backs of... well lets just leave it at that.
That intro was straight out of an Insidious film. FFS. Well done.
Your best cold open yet.
Nice, enjoying what you do. Looking to build a TrueNAS box using an HP workstation to backup my ASUSTOR NAS and family laptops and desktops.
I've got a trio of archive/backup clusters (two clusters onsite, one cluster offsite about 1000-miles or 1600KM away). About every 3-4 years or so they get replaced with bigger newer faster stuff. The seeding between clusters is always the worst part and takes the most time. It's nice you're able to get 10GB point to point between locations and I wish we had that. For us the distance between our Main and Offsite location made it financially unfeasible to get much more then about 100-meg point-to-point for a production adjacent geographically redundant "Oh shit" backup cluster. The 100-Megs is more than enough for us to pull current backup snapshots or a couple months of archival data back down in a reasonable time but seeding the whole 14 years of archival data is a different story. If I were to attempt to seed an empty cluster over the 100-meg it would take over three months to complete. Our solution is to seed the offsite cluster locally and then pack everything into a van and drive it there. This allows us to move the seed in about 4 days start to finish. 1 day to build the third cluster and seed/test it, 2 days to pack it up and drive it to the offsite location, and 1 day to install and online it. There are also some other benefits to doing this. The big one is we can treat it like the delicate equipment it is and completely own the whole transportation process. It's also usually cheaper compared to palleting things up, shipping it up there as freight, and then spending money for the Colo's tech to install it. On that last note, while the local Colo tech is more then competent, for that they charge to do anything besides a reboot/power-cycle, it's cheaper to just have my guy there who knows our infrastructure and can decom and haul back the old cluster as well.
Lol, great intro and very interesting video!
The intro made me think Wendell had watched his own channel :)
that intro indeed was amazing xD
Awesome. Is that a 10G internet connection, or do you somehow have a direct link between the office and the offsite backup?
wendell and crew did a art at the start
I'm prepared and have backups for when I get freak out with the thought of losing one of my four 8TB drives and here's Wendell and Linus xD
We have the lab_32 from LTT and now stdio_54 from L1!
Awesome intro!
I want to see some details about how the hell you recovered that data
9:00 I thought he was going to "pour" the drives out of the box and into the case lol
How do you get a fibre run like that setup? Is it run through an ISP or is it a direct line from the main studio that's been run either on poles/underground by a contractor?
I get the impression that his root cellar is on his property with the rest of his studio and office sets, so it's probably just a line running outside and under the house to the cellar, full DIY, and he's treating it as an "offsite" backup because it's on an independent power circuit, and is protected from the elements by the cinder block walls, so many of the disaster eventualities that could affect the main house won't necessarily destroy what's in the cellar.
It's on the same property as his business. I've been to his office so I recognized where it was
@@upintheclouds1337 - Well... hopefully the sump pump doesn't fail 🤔
We need to create a physical backup of Wendell himself, we can’t afford to lose him
YESSS. MOOOOORRREE CONNNTEENNNTT! haha. Thanks for another great video Wendell
I would have (almost) paid to watch the construction montage.
I don't know, but I'd imagine some of that could be available on the Patreon. Or maybe even on Twitter.
That " Linus " Moment
So my old teacher was from a small island just off of Portugal. He had to ensure all backup servers were on the highest floor possible in case of flood.
Hi the intro was awesome, but i am still waiting for the video of you helping Linus with the petabyte server. When will it come?
I thought that to be continued cut was going to end with Wendell injuring his back getting that chassis out.
Don't know why but this video makes me want to do offsite backup of my stuff ... problem is that i have nowhere to store what's on my now 8TB NAS ...
that intro was so good
I'm glad I give these guys my patreon money....this shit is awesome
What creative pharmaceutical(s) was using for that intro edit? Better living through better industrial chemicals?
Intro is killer
Ah, my knees!
My backup solution: Just some raw SATA HDDs i plug into a USB dock like an old NES cartridge and rsync the filesystem to when doing a backup. No fancy hardware, no fancy software. It is as simple as it gets. And it is actually offline when not in use.
LTT needs a tattoo on his damn head - RAID/ZFS IS NOT BACKUP