Making a quiet Supermicro SC846 - 100 TB file server
ฝัง
- เผยแพร่เมื่อ 30 ธ.ค. 2017
- An overview of the modifications I've made to my Supermicro SC846 chassis to get it down to ~40dB. The server houses my 100 TB FreeNAS build.
Stux's fan control script: forums.freenas.org/index.php?...
3D model of front fan shroud: sketchfab.com/models/4c32694f...
Overview of server build (being updated): jro.io/nas/ - วิทยาศาสตร์และเทคโนโลยี
![[TH] GEN vs SEN | FPX vs TH - VALORANT Champions 2024 DAY 1](http://i.ytimg.com/vi/VcyH-0LAlhs/mqdefault.jpg)
3 Years ago I sliced the model up into 4 pieces with alignment pegs to print on the local makerspace's Ultimaker 3, and this fan shroud is still the best thing I have ever done to my server.
I can't tell you how much I'd wish every instructional video on youtube was like this. Perfect pace, well structured, everything is backed up by actually showing the changes you've made, nice summary at the end. Well done! Thank you so much for sharing your modifications, Jason.
you all prolly dont care at all but does any of you know of a trick to log back into an instagram account..?
I somehow forgot the account password. I appreciate any assistance you can offer me!
@Felix Joseph i really appreciate your reply. I found the site thru google and im in the hacking process atm.
Seems to take a while so I will reply here later with my results.
@Felix Joseph HOLY **** IT ACTUALLY WORKED! I literally got access to my ig password within roughly 30 minutes by using the site.
Thank you so much you really help me out :D
@Nehemiah Immanuel no problem :D
Haha I couldn't hear the fans in your video at all due to the fans in my own server...
Absolutely incredible! Thanks for sharing. I have almost the same exact build. When on, you can hear it in the basement from the 3rd floor. Can't wait to try out your modifications. Hopefully, it'll tame the "roar of the beast"!
Jason, thanks so much for this video and your website. I'm going down the same road, and your vids and sites have been a tremendous help. Thanks for taking the time to document this build.
Absolutely phenomenal. Exactly what I’d like to achieve. Thank you so much for sharing. 🙏🏻
Jason , Great design. I like your 3d Printed shroud. Thanks for the great vid.
Awesome Job mate! Unfortunately, these server chasis do not come built for home labs. But its good to see people modifying to fit our needs by being creative. Well done!!
Great video,well commented and shot.
Thanks for the info.
That's a really good deal for a 4U Supermicro chassis. I have one of their micro-atx towers and they're really nice. I wish Noctua sold bulk fan packs!
Nice job on the cable management!
This is a great detailed video. Thanks!
amazing setup bro! 100TB.. envy. If you have any other projects plz make a video, you got some skill. Well presented with good balance of details and nice flow of speaking.
Printing this file currently for my CSE-847. Drives are getting warm now that I switched over to a 280mm radiator this morning.
I Love You video, great tutorial excellent explanation, definitely going to modify my server using your ideas. please make some more!!!
Amazing video! Super detailed and well made.
Very nice work! As I'm watching this video, I can't help thinking that this is exactly what I would do with the 846! ...except for the tape. :-P
I just ordered My 846. Can't wait til I get it!
1:50 "and the noise output is, as you can hear..."
*my mom turns on vacuum downstairs*
Excellently detailed
Very clean job!
Nice build with the front fans, I'm surprised manufactures don't already accommodate this push/pull fan configuration in the front for their SAN (or similar) chassis.
I really appreciate this video. Thank you for sharing. I might just come back for more.
nice work !
Loved the video, I'm running a Supermicro 2U 8 Bay (LGA2011) box for Freenas. Currently running 12TB RAW storage with a DS4243 DAS attached to it for VM storage and SAN duties. (24x 450GB NetApp Drives that I flashed using SG3util to the correct 512 format.)
Nice! I'm running 4 DS4243 all with 24x 3TB SATA drives combined with the PM8003 and an DL380 G6.
I'm using Rockstor without any problem.
Great idea
I would seriously consider mounting a mesh filter in front of the fans, with magnets, which you can easily extract and vacuum out.
Very helpful!
Recently grabbed a SuperMicro CSE-847 with 36 drive bays off of Ebay. I am looking forward to doing a similar build. Just debating whether to use Proxmox with Ceph or FreeNas with ZFS. Adding OSD's is a lot easier then VDEV's.
Just got my 3d print in. Looks and works great. For those out there who are planning on using 140mm Noctua fans. Perhaps take into account the rubber feet on each corner of the fans. The fit in the existing fan holder is too tight. You can sand it down to get them to fit in. Or perhaps modify the file before you send it off to print to add 1-2 extra millimeters in the print. Or if you want just take the rubber feet off.
May I ask where you printed it and how much it cost? I'm searching around for places with 3D printers and they're either too small (no 20" printers at libraries) or very expensive (online quotes for several hundred dollars USD).
CCMCornell The creator of this video sent me to 3dhubs and they were great. I did FDM, Standard PLA, 200um, 60% infill. It was $211 shipped. But I splurged a little on the infill because I am prone to breaking and dropping things. I think 20% infill came to $150-$160ish.
Oh and one more thing. I have 24 drives in my case as of yesterday. I have it crudely set up as I’m in recovery mode. All 24 drives are chewing away at 98% utilization right now on a recovery/rebuild job. The drives in the very top of the case where the most heat is are sitting at 30c down from about 65c without the front fan wall.
@@adambahe9309 what gauge extension wire did you use to get them to run at full speed? I'm going to order a shroud myself (trying to figure out a way around this business email) and am looking at the extension cable.
Almost done....!
@@Tential1 I bought a fan extension cable off Amazon. And then a 4 fan splitter. smile.amazon.com/Fancasee-Splitter-Internal-Motherboard-Extension/dp/B07BWFT253/
Your videos are great!
I know nothing about you but have a question...are you a Baltimore native?
Cool! Thanks!
I have an SC846 as well, but did not do the front fan wall. It has dual Xeons at 12 cores and 3.0Ghz. The CPU runs at 60C and the drives around 50C.
I would highly recommend getting those below 40C. Anything higher will degrade drive life quickly. www.backblaze.com/blog/hard-drive-temperature-does-it-matter/
Quoting from the backblaze link you posted: "Overall, there is not a correlation between operating temperature and failure rates. The one exception is the Seagate Barracuda 1.5TB drives, which fail slightly more when they run warmer."
So, other than someone running the Barracuda 1.5TB drives, running the drives warm or cool probably doesn't make a meaningful difference. I've been running my HDDs from 40C-50C for over a decade without issues. Ironically, and perhaps coincidentally, I usually experience HDD failures in the winter months when the temperatures are lower.
Drive operating temperature is most definitely correlated with failure rate. Here is a detailed study by researchers at Google: static.googleusercontent.com/media/research.google.com/en//archive/disk_failures.pdf
Any suggestions on someone who can print me up one of those front fan mounts? I really like the simplicity yet design of it and would love to install that vs my cheap version of cable ties between 3 fans.
Any chance you can share a link to the script you use to set fan speed based on drive temp? I'm guessing it pulls drive temp by querying all the drives using smartctl and then uses lm-sensors somehow to adjust the fan speed accordingly. It would be really nice to take a peek at how you are doing it
I am doing the same right now, although I am having issues finding someone who can print the front fan shroud, too big.
Noctua FTW
I read your article but it's a little over my head; you're using raid-5, right?
Does this shroud also work for the 847? I think the front is more or less identical?
Where do you get those brackets to hold 2 ssd to the side of the power supply bay?
I know this is an old video, but how and where do you back up 100 terabytes of data? That can't be cheap.
Do the Noctua fans really help? I recently got a SC847 case. Changed the 7 stock ones for 5 Fractal design R5 stock fans, which did not help. The system got very hot and I had to put the 7 stocks fans back. Thinking of getting the Noctua, but they are pretty expensive, that's why in need to be sure these will help better than other cheaper silent fans.
So you did IT or not? I Have the same plan
Dear Jason, you did a fantastic job making the server so silent. The stock 80mm fans sound like jet engines. I would appreciate if you could help me out. I am looking to purchase a 4u Supermicro server with 2x Xeon E5-2690 v2 10core processors, 3 LSi 9211-8i HBA cards, 64GB Ram, I am thinking of using two of the 90$ Noctua CPU coolers NH-D15 to keep the CPU temps in control. I will be using UnRaid as my OS, and all the drives would be spun down except the ones in use. I don't want to use the external shroud that you made, and don't mind a little noise from the internal 120mm Noctua fans crancked at high speed. Would the Noctua 3 x 120mm Fans (Inside) + 2 x 80mm Fans (Rear) + 2 CPU coolers be enough to cool the system & 24 Drives? Alongside this, I am planning to add a GTX 1060 in future. Is the cooling enough?
I just ordered a similar system of ebay and plan on using unRAID and doing a similar setup to yours. Did you end up doing the customizations? Are they keeping everything cool? How is the noice level?
What are the SAS/HBA Cards you are using? Want to upgrade to this chassis as my mobo is compatible. I have a Areca 2 port sas atm that does Up to 8 or 10 HDDs was looking for this setup And cant find it with SAS cards in it for only 200$ can find sata2 cards for under $200! Thanks for thee video.
My setup atm is a SC835, X8DTE Dual xeons 5600Gen @ 24 cores 3Ghz, 24Tbs Raw I am at that point where I have around 85% used and need a larger Solution. Used with FreeNas With Vm's and a media Server
I'm using 3x IBM M1015 HBAs, which you can find on eBay for ~$200 each.
OMG Blue LEDs! Why Supermicro?
Hey Jason, trying to see if my local library can 3D print that fan shroud. Is there a particular size 3D printer that can handle the job?
It's gotta be at least 19-20" in one direction. The 3D model should have more accurate dimensions if you want to take a look at it.
Is this thing powerful enough for 4K transcoding?
@JasonRose How can I order one of this shrouds?
Where can I buy the fan shroud from
If you had to redesign that front panel, any changes you would make?
I have an updated version of the model here: skfb.ly/6NIZY
Other than that, I'd probably add in integral zip tie mounts and use threaded brass inserts on the fan mounting tabs.
@@JasonRose Who would you recommend for printing?
You could get a water radiator as an option to dial down the temperature. More stable than Air, and you'd only need to circulate a little water to do it.
That would require a water block on every drive... Not a great solution.
what kind of drive controllers were those? (whatever those pcie cards were that were flashing
They're IBM M1015's. They're very popular because you can find them on eBay for pretty cheap (US$ 75-100). They're just a rebranded version of LSI's SAS 9211-8i card so, with a bit of work, they can be flashed with LSI's version of the firmware which allows them to "pass through" the drives. That pass-through makes them ideal for ZFS based systems which need direct access to the drives to more effectively manage the storage array.
@@jiggsmoof wow. pretty cool man. ill have to look into them i guess. thanks a lot!
That’s pretty quiet
...my desktop is louded than that idle...and my workplace is even louder :/
Please describe all components u have used with some link. Here hard to find ecc ram with proper compatibility.
Here you go: jro.io/nas/#list
(Link from the video description)
Jason Rose. i got a question. there are many supermicro SC846 server versions available. currently i got one of those: www.ebay.nl/itm/Supermicro-SC846-24x-SATA-Storage-Server-Adaptec-5405-SAS-Expander-4x-4GB-RAM/152973853405?hash=item239df3c2dd:g:rggAAOSw-89ZUwtB the description says: 48TB max. is that the reason why you got more hard-drive controllers in your chassis? i got only one controller in there. can you explain a little bit of how you got that amazing 100TB?.
The main difference between chassis models is 1) the backplane that comes pre-installed, and 2) the PSUs that come pre-installed; both of these can be swapped out pretty easily, however. The PSUs are fairly self-explanatory, and I have an explanation of the different backplane models here: jro.io/nas/#parts ("Backplane" bullet point). The EL1 backplane that is in your server has a built-in SAS expander, so you shouldn't need more controllers for it, but it isn't compatible with SAS2 drives, so the maximum total capacity is limited. If you want to expand more, I would buy a new backplane, like the BPN-SAS-846A. The 846A backplane is direct-attach, so you will need enough controllers to host 6 SFF-8087 SAS connections. If you don't want to buy more controllers, you can get a BPN-SAS2-846EL1 backplane (which can do SAS2).
Are you sure the outside three fans are necessary? Another tip, try to avoid pushing air into the heat source you're trying to cool but rather have the fans downstream sucking air through the heat source. This keeps the air flow more laminar, the turbulent flow after the fans tends to have more drag going through the drives or heat sink. Turbulence is inevitable somewhere but having the fans on the back side means the air goes to turbulent flow after it's done the job of cooling.
I was hoping for something other than 12 minutes about fans... What about your HDDs? Aren't they loud? Multiple HDDs spinning and writing make me nervous ^^
WD Red drives are basically inaudible over the fans even at full disk load. I focus on the fans because they're the things that make all the noise.
100 TB quiet server? you can modify my chassis any day.
Do you have 100+ gb of system ram? Cuz the recommended memory for zfs is 1 gb/ 1tb of raw storage...
At the time that video was shot, I had 64GB of RAM. The ZFS 1GB RAM/1TB storage rule isn't really valid in most cases.
I used to run hot storage before most of you knew what a server was. But then i figured out i dont use 99.99999% of the data like ever (im a hoarder, i guess). then i calculated the power bill. not really worth it. so i switch to cold storage and drives with labels in a closet. not fancy, not much to brag about but my wallet is happy.
Same here. I don't really need access 24/7 to ALL my data. When I wish to see some photos I plugin the main drive with all of them and have my fix. As for the data used regularly, there's gdrive Amazon photos&videos, Bitbucket, Gitlab etc. Free and always accessible. Plus my multi drive setups in my computers. Anyways, I guess it is a different story when you build these home servers for fun and personal challenge as the guy from the video does.
@@andysalic8065 Some people also run their own businesses out of their homes and need their data accessible and working. I'm a consultant and have various systems and processes working all the time. Everyone's use case is different and you're right, not everybody really needs their data live 24/7.
Just add water.
Difficulty to follow. Unclear. Boring. Would not recommend
Why would you waste your time with this. It’s so dumb