A lot of comments suggesting I "replace the old thermal paste". This came to me as a barebones server. The thermal paste is brand new Arctic MX-4. As I said in the video, dual 135W TDP chips are a strong ask of servers like this. I'd recommend sticking to 95-120W chips, or installing this server into an air conditioned rack ;-)
Might be a good idea to make a custom shroud that better directs the airflow across the CPUs, and put the fans on rubber grommets, should help cut the noise.
Would dual e5-2690v2`s be pushing it? At 130 rated they´re a bit high but they also usually over-estimate the draw for insurance. I´d guess for intermittent processing they would be OK but for 24/7 work they´d be frying in there.
well, I think it won't qualify as a white noise machine. The spectrum will show plenty peaks instead a flat one. Nevertheless, your comment is funny ;)
Yep by default this server is very noisy... But I was able to mod the top cover to add one 80mm fan as extractor for each processor, that brings down the temperature alone and instead of the default 5 front fans just took out 3 and left 2 there.
This is the kinda shit I love. So hard to find people doing budget server builds. Even if they are the "best", I don't need/want a $5000 home lab. Keep it up man!
"Of course since it's a Craft Computing video, something had to go wrong" I don't think I've ever seen a server build go perfectly smooth on TH-cam so don't feel too bad.
you know shockingly, my dell poweredge tower loaded up extremely easily, including setting up IDrac. i was really impressed. now i have a 16 thread tower with 72gb ram and two chips, a slew of pcie 4, a pcie 16, onboard quad intel gigabit, and 8 hot swap sas bays. its a beast!
Great find. Nothing like snagging a solid server for cheap (or free). Some of my favorite memories from my IT MSP days would be onboarding new clients and taking a tour of their server room and seeing decom'd equipment still in the rack powered off. That would usually be followed by a conversation something along the lines of: us: [Heavy Breathing] "do you... do you uhhh want us to get rid of this old crap for you? No charge" them: "yeah sure whatever i don't care this stuff was here before i started working here" us: "o-ok... we will get a trailer and some guys out here to clean this up for you" [internally rejoicing at the upgrade our lab stacks would receive]
A quick note: Intel VT-X is the general function for virtualiziation from Intel (Which pretty much every CPU hast). It has nothing to do with passthrough. For passthrough your CPU and Mainboard need to support Intel VT-D. This is less common and usually only found in Xeon and HEDT (and i think some weird i3s....) Cheers!
Dude. The idea of this sever, the beer, and that sweet tech wreath... I love your channel. Thank you for all the great ideas! I made some CPU ornaments years back from some ewaste pc's at work and brought them home (Pentium 4's and D's). Wife only let me use 4 out of the 30ish. I salute you sir.
Ah I see...so you started a youtube channel just so you could buy stuff and give the boxes to Rambo? IT ALL MAKES SENSE... Loving the videos man, keep it up!
I bought one of the Chenbros. Kinda surprised they didn't sell-through faster. But then it makes sense because of the size. If you don't have a rack (I don't), where can you put it? Mine hasn't arrived yet (it's been two weeks), but I'm considering hanging vertically on the wall, using a 4U wall bracket.
What timing - I have 2 of those coming in tomorrow with 2650V2’s. Didn’t realize the board had iSCSI built right in though - that’s awesome, I will put the 2 x 240GB SSD’a I bought to boot them up into the NAS. Thanks for the vids, Jeff - you’re doing great work!
I know that feel, last year bought a used server for 300 euros including shipping to other side of EU HP ProLiant DL360 G7 with Dual X5690 CPU's and 144GB DDR3. tossed out the sas drives and put in used Samsung SSD 840 Pro drivesi had laying around. Best 300 euros i have spent on ebay purchase. hosting mail/web and game servers with VMware ESXi
@@isaackvasager9957 Should put dual E5-2648Lv2, put in ssd, 128gb ram, and it will happily run a LOT of vm especially in not-so-demanding workload environment. So no, it is not useless. But yes, it does not fit in processing power scenario. We cannot talk about cheap and processing power in the same place, I think.
@@CraftComputing could you do a video on updating the bios? There is an updated bios from supermicro. I have no idea if the updated bios will fix the pci problem. But I hope it does. I have the same server, and want to install a 10g pci card. However with the card in the slot, the server will not even boot up. Card is an HP NC523sfp / QLE3242-HP
Power consumption at idle and under indicated load would be a nice addition. A Kill A Watt meter makes easy work of it. Or some of those little smart outlets have energy meter built in. So it gives you power draw at any given time and a remote power off/on if needed.
You would love the area that I live in. We have a property disposition center that is part of the local university. There they sell off all the old office/lab/computer equipment. 1 or 2 generation old servers, computer and equipment are all there. Pretty darn cheap as well, all in good condition and I've never gotten a bad item. =)
VT-x is hardware virtualization support. PCIe passthrough requires *VT-d*. Some hardware that has VT-x is missing VT-d, especially 1st and 2nd gen Core era parts.
I came across a free Craigslist Special Barracuda Web Filter 310. I've been in the process of setting up pfSense. Having come with 2 Intel Gigabit nics this will work pretty good for replacing my primary router. I had originally planned to configure an old computer (6-core amd FX6100) as a router with 3Com Giganics, the Barracuda will offload the OpenVPN, firewall, and various other basic things. That way I won't have to worry about goofing up the server and shutting everything down. It's been a struggle configuring, mostly due to my lack of knowledge of setting up pfSense, but getting there.
So I have a few of these and decided to check out the video because the nice blue color caught my eye. I personally ran everything from 2630L v1 to a 2695v2 and never really had much of an issue with heat on more intensive workloads. That said, my rack is in a basement that gets to about 70f in the summer. I wanted to upgrade to v3/v4 chips so I grabbed a pair of X10DRD boards and it was a near perfect swap. The back IO was a little off going from RJ45 to SFP but still worked fine. Having downsized my setup for efficiency I can say the with the limited capacity of the board, going to the X10 series let me increase the density ALOT. 256GB of ram, e5 2640v3 and a ssd for boot, only idles at 70 watts.
New video - it's a good day. Then crushed when they don't ship internationally. Any plans on a video with a medley of the tasting reviews? I look forward to the bonus at the end. Always makes me smile watching your expressions after first tasting.
Great channel! I have the same server and I have replaced the fan with 5x Noctua NF-A4x20 PWM (you can control the fan speed - the FLX model doesn't allow you to do so), and it is nearly silent. I need to change the one in the power supply and it is super quiet. Keep up with the excellent job! Ciao!
I used to pick up older HP DL300 models from a local school on eBay. G5-G7, sometimes as little as a couple dollars. Usually with at least most of the parts. Not all would have two CPUs or coolers, some with RAM, some without, always PSUs but never drives. Made some decent cash off them after tinkering and setting them up. I used a few for game servers a while and still made a profit. I still actually have one with a pair of 6c/12t and 32gb of RAM collecting dust.
I have fun with old server stuff. My actual media server is a dual socket Xeon X5677's with 24gb of RAM. I used to keep it in a 4U chassis, but actually moved it to a Cooler Master HAF lanbox. Since I host things like Minecraft, I need server processors that are fast, and it's still hard to find affordable upgrades beyond what I have at the moment.
Some cases did have "air guides" to push the air into needed locations. if you need that full spee, maybe a makeshift "air guide" woudl improve temps on that second CPU. Still, that is one nice ifnd. I'm guessing your rack is in a different room, but do you think replacing the fans with Nocuta fans would proivde some benefits? or would that be a dissaster on temps?
I was thinking about the same thing with the fans. Are the headers on the motherboard 3pin or 4pin? My desk is right next to my server rack, so I don't want to hear loud fans. How did the noctua change out end up for you? Is this thing quiet then?
@@mattscheurman1616 MUCH more quiet. What a difference! Only thing is, you will need to adjust fan speeds in the IPMI or have some air from a standing fan blowing on or around it since the fans run pretty slow speeds at idle. Even then, the noise is practically non-existent. They only fan not replaced is the power supply fan which upon further investigation, is wired pretty far into the unit. Not going near the death caps lol. That one is decently quiet. The fan connectors are 4-pin.
Put a 10gig or 25gig NIC in that open slot and that thing would make an OK secondary virtualization server connected to a fast NAS. although I would prefer a 2011-3 platform.
regarding that psu - your alternative would be buying any fitting one and using an 300€ molex crimp tool to crimp the connectors yourselve - yes the tool costs money, but having one myself, it just does what it is supposed to do, not like 12€ ones...
If you dropped the CPUs to more low power ones and replaced those fans with something like Noctua’s 40mm it might be usable in a home setting. The base kit on eBay would make a pretty decent firewall if you don’t do VMs
I bought one of these jet engines a year ago. Only complaint is the sound. It's great for Proxmox and the best price to performance ratio I could find.
I had 3 of these, one of them was as loud as jeff's and i couldn't figure out how to quiet it down, but the other two ran near silent. Each of the servers had a pair of E5 2697 v2 cpu's and 8x16gb ddr3 ecc ram. Maybe its something with the v1 chips. I was also able to get a quadro k2200 passed through in esxi 6.7 u1
I suppose it'd make more sense to go dual 2650v2 on there. Decent clock speeds, easier to manage heat output. In virtualisation, the CPU is rarely the bottleneck. Heck, even the E3 class E2136 in my Dell T140 will do fine, beating the Xeon Silver 4110 in multi core.
Hp dl380p, e5 2660 v2(10c/20th, 2.2ghz), 64gb 12800r(4x16gb), 2x250gb sas drives. $150 Hp dl385 g8, dual 6328 opterons(they're kinda crap, but useable), 64gb ddr3(8x8, 12800r). $150 Dropped an additional 50 for the secondary risers and cages. 3 risers and 3 cages. Stupidest deal I've ever gotten on servers was a dl360 g6. Dual 5550, 72gb of ram(10600r, 18x4 sticks) $60. I just bought it for the ram.
As overkill as this would be I'm sure this server would make a great firewall/router box ala pfSense/opnSense. I run a QOTOM MiniPC for my OPNsense needs and it works great, but having more power would be nice too. haha. Great video Jeff!
you can possibly test the new bios version is BIOS revision: R 3.3 on the supermicro website for the mainboard! pass through maybe for graphics card work
Great information ✊🏾 I'm new to home lab setups. What's the practical use scenario for a serve like this? Can it be used as a Plex server? Thank you for sharing your knowledge.
@Craft Computing, Do you think the server could become more "home friendly" by replacing the factory fans with Noctua NF-A4x20 fans or would they be inadequate for cooling purposes?
I picked one up just recently, mainly to use as a third system in a Proxmox cluster just to play around with cluster/HA abilities. Two L-series CPUs and 64GB ECC RAM. I 3d printed my own adapters to swap out the fans for Noctuas. If I was really pressing the CPUs then it really wouldn't be enough, but at the minimal use I put on it they work fine. Mine had the drive cage, but had to buy the riser and rails separately. The main nuisance is the outdated IPMI relying on the garbage Java console.
I would love to have a text label edited in, whenever you mention those long part names like E5 2698. Maybe even for all parts? I tend to pause the video and need to listen twice or listen very carefully the whole time... which i usually dont do. Anyways: love your content. I really enjoy these budget server builds
What model rack are you using, and where did you get it? It looks particularly nice, and I am looking to replace my old 42U rack which has threaded screw holes for one which uses rack nuts to fit my Dell server rails, which I may also go for something a little shorter.
Thanks for this. I was oh so close to ordering one of these servers. My rack is next to my desk in my home office. I cannot imagine competing with those fans on conference calls. I will continue to look for other budget rack alternatives. I have a small (depth) rack so I need short servers. Might just have to build my own with new desktop gear. I wanted a 2 cpu build so bad. Thanks!
Hi, I just ordered this a few hours ago after watching this video. The 1U server and the rails However, not sure if the seller will include the riser card I plan to use 2 x E5-2650L V2 cpus which would plenty for my use case I'm trying to buy the RAMs too From your video you've mentioned DDR 3 Registered Any further info about the RAMs I'd appreciate much. I'm from Singapore I've ordered this through my friend in SFO and he'll ship it to me in SG Sadly the seller does not ship to SG I plan to install the latest Ubuntu and use it as a sandbox Thanks
Question, I have bought a server rack that is identical to the one that you had before your current one, and I need to mount 3x 4U servers on it, but they didn't come with a rail and I am unsure how to buy one that fits them. Nice video mate!
Please keep in mind that a modern low end Destop system will peform better in any task you can throw at it at significatly higher power efficiency. Old DDR3 Servers are a fun hobby project not a wise investment. Especially if you run it at home 24 and are paying consumer electricity prices. I know that because I own one.
Power efficiency, generally yes newer desktops will be better. But for performance, this is hands-down better! Jeff's setup here has sixteen cores. Considering the improved performance per thread of newer CPUs you'd probably need a modern 12-core CPU to compete. What modern low-end desktop has a 12-core CPU and 64-128 gigabytes of RAM? Please tell me, I'd like to buy one. When I looked a month ago the best value I could find I was a 6 core CPU with 8GB of RAM at a similar price point.
Another great video. What you call a server addiction I call another video for our vewing pleasure. As for the Beer. I love a good Coffee/Chocolate Stout/Porter beer. To me the color looked great and the bitter and sometime sweet notes(depends on how the Brewer decided to make) is one of my favorite styles of beer. You should try High Tower Brewery Coffee Stout brewed with real coffee beans its really good and almost feels like a meal in a glass.
Hey CC , I have seen that 2650 v2s are around 45 AUD shipped from AliExpress. Is that the best value 2011 cpu for a range of tasks in your opinion? Would like to see an updated opinion on 2011 options in 2021.
I got 4 of these, and had a hell of a problem with them, some doa, some crashing randomly. Figured out eventually that they say they support higher speed memory, but it seems like the chipset does not. put the lower speed ram in it and they work just fine. ANd it was not the memmory as any unity i put it into has a problem, unless you put it into a difrent motherboard, then it works fine and passes memtest. Symptoms: Booting from USB causes Kernal Panic.
You should try getting the latest BIOS from SuperMicro's website and installing it. Sometimes these rebranded servers have custom BIOSes modded by the resellers even though it looks normal and features can be disabled. I've had a few of these before.
I really like your videos man! You show the low budget side of things. Thanks to you I’ve build a pretty dialed truenas machine. I was just wondering if you checked the thermal compound on those CPUs. Given the temperature delta between the 2 I would just double check for peace of mind.
So what if you mount a waterblock, route lines to the back. mount them as quick connects and have pump/radiator on the back of the rack ? That would solve the noise-issue , maybe silent fan to cool the mobo/ram.
Yep by default this server is very noisy... But I was able to mod the top cover to add one 80mm fan as extractor for each processor, that brings down the temperature alone and instead of the default 5 front fans just took out 3 and left 2 there.
I have a pair of these with the e5-2609 v2 xeons, great little workers. It does have VTX and VT-d. Virtualization or something is what it's called and it's in a weird spot. SR-IOV unfortunately is not available in the BIOS :(. So I was able to direct attach the video card to single VM in Hyper-v but it was painful and not at all redundant :P. Good thing I only needed it for plex.
Out of curiosity, with these servers you buy, do you replace the thermal paste under the CPU heatsinks? Just wondering if that might help with your temperatures in case the reseller didn't do any kind of refurbish on the system before selling them.
No, Arctic MX-4. The problem with the second CPU is likely depth, as it's not nearly as close to the fans as the other CPU. I'm going to see if I can improve temps in it.
I would love to get one of these, but the shipping costs to Germany are way to high with 200€... Are there any alternatives I could search for (especially with a similar depth)?
I thought one of the CPU's heatsinks looks crooked or off a little. I would remove, clean and re-apply paste and heatsinks, just as a general rule. The current paste is probably stock and has been through many temperature changes.
A lot of comments suggesting I "replace the old thermal paste". This came to me as a barebones server. The thermal paste is brand new Arctic MX-4. As I said in the video, dual 135W TDP chips are a strong ask of servers like this. I'd recommend sticking to 95-120W chips, or installing this server into an air conditioned rack ;-)
Also, quick update, the seller is sending a replacement board for the DOA server, no questions asked.
But what about the cpu voltages?
Might be a good idea to make a custom shroud that better directs the airflow across the CPUs, and put the fans on rubber grommets, should help cut the noise.
Would dual e5-2690v2`s be pushing it? At 130 rated they´re a bit high but they also usually over-estimate the draw for insurance. I´d guess for intermittent processing they would be OK but for 24/7 work they´d be frying in there.
Just curious: How do you manage the heat on a hot day if these are in the garage?
It's useful as both a cheap server, and a white noise machine.
And a terrible room heater
@@proNOOBIE_ not that terrible as a heater, you can heat your room at the samw time you compute thaings, and then the heating is free 😅
well, I think it won't qualify as a white noise machine. The spectrum will show plenty peaks instead a flat one. Nevertheless, your comment is funny ;)
Craft ASMR
Yep by default this server is very noisy... But I was able to mod the top cover to add one 80mm fan as extractor for each processor, that brings down the temperature alone and instead of the default 5 front fans just took out 3 and left 2 there.
This is the kinda shit I love. So hard to find people doing budget server builds. Even if they are the "best", I don't need/want a $5000 home lab. Keep it up man!
Wow the RTX voice reveal, really impressive
Now that’s an incredible tech demo, right up there with the Barnacules Nerdgasm leafblower with RTX on demo
And you don't even need an rtx card for it
This was done with nVidia Broadcast, which does require the RT cores.
⁰⁰⁰
)1l
@@CraftComputing Tensor cores to be precise ;-)
"Of course since it's a Craft Computing video, something had to go wrong"
I don't think I've ever seen a server build go perfectly smooth on TH-cam so don't feel too bad.
you know shockingly, my dell poweredge tower loaded up extremely easily, including setting up IDrac. i was really impressed. now i have a 16 thread tower with 72gb ram and two chips, a slew of pcie 4, a pcie 16, onboard quad intel gigabit, and 8 hot swap sas bays. its a beast!
Great find. Nothing like snagging a solid server for cheap (or free). Some of my favorite memories from my IT MSP days would be onboarding new clients and taking a tour of their server room and seeing decom'd equipment still in the rack powered off. That would usually be followed by a conversation something along the lines of:
us: [Heavy Breathing] "do you... do you uhhh want us to get rid of this old crap for you? No charge"
them: "yeah sure whatever i don't care this stuff was here before i started working here"
us: "o-ok... we will get a trailer and some guys out here to clean this up for you"
[internally rejoicing at the upgrade our lab stacks would receive]
Me: "So how many servers do you need at home?"
Craft Computing: "Yes."
This is so awesome. I was talking to a customer today and they said wow are you in the data center... yes (actually home)
Jeff turns RTX on because the server is loud as f but then all we get is Jeff shouting for no reason because he can still hear them.
I find that funny
A quick note: Intel VT-X is the general function for virtualiziation from Intel (Which pretty much every CPU hast). It has nothing to do with passthrough. For passthrough your CPU and Mainboard need to support Intel VT-D. This is less common and usually only found in Xeon and HEDT (and i think some weird i3s....)
Cheers!
Dude. The idea of this sever, the beer, and that sweet tech wreath... I love your channel. Thank you for all the great ideas! I made some CPU ornaments years back from some ewaste pc's at work and brought them home (Pentium 4's and D's). Wife only let me use 4 out of the 30ish. I salute you sir.
Ah I see...so you started a youtube channel just so you could buy stuff and give the boxes to Rambo? IT ALL MAKES SENSE...
Loving the videos man, keep it up!
Honestly I think a lot of people would just watch videos of Rambo playing in the boxes.
Definitely an opportunity for a second channel there 😜
@@CraftComputing craft computing cat tips :D
Cat Computing
Love the RAM wreath on the wall
THE DAY IS FINALLY HERE! esiso must be your biggest fan ...
They've only sold 150 of those NAS servers since last video 😂
@@CraftComputing wow lol
Nope, it is the company I work for.. MANY HP DL360 and 380 servers...All purchased from them..
I bought one of the Chenbros. Kinda surprised they didn't sell-through faster. But then it makes sense because of the size. If you don't have a rack (I don't), where can you put it? Mine hasn't arrived yet (it's been two weeks), but I'm considering hanging vertically on the wall, using a 4U wall bracket.
@@marked23 There are vertical server mounts that are truly space saving.
Jeff - any plans for an Unraid build? Would love to see one!
The warning stickers are for Jason (Byte my bits) benefit. If you have seen his new video about battery replacement...You will understand.
What timing - I have 2 of those coming in tomorrow with 2650V2’s. Didn’t realize the board had iSCSI built right in though - that’s awesome, I will put the 2 x 240GB SSD’a I bought to boot them up into the NAS. Thanks for the vids, Jeff - you’re doing great work!
Jeff. Have you looked to see if Supermicro has a BIOS update that would allow you to do hardware pass-through? Keep it up. Thanks
I know that feel, last year bought a used server for 300 euros including shipping to other side of EU
HP ProLiant DL360 G7 with Dual X5690 CPU's and 144GB DDR3. tossed out the sas drives and put in used Samsung SSD 840 Pro drivesi had laying around.
Best 300 euros i have spent on ebay purchase. hosting mail/web and game servers with VMware ESXi
I do enjoy your videos but I wish you would add a watt meter and just mentioned idle and max power draw. Would be appreciated! Cheers
@@isaackvasager9957 or one could just opt lower TDP xeons
@@isaackvasager9957 Should put dual E5-2648Lv2, put in ssd, 128gb ram, and it will happily run a LOT of vm especially in not-so-demanding workload environment. So no, it is not useless. But yes, it does not fit in processing power scenario. We cannot talk about cheap and processing power in the same place, I think.
Intel VT-x is virtualization extensions, while VT-d is the "PCI-E" passthrough equivalent.
You'd think after 10 years as a server admin, I'd stop confusing those acronyms every other day.....
@@CraftComputing Nope, the confusion is part of the intention in the naming process.
There is an updated bios from supermicro. Could you do a video on updating the Bios Craft?
@@CraftComputing could you do a video on updating the bios? There is an updated bios from supermicro.
I have no idea if the updated bios will fix the pci problem. But I hope it does. I have the same server, and want to install a 10g pci card. However with the card in the slot, the server will not even boot up. Card is an HP NC523sfp / QLE3242-HP
Power consumption at idle and under indicated load would be a nice addition. A Kill A Watt meter makes easy work of it. Or some of those little smart outlets have energy meter built in. So it gives you power draw at any given time and a remote power off/on if needed.
You would love the area that I live in. We have a property disposition center that is part of the local university. There they sell off all the old office/lab/computer equipment. 1 or 2 generation old servers, computer and equipment are all there. Pretty darn cheap as well, all in good condition and I've never gotten a bad item. =)
Thermal compund can dry up after a few years of use, so you could try to remove the heatsinks and check if it is still ok.
VT-x is hardware virtualization support. PCIe passthrough requires *VT-d*. Some hardware that has VT-x is missing VT-d, especially 1st and 2nd gen Core era parts.
I came across a free Craigslist Special Barracuda Web Filter 310. I've been in the process of setting up pfSense. Having come with 2 Intel Gigabit nics this will work pretty good for replacing my primary router. I had originally planned to configure an old computer (6-core amd FX6100) as a router with 3Com Giganics, the Barracuda will offload the OpenVPN, firewall, and various other basic things. That way I won't have to worry about goofing up the server and shutting everything down.
It's been a struggle configuring, mostly due to my lack of knowledge of setting up pfSense, but getting there.
So I have a few of these and decided to check out the video because the nice blue color caught my eye. I personally ran everything from 2630L v1 to a 2695v2 and never really had much of an issue with heat on more intensive workloads. That said, my rack is in a basement that gets to about 70f in the summer. I wanted to upgrade to v3/v4 chips so I grabbed a pair of X10DRD boards and it was a near perfect swap. The back IO was a little off going from RJ45 to SFP but still worked fine.
Having downsized my setup for efficiency I can say the with the limited capacity of the board, going to the X10 series let me increase the density ALOT. 256GB of ram, e5 2640v3 and a ssd for boot, only idles at 70 watts.
New video - it's a good day. Then crushed when they don't ship internationally.
Any plans on a video with a medley of the tasting reviews? I look forward to the bonus at the end. Always makes me smile watching your expressions after first tasting.
8:18 relatable accidental keyframe
😑
No way I have the same server and could find 0 information on it. Am very glad I found your Chanel
Great channel! I have the same server and I have replaced the fan with 5x Noctua NF-A4x20 PWM (you can control the fan speed - the FLX model doesn't allow you to do so), and it is nearly silent. I need to change the one in the power supply and it is super quiet. Keep up with the excellent job! Ciao!
I used to pick up older HP DL300 models from a local school on eBay.
G5-G7, sometimes as little as a couple dollars. Usually with at least most of the parts. Not all would have two CPUs or coolers, some with RAM, some without, always PSUs but never drives.
Made some decent cash off them after tinkering and setting them up. I used a few for game servers a while and still made a profit. I still actually have one with a pair of 6c/12t and 32gb of RAM collecting dust.
Thank you. I was miffed at the lack of measurements last time
I have fun with old server stuff. My actual media server is a dual socket Xeon X5677's with 24gb of RAM. I used to keep it in a 4U chassis, but actually moved it to a Cooler Master HAF lanbox.
Since I host things like Minecraft, I need server processors that are fast, and it's still hard to find affordable upgrades beyond what I have at the moment.
That Oatmeal Stout has been my beer of choice lately
Some cases did have "air guides" to push the air into needed locations. if you need that full spee, maybe a makeshift "air guide" woudl improve temps on that second CPU.
Still, that is one nice ifnd.
I'm guessing your rack is in a different room, but do you think replacing the fans with Nocuta fans would proivde some benefits? or would that be a dissaster on temps?
surely a few noctua fans and a tweak in supermicro's IPMI can help the fan noise! I just bought one of these to replace one of my servers.
I was thinking about the same thing with the fans. Are the headers on the motherboard 3pin or 4pin? My desk is right next to my server rack, so I don't want to hear loud fans. How did the noctua change out end up for you? Is this thing quiet then?
@@mattscheurman1616 MUCH more quiet. What a difference! Only thing is, you will need to adjust fan speeds in the IPMI or have some air from a standing fan blowing on or around it since the fans run pretty slow speeds at idle. Even then, the noise is practically non-existent. They only fan not replaced is the power supply fan which upon further investigation, is wired pretty far into the unit. Not going near the death caps lol. That one is decently quiet. The fan connectors are 4-pin.
Thank you for an honest review. The loud fan noise got my attention haha.
Put a 10gig or 25gig NIC in that open slot and that thing would make an OK secondary virtualization server connected to a fast NAS. although I would prefer a 2011-3 platform.
regarding that psu - your alternative would be buying any fitting one and using an 300€ molex crimp tool to crimp the connectors yourselve - yes the tool costs money, but having one myself, it just does what it is supposed to do, not like 12€ ones...
If you dropped the CPUs to more low power ones and replaced those fans with something like Noctua’s 40mm it might be usable in a home setting. The base kit on eBay would make a pretty decent firewall if you don’t do VMs
Finally a good cheap pc and room heather for winter
“We got an over temp alarm” YAAYYY you are such a nerd! AND I LOVE IT!!!
quad channel setup is a MUST to have
I bought one of these jet engines a year ago. Only complaint is the sound. It's great for Proxmox and the best price to performance ratio I could find.
Great !!! Did you create vms and cts with out any issue ?
@@giovannipena2663 yep, no issues. I'm using 2 500 gb ssds with ZFS for storage and loaded it with 128gb of memory.
I had 3 of these, one of them was as loud as jeff's and i couldn't figure out how to quiet it down, but the other two ran near silent. Each of the servers had a pair of E5 2697 v2 cpu's and 8x16gb ddr3 ecc ram. Maybe its something with the v1 chips. I was also able to get a quadro k2200 passed through in esxi 6.7 u1
What Bios is on the system that allows gpu pass through?
Might try updating the bios to most recent: 3.3 according to super micro. May fix the ability to enable VT-X
Yeah I really need to know this before I jump.
I suppose it'd make more sense to go dual 2650v2 on there. Decent clock speeds, easier to manage heat output. In virtualisation, the CPU is rarely the bottleneck.
Heck, even the E3 class E2136 in my Dell T140 will do fine, beating the Xeon Silver 4110 in multi core.
I recently found a dell PowerEdge r720 with two E5-2665's and 64Gb of ram for $200 shipped. I think I got a killer deal what do you guys think?
That's definitely a good deal!
Hp dl380p, e5 2660 v2(10c/20th, 2.2ghz), 64gb 12800r(4x16gb), 2x250gb sas drives.
$150
Hp dl385 g8, dual 6328 opterons(they're kinda crap, but useable), 64gb ddr3(8x8, 12800r).
$150
Dropped an additional 50 for the secondary risers and cages.
3 risers and 3 cages.
Stupidest deal I've ever gotten on servers was a dl360 g6.
Dual 5550, 72gb of ram(10600r, 18x4 sticks)
$60.
I just bought it for the ram.
As overkill as this would be I'm sure this server would make a great firewall/router box ala pfSense/opnSense. I run a QOTOM MiniPC for my OPNsense needs and it works great, but having more power would be nice too. haha. Great video Jeff!
The seller is very easy to work with he does sometimes take a bit for him to get back to you. Have bought 3 storage servers through him.
There is nothing wrong in feeling excited every 4 days.
In 2020 we need little things like that
If you need to replace the PSU keep the existing cables so if the new one doesn't have them you do!!
you can possibly test the new bios version is BIOS revision: R 3.3 on the supermicro website for the mainboard! pass through maybe for graphics card work
Definitely plan on giving it a shot.
I just realized I'm not subscribed. Fixed it. To be fair, your videos has always showed up on my feed (which is why I thought I was subscribed)
ahh ya a good ol ninkasi oatis. Huge fan. The vanilla oatis is one of the best stouts IMHO
Great information ✊🏾 I'm new to home lab setups. What's the practical use scenario for a serve like this? Can it be used as a Plex server? Thank you for sharing your knowledge.
The Christmas wreath made of ram sticks is a nice touch.
Would love a iSCSI tutorial, trying to get that up and running on my server and having nothing but issues
The RTX voice part, 10/10.
@Craft Computing, Do you think the server could become more "home friendly" by replacing the factory fans with Noctua NF-A4x20 fans or would they be inadequate for cooling purposes?
I am wondering this same thing myself.
You should look into trying to find a modded or custom bios for that board to see if you can get those features enabled.
I bought one of these, it is a great server and my first server.
VT-x is just hardware assisted virtualization. You should look for VT-d for device passthru.
What is the plan with the DIY server that you pulled from the rack?
All of the recent servers are to be able to tinker with. It'll go back in at some point :-)
I picked one up just recently, mainly to use as a third system in a Proxmox cluster just to play around with cluster/HA abilities. Two L-series CPUs and 64GB ECC RAM. I 3d printed my own adapters to swap out the fans for Noctuas. If I was really pressing the CPUs then it really wouldn't be enough, but at the minimal use I put on it they work fine. Mine had the drive cage, but had to buy the riser and rails separately. The main nuisance is the outdated IPMI relying on the garbage Java console.
any plans to release the STL's on thingiverse?
couple of days ago i've gought a DellR620 with dual E5-2620, 16GB of ram and Dual 750W PSU. All for 130€ shipped
I think you misunderstood warning on shroud. It's intended for whole inside of server, not just what's under shroud. At least how I see it.
I would love to have a text label edited in, whenever you mention those long part names like E5 2698. Maybe even for all parts? I tend to pause the video and need to listen twice or listen very carefully the whole time... which i usually dont do. Anyways: love your content. I really enjoy these budget server builds
What model rack are you using, and where did you get it? It looks particularly nice, and I am looking to replace my old 42U rack which has threaded screw holes for one which uses rack nuts to fit my Dell server rails, which I may also go for something a little shorter.
In the video you talk about the PCI pass through not working. I'm assuming that's for just vms? Would the pci slot for a gpu would work normally then?
Gets to play in the boxes. Do you blame him though?
Thanks for this. I was oh so close to ordering one of these servers. My rack is next to my desk in my home office. I cannot imagine competing with those fans on conference calls. I will continue to look for other budget rack alternatives. I have a small (depth) rack so I need short servers. Might just have to build my own with new desktop gear. I wanted a 2 cpu build so bad. Thanks!
Do you think replacing the fans with noctua fans would help the sound issue?
Hi,
I just ordered this a few hours ago after watching this video.
The 1U server and the rails
However, not sure if the seller will include the riser card
I plan to use 2 x E5-2650L V2 cpus which would plenty for my use case
I'm trying to buy the RAMs too
From your video you've mentioned DDR 3 Registered
Any further info about the RAMs I'd appreciate much.
I'm from Singapore
I've ordered this through my friend in SFO and he'll ship it to me in SG
Sadly the seller does not ship to SG
I plan to install the latest Ubuntu and use it as a sandbox
Thanks
Any chance that supermicro offers a bios that enables VT-X, etc.?
i think it is in the bios. According to the manual it is in the North Bridge Setting. Enabled or Disabled.
on the front is pretty much nothing but a bunch of...."SPEED HOLES"... BRILLIANT!!!!
the RTX on is a nice touch with the noise suppression on
Question, I have bought a server rack that is identical to the one that you had before your current one, and I need to mount 3x 4U servers on it, but they didn't come with a rail and I am unsure how to buy one that fits them. Nice video mate!
Please keep in mind that a modern low end Destop system will peform better in any task you can throw at it at significatly higher power efficiency. Old DDR3 Servers are a fun hobby project not a wise investment. Especially if you run it at home 24 and are paying consumer electricity prices. I know that because I own one.
Power efficiency, generally yes newer desktops will be better. But for performance, this is hands-down better! Jeff's setup here has sixteen cores. Considering the improved performance per thread of newer CPUs you'd probably need a modern 12-core CPU to compete. What modern low-end desktop has a 12-core CPU and 64-128 gigabytes of RAM? Please tell me, I'd like to buy one. When I looked a month ago the best value I could find I was a 6 core CPU with 8GB of RAM at a similar price point.
Hey Jeff! @craftcomputing Love the videos but I have a question. I thought you could only run windows server on dual cpu systems?
Windows 10 Pro supports dual socket motherboards. Home is single socket only.
Windows 10 Pro will work with 2 CPUs. If you go beyond 2, you need Windows Server.
@@nelizmastr Doesn't Windows Pro for Workgroups also work with more More CPUs?
Another great video. What you call a server addiction I call another video for our vewing pleasure. As for the Beer. I love a good Coffee/Chocolate Stout/Porter beer. To me the color looked great and the bitter and sometime sweet notes(depends on how the Brewer decided to make) is one of my favorite styles of beer. You should try High Tower Brewery Coffee Stout brewed with real coffee beans its really good and almost feels like a meal in a glass.
Hey CC , I have seen that 2650 v2s are around 45 AUD shipped from AliExpress. Is that the best value 2011 cpu for a range of tasks in your opinion? Would like to see an updated opinion on 2011 options in 2021.
It's definitely a great chip for the price. It's actually what I linked in the video description as a recommendation for this server.
Yes - 2650V2 is best bang for the buck assuming you’re building a virtualization box.
I got 4 of these, and had a hell of a problem with them, some doa, some crashing randomly. Figured out eventually that they say they support higher speed memory, but it seems like the chipset does not. put the lower speed ram in it and they work just fine. ANd it was not the memmory as any unity i put it into has a problem, unless you put it into a difrent motherboard, then it works fine and passes memtest.
Symptoms: Booting from USB causes Kernal Panic.
You should try getting the latest BIOS from SuperMicro's website and installing it. Sometimes these rebranded servers have custom BIOSes modded by the resellers even though it looks normal and features can be disabled. I've had a few of these before.
I use these HYVE Zeus servers as Untangle router boxes, I have one at home right now :)
a tour of your servers and their purposes would be a good gap filler video, what do you need them all for? :)
i just picked up a dual xeon x5675 server with 32gb ram and dual power supplies for £59.99 which is about $79
This is going to fit great in my skb case
I really like your videos man! You show the low budget side of things. Thanks to you I’ve build a pretty dialed truenas machine. I was just wondering if you checked the thermal compound on those CPUs. Given the temperature delta between the 2 I would just double check for peace of mind.
So what if you mount a waterblock, route lines to the back. mount them as quick connects and have pump/radiator on the back of the rack ? That would solve the noise-issue , maybe silent fan to cool the mobo/ram.
Alphacool actually makes server watercooling gear. I might have to give them a ring.
Baby blue front bezel?? Who in the world would rock that? Flys away.
Yep by default this server is very noisy... But I was able to mod the top cover to add one 80mm fan as extractor for each processor, that brings down the temperature alone and instead of the default 5 front fans just took out 3 and left 2 there.
I have a pair of these with the e5-2609 v2 xeons, great little workers. It does have VTX and VT-d. Virtualization or something is what it's called and it's in a weird spot. SR-IOV unfortunately is not available in the BIOS :(. So I was able to direct attach the video card to single VM in Hyper-v but it was painful and not at all redundant :P. Good thing I only needed it for plex.
Out of curiosity, with these servers you buy, do you replace the thermal paste under the CPU heatsinks? Just wondering if that might help with your temperatures in case the reseller didn't do any kind of refurbish on the system before selling them.
I just built myself a 2011-3 server. Two Xeon E5-2670 v3 and 16GB of DDR4. Total cost was not even 300€.
I'd be really interested in how you do your home network. I'm going to expand mine this upcoming year and looking to see how.
Are you rocking the old thermal compound that came with the system.... from 2013-ish?
No, Arctic MX-4. The problem with the second CPU is likely depth, as it's not nearly as close to the fans as the other CPU. I'm going to see if I can improve temps in it.
I would love to get one of these, but the shipping costs to Germany are way to high with 200€... Are there any alternatives I could search for (especially with a similar depth)?
Perhaps you can enable VTx through IPMI?
I tried on my server (same shown in the video) and I did not see a way to do it through IPMI.
So...maybe I'm slow. VT-x is disabled but it would work for Proxmox still?
I thought one of the CPU's heatsinks looks crooked or off a little. I would remove, clean and re-apply paste and heatsinks, just as a general rule. The current paste is probably stock and has been through many temperature changes.
This was a barebones server. I put on the thermal paste myself.