I really like the break down of the differences in architecture and hardware choices. Please do more! Seeing how all the supporting tech needs to change for higher and lower tiers of switches makes a good idea of why and how these things get to the price points they get.
Very cool stuff, I would be interested in learning more about that SFP28 switch you mentioned as well! Also, when you do the optical cabling, please do a video on that as well! I am interested in learning how to make my own optical cables and it is harder to find instructions on how to do that.
Something that may be interesting is that Chris did a SONiC article 4+ years ago on STH. www.servethehome.com/get-started-with-40gbe-sdn-with-microsoft-azure-sonic-for-under-1k/
I would like to see as many of these Dell switches as you want to show. I need to replace around 128 Gigabit ports in a stack sometime in the near future. Probably going to go with Xtreme, but my mind is still open to alternatives. My only other port needs is like half a dozen 10gb ports for some servers.
Awesome review as always Patrick! - 100% agree mgmt & Console ports should be in the front. - Missing power cables option in the front & back, like we see in some QCT switches. Why is it not seen anywhere else? - Is the S5232F-ON racked from the front of the rack like a server or from the back of the rack? Sad note: Cumulus Linux 4.4 supports NVIDIA Spectrum-based switches only. Cumulus Linux 3.7 and 4.3 continue to support Broadcom-based networking ASICs.
Yea. At some point, the world is just going SONiC if we are being realistic. I know that is a controversial take, but SONiC is a much larger ecosystem at this point and NVIDIA has not been using Cumulus to attempt to take share.
i really wish switch manufacturers would sell a replacement lid that took up an extra U, and had mounts for 120 & 140mm fans, so that if for people who wanted to use one of these NOT in a data center, we could simply replace the aircraft engine fans with quieter ones.
Great catch. Found it on the S5292F-ON too. Had a reader already find it in a Gigabyte server. I have reached out to AMI's legal department asking about this.
Love these videos, I have two Agema 100 GbE Switches running a custom NOS. I can't use them though because they're, as you said, too loud and can't really be silenced. Maybe we could see a video where you try to silence these things for homelab usage?
That was actually the idea behind the S5296F-ON. I recorded the video today. That was a less than successful idea that the 2U would be significantly quieter.
@@ServeTheHomeVideo At this point I'm almost tempted to mod the top lid to have multiple 140MM Fans in it, but if I recall, there arn't any standard 4pin headers.. I could always use external power for the fans but even that's a bit 'ghetto' for my taste. :-D Love your content by the way, I'm always watching!
@@ServeTheHomeVideo I've been working on trying to get my S3048 quiet with modding. I've got one fan module swapped with a noctua. The system boots with it, but reads as failed. I tried the same on the power supply fan, but that signals to the power supply that it is failed, so the switch just doesn't post. Next step is seeing if I can cram micro-controllers in there to spoof the tach speed to the power supply and fan control boards. muhahahaha!
All "cool changes" that you listed are either trivial for an end function or are meant to host extra spyware. One expects from his switch to do switching, not bazzilion of extra ( mostly hidden) functions.
The reason Dell is a lattice shop is because their FPGAs are massively cheaper with respect to xilinx and intel/altera ones. My guess is that since in a high end networking switch these components will only be used for fairly mundane glue logic, they don't need the performance. Now downside of lattice is that their ecosystem is way less mature, thus they are much more painfull to develop for with respect to the big two
Often these FPGAs are used for things like blinking status lights. This is also an area where the S5296F-ON (96x 25GbE + 8x 100GbE) version of this switch is a bit different. That one actually has a Xilinx part.
I feel these videos are a lot more interesting a few years down the road. On one hand I can get a new Ubiquiti EnterpriseXG 24 for $1300 and on the other I can get a used S5232F-ON for $1150. One of them is a 10Gbps switch with 2 25Gbps upload ports where this thing is all 100Gbps. As a home labber this is REALLY interesting. Seriously. Why is Gigabit or even 2.5Gbps even considered acceptable in 2024?
@@ServeTheHomeVideo Yes and as such probably quieter. Then again intel is launching a consumer CPU that pulls 400W today and a 4090 can pull almost 500W. If all users cared that much about power consumption then those products would be dead in the water. If they really felt the need to address power consumption I feel like they would implement a mechanism for devices to renegotiate link speed on the fly. It could run in 100Mbps mode while it is sitting there not doing much but then renegotiate up to 1Gbps when a user connects to the device and then renegotiate again whenever a file is being transferred. Consumer workloads tend to be very sporadic so I think this would be clearly something they could do if power consumption really is that much higher.
for the fiber series, please include server side HBAs and device to device direct routing. I'm looking for a reccomendation for a FC HBA to connect to my LTO(5) library that has fiber only sfp on it.
Would love to know how the Dell switches compared to the Celestica SeaStone DX010. I'd looked at both the S51xx and S52xx series. The fact the S51xx didn't support anything other than OS10 and OPX was disappointing, but the price was compelling.. The S52xx are quite a bit more expensive, but offers enterprise SONiC support. Tomorrow I take delivery of 2x DX010, a ICX6610 and a box of modules =D
This is now a generation old, but used prices are up a lot. These days it is probably ~$2750 or so used. Two years ago it was probably $8-11K. Linus' $15K switch in his 100GbE video was 2 generations older than this, and a lower-end switch, but I think he was using new-at-the-time pricing before normal discounts. Without the chip shortage this would be a $1500-2000 switch but used prices have risen because of it.
Excellent review as usual. Can you please elaborate on the Dell VLT technology to connect 2 switches (similar to stacking) because Dell has a different implementation of stacking than usual switches.
Lattice has more to trade when it comes to commodity and programmable components. In other words Dell pays less and Lattice bundles in more of the down bin parts Altera and Xilinx don't offer or won't bundle as sales close margin sacrifice. mb
That proves it mid shelf B.O.M., Denverton off the surplus market. They're actually are not many and are very difficult to replace any Intel micro server although D is available. mb
I really like the break down of the differences in architecture and hardware choices. Please do more! Seeing how all the supporting tech needs to change for higher and lower tiers of switches makes a good idea of why and how these things get to the price points they get.
100% need a video on the 25gbe switch
Man, the switches you bring just make my eyes water 🤩
And so does the price tag.
I want one of every managed switch you reviewed
Only one?
Just what my one bed apartment needs. ;)
Energy company: *gleefully rubs hands*
Pretty cool the switches, we typically use the Arista 100G, however over a year ago it was around $1300 for one now they are around 6500 :(
@@technicalthug Yup sadly that is gone this past year. Hopefully we will see another big drop again in the future.
@@technicalthug hell no.
Very cool stuff, I would be interested in learning more about that SFP28 switch you mentioned as well! Also, when you do the optical cabling, please do a video on that as well! I am interested in learning how to make my own optical cables and it is harder to find instructions on how to do that.
Let’s open that S5296 switch! 🤩
I’d love to see a initial provisioning tour of this stuff. I’ve been waiting for approachable white box switching for 6+ years.
Something that may be interesting is that Chris did a SONiC article 4+ years ago on STH. www.servethehome.com/get-started-with-40gbe-sdn-with-microsoft-azure-sonic-for-under-1k/
I want to see a video of the S5296F-ON!
Patrick's strong shoulders because he's been flexin' holding gear up recently.
I need a table badly.
+1 on reviewing that 2u eldritch abomination
I would like to see as many of these Dell switches as you want to show. I need to replace around 128 Gigabit ports in a stack sometime in the near future. Probably going to go with Xtreme, but my mind is still open to alternatives. My only other port needs is like half a dozen 10gb ports for some servers.
Awesome review as always Patrick!
- 100% agree mgmt & Console ports should be in the front.
- Missing power cables option in the front & back, like we see in some QCT switches. Why is it not seen anywhere else?
- Is the S5232F-ON racked from the front of the rack like a server or from the back of the rack?
Sad note: Cumulus Linux 4.4 supports NVIDIA Spectrum-based switches only. Cumulus Linux 3.7 and 4.3 continue to support Broadcom-based networking ASICs.
Yea. At some point, the world is just going SONiC if we are being realistic. I know that is a controversial take, but SONiC is a much larger ecosystem at this point and NVIDIA has not been using Cumulus to attempt to take share.
i really wish switch manufacturers would sell a replacement lid that took up an extra U, and had mounts for 120 & 140mm fans, so that if for people who wanted to use one of these NOT in a data center, we could simply replace the aircraft engine fans with quieter ones.
"American Megatrands[sic]" sticker on the BMC? Err, what?
Great catch. Found it on the S5292F-ON too. Had a reader already find it in a Gigabyte server. I have reached out to AMI's legal department asking about this.
I’m curious - did you ever hear back from AMI about this?
@@electronicharry hoping to have that piece out the week of Thanksgiving
Online now, quite delayed. th-cam.com/video/dUVmDcv782k/w-d-xo.html
You sir are a legend now
Love these videos, I have two Agema 100 GbE Switches running a custom NOS. I can't use them though because they're, as you said, too loud and can't really be silenced.
Maybe we could see a video where you try to silence these things for homelab usage?
That was actually the idea behind the S5296F-ON. I recorded the video today. That was a less than successful idea that the 2U would be significantly quieter.
@@ServeTheHomeVideo At this point I'm almost tempted to mod the top lid to have multiple 140MM Fans in it, but if I recall, there arn't any standard 4pin headers..
I could always use external power for the fans but even that's a bit 'ghetto' for my taste. :-D
Love your content by the way, I'm always watching!
@@ServeTheHomeVideo I've been working on trying to get my S3048 quiet with modding. I've got one fan module swapped with a noctua. The system boots with it, but reads as failed. I tried the same on the power supply fan, but that signals to the power supply that it is failed, so the switch just doesn't post.
Next step is seeing if I can cram micro-controllers in there to spoof the tach speed to the power supply and fan control boards. muhahahaha!
Thanks for this! very detailed.
All "cool changes" that you listed are either trivial for an end function or are meant to host extra spyware.
One expects from his switch to do switching, not bazzilion of extra ( mostly hidden) functions.
Would love to see more on SONiC
Wonderful video, I am learning a lot!
Glad it was helpful!
You have it already, of course you do a review! 😜
I just recorded the video since we have quite a few comments asking for that.
I want a video of the 2U you lifted up
The reason Dell is a lattice shop is because their FPGAs are massively cheaper with respect to xilinx and intel/altera ones.
My guess is that since in a high end networking switch these components will only be used for fairly mundane glue logic, they don't need the performance.
Now downside of lattice is that their ecosystem is way less mature, thus they are much more painfull to develop for with respect to the big two
Often these FPGAs are used for things like blinking status lights. This is also an area where the S5296F-ON (96x 25GbE + 8x 100GbE) version of this switch is a bit different. That one actually has a Xilinx part.
Can this switch sustain 100% I/O load and if it can how hot are those 100Gb port running ?
Thx for the nice video
Aha, Patrick does a "Now for something completely different." moment ;)
I feel these videos are a lot more interesting a few years down the road. On one hand I can get a new Ubiquiti EnterpriseXG 24 for $1300 and on the other I can get a used S5232F-ON for $1150. One of them is a 10Gbps switch with 2 25Gbps upload ports where this thing is all 100Gbps. As a home labber this is REALLY interesting. Seriously. Why is Gigabit or even 2.5Gbps even considered acceptable in 2024?
To be fair, 2.5GbE is much lower power
@@ServeTheHomeVideo Yes and as such probably quieter. Then again intel is launching a consumer CPU that pulls 400W today and a 4090 can pull almost 500W. If all users cared that much about power consumption then those products would be dead in the water. If they really felt the need to address power consumption I feel like they would implement a mechanism for devices to renegotiate link speed on the fly. It could run in 100Mbps mode while it is sitting there not doing much but then renegotiate up to 1Gbps when a user connects to the device and then renegotiate again whenever a file is being transferred. Consumer workloads tend to be very sporadic so I think this would be clearly something they could do if power consumption really is that much higher.
In terms of noise, which one is quieter - the Mellanox 100 Gbps switches or the Dell? Or are they about the same?
for the fiber series, please include server side HBAs and device to device direct routing. I'm looking for a reccomendation for a FC HBA to connect to my LTO(5) library that has fiber only sfp on it.
Yes please
For the money, id like to see heatsinks on those chokes. How hot do they get?
Thanks!
Wow! Thank you!
Would you not prefer something like Mellanox over the Dells?
Pricing matters here.
18:10 you can't just say it's loud without showing us :P
Would love to know how the Dell switches compared to the Celestica SeaStone DX010. I'd looked at both the S51xx and S52xx series. The fact the S51xx didn't support anything other than OS10 and OPX was disappointing, but the price was compelling.. The S52xx are quite a bit more expensive, but offers enterprise SONiC support.
Tomorrow I take delivery of 2x DX010, a ICX6610 and a box of modules =D
@ServeTheHome I want to know are these switches future proof or not?
Certainly more than the S5100F-ON switch series. Networking is evolving rapidly though.
We need hot swap CR2032
How much does this switch cost approximately?
This is now a generation old, but used prices are up a lot. These days it is probably ~$2750 or so used. Two years ago it was probably $8-11K. Linus' $15K switch in his 100GbE video was 2 generations older than this, and a lower-end switch, but I think he was using new-at-the-time pricing before normal discounts. Without the chip shortage this would be a $1500-2000 switch but used prices have risen because of it.
Looking at a video with a 100GbE switch...I got like 40mbit to my server with a wifi link and powerline inbetween wooo
Let’s see that big mama 25 gig switch!
Why is this needed *in the home?*
Why am I tripping out right now, I swear I’ve already watched this?
N E E D a 25gbe switch teardown!
Does anyone know what switch asic is in Extreme X870? Thanks.
Excellent review as usual. Can you please elaborate on the Dell VLT technology to connect 2 switches (similar to stacking) because Dell has a different implementation of stacking than usual switches.
What about Edgecore???
Still working on finding more of those to open up.
more fiber and sfp switches vds
Probably not SFP. More SFP28 and QSFP28 are coming.
Great review, but please - "Printed Circuit Board board"? triggered.gif
Tomahawk? mb
25 GbE; Windows Server then . . . mb
Got it Trident mid shelf. mb
Lattice has more to trade when it comes to commodity and programmable components. In other words Dell pays less and Lattice bundles in more of the down bin parts Altera and Xilinx don't offer or won't bundle as sales close margin sacrifice. mb
That proves it mid shelf B.O.M., Denverton off the surplus market. They're actually are not many and are very difficult to replace any Intel micro server although D is available. mb
It will be good when the open network conference circuit starts up again at SCCC. Big updates then. mb
th-cam.com/video/l79UkhT9OVI/w-d-xo.html S5248F-ON is circled and not the S5232F-ON
First!
❤️ STH videos.
Wow! You are fast!
I’ll never trust any dell branded switch ever again. Sorry they sold to much crap over the years.
early squad
who in the world can afford this stuff for the home? this is a $5500 switch, before you buy any modules or cabling...