A good demo is using iperf with multiple connections (threads), they typically add up to the full bandwith - but only if the hashing is on the correct protocol level (tunnels and vlan require a different hashing on deeper levels besides the normal level 2 ip+port)
School for Hackers actually I am not sure about the vlan, i might be wrong there. At least I had problems with the xmit hash policy (layer3+4) not working for gre tunneled links (it was not distributing the tcp connections inside the tunnels). Might be not a problem for normal VLANs, maybe for Vxlan tunnels. For the typical NAS I guess distributing the layer3 clients is more than enough load balancing.
I just watched your TrueNas Core LAGG video and this video seems to have more correct information concerning LACP with its different modes of LACP especially the 802.3ad mode.
Great video. I have two lag setups between two UAP HDs and 24 port 250W Poe switch and lag between switch and Netgate Sg-3100. One note is that you have to setup lag downstream device before upstream lag or the connection breaks.
I havent tested with pfSense specifically, but if you only have 2 available port and your connected via the LAN, you can create a LAGG using the single available port, then swap your PC to the LAGG, then delete the LAN, then add the free LAN port to the LAGG. this way you dont lose connection while making the switch, and dont need to connect to the WAN port. This worked on old FreeNAS Corral, so I assume it will work with pfSense
The hero I needed! Setting up a VPN device for about 50 users on one of those i3 4 port fanless 4 port machines. Now - I don't NEED link agregation, but it helps!
Ben using an HP Procurve 24 port switch and have 0 problems running it with a 4 channel LAGG LACP setup. Did some testing using a proxmox with lacp setup, and ISCSI drive with FreeNAS. Ran a virtual machine on that ISCSI drive and linux drive speed test was able to read close to 7gb/s write 3.5gb/s. I just slapped it all together and freenas had 8 ssd drives in raid 0. There was no production running on it. I love my procurve switch, but it took me a couple days to figure out how to get it setup as there are no options in the web interface it had to be configured via putty and console cables.
Thanks for the video! I have a issue that popped up as of lagging 2 connections. I can no longer access any of my haProxy sites on LAN (sometimes they start working but when they do it takes approx 5 mins for the page to come up and sometimes it just timesout); i can only access them from the WAN. I have been going through your videos trying to find a fix. Before the lagg config. I also notice when i restart my unifi switch port for the lag - the sites will work fine via LAN as well BUT only for a few mins.
Thanks for the video. It demonstrates that LAGG is not that complicated to set up. It is just a shame that pfSense does not allow the creation of a LAGG interface in the console. That would have help me many times when doing the initial install a new pfSense box.
@@scottluebke5012 hmmm...it's easy on others. unifi is confusing for vlans and lagg since they do things non standard. eg LACP on HPE Aruba and Dell OS 10 switches is easy.
So what is also effectively create a bridge for those two ports I'm assuming centering they both have one IP address and are on the same subnet of course?
I assume this could get a little dicey in an ipv6 world no? Or maybe some additional configuration steps would be needed. I assume reports would share the same link local and global addresses eh?
Hey, love your videos. I have a question if I may, is multi-WAN the same as WAN aggregation? I have a Motorola MB8600 and a multi gig subscription and would like to use WAN aggregation to achieve the higher throughput from my modem to my soon to be built pfsense box and then out of that to a multi gig switch. But I cant find a definitive answer to is WAN aggregation the same as multi-WAN.
wondering if I could split my Fiber 3go internet to two 1go ports on my pfsense to leverage that internet speed to all the house (2 swicthes, 3 WIFI routers, IPcam)...(I wish my pfsense box had 2.5 of 10 go ports but it don't) Advises, opinions welcomed.
That only thing that I really wish Untangle had was the ability to create a LAGG for the switch uplink. I should set up a pfSense box sometime just to play with it.
Tom, I have some open ports on my pfSense. Switch is a 24port Unifi. Is it possible to configure LACP on pfSense and on Unifi and then move the vLan's onto the newly created trunk pair. with a matching setup on the unified side ? like to trunk 2 x 1GbE ports on both sides.
I have no Parental Interfaces listed in the box when trying to setup a LAG so I cannot select my OPT1 and OPT2 interfaces. What do I need to do to get the Parental Interfaces listed?
Hmm... I really want that Cat6 reinforced cable, but they're totally out of stock on the affiliate link :/ I found the them on the monoprice site though.
We need a way for you to make "choose your own adventure" versions of the videos. I needed this exact information last night...but for an SG-3100, not a 5100. I'm starting to suspect that LAGG is not supported for the built-in switch ports on the 3100 (LAN1..LAN4), only actual interfaces (LAN, OPT1, WAN). Can anyone confirm?
Found this video after playing with this earlier today. Got everything configured this morning and everything was great for about an hour then everything lost connectivity. The only way to get back up was to login to pfSense locally and restore a backup.
@@homeassistantiptv8068 I did get it working. After I restored my previous configuration I set it back up and it worked without any issue the second go round. It's been running without issue for 3 months now. I think the issue I was having may have been with the ports I had originally chosen on my switch to setup the LAGG.
@@MatthewMcNair Thanks, i got mine up and running as well! I had done it as per the video but then what i did was delete the lagg setup on PF and re-did it and as soon as i hit Save - that did the trick. So almost the same as you where it took it the 2nd time.
What I've found with cable failures is 99.9% of the time a person is nearby when the cable 'fails', they then walk away and come back to deal with the 'failed' cable. i.e. People cause most cable 'failures'. Now if you use cheaper then cheap cables and gear YMMV. Cheap is not always about what it costs.
Interesting. I've tried almost this exact thing a couple of times in the past in my home lab with several different switches, with and without lacp, but without much luck. Each time things worked well for an hour or two, I saw the improved throughput (from multiple clients) and redundancy, but after that my network always started to get unstable. Random dropped pings, even between machines on unaffected switches, pairs of hosts that couldn't communicate (but could communicate with other hosts), DHCP failures, lots of entries in the ARP caches, etc. In each case, removing the lagg returned everything to normal almost instantly. Still haven't figured out what I was doing wrong.
I HATE that the console port on the XG6 switch is right next to port 1. I know it's a small device and not a lot of options as to where to put it, but dang Ubiquiti, move it more over to the edge or something.
I really don't understand why would anyone lagg to a router. Sure, betwene switches? Absolutely. From a switch to a storage or app server? Certainly. I did exactly that. But from a router to a switch? Usually link beyond the router has the least bandwidth avaliable to the network, so it would seem useless for most applications... Given that VRRP would serve as better solution (because you also plan for HW failiure).
In my case, my switch is rather basic so traffic between VLAN's goes to pfSense then back out to the other VLAN. If there is alot of traffic going across different VLAn, it will help. LAGG could allow my PC to connect to my NAS at 1gbps whilst allowing other traffic to flow smoothly. In my case i use a seperate port/cable/VLAN for iSCSI traffic, but a LAGG could achieve a similar result.
It's not too bad at all. Lots of videos about it on youtube too. Doing it with a 2960G and my pfsense box now. Basically in Cisco you would just create an etherchannel bond with LACP as active and connect it over. (make sure to only do it in powers of 2 though, so like 2 ports, 4 ports, 8 ports, etc). Cisco's algorithm with LACP doesn't get along with other configurations of number of ports.
@@DementiaAcerbus Thanks, good to know. I have 2 cisco 24port SW stacked. I plan on creating the etherchannel on the SPF ports on SW1 and SW2. I need to config them as trunk also. The change the config on the UDM-pro as well. I'm a noob to all of this and not an IT person by no means.
@@LAWRENCESYSTEMS I'm just hoping carp will run on a LACP interface (im planning on using two Netgate devices in HA mode), from what the pfsense guys tell me it should be doable.
Yes. Create your LAGG interface and add the VLANs to it. This will create new Network ports such as "VLAN 99 on lagg0". Then just change the port on the interface that you want to migrate from a single link to a LAGG from "VLAN 99 on ix0" (replace ix0 with your port name) to "VLAN 99 on lagg0". Since you did not change the interface (LAN, OPT1, etc.) itself but just its binding, all the rules will remain intact.
Dude! That's hilarious - your position as a videographer, does rather make things difficult for you, as you're continually facing away from the ports & their labels!
Use what makes you happy, but since OPNSense is slow on security updates compared pfsense lawrence.video/opnsense it's not really something I am interested in.
You are like a mind reader. I was learning in depth about LACP last night. I love your videos. Thank you for the great work. Cheers from Canada!
These tutorials are really great! Sincesrly, thank you Tom, and to the rest of your crew!
You're very welcome!
Just set up my pfsense box last weekend using your guide, now I’ll be following this guide too! Thank you!!!
A good demo is using iperf with multiple connections (threads), they typically add up to the full bandwith - but only if the hashing is on the correct protocol level (tunnels and vlan require a different hashing on deeper levels besides the normal level 2 ip+port)
Yup
Because of the vlan tagging?
School for Hackers actually I am not sure about the vlan, i might be wrong there. At least I had problems with the xmit hash policy (layer3+4) not working for gre tunneled links (it was not distributing the tcp connections inside the tunnels). Might be not a problem for normal VLANs, maybe for Vxlan tunnels. For the typical NAS I guess distributing the layer3 clients is more than enough load balancing.
Yeah it gets a mile deep here, doesn’t it?
I just watched your TrueNas Core LAGG video and this video seems to have more correct information concerning LACP with its different modes of LACP especially the 802.3ad mode.
Great video. I have two lag setups between two UAP HDs and 24 port 250W Poe switch and lag between switch and Netgate Sg-3100. One note is that you have to setup lag downstream device before upstream lag or the connection breaks.
I havent tested with pfSense specifically, but if you only have 2 available port and your connected via the LAN, you can create a LAGG using the single available port, then swap your PC to the LAGG, then delete the LAN, then add the free LAN port to the LAGG. this way you dont lose connection while making the switch, and dont need to connect to the WAN port.
This worked on old FreeNAS Corral, so I assume it will work with pfSense
As always well done! Good job Tom
The hero I needed! Setting up a VPN device for about 50 users on one of those i3 4 port fanless 4 port machines. Now - I don't NEED link agregation, but it helps!
As always, great video tutorial! I watched a few of your clips before and I was wondering that I haven't subscribed yet...But I did this time ;)
Ben using an HP Procurve 24 port switch and have 0 problems running it with a 4 channel LAGG LACP setup.
Did some testing using a proxmox with lacp setup, and ISCSI drive with FreeNAS. Ran a virtual machine on that ISCSI drive and linux drive speed test was able to read close to 7gb/s write 3.5gb/s. I just slapped it all together and freenas had 8 ssd drives in raid 0. There was no production running on it.
I love my procurve switch, but it took me a couple days to figure out how to get it setup as there are no options in the web interface it had to be configured via putty and console cables.
Thanks for the video! I have a issue that popped up as of lagging 2 connections. I can no longer access any of my haProxy sites on LAN (sometimes they start working but when they do it takes approx 5 mins for the page to come up and sometimes it just timesout); i can only access them from the WAN. I have been going through your videos trying to find a fix. Before the lagg config. I also notice when i restart my unifi switch port for the lag - the sites will work fine via LAN as well BUT only for a few mins.
Thanks for the video. It demonstrates that LAGG is not that complicated to set up.
It is just a shame that pfSense does not allow the creation of a LAGG interface in the console. That would have help me many times when doing the initial install a new pfSense box.
It's easy to set up because he's using a Unifi switch, and Unifi switch configuration is SO easy. Doing LAGG on most switches is not easy.
@@scottluebke5012 hmmm...it's easy on others. unifi is confusing for vlans and lagg since they do things non standard. eg LACP on HPE Aruba and Dell OS 10 switches is easy.
@@psycl0pticfacts.
My switch freaked out and wanted to be adopted.. I lost all DNS.. it was scary.. just went back and gonna think this over.
Such a neat video! Thanks for the quality content 👍
Glad you enjoyed it!
So what is also effectively create a bridge for those two ports I'm assuming centering they both have one IP address and are on the same subnet of course?
I assume this could get a little dicey in an ipv6 world no? Or maybe some additional configuration steps would be needed. I assume reports would share the same link local and global addresses eh?
Hey, love your videos. I have a question if I may, is multi-WAN the same as WAN aggregation? I have a Motorola MB8600 and a multi gig subscription and would like to use WAN aggregation to achieve the higher throughput from my modem to my soon to be built pfsense box and then out of that to a multi gig switch. But I cant find a definitive answer to is WAN aggregation the same as multi-WAN.
Not the same more details here: th-cam.com/video/YjhEjWs8YzE/w-d-xo.html
@@LAWRENCESYSTEMS Thank you! I'm sitting here trying to figure it out. thanks!
wondering if I could split my Fiber 3go internet to two 1go ports on my pfsense to leverage that internet speed to all the house (2 swicthes, 3 WIFI routers, IPcam)...(I wish my pfsense box had 2.5 of 10 go ports but it don't) Advises, opinions welcomed.
Great content, Love It, Thank you !!
That only thing that I really wish Untangle had was the ability to create a LAGG for the switch uplink.
I should set up a pfSense box sometime just to play with it.
Where did you get those short cables? The shortest I've been able to find commercially is 0.5 ft. It appears to me those cables are shorter.
Those are .5 kit.co/lawrencesystems/homelab-rack-build/monoprice-cat6-ether
Tom, I have some open ports on my pfSense. Switch is a 24port Unifi.
Is it possible to configure LACP on pfSense and on Unifi and then move the vLan's onto the newly created trunk pair.
with a matching setup on the unified side ?
like to trunk 2 x 1GbE ports on both sides.
Yes
@@LAWRENCESYSTEMS found your video from last year...
just now need to develop "bravery" to action on my setup.
I have no Parental Interfaces listed in the box when trying to setup a LAG so I cannot select my OPT1 and OPT2 interfaces.
What do I need to do to get the Parental Interfaces listed?
I've definitely seen switchPORT failures, which is why I always try to make use of a LAG, when possible.
Hmm... I really want that Cat6 reinforced cable, but they're totally out of stock on the affiliate link :/
I found the them on the monoprice site though.
Nice tutorial, the only thing absent was some practical use cases, you mentioned but not showing some.
Got to save something for the next videos ;)
@@LAWRENCESYSTEMS Oh, great! well, time to wait then the next one.
do you have something like this for lacp trunk link pfsense to a dell powerconnect 5448
We need a way for you to make "choose your own adventure" versions of the videos. I needed this exact information last night...but for an SG-3100, not a 5100. I'm starting to suspect that LAGG is not supported for the built-in switch ports on the 3100 (LAN1..LAN4), only actual interfaces (LAN, OPT1, WAN). Can anyone confirm?
Found this video after playing with this earlier today. Got everything configured this morning and everything was great for about an hour then everything lost connectivity. The only way to get back up was to login to pfSense locally and restore a backup.
Did you ever find a fix for this?
@@homeassistantiptv8068 I did get it working. After I restored my previous configuration I set it back up and it worked without any issue the second go round. It's been running without issue for 3 months now. I think the issue I was having may have been with the ports I had originally chosen on my switch to setup the LAGG.
@@MatthewMcNair Thanks, i got mine up and running as well! I had done it as per the video but then what i did was delete the lagg setup on PF and re-did it and as soon as i hit Save - that did the trick. So almost the same as you where it took it the 2nd time.
What I've found with cable failures is 99.9% of the time a person is nearby when the cable 'fails', they then walk away and come back to deal with the 'failed' cable. i.e. People cause most cable 'failures'. Now if you use cheaper then cheap cables and gear YMMV. Cheap is not always about what it costs.
Interesting. I've tried almost this exact thing a couple of times in the past in my home lab with several different switches, with and without lacp, but without much luck. Each time things worked well for an hour or two, I saw the improved throughput (from multiple clients) and redundancy, but after that my network always started to get unstable. Random dropped pings, even between machines on unaffected switches, pairs of hosts that couldn't communicate (but could communicate with other hosts), DHCP failures, lots of entries in the ARP caches, etc. In each case, removing the lagg returned everything to normal almost instantly. Still haven't figured out what I was doing wrong.
have you figured or discovered anything with this issue? I am having the same issue
Have you activated LACP or used Link Aggregation without LACP (which is not as stable in case of misconfiguration)
How can I access gui via Lag Interface IP ?
Can this only work with a switch or can we aggregate pFsense with a NAS that supports LACP (e.g. Synology)?
Probably but I don't recommend routing storage.
You are a blessing.
How about WAN?
Would you assign 3 VLANs to 3 single interfaces or create a LAGG and assign all 3 VLANs to this one?
it depends on your use case.
I HATE that the console port on the XG6 switch is right next to port 1. I know it's a small device and not a lot of options as to where to put it, but dang Ubiquiti, move it more over to the edge or something.
Yeah, accidentally sticking in the wrong whole is annoying.
Where do you got that very thin ethernet cable?
th-cam.com/video/l6qK0uOKlF0/w-d-xo.html
What benefits is there for gaming with this? better latency? or just fail over?
Just failover.
I really don't understand why would anyone lagg to a router. Sure, betwene switches? Absolutely. From a switch to a storage or app server? Certainly. I did exactly that. But from a router to a switch? Usually link beyond the router has the least bandwidth avaliable to the network, so it would seem useless for most applications... Given that VRRP would serve as better solution (because you also plan for HW failiure).
In my case, my switch is rather basic so traffic between VLAN's goes to pfSense then back out to the other VLAN. If there is alot of traffic going across different VLAn, it will help. LAGG could allow my PC to connect to my NAS at 1gbps whilst allowing other traffic to flow smoothly. In my case i use a seperate port/cable/VLAN for iSCSI traffic, but a LAGG could achieve a similar result.
Excellent!
I need to learn how to do this with an old cisco 3750 switch
It's not too bad at all. Lots of videos about it on youtube too. Doing it with a 2960G and my pfsense box now. Basically in Cisco you would just create an etherchannel bond with LACP as active and connect it over. (make sure to only do it in powers of 2 though, so like 2 ports, 4 ports, 8 ports, etc). Cisco's algorithm with LACP doesn't get along with other configurations of number of ports.
@@DementiaAcerbus Thanks, good to know. I have 2 cisco 24port SW stacked. I plan on creating the etherchannel on the SPF ports on SW1 and SW2. I need to config them as trunk also. The change the config on the UDM-pro as well. I'm a noob to all of this and not an IT person by no means.
I don’t understand how to bring em1 (LAN) to em3 and create LAG with em1+2. just get kicked out of web GUI
This only provides redundancy on cabling, what about a config for pfsense with multiple switches which themselves are linked via MLAG?
yes, for better redundancy use multiple switches.
@@LAWRENCESYSTEMS I'm just hoping carp will run on a LACP interface (im planning on using two Netgate devices in HA mode), from what the pfsense guys tell me it should be doable.
great thans 4 U from Russia! I want 2 hawe 1 DHCP for 3 physical interfaces (virtual switch). is this metod acceptable for it?
DHCP works with LACP & LAGG
@@LAWRENCESYSTEMS works fine! thanks alot twice!)
DNS stopped working.. any idea?
Hi. I installed pfSense VM on ESXi. Can i do that on it?
I never tried
Is there any way to convert an existing vlan setup to vlans over a lagg interface without losing any of the rules I already have set?
Yes. Create your LAGG interface and add the VLANs to it. This will create new Network ports such as "VLAN 99 on lagg0". Then just change the port on the interface that you want to migrate from a single link to a LAGG from "VLAN 99 on ix0" (replace ix0 with your port name) to "VLAN 99 on lagg0". Since you did not change the interface (LAN, OPT1, etc.) itself but just its binding, all the rules will remain intact.
Dude! That's hilarious - your position as a videographer, does rather make things difficult for you, as you're continually facing away from the ports & their labels!
Yup, it can be a challenge.
< all about the fibre bonds
It's good to have plenty of fiber in your diet. :)
This comes out the same day as I realize the udm pro does not do lagg... :'(
Neither does the ER-4. No switch-chip, no LAG.
No, I wouldn't like to hire you Tom but I would like to see you produce videos on OPNsense and IPV6. Interesting that you don't, isn't it?
Use what makes you happy, but since OPNSense is slow on security updates compared pfsense lawrence.video/opnsense it's not really something I am interested in.
At first it looked like you had a green Mohawk.
Not really my style, but I might be wrong about that.
It would be totally natural on you. That’s a compliment. ;)
I clicked on this video thinking I would hear about how pfSense lags. lol
Second lool!
laggy interface lol
Hello Tom. Could you please put an Amazon link for the patch cords that you are using ?
@@rommeljjimenez You replied to me accidently. I think I can help you though. www.amazon.com/Monoprice-SlimRun-Cat6A-Ethernet-Patch/dp/B01BGV2C7U
@@davidg4512 Thank you!!!
first lol
Dammit, beat me by three minutes!