RAID vs HBA SAS controllers | What's the difference? Which is better?

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 ส.ค. 2024
  • I’ve been getting a lot of questions lately from people who are new to the data storage world. And sometimes there’s a bit of confusion surrounding the difference between a RAID controller versus an HBA controller, or “IT mode” controller. In this video, we’re going to compare RAID controllers and HBA controllers. We’ll start by discussing what an HBA SAS controller is and their anatomy. Then, we’ll discuss what a RAID controller is and the components of a RAID controller. We’ll then compare them and talk about their differences and similarities. And finally, we’ll discuss which one is better.
    Video index:
    0:00 - motivation for this video
    0:22 - overview
    1:07 - HBA = Host Bus Adapter
    2:24 - Anatomy of a Host Bus Adapter
    5:35 - RAID = Redundant Array of Independent Disks
    7:53 - Anatomy of a RAID SAS controller
    10:49 - Comparing RAID vs HBA
    13:35 - Comparing RAID vs HBA with ZFS (feature comparison)
    16:45 - Comparing RAID vs HBA with ZFS (pros / cons)
    19:19 - Which is better? RAID or HBA?
    If you'd like to support this channel, please consider shopping at my eBay store: ebay.to/2ZKBFDM
    eBay Partner Affiliate disclosure:
    The eBay links in this video description are eBay partner affiliate links. By using these links to shop on eBay, you support my channel, at no additional cost to you. Even if you do not buy from the ART OF SERVER eBay store, any purchases you make on eBay via these links, will help support my channel. Please consider using them for your eBay shopping. Thank you for all your support! :-)
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 176

  • @Alphahydro
    @Alphahydro 2 ปีที่แล้ว +13

    When I was researching parts for my server, the hardest part was choosing a raid card. Trying to determine what raid level to go with and an acceptable price was the most challenging part, and then I found ZFS and realized I didn't need exactly what I had been looking at.

  • @BennyTygohome
    @BennyTygohome 2 ปีที่แล้ว +6

    I really appreciate your channel. If i ever forget which card i need for particular purpose i can always rewatch one of your vids. Thank you.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +2

      Thank you for watching! Glad this channel has been useful to you!

  • @truthontech
    @truthontech ปีที่แล้ว +9

    Awesome video! This is the most unbiased explanation I've come across and will watch this often as part of my reference material. Was extremely concerned that my hardware raid implementations were not good enough and were obsolete. Really glad to have found this channel.

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      Glad it was helpful!

    • @lilblackduc7312
      @lilblackduc7312 6 หลายเดือนก่อน

      @@ArtofServer..If good deeds and trying to help people out has a 'payoff', I hope you get yours, handsomely! I don't know if you believe in that sort of thing. But, from the few video/tutorials of yours that I've seen, you earned it. You've saved me from a lot of uncertainty & indecision. 🇺🇸 👍☕ It looks like others have commented the same sorts of feelings.

  • @GallopTechGroup
    @GallopTechGroup 2 ปีที่แล้ว +1

    Great video! Thanks for taking the time to create it and help out !

  • @yimacs
    @yimacs ปีที่แล้ว +1

    Great video. Learned a lot. Especially like you people component in choosing between RAID and HBA! Brilliant.

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      Thanks! Hope this was helpful! :-)

  • @DP-je2sk
    @DP-je2sk 2 ปีที่แล้ว +2

    I love watching your videos. I learn so much from them.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Thanks! Glad you are benefiting from my content! Thanks for watching!

  • @amauryviera1179
    @amauryviera1179 2 ปีที่แล้ว +2

    Another great video. Thank you so much. Will be nice a video talking about the difference between raid, 0 1 10 5 6, etc and your experience with them with use cases.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +1

      Request noted. Thanks for watching!

  • @VitaliySunny
    @VitaliySunny 2 ปีที่แล้ว +2

    Very cool comparison. Thanks a lot!

  • @hanarhalwest5621
    @hanarhalwest5621 2 ปีที่แล้ว +3

    Many thanks from Erbil , awesome illustrations!

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +3

      Thank you! Wow, I didn't know i had viewers from Kurdistan!

    • @hanarhalwest5621
      @hanarhalwest5621 2 ปีที่แล้ว +3

      @@ArtofServer Many thanks 🙏

  • @willcurry6964
    @willcurry6964 ปีที่แล้ว +1

    So much information provided. Thanks

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      Glad it was helpful! thanks for watching!

  • @solewalk
    @solewalk ปีที่แล้ว +1

    You explained artfully. Fantastic!

  • @KolyaNadj
    @KolyaNadj ปีที่แล้ว +1

    Very informative and nicely explained. Good job.

  • @metrotechguru5863
    @metrotechguru5863 2 ปีที่แล้ว +2

    Excellent video. Thanks for your hard work.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Thanks for your kind words! :-)

  • @notsrynot
    @notsrynot ปีที่แล้ว +2

    So good! Thank you so much for this ❤

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      Glad you like it! Thanks for watching!

  • @connectarunkumar
    @connectarunkumar 2 ปีที่แล้ว +1

    Thanks for reminding those old golden days of my initial carrer with LSI.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      You are very welcome 😁

  • @clarencelamus441
    @clarencelamus441 2 ปีที่แล้ว +2

    Thanks for sharing and make this video, great job!

  • @sms9106
    @sms9106 2 ปีที่แล้ว +2

    Awesome video and great channel. Been in this business for many years and always can learn something.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +1

      Thank you! :-) What did you learn from this video that was new to you?

    • @sms9106
      @sms9106 2 ปีที่แล้ว

      @@ArtofServer I mainly only did Windows Server and Hardware RAID. Only recently started looking at TrueNAS solutions and now understand more about HBA's and how they function vs my traditional method.

  • @LucasCarroll0
    @LucasCarroll0 3 หลายเดือนก่อน +1

    Unbelievably informative thank you.

    • @ArtofServer
      @ArtofServer  3 หลายเดือนก่อน

      Glad it was helpful!

  • @GuillermoPradoObando
    @GuillermoPradoObando 2 ปีที่แล้ว +1

    What a great content. Thanks you dude for share us this useful information.
    I always I've been working with hardware raids but I want to test hba + zfs

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Glad you enjoyed it. Thanks for watching!

  • @reactor4
    @reactor4 ปีที่แล้ว +1

    Great video, keep up the good work.

  • @daniellundin8543
    @daniellundin8543 6 หลายเดือนก่อน +1

    Thanks! Learned a lot, appreciated

    • @ArtofServer
      @ArtofServer  6 หลายเดือนก่อน

      Glad it was helpful!

  • @JonathanSwiftUK
    @JonathanSwiftUK 6 หลายเดือนก่อน +2

    You hit the nail on the head.

    • @ArtofServer
      @ArtofServer  6 หลายเดือนก่อน

      Thanks! :-)

  • @ThomasTomchak
    @ThomasTomchak 2 ปีที่แล้ว +21

    While I’m not new to HBA/RAID cards, this video still filled in some holes in my knowledge. Some of the card specific details were helpful too. I didn’t know about the heartbeat light for example.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +1

      Hi Tom! Good to hear from you! Thanks for watching!

    • @OT-tn7ci
      @OT-tn7ci ปีที่แล้ว

      I know everything in the video.
      After watching the video lol.

    • @nagantm441
      @nagantm441 หลายเดือนก่อน

      Is there a way to disable the light?

  • @SQUID_Road_Glide
    @SQUID_Road_Glide ปีที่แล้ว +1

    Outstanding lesson. Subscribed

  • @woxit6107
    @woxit6107 2 ปีที่แล้ว +2

    Thanks for your time and effort. (22:19 lol)

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Thanks for watching!

  • @Gaspa79
    @Gaspa79 3 หลายเดือนก่อน +1

    Great ppt man thanks

    • @ArtofServer
      @ArtofServer  3 หลายเดือนก่อน

      Thanks man! :-)

  • @mahuubao
    @mahuubao 2 ปีที่แล้ว +2

    Excellent ... Well done ...

  • @j_taylor
    @j_taylor 2 ปีที่แล้ว +2

    Great explanation!
    I absolutely agree with your closing "most important" point. It's tempting to go for "the best" whether that's the fastest RAID or the fastest car. When things go wrong, what are you ready to handle?
    I'm off to cuddle with my retired Drobo.

  • @dtavares85
    @dtavares85 2 ปีที่แล้ว +1

    You ROCK!!! Thanks.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Thanks! Happy holidays 🎊

  • @lilblackduc7312
    @lilblackduc7312 6 หลายเดือนก่อน +1

    Thank you for this fine video/tutorial! 🇺🇸 👍☕

    • @ArtofServer
      @ArtofServer  6 หลายเดือนก่อน +1

      Glad it was useful!

  • @assortedwires8110
    @assortedwires8110 2 ปีที่แล้ว +1

    Got those 5 machines home last night. looks like 4 have the perc i/6 and one has the hba. Im stoked. trying to decide to go sata or sas for drives rn. big thanks to you setups moving right along and im learning a lot.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +1

      Congrats and have fun with your new machines! :-)

    • @dougm275
      @dougm275 2 ปีที่แล้ว +1

      I like SAS drives for labs because the pulled enterprise SAS drives are so cheap. As far as buying *new* SAS drives to store everyday data that I'll keep for years, I'm not so sure.

    • @assortedwires8110
      @assortedwires8110 2 ปีที่แล้ว +1

      I ended up finding and going with some used dell 600gb sas hdd's with caddys for 25 on amazon. best deal I found for filling up the r610s. Cant wait till they get here, Then i can start playing around with these raid controllers.

    • @assortedwires8110
      @assortedwires8110 2 ปีที่แล้ว

      @@ArtofServer Thanks! Fun indeed, Caddys came in the other day so i got proxmox up and running. Had a fun moment last night when i changed the vmbr0 ip and locked myself out of the gui. >.< lol As a linux noob i stumbled my way through command line but got it working again. currently working on figuring how to update the lifecycle controllers that are way out of date. been having some boot loop issues, may be brownout related. but figured i get those things updated either way.

  • @alexroman665
    @alexroman665 2 ปีที่แล้ว +1

    Yes! I would like a HWRAID deep dive video : )

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Got it. Thanks for the feedback!

  • @DesleaRJudd-od1qr
    @DesleaRJudd-od1qr ปีที่แล้ว +2

    Great video! It would be helpful to know more about this from a perspective of use cases other than RAID. I only need a SAS card to interface with a tape drive, and a few old SAS drives I have picked up in bulk lots from auctions. I don't use RAID for redundancy because I don't need always-on, my workflow is based on on- and offsite backups. I still don't really know whether one of these cards would be better than the other for my use case (although I do understand more about them in general, thank you).

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      If you need help understanding how the various HBAs available compare to each other, then this video might help you: th-cam.com/video/hTbKzQZk21w/w-d-xo.html
      what are you doing for on and off-site backups?

  • @rockinhocrespo3372
    @rockinhocrespo3372 ปีที่แล้ว +1

    Thanks brofor this video, is very detailed and very true. Old techology vs new, In my case I use both, i´m always learn from practice

  • @chriscampbell894
    @chriscampbell894 2 ปีที่แล้ว +15

    Is it true that if a raid card fails you need to replace with the exact same model to keep your data? If so, that seems like a pretty significant downside compared with a software solution.
    Loved the video, great presentation. Clear, concise and easy to follow.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +10

      That's a great question and it is not. I'll be making a video on that exact topic soon.

    • @woxit6107
      @woxit6107 2 ปีที่แล้ว +2

      You are being 'served'. 🙂 Check this here: th-cam.com/video/6EVjztB7z24/w-d-xo.html

    • @LubomirGeorgiev
      @LubomirGeorgiev 2 ปีที่แล้ว

      Raid is not backup! If you really care about the data you should back it up.

    • @DannleChannel
      @DannleChannel 2 ปีที่แล้ว +2

      @@LubomirGeorgiev You're not wrong, but replacing a single PCIe device and quickly resuming normal operation is always going to be hugely preferable to replacing the device AND restoring an entire system from a backup.

    • @LubomirGeorgiev
      @LubomirGeorgiev 2 ปีที่แล้ว +1

      @@DannleChannel I agree. It really depends on the raid controller used. I have been able to import a RAID array from an older Dell PERC to a newer one without issue. In that particular scenario, the server just died and we bought a new one and moved the HDDs to the new server.
      They have some documentation about this exact topic. I can only speak about PERC since we only use Dell servers.. No idea how other vendors manage this.

  • @BerkeleyTowers
    @BerkeleyTowers 2 ปีที่แล้ว +3

    Hey, nice vid..... Just a point though about the single most important point to me about RAID systems..... Unless something has changed and I've missed it, if you want to expand your RAID array, you have to stick with the same capacity disk (or waste capacity if you get a larger one). If your storage grows over time, having the ability to use dissimilar HD's allows you to expand as capacity goes up and price comes down. Your older smaller disks naturally get retired as they fail/get replaced. I changed to HBA/Unraid a decade or so ago and I've never regretted it for a second. It maybe an Unraid thing, but I tried multiple RAID cards in JBOD mode and never had any success. When I think of the money I dropped on fancy RAID cards, it makes me weep... HBA cards are so cheap secondhand these days, it's almost a no brainer. Oh, and whatever direction you go in, if you value your data you NEED a backup solution! Personally, I've gone the LTO tape way.........

    • @j_taylor
      @j_taylor 2 ปีที่แล้ว +2

      The hardware RAID controllers that I've used are limited to the least common size of drive as you describe.
      Software RAID is not, though. Basically, ReadyNAS and Synology (maybe QNAP too) partition your drives to make several RAID sets using common sizes.
      For example, suppose you have 6 drives: (3) 6TB, (1) 3TB, (1) 2TB, and (1) 1TB.
      All 6 drives get a 1TB partition = 6*1TB, then double parity ("RAID 6") = 4TB usable
      5 drives get another 1TB partition for 5*1TB double parity = another 3TB usable
      4 drives get another 1TB = 4*1= 2TB usable
      3 drives still have 3TB free each so that's 3*3TB = +3TB usable
      So, that mixed set with double parity gives you 4+3+2+3= 12TB data.
      Replace the 1TB drive with a 3TB drive. Now you add a partition on the new drive to the second TB set and the third TB set, so your new total is 4+4+3+3= 14TB data.

    • @j_taylor
      @j_taylor 2 ปีที่แล้ว +2

      Incidentally, Drobo and Compellent take a different approach. They divide every drive into small zones, say 1GB size. Then they maintain a bitmap of all the zones in the set, and distribute data across the bitmap. There's another layer where they manage the actual drives and track status etc. The result is that the total storage pool is more flexible and if it understands the filesystem, it manages data integrity and parity at the data level rather than blindly calculating every sector on every disk.
      There are drawbacks, mainly cost, but I think it's a really neat approach.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +1

      Thanks for sharing. I agree, RAID redundancy is no substitute for backups. Have that on my list of future video topics. It's good you found a solution that works for you. Thanks for watching!

  • @CMDRSweeper
    @CMDRSweeper 2 ปีที่แล้ว +3

    The last point is very very true... Which is also why I have been so slow at migrating my mdadm software RAID to ZFS.
    But as I have started using a backup for the backup strategy, I have the other half of it on ZFS and have interacted with it, and operated Linux root on ZFS, all to get familiar with it.
    Still, for Windows environments, ZFS isn't a good option yet, so there hardware RAID still reign supreme.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +1

      That's a very sound approach. Thanks for watching and sharing your thoughts!

    • @wildmanjeff42
      @wildmanjeff42 7 หลายเดือนก่อน

      ZFS pools on Truenas storage servers are accessable using SMB shares, and have all the data protection as far as data corruption or loss (if you provide for that in your storage setup).
      This is actually a lot better in my experience over many years vs. NTFS and FAT systems with windows.
      ZFS runs natively on FreeBSD (Truenas core) and has been rock solid. Truenas Scale is progressing very fast if you like linux (which I do but prefer truenas core since it has been rock solid for years and I already know it.... I need to try out Truenas scale though.)

  • @RankoKrneta
    @RankoKrneta 10 หลายเดือนก่อน +1

    @ArtofServer Sir, Thank you very much for this video! :)

    • @ArtofServer
      @ArtofServer  10 หลายเดือนก่อน

      Hope it helps! :-)

    • @RankoKrneta
      @RankoKrneta 10 หลายเดือนก่อน

      @@ArtofServer Yes it does. Oh man I wish you are closer, at least some country in Europe :D
      Is it possible to ask you some questions on private, like email or something?

  • @chriss377
    @chriss377 7 หลายเดือนก่อน +1

    Hardware raid used to be necessary to have large data arrays and speed. Major advantage was off loading parity to the controller. It was simple and with a hot spare sort of set it and forget it. ZFS and CEPH are much more CPU intensive but we arent working with sigle core cpus anymore. Nowadays I think GUI driven configuration and management like Proxmox offers are the better solution.

    • @ArtofServer
      @ArtofServer  7 หลายเดือนก่อน

      Thanks for sharing your thoughts!

  • @edwarddejong8025
    @edwarddejong8025 ปีที่แล้ว +1

    very sound advice to favor RAID for unsophisticated staff. the rebuild in RAID is basically automatic; just pop in a new drive and a day later all is back to normal.

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      yes, I believe a tool is only as good as the skills of the person using it. that said, RAID rebuilds are costly and put a heavy burden on the entire array. ZFS rebuilds (resilver) is data aware and only rebuilds what is needed so it can minimize the load on the system during the process.

  • @GiovanniCerra
    @GiovanniCerra ปีที่แล้ว +1

    thanks bro

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      Glad this was helpful! Thanks for watching!

  • @animry
    @animry 2 ปีที่แล้ว +1

    Hi great video... I'm new in this subject and im glad i came across your channel.
    I was trying to buy some cards blindly and now this video make me reconsider my setup.
    i have a question though, how is HBA compared to Sata PCIE expiation cards? everybody say they are rubbish and i have to go for enterprise grade cards but they dont say why?!
    im planning to use it for windows storage spaces (SSD pool drives)

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Glad it was helpful! With SATA controllers, you need to find good ones because there are a lot of poorly designed SATA controllers where there may be a lot of SATA ports, but they didn't design it with enough PCIe bandwidth to support that many SATA ports. Or, alternatively, the SATA controller chip cannot handle the I/O at load. There are probably some good ones out there, but it's very easy to find SAS controllers that are well designed.

    • @animry
      @animry 2 ปีที่แล้ว

      @@ArtofServer thank you.

  • @praetorian5499
    @praetorian5499 2 ปีที่แล้ว

    Your channel is the shit. Thank you.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      I hope that's a compliment? not sure... ? :-/

  • @cirniman
    @cirniman ปีที่แล้ว +1

    thanks a lot for your videos, I really appreciate them. I still don't see the difference between the IT-Mode on my PERC 730 in the BIOS and a flashed RAID Controller to an IT-Mode. Is there any?

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว +1

      The main difference between a MegaRAID controller running in "HBA mode" vs a true HBA firmware is the driver's behavior. For most use cases, the difference does not matter so you can often get away with doing that. However, "HBA mode" does not change the PCI ID, which is used to determine the driver to attach to the device. So "HBA mode" still uses the MegaRAID driver, not the HBA driver in the OS. In some OSes, the difference in driver may support different features. For example, I've seen low level access to the drives behave differently in some cases.

  • @farihafatima4206
    @farihafatima4206 2 ปีที่แล้ว +1

    informative video

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Glad this helped you! Thanks for watching!

  • @GrenPara
    @GrenPara ปีที่แล้ว +1

    Hello, Great video thanks for making it.
    I must have missed something thou as I dont know if card will work on windows 11 to add more sata drives as all ports taken on mobo.
    Also what HBA sas card is best for number of drives (not raid)?
    Thanks

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว +1

      Thanks for watching. I think your question is answered by a different video. Check out this video: th-cam.com/video/hTbKzQZk21w/w-d-xo.html
      Hope that helps you out! :-)

    • @GrenPara
      @GrenPara ปีที่แล้ว

      @@ArtofServer Hello, Thanks for the fast reply and help.

  • @rjvtechnologies
    @rjvtechnologies 11 หลายเดือนก่อน +1

    tip: use raid 0 for all disks and then use zfs that saves parity of the raid 0 on a different disk, a disk parity backup that can be used to restore a disk failure on a raid 0, config can be daunting but is doable

    • @ArtofServer
      @ArtofServer  11 หลายเดือนก่อน

      you mean like in this video: th-cam.com/video/S_YN1vluLws/w-d-xo.html

  • @HaloWolf102
    @HaloWolf102 5 หลายเดือนก่อน

    I had a PERC 6/i RAID controller, and I bought a PERC H700 card because the 6/i doesn't handle drives above 2Tb. However, out of the 9 drives that I had, the H700 could only make a virtual drive for 1 drive.
    You recommend RAID, but with my experience so far. I am gonna try HBA out because I can't get anything to work with a RAID controller.

    • @ArtofServer
      @ArtofServer  5 หลายเดือนก่อน

      I don't actually recommend one or the other. I recommend what best suits the need and the person responsible is most comfortable using when there's a bad situation.
      Not sure why your H700 only allowed you to create VD with just 1 drive. Could be that some of the other drives had some issues? If you still have the H700, make sure it has the latest firmware update.

  • @Raymond6494
    @Raymond6494 2 ปีที่แล้ว +2

    nice vib Thank you.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Thanks for watching!

  • @patrickprafke4894
    @patrickprafke4894 2 ปีที่แล้ว

    I've seen these 10 port sata pcie cards. Would these work as a zfs hba card? I literally have no clue.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +1

      If you're talking about those 10 SATA port cards with a PCIe x1 or x2 connector coming out of China, well, so long as your OS has the driver, they can sort of "work". However, you can imagine the I/O from 10 HDDs being squeezed into that PCIe x1 or x 2 connector isn't going to be a pretty sight.

  • @jeremycoe7259
    @jeremycoe7259 2 ปีที่แล้ว +1

    I have a T7910 w/ a internal SAS3008 RAID card w/ free ESXi. Im not using the RAID features, ie no raid levels configured. In that case, is there any advantages/disadvantages in flashing the RAID card firmware to IT mode ? Rgds.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      That's a good question. The answer depends on your software. Some OSes or applications don't have the code to access the SMART data behind a RAID card driver like the megasas driver and expect the HBA driver like the mpt3sas. In that case, you would be better off flashing that SAS3008 to IT mode. But if your OS is fully capable of performing it's regular duties even when using the megasas driver, then you are fine as-is. I talk a little bit about such issues in this video: th-cam.com/video/BgOcCCAzHiY/w-d-xo.html

  • @pivot3india
    @pivot3india ปีที่แล้ว +1

    can seagate exos SATA drives connect to LSI SAS controller ?

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      Most SATA-3 drives can connect the LSI SAS-2 or SAS-3 controllers just fine. However, there are some drives with known firmware bugs or other issues. Seagate drives seem to have the most such issues. If the Seagate drives you have don't have such problems, it should work just fine, otherwise it's a guess in the dark.

  • @manuell.5696
    @manuell.5696 2 ปีที่แล้ว +4

    dont forget there are FC HBAs!

    • @j_taylor
      @j_taylor 2 ปีที่แล้ว +1

      Haha true. For the home server audience, though, fibre channel might not be relevant.
      If they weren't so loud and hot, I'd love a FC SAN at home, maybe Compellent with a few drive shelves...yum!

  • @mithubopensourcelab482
    @mithubopensourcelab482 2 ปีที่แล้ว +1

    We seek you kind permission to re-produce the content in our local language. Your contents are great and deserves to reach to people who are not that much conversant to English.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      If you can translate to your native language and send me the subtitles, I can add them to my videos so people can read the subtitles in their native language.

    • @mithubopensourcelab482
      @mithubopensourcelab482 2 ปีที่แล้ว

      @@ArtofServer Where I am supposed to send sub titles ?

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      My contact info is on the "about" tab on my channel page.

  • @davebing11
    @davebing11 6 วันที่ผ่านมา +1

    will ZFSs arrays typically support 10GB ethernet transfers or 25GB links?

    • @ArtofServer
      @ArtofServer  5 วันที่ผ่านมา

      that highly depends on how you configure your ZFS pool, what type of transfers you are doing (sequential vs random, large blocks vs small blocks, etc.) and the performance characteristics of your storage devices.

  • @eduardonobrega77
    @eduardonobrega77 2 ปีที่แล้ว +2

    What about performance? Comparing raid 6 with ZFS raidz 2 with same amount of disks
    And is it right to say that if you need to expand the vdev you need to create a new one?
    With Raid i know you can expand the disks and have more performance by using more disks at the same VD

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว +2

      Yes, I've been thinking about a performance comparison as well! However, I haven't decided what type comparison would make the most sense? Something like ZFS is heavily influenced by the speed of CPU and RAM since it depends on it. So, the results can be very different depending on the choice of CPU and RAM. Also, what would be a fair choice for RAID controller to compare with? The SAS2108 mentioned in this video? Or, a newer SAS-3 RAID? But then, do we test SAS-3 SSD array vs SAS-3 SSD zpool? In that case, do we use ZFS default settings or special tuning for SSD? So many variables... it's not a simple comparison.
      ZFS currently is not able to expand a vdev for raidz type. You can add to mirrors for more replication. If you need more space in a ZFS pool, you can increase by adding more vdev to the pool, but it does not automatically rebalance the old data across the vdevs.
      Modern RAID controllers can expand RAID5/6 volumes, but it is incredibly slow.
      Thanks for watching!

  • @lazzer408
    @lazzer408 3 หลายเดือนก่อน +1

    Does ZFS support SGPIO signaling of the LEDs on the backplane? Does HW RAID? I feel that's important to know. Otherwise, how will you know if a drive member failed?

    • @ArtofServer
      @ArtofServer  3 หลายเดือนก่อน

      No, SGPIO and backplane LED control is not a widely adopted standard. Each vendor seems to choose their own way of doing things. If the hardware vendors can't decide on a common method, I don't expect the software layers above to handle it. You can however, write your own code to hook into ZFS and manipulate the LEDs (if your controller and backplane are capable) as desired for your specific setup.

    • @lazzer408
      @lazzer408 2 หลายเดือนก่อน

      @@ArtofServer I bought a 9260-4i and my LEDs are working now. RAID is configured in the management utility. If a member fails, the red light comes on. SO much easier then writing code.

  • @milhousevanhouten3048
    @milhousevanhouten3048 6 หลายเดือนก่อน +1

    When you were comparing hardware RAID vs ZFS, you left out a very important part about data integrity. ZFS uses checksums to guard against bit rot. Hardware RAID has a feature called "patrol read" which performs background scanning of disk blocks, but most documentation is very vague about the exact method. Does it use checksums like ZFS, or does it simply read data blocks without checking their integrity and if the drive returns read error, only then it attempts some sort of recovery?

    • @ArtofServer
      @ArtofServer  5 หลายเดือนก่อน

      That's a good point to compare too. However, I think it's a bit more complicated. HW RAID uses both patrol reads and consistency checks to ensure data integrity, and has parity or redundancy to attempt recovery. ZFS is similar, but uses checksums on each record block and does it all in RAM. It's not trivial to say which is superior. For example, if you're not using ECC RAM, ZFS can really mess up checksums in RAM without knowing it. So at some point, ZFS depends on hardware error detection/correction. HW RAID basically just does all of that within it's hardware. Either way, it's a good point to mention, but I think it warrants a more in-depth discussion.

    • @milhousevanhouten3048
      @milhousevanhouten3048 5 หลายเดือนก่อน

      @@ArtofServer At least for my RAID card (LSI 9261-8i) and RAID0 virtual drive, patrol read only checks for "media errors" which does not involve any checksum verification. In fact, patrol reads on SSDs are disabled by default. Without ZFS, the hardware RAID will never detect bit rot, unless the disk firmware detects it and returns read error. The consistency check is even less effective.

  • @Nate-qc8kb
    @Nate-qc8kb 10 หลายเดือนก่อน +1

    Could anyone weigh in on the 2TB limit? My end goal is 24 x 20TB 3.5" SATA drives. Right now I have a Dell PowerEdge R730 which only has 8 bays, all of which are full. I'm looking for a new chassis and ofcourse HBA that can support 24 drives with 20TB capacities..

    • @ArtofServer
      @ArtofServer  10 หลายเดือนก่อน

      See this video th-cam.com/video/u55vIGMzzKw/w-d-xo.html

  • @UnkyjoesPlayhouse
    @UnkyjoesPlayhouse 2 ปีที่แล้ว +1

    Drive Bender for windows and for the win :)

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      If you haven't already, you should make a playlist of your videos on drive bender. Thanks for watching! :-)

  • @gabriele8332
    @gabriele8332 2 ปีที่แล้ว +1

    so JBOD=HBA and we don't need to flash in IT mode raid cards that support JBOD?

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      From a hardware perspective, that's true, but you'll need to enable JBOD mode in your RAID controller and configure JBOD drives. However, from a software perspective, some are more particular. For example, watch this video: th-cam.com/video/BgOcCCAzHiY/w-d-xo.html

  • @edwardallenthree
    @edwardallenthree 2 ปีที่แล้ว +7

    A raid card is like an electric screwdriver. An HBA is like a screw bit. ZFS or software RAID is like a drill.
    If you have ZFS (a drill), you want an HBA (a bit). If you don't, you may want a RAID card (an electric screwdriver)

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      That's not a bad analogy!

  • @Matlalcueitl
    @Matlalcueitl ปีที่แล้ว +1

    If you have only RAID cards and not HBA ones you can always make RAID cards act as HBA ones by setting up JBOD mode or RAID0 on all individual disks and then make a ZFS pool on them. It's not as fun as having HBA card but still.

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      yes, I've demonstrated that in the past in this video: th-cam.com/video/S_YN1vluLws/w-d-xo.html

  • @pivot3india
    @pivot3india 9 หลายเดือนก่อน +1

    How can we have dual HBA controllers for redundancy ?

    • @ArtofServer
      @ArtofServer  9 หลายเดือนก่อน

      You can, but you need to have a dual port backplane, and either SAS drives or SATA drives with SAS interposers.

    • @pivot3india
      @pivot3india 9 หลายเดือนก่อน

      @@ArtofServer do you have any video on how to do this ?

  • @markshade8398
    @markshade8398 ปีที่แล้ว +1

    Great info and we'll delivered. But.... Way toooooo many commercials.

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว +1

      Sorry about that. YT has been aggressive with pushing ads lately, especially on my more popular videos. :-(

  • @3ALEGIONS
    @3ALEGIONS 6 หลายเดือนก่อน +1

    Easy to understand video on TH-cam...

    • @ArtofServer
      @ArtofServer  6 หลายเดือนก่อน

      Glad it was helpful! Thanks for watching!

  • @rufusmurphy9990
    @rufusmurphy9990 2 ปีที่แล้ว +2

    Art of Server : the next generation 😂

  • @thenanook
    @thenanook ปีที่แล้ว +1

    you save me 1 hr in google , thanks

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      glad to hear it! thanks for watching!

  • @GW2_Live
    @GW2_Live ปีที่แล้ว +1

    ZFS Still can't even add a device to vdev, this is still the only major issue with zfs IMO

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      That is true, but it's work in progress.

    • @GW2_Live
      @GW2_Live ปีที่แล้ว

      @@ArtofServer honestly with what it does above and beyond other file systems it's something I'm willing to deal with, still does drive me a little nuts though

  • @daanw6270
    @daanw6270 หลายเดือนก่อน

    All I wanted to do was set up a little plex server, but here I am, balls deep in some advanced server shit which only confuses me more, lol

  • @wangyi6854
    @wangyi6854 2 ปีที่แล้ว +1

    I will choose RAID. The ZFS recovering process is totally a disaster.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Sounds like you've had some painful experiences?

  • @profjake
    @profjake ปีที่แล้ว

    i understand your point BUT zfs on top of raid OR just plain raid is not nearly as robust or secure as zfs. Here is why.... first, if raid card fails, you lose the raid array structure. It is not as likely but I have seen it happen. 2nd, the drives are tied specifically to that raid card and that machine. Many techs dont realize this but you can remove zfs pooled drives from 1 machine, RANDOMLY place them in a new server, into ANY physical position, and as long as that server can read the drives, you can import the raid and you are back in business. The drives are individually marked as to their zfs membership. 3rd, raid cards are not (easily) ugradeable. You are limited by their processor and ram installed on that raid card. ZFS raid relies on the server CPU and ram and can be tweaked so technically it can be MUCH faster than a raid card. 4th, ZFS raid is much more robust. It is DIFFICULT to destroy a zfs pool, like if u put a zfs pool member ina different machine and try to add it to an existing or new raid, it will warn you AND even tell you the pool name that this drive previously belonged to. Additionally, zfs drives dont have to be the same brand, type, form factor, size.. i.e. you can mix and match sas, sata, 2.5, 3.5, scsi, etc...not always a good idea for performance but in a pinch you can stick in a sata drive to replace a failed SAS drive until you get a SAS replacement. I LITERALLY did this just today. ALSO, zfs pools can be more easily expanded. On the other hand, with hardware raid, it is really easy to "mess up" and lose your raid. PLUS you can't always manipulate the raid from within the OS and it requires a reboot into the raid bios to do anything. WITH zfs, the OS is aware of it and can control it. You NEVER have to STOP your machine to manipulate your zfs pools. This is CRITICAL for our VE platforms where we are running dozens of mission critical vms and containers. So IMO, you are MUCH safer using ZFS pools than hardware raid. Yes there is a learning curve BUT if you can get a low level tech to swap a drive out physically, if they arent savvy enough to rebuild the pool, u can always get a tech to remote in and do it.. like I am doing right now! The only thing I would stay away from with zfs is boot drives. Either do a hardware raid or nvme boot, or a small separate zfs mirror for your boot, but your primary storage which does all the work, should be a separate zfs pool. I have learned this from MANY years of experiences, good and bad.

    • @ArtofServer
      @ArtofServer  ปีที่แล้ว

      I'm not sure what you are referring to? I never talked about ZFS on top of RAID?
      Also, I think you'll find this video interesting: th-cam.com/video/6EVjztB7z24/w-d-xo.html

  • @piotrprs572
    @piotrprs572 11 หลายเดือนก่อน +1

    it's not that simple .... HBA is more demanding solution for cpu power. You can easly get around 50% cpu utilization on HBA matrix.
    So you need 1 comp. for HBA matrix only. It's good when you make you own NAS. But raid controllers are good when you do some server stuff with some of redundancy. So in my opinion... HBA => NAS, Raid -> Server operating systems.

    • @ArtofServer
      @ArtofServer  11 หลายเดือนก่อน

      I don't understand your logic. A "NAS" is a "server operating system" for a specific purpose. So, by your logic, both "HBA" and "RAID" controllers are suitable for "NAS", which is a server operating system. ;-P

  • @liudas000
    @liudas000 2 ปีที่แล้ว +1

    Long story short - RAID card does HW RAID and HBA does SW RAID... All looks fine as long as you dont use VMware, because ESXI doesnt support SW RAID at all...

  • @abidsaleem6149
    @abidsaleem6149 2 ปีที่แล้ว

    RAID controller is "single point of failure". If RAID controller is failed your data will be lost. You need to have redundant RAID controllers.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      That would require a more complicated ring topology SAS setup. I don't think that applies in this discussion.

  • @artlessknave
    @artlessknave 2 ปีที่แล้ว +1

    teeeeechnicallly, there is no such this as "hardware RAID" since all RAID is software. RAID cards just have dedicated hardware for running the proprietary software that calculates the RAID.
    using proprietary software "hardware RAID" can create vendor lock-in, with that specific vendor, or even exact card, being required to even access the data. something like zfs doesnt have this.

    • @ArtofServer
      @ArtofServer  2 ปีที่แล้ว

      Stay tuned for a video showing how the vendor lock-in is a myth.

  • @binks3371
    @binks3371 10 หลายเดือนก่อน +1

    smash thumb down button twice, lol