Adventures in Motherboard Raid (it's bad)
ฝัง
- เผยแพร่เมื่อ 4 ส.ค. 2021
- **********************************
forum.level1techs.com/t/criti...
Thanks for watching our videos! If you want more, check us out online at the following places:
+ Website: level1techs.com/
+ Forums: forum.level1techs.com/
+ Store: store.level1techs.com/
+ Patreon: / level1
+ KoFi: ko-fi.com/level1techs
+ L1 Twitter: / level1techs
+ L1 Facebook: / level1techs
+ L1/PGP Streaming: / teampgp
+ Wendell Twitter: / tekwendell
+ Ryan Twitter: / pgpryan
+ Krista Twitter: / kreestuh
+ Business Inquiries/Brand Integrations: Queries@level1techs.com
IMPORTANT Any email lacking “level1techs.com” should be ignored and immediately reported to Queries@level1techs.com.
-------------------------------------------------------------------------------------------------------------
Intro and Outro Music By: Kevin MacLeod (incompetech.com)
Licensed under Creative Commons: By Attribution 3.0 License
creativecommons.org/licenses/b... - วิทยาศาสตร์และเทคโนโลยี
![[LIVE] : ONE ลุมพินี 69 | คู่เอก "กุหลาบดำ vs นาบิล"](http://i.ytimg.com/vi/PNM6U8e_HMo/mqdefault.jpg)
![[Live] : ONE FIGHT NIGHT 23 | คู่เอก "เร ยุน vs อาลิเบก"](http://i.ytimg.com/vi/ClLQVYWSrUk/mqdefault.jpg)
RAID works by having multiple legends and heroes living in the shadows.
Hahaha
RAID SHADOW LEGENDS!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
GET OFF OF MY HEAD!!1!1!!1
Boooooo
The one time I would have accepted a raid shadow legends sponsor spot
Never since a security bios patch update ate my entire array.
A bios update for my Sabertooth X99 would cause drives to just drop saying they were bad even though they weren't. I caught this before I lost too many. Not all were as lucky sadly.
This man goes through so much pain so you don't have to. Only total respect.
The only raid I would EVER do is raiding the pantry for orange soda and snacks.
nvme for the win beats raid 10 fold for speed atleast
@@raven4k998 but what if you raid 0 two nvme drives
@@Zellonous I was kidding child Raid is just for no reason at this point cause it no longer does anything other then use the word raid and compromise your data cause people no longer care aboot raid to save data integrity
@@Zellonous then you raided two nvme drives for what reason????
I am taking classes for my IT A+ certification tests, and we just started talking about RAID this week!!! Thanks for the info!!!
Good luck on your exam!
"Hard won experience" - This... I felt this when you said it. So many nights working through the AORUS RAID tools both SATA and Nvme. So many more nights making server 2019 Core work with an AORUS board to begin with.
Oh man even better we were doing this at the same time roughly it seems... ~4 weeks ago I built 3 AMD RAID systems to move CHIA plots long term and also had one with weird performance that turned out to be ONE BAD CABLE. New cable from a box of 6 and 1 just wasn't up to the job.
Aorus boards are junk. I will not buy one again even if they have great caps
@@timothygibney159 to each their own. Gigabyte has always gone above and beyond for me with the couple of RMAs I've had in the last 15 years and the only complaints I have are about RAID which is more AMD and Gigabytes choice of certain Intel LAN and WAN modules. Some aren't compatible with certain OSes due to driver silliness by Intel.
Of all the board vendors, Gigabyte has earned the most credibility with me and 4/5 systems in my home run on their boards. The 1 other is an ASROCK build.
@@daemonfox69 I have to keep taking the cmos battery out once a week to keep it booting. My 2nd nvme drives keeps disappearing and this is the 2nd gigabyte board with the same problem. They won't rma their boards either
I've also had good experiences with Gigabyte, not enough to say it's my go-to, but if it's an option I'll definitely consider it.
But I wouldn't use an Aorus as a server, tho.
"Intermittent" the worst thing to hear when talking tech.
Can you do a comparison between file systems that support raid (ZFS/Btrfs) and also solutions like intel rapid storage?
Thank you for bringing this up. I spent a lot of time struggling with RAID on my x370 gigabyte board and ultimately I just had to ditch the idea and bought a larger SSD with a huge gaming/backup HDD.
Growing up I got into so many re-install scenarios with my PC builds due to my own ignorance about RAID. One particular build in the early-2000s I was doing a RAID 0 setup with two WD Raptor 74GB drives using a PCI (not PCIe) RAID card. I reinstalled Windows and games so many times troubleshooting corrupted drives that to this days I remember the majority of CD keys for my big games from that era.
Since those days I've generally stayed away from using RAID, although recently I started messing with ZFS and Windows Storage Pool stuff. Thanks for yet another fun video, L1T!
This is super informative and delivered in an entertaining way as always, Wendell!
My workstation runs 4 905P drives mounted on a Hyper 16X in VROC RAID 0. The performance was pretty untouchable when considering both sequential and 4KQ1T1 until the P5800X came out. After some tuning and OCing I get 200-220MB/S 4KQ1T1 read which is nuts for a drive that also has insane sequential read.
Could you do a video explaining the scaling issues with Optane for the consumer? It's very fascinating how much that segment has stalled. As we move more and more to the cloud at a consumer level, you would think a 128gb-256gb optane-only computer system would be the end-goal for consumer performance.
Is there a follow up to this? Also is there is a way to enable logging of these errors in the AMD system!?
I wonder - IF I plan to make really fast cache disk for my AfterEffects - should benefit - if system is not on raid?
So do you recommend Windows software raid? One big issue with Windows software raid is that whenever the PC is shutdown uncleanly (like a crash), windows wants to do a full sync again. And when using something like a 12 TB HDD, such a full sync takes 50 hours or so. And it restarts whenever you restart your PC. Now when you PC is never running for 50 hours straight, that full sync can never actually finish, and you hear HDDs working the whole time while using the PC. It's not great. I haven't found a solution or better way for that yet.
Would you be able to test a Highpoint Rocket RAID card to compare the difference? I don't quite understand how much work it really does. I'm using a 2720A and upgraded from a 2680.
Do you happen to know if any of these microcenter ssds have dram cache? I spent a while looking and couldn't find anything concrete lol
15:35 Makes sense. I once had a MOBO SSD RAID0 (using two earlier Sandisks) on a MSI 990FX board for boot and OS (WIN10). It was good performance when the Raid was new but over time the writes slowed to just 150MB/s coming from over 600MB/s. The reads were not affected much. I even thought the disks were getting 'worn out' but I removed them from the Raid and formatted then and turns out the disks were pretty much good the same. Maybe TRIM issues were the prob.
Question, isn't the disk manager raid in windows single threaded and they recommend a storage space to take advantage of additional cores/threads?
Correct, the dynamic disk software raid used in disk management is considered obsolete/depreciated/legacy by Microsoft at this point (as you would expect as it was introduced in Windows/Server 2000!) and was replaced with storage spaces.
Im curious how this translates to Threadripper systems. My Zenith II has 5xNVME slots, all of them on the CPU, Im using 4x500Gb NVME drives in a quad RAID0 and I was able to get the expected throughput using custom testing in IOmeter but Crystal Disk Mark was....lets go with "random" at best for the numbers it spat out.
Would it be worth me using an Optane drive on its own for my bootable drive in that 5th slot and then use Windows RAID for the 4xRAID0 drives and bypass AMD's driver all together?
You just saved me a ton of time! Thank you so much! I have a question though, if anyone could help.
I recently built a new Ryzen 5900X + RTX 3070 + MSI X570 Tomahawk multipurpose system. Crucial P1 NVME as a boot drive (good enough for me) and a Seagate 2TB HDD for storage. I will add a NAS to my setup some time in the future. But I wanted a large-ish drive for games (non critical data) that would be at the same time relatively fast compared to a regular HDD and cheap (also environmentally friendly; I'll explain).
So, I have a few 500GB HDDs lying around that I got for free, were not in use, and could be considered e-waste. I decided to populate all remaining SATA ports on my MOBO with them and make a 5 drives RAID-0 array as my games drive using Windows Disk Manager's RAID giving me a fast-ish 2.5-ish TB games drive. It's working fine. So much that I delayed testing the MOBO RAID indefinitely. My question is: does this setup make sense to you? Is there anything that I could do better?
Thanks again! Great content
Hey Wendell. What about 4xoptane NVMe drives in raid 0 as a windows boot drive? I think max are 64gb each (I have 32gbs).... But wondering if that beats the primo cache solution you have?
Since trying RAID 0 & 1 many many years ago and having issues (on HDD’s), I never went back to using it for my home / gaming pc’s. I’m not into IT and tech support etc which some of these RAID options for businesses has it perks. Great video thou. Appreciate the work you do on this channel and the love your content 🥰🥰
Is Intel RST and VROC at a "lower level" than OS software RAID? So even less latency? Sorry if you answered already.
I'm a big fan of the linux raid10 with the F2 layout, even with just 2 drives. Read performance is identical to raid 0, write identical to raid 1. Not sure if it still matters with fast SSDs (compared to the near-2 layout), but I don't really see any downsides.
I run a RAID 5 with a RAID 10 cache in front, it's excellent.
@soyel94 Raid 10 requires 4 disks not 3. Raid 5 just don't do it. Drives fail on rebuild. Raid 10 is superior to using parity when it comes time to rebuild.
Wendell: "Theres something wrong with the reads"
Me: LITERACY!!
i love how youtube's compression had so much trouble dealing with your shirt
Well, I agree, RAID on motherboards hasn't been overly hot. But doesn't using RAID on SSD's pose problems with Trim and also increase (exponentially) write amplification?
Depends on the kind of RAID and the parity type you decide to go. Raid 0, 1 and 10 would probably pose little to no issues for SSDs, it would be the ones that contain a parity on each device for rebuilding, and when it comes to rebuilding the RAID it would potentially cause other issues. ( Just using what I was told in school )
Edit: I wouldn't know much about trimming though
I imagine non-NAND flash drives would fair better.
RAID5 has natural write amplification because changing 1 byte, requires reading in blocks on another disk and then calculating parity and writing that too.
RAID10 and increasing the disk budget was always a better option, as simplicity saved more than doubling disks
Trim and optimization works with raid as long as the array isn't dynamic
Great vid as always. Also loving the background music. Sounds like bopping through cyberspace. Anyone know what it is?
Hello! This song is called Vital Whales by Unicorn Heads. I found it through the TH-cam audio library. ~ Editor Autumn
so on my epyc system with unraid is AMD suppressing sata errors? most of my drives are on the PCIe raid/IT mode controllers. i tend to raid large spinning rust drives. i tend to use real raid controllers but, i get the feeling a windows raid would be fine for 4x HDDs
Could you make a video or point me to a video on zfs for / ?
We have SM and Dell PE servers in our environment that primary use ZFS for their data stores however for root we then do a md raid1 for that bit of reliability and if I could have a one size fits all that would be wonderful :P
How how do you feel about linux kernel raid versus RAIDIX with consumer nvme drives?
When you said computing in the future did you mean the P5800X or the older
Optane memory sticks?
Great intro, Wendell.
Yes, we do come for the rambling. :3
so is it better to use os driver, mb chipset driver or nand driver? (currently using Micron SSDs 2.1.18.0 nvme driver)
I have had fuzedrive completely blow out a partition of mine necessitating a complete system reload (without fuzedrive)
Was it a boot drive? Caching a boot drive from my experience is even riskier than raid so many issues with Optane as well. Ended up reverting many people to just straight NVMe boot drives.
The writeback caching inconsistency isn't so much about whether the drives are silvered, it's about whether the writes happen in the correct order. ie when doing an atomic mv of one file over another, writing the metadata for the mv before writing the data of the new file to disk, resulting in an atomic obliteration when the software stack expects this to be impossible and applies no other mitigations. Writeback allows things to be written out of order, ie not synchronously.
How about file system level raid like with zfs or btrfs?
How does that translate if you dual boot? Will software raid work on both systems for non boot drives?
The Highpoint 370 controller and VIA RAID found on my old motherboards really does look as if it was done well by comparison. Though their main problem was the PCI bottleneck.
Thank you for this video! Your wording is straight and to the point without being too meandering. Even when you have little asides you're keeping each one to the point. You rock!
I wanted to set up a non booting RAID with a B550 aorus master board, dug up and installed 2 unused spinny 1TB drives, etc. but stopped when I learned that even a BIOD update can damage the array. RAID plan dropped.
Please guide on what could be a good (and safe) solution for a machine that dual boots between windows 10 and Linux ubuntu 21.04. I want redundancy and speed so that I can use it as a data location along with my main M.2 980 pro 1TB drive. I have an old PCIE SATA expansion card, maybe that will free me from the BIOS update array loss threat.
Intels Marketing also blocked NON-Intel NVME drives from working on Z590 platform.
that was fun. tried two 480gig optaine drives on a Gen 1 threadripper using amd raid.....intel forever lost points on that move. all my servers are epyc now.
Have had two 2TB intel 660p m.2s in raid0 across z370 and now x570 for years now. x570 was a little bit of a pain to setup but intel was effortless. Have had no issues /shrug
(Just wanted one 4TB drive was sick of multiple drives, everything of value is stored on NAS so if the volume dies whatevs)
Intel Matrix Storage is nice in that the metadata format is supported by Linux (via mdadm) so it is a shame it cannot be relied upon. It greatly simplifies setup when you need to boot from the array.
Well this validates the mess I got into trying to RAID 1 some "data" drives in conjunction with some other drives in non-RAID (AHCI mode). OS was straight up non-RAID on the M.2 drives, same mobo. Serenity now! Luckily no data was lost but did take some time to recover, my itching for a RAID controller seems well founded now.
@Leve1Techs Which driver did you use for AMD RAID on Linux? Is there a new one? Or just the 17.2.1 that is over 4 years old ?
I had 3 3TB WD red drives with hardware raid and mdadm and I prefer the latter by a lot, but now decided to move to unRAID and its simple array. I am unsure about the performance. Can't remember the hardware raid much, but mdadm pushed 75mb/s I believe and unRAID seems slower.
Quick question: would having 2 mechanical disk instead increase the read speeds in Raid 0 & 1? These issues seem to be when using NVMe/SSDs
Yes, but you'd still need ZFS for integrity so motherboard RAID is still pointless
How about RAID on dedicated external controllers such as LSI 9360 series. Worth it or same as motherboard RAID?
working with raid fairly frequently and tbh aside from the drivers you need to install (especially ryzen if its the OS drive) i dont particularly have an issue. that is until the whole 10th gen cpu with 1st slot nvme issues.
Revisit on x670e? Amd also says there is different drivers for different cpu. Did and cc? Been a year they had to have fixed bugs by now and new platform.
Then a purpose designed RAID controller board is the way to go, just wondering if we were to rewrite the RAID controller software to get rid of the bugs.
Thanks for your time and effort.
That made me think of the time I built a Windows server with motherboard RAID, and Windows refused to enable disk cache because it didn't see a battery backup. It was the slowest new install I've ever done and there was no fix at the time.
I cannot tell you how much I appreciate the time in and the effort!
I am currently upgrading to trx40 and have plans to use a raid card.
I will take your advice to heart Wendell.
Will use windows to configure the raid 0.
Undecided on weather or not go with a bootable raid.
The only advantage that I am aware of is faster boot times.
Thank You Again Wendell!!
I would Sub to the channel........ but I already have.
I use a raidcard in my wks, running raid 6 on 4 15000rpm discs. bloody fast. it's used as a local datadisc, that regulary writes to a zfs system.
it writing to the zfs array, the whole system literally needs to wait for the 1gbit connection most of the time, the raidcard is only a 3gbps controller, fast enough for local
I currently have my OS (Win10) installed on a RAID0 array with 2x500GB SSD's, using the Gigabyte motherboard onboard RAID. Thinking about adding another 2x500GB SSD's and switching to RAID10. How much will performance change? In case it matters, this is a 12-year old custom build with an Intel 3770K, and it's a bulletproof workhorse. Never failed once in 12 years.
Problem with windows software raid if you have a unclean shutdown, it assumes it needs to resync data and so you get a slow rebuild forced on you, and I found out from Macrium documentation a while back that dynamic disks in windows are depreciated. So I stopped using it.
However software raid in Linux and BSD is awesome, and I stay away from hardware raid and onboard raid systems.
True, but only on mirrored drives. The striped drives are not affected.
i wonder if they have fixed these issues yet? i am concidering doing sata raid0 over a nvme raid0 on x570 or maybe even wait for x690/x790 if they make that..... yes i put 90 for a reason i think tr40 should go away and bring back max pcie to desktop. :)
I read the Intel board raid works with non-intel SSDs if you get the more expensive key.
ZFS: I'm RAID but cooler
Bootable raid for Windows might be possible through a alternative EFI bootloader on a pendrive a bit like booting nvme without motherboard support.
TRIM appears to be working on my system - but Optimize Drives (defrag) shows my NVME RAID 1 array as a "Hard disk drive". Is that problematic?
Would another use-case for motherboard raid be a shared storage array in a dual booting system?
If you need RAID *and* don't want a hardware controller *and* want to dual boot then yes. Most setups don't tick all three boxes though.
When discussing Windows Raid it would be helpful to clarify the two types, that through disk manager, and those via Storage Spaces. Worth mentioning that some features are depreciated - for example spanned disks. Storage Spaces is the preferred method for Windows software Raid. For me you can't beat hardware raid with a decent memory cache and battery backed write caching. RST motherboard using Raid 0 is a fast option, but no data resilience - good for test/lab systems only.
Had two 3tb drives die in raid but thankfully already transitioned all of the storage to the cloud and no employees were using the share drive anymore.
Only thing you'd mix is with unraid raids but yeah still latency is huge issues and that causes data transfer rate over the network to tank and be slow as hell.
I'd never recommend raid outside of Nas backups that are changes only.
Well this leaves me stuck lol.. I have a hw raid card that I was thinking of moving over to the onboard z68 chipset.. Now Im not so sure..
I used onboard raid 0 for a pair of raptor drives back in the day for my games and OS but now with ssds things like that just aren't necessary.
Would enjoy a review of all the x570 Mobo's out there - specifically the ASUS ROG STRIX x570e-Gaming.
Watched one of your old vids, you mentioned Sun Microsystem Sparc Servers, yup, that took me back couple of decades....
Nice to have a clear answer. Thanks
For me, the only RAID that works, at affordable cost, is Linux md raid; you can setup a raid 1 root system drive as long as you have a separate non raid boot partition to store the kernel , bootloader and initramfs. For data, it just works as expected and is rock solid as long as you check periodically the drives status or report drive errors by mail for example.
Kinda think that in most 'ordinary' states - the SSD has kinda killed some of the reasons for RAID, and provide good speed out of box. The protection.. while valid, is equally well done by backup, which you still have to do if you choose RAID..
Note - I'm saying the above for ordinary. For server, or special soup - RAID still have magic sauce you might chase down, but anyways..
Is it possible for grub or other boot loader to be able to boot Windows/Linux from media from which the Bios has no boot support such as Software Raid, or in my case PCI-E NVMA?
Assuming Grub is sitting on the media for which BIOS has no boot problems.
Hi. On Linux you only need one boot partition (/boot) as non raid to store your boot files (kernel, initramfs and bootloader such as grub). Then all the rest of your system ( root drive /, /home etc..) can be stored in different raid volumes. For example, I tend to use this scheme on servers: one /boot partition (non raid) + one alternative /boot2 partition on a second drive (non raid but synched periodically using rsync), a raid 1 volume (two partitions, one per drive) for the root filesystem / and one raid 5 array (at least 3 partitions on 3 drives) for your data in /home. There are several tutorials on how to do that for the different linux distributions. It is usually supported for all "server" distros but it can be a bit complicated for a regular desktop install...
The very famous FIO test is running in the background of CrystalDiskMark. If you are try to benchmark the device using FIO directly, you should get the exact benchmarking experience or the actual read and write speed.
about F'n time you guys talked about this. I had to find out this the hard way myself.
Motherboard BIOS fake RAID was a huge waste of time, and buggy AF on my X399 MEG Creation. Windows (also fake) RAID is the way to go with a PCIe Expander card.
My intentions was just to get max READ/WRITE speeds with RAID0. Wasn't bold enough or wanting to deal with hell of making it a bootable RAID so I didn't go that route.
I revived an old server using a 6 SAS enterprise grade HDD single raid 10 array (3 TB usable) for everything - boot and storage. I tested with simulated HDD failures and its very smooth and stable. When replacing a drive, it was seamless with no noticeable effect on performance during the restoration process. I used a perc raid card but I'm sure it would not have been as smooth with motherboard sata raid.
i tried raid with 2 500gb m.2 one of them was my boot drive which might have changed something but i thought it would just erase the 2 (Raid 1 Mirror) and i would be able to boot off a usb and have it work but my system refused to boot and would just bluescreen and this is after i configured the boot order. so definitely not worth the headache
So in the situation where I want a bootable NVMe RAID on an X570 MB using something like 2 WD SN 750 1TB SSDs to give a 2TB array, and I'm doing this because RAID 0 on my board shows excellent results (exceeding PCIe gen3 X4 speed), and I want this to meet the min. spec for DirectStorage because the only thing I do with this system is game under Win10, and then run Ubuntu from the 3rd NVMe connected to the CPU, this is somehow bad? I understand the latency but I'm clearly exceeding the speed of the individual drives and I think in gaming, the bandwidth is going to be more important for DirectStorage since you're often pulling off compressed files which are larger, or that's what I've always believed.
The other option since I need 2 TB of storage for the gaming system is that I deal with 1 NVMe SSD for at least 1TB of storage, that doesn't cost so much and 1TB of NVMe storage where the one drive meets the spec of DirectStorage such as the 980 Pro which is expensive. And I know this sounds trivial since it's not really used right now in PC gaming, but it will, and I built this system to last years, not a couple years, but like many years since a PCIe gen4 system with the 5800X3D CPU, a high quality GPU and really fast storage is going to be a gaming BEAST.
Specs:
Asrock X570 Taichi
32GB 3600 CL14 RAM
will have the 5800X3D CPU
2 WD SN750 1TB NVMe SSDs
PowerColor Red Devil 6800 XT 16GB DDR6
2K 32" 144Hz gaming monitor w/FreeSync
Ya, a ramble of a video indeed. I know the topic was about motherboard RAID (specficially AMD firmware) but all focus was lost after your returned from your sponser message.
...so anyways, I have three 1TB WD spinning hard drives I'll raid together in RAID 0 as my backup and Steam game library volume. It won't be my OS volume - that'll go on a single nvme drive (with no raid to speak of.)
I used RAID 0 on HDDs and at that time HDDs were offering much higher capacity per dollar. Performance is as expected; double the read and write for sequential and a slight increase for random. Been using it for about 3 years with no issues and I'm overall happy with it.
Would I go for RAID in the future?
Definitely not as SSDs have become so cheap. RAID on SSDs seems a little dumb because NVMe is already so fast and when PCIE 5 becomes the norm, it just wouldn't make sense.
Great video!! Thank you
Wayy back when you could get a MS soft raid volume to boot...but it was very tricky.
It's actually not that hard to boot Linux from software raid, at least from btrfs or zfs.
You just have to have multiple efi system partitions in case of raid1. I see that quite often.
Have an onboard RAID0 array with two WD Caviar Blacks from over a decade ago that are still running strong. These drives are really built to last.
Nice! What's your motherboard?
there was a time when hardware RAID was the real "pro" deal... and software RAID was bad... has the tables turned?
That's what I needed to know about the Intel motherboard RAID. I was hoping, and from looking at a few other videos and seeing the config in the BIOS, I was expecting this to be a hardware RAID. My experience with a hybrid has not been good. I needed the Windows Server free backup that I also had scheduled once a week as SOP in case there were ever an issue with the primary backup technology which was EMC's StorageCraft ShadowProtect. EVER happened and after many hours on the phone with StorageCraft, we both realized that that they weren't actually getting an operating system restorable backup with the new hybrid controller that Dell switched to as their standard server controller that they didn't document as a hybrid and the OS came pre-installed on the server. We got a hardware controller from them for that server but immediately verified with them that none of the other systems had one of their hybrids.
I can confirm a 100% watch rate for the rambles. Deliver us some wisdom silicon daddy!
I bet on Linux you could have a pretty easy bootable RAID array without using and drivers before booting. The only compromise is that you'll be installing your bootloader onto a different non-redundant drive and booting into initramfs to load the driver to mount your file system. (or you still use the separate drive, but compile the driver into the kernel)
Wouldn't that solve the issue on Linux?
Wish I'd seen this video a few months ago. Build my first PC in 15 years back in January. 5900x on x570 platform. Last time I built a PC, RAID was the standard for storage, so if 1x gen4 NVMe can hit 5k MBps reads, 2x in RAID0 would be even better, right? Wrong. After getting everything setup, I had 2x Corsair gen4 NVMe drives in RAID0 boot drive with all benchmarks showing a ton of performance left on the table. Nowhere near 5k MBps read. Was finally able to narrow the cause down to AMD's RAID driver. Such a headache to switch back to AHCI managed drives.
I did the same and saw only improvement in large block transfers (2x as expected in pure sequential reads), but everything else was slower with nVME RAID via RaidExpert2 and on-board config. Anyway, I can't see why anyone would boot off a RAID, especially with how fast M.2 sticks are these days. You're just asking for trouble.
I used two 250 GB SSD's on an Asus motherboard in a raid-0 for my OS and I keep getting errors. Found that I had to use two different sata ports to get rid of the errors. Had to use ports 1&3 vs. ports 1&2.
one of the two ssd in soft LSi raid0 die on me few weeks ago on s2600 workstation...yes I have backups but it won't restore....glommy
Any thoughts on Windows Storage Spaces? I've used Unraid and TrueNAS but on Windows I can use Backblaze's unlimited off-site backup for 7 dollars per month. The Windows setup I have now is technically worse in just about every other way. If backblaze supported Linux on their personal backup plan I'd switch back in a heartbeat. Is there any Linux supported offsite backup solution that'll keep my 11ish TB safe for 7 bucks a month?
Tarsnap? Storage spaces is pretty not great except for the narrow use case it's designed for
@@Level1Techs I'll give it a go on a subset of my data. There's something to be said for Backblaze's flat-fee unlimited capacity backup - it means it doesn't take up mindspace. I'm not sure how much the deduplication and compression on tarsnap would actually cost per month. It's 0.25c per GB, which would be very expensive if it worked the same way as typical backup solutions. I'd need to test with some of my data.
@Level1Techs Hi Wendell, Can you point me to the forum threads? I wrote the internal Intel performance manuals and developer automation.
Perhaps I can provide recommendations and when I have some spare time I can write up some simple AI/ML automation scripts.
Personally, I use the Designate x299 10G with 10 NVMe SSDs + VROC + TPM 2.0 + 10980XE + 256 GB 3600 MHz DRAM; which requires special firmware from Gigabyte Engineering in Ubuntu 20.04 LTS x64 and Windows 10 x64.
P.S. If you look up my patents, we have something much better coming to a theater near you 😉
forum.level1techs.com/t/critiquing-really-shitty-amd-x570-also-b550-sata-ssd-raid1-10-performance-sequential-write-speed-merely-a-fraction-of-what-it-could-be/172541/27
Nice to meet you, sure docs and whatever you need to use the awesome including the bios is good. I get the impression some at Intel didn't think there were enough enthusiasts to bother documenting the awesome
KDiskMark? I've never gotten reliable numbers from that.
What's funny is that I experienced the opposite with my Asus B570 board. I got poor results with the windows disk management raid 0, and around a 10-15% boost in speeds with the AMD Raid Software. I am however not using SSD's, but x5 WB 4TB HDD's.. Something to consider as well, is the heat on those SSD's, and how they slow down after being ran hard for long period of times which will also lead to weird intermittent R/W speeds. I also noticed your using cheap SSD's, which are notorious for getting hot and slowing down.
Even a decent Samsung NVME, if ran for long periods of say PLOT creation for HDD coin farming will start to flip-flop. Latency will sky rocket above 1 Million, and IOPS sink randomly.
Thanks for the suggestion. I have an ASUS B-550 F Gaming MB and wish to setup two 4TB WD drives in Raid 1.
I will test setup in the BIOS to see if that delivers the expected results of 1x write & 2x read speed. 😁
@@stevetech1949 I need to correct myself, I have the Asus B-550 F Gaming MB as well not the 570. I am up to x5 4TB HDD's that I have put into a Raid 0 array. With the 550 board, don't forget that if you use the second nvme slot, it turns off your last two SATA ports on the board. Ohh and with the 5 drives in RAID 0, currently hitting around 600-700MB transfer rates on the array.
I'm wondering if it's just better to disable all the built-in soft-RAID features on the motherboard and just get an inexpensive RAID Controller off of E-Bay that can be put into IT Mode? (ie JBOD and ZFS)
In my experience even the high-end ones (tested a Broadcom HBA 9400, so not the current top-of-the-line but pretty good) these are still a bit slower when using them with SATA SSDs compared to the native motherboard SATA ports in AHCI (!) non-RAID mode. But if you know that you are going to max out the interface between the motherboard chipset and the CPU with other stuff like Thunderbolt or multiple 5 or 10 Gb/s USB devices installing HBAs in PCIe slots that get their lanes directly from the CPU does indeed help.
Just use the sata ports on the motherboard with the drives in standard ahci mode and zfs.
The only reason to use an hba is for large numbers of disks where they can tie in to some sort of backplane, or fast enough throughout that you'd saturate the chipset link to the CPU and the dedicated PCIe lanes from a card would be faster.
@@morosis82 - using between 6 and 8 drives would seem to be the best storage to cost ratio. I just think the bugs will be well known or resolved with an HBA.
@@johncnorris when you use an IT mode HBA, there's no real secret sauce, it's effectively just a secondary SATA (SAS) controller replacing the one that's already on your motherboard.
For single drives in standard mode tied into a software raid system, which neither of those controllers know anything about, it's basically the same thing.
My comment about drives was if you need lots (more than the number of motherboard headers), or require a certain amount of speed, then a HBA attached to a PCIe x8 slot can be faster than the ports on your motherboard that are attached through effectively a PCIe x4 interface via the chipset. But at least with PCIe3 and above, you need a lot of fast SATA drives to saturate even x4 lanes, like 8 fast SSDs for example.
Of course, those x4 lanes also service your other hardware like network, USB, etc.
How does this compare to LVM "raid"?
Is this a reupload? Edit: Also, interesting that intel has better error handling; nitty details of like that can be more important than pure performance.
that the 550 xe?