Introduction
IOSP and GB/s does *not* tell the whole story!
NVMe was a great thing to happen to SSDs. The per-IO reduction in latency and CPU overhead was more than welcome, as PCIe SSDs were previously using the antiquated AHCI protocol, which was a carryover from the SATA HDD days. With NVMe came additional required support in Operating Systems and UEFI BIOS implementations. We did some crazy experiments with arrays of these new devices, but we were initially limited by the lack of native hardware-level RAID support to tie multiple PCIe devices together. The launch of the Z170 chipset saw a remedy to this, by including the ability to tie as many as three PCIe SSDs behind a chipset-configured array. The recent C600 server chipset also saw the addition of RSTe capability, expanding this functionality to enterprise devices like the Intel SSD P3608, which was actually a pair of SSDs on a single PCB.
Most Z170 motherboards have come with one or two M.2 slots, meaning that enthusiasts wanting to employ the 3x PCIe RAID made possible by this new chipset would have to get creative with the use of interposer / adapter boards (or use a combination of PCI and U.2 connected Intel SSD 750s). With the Samsung 950 Pro available, as well as the slew of other M.2 SSDs we saw at CES 2016, it’s safe to say that U.2 is going to push back into the enterprise sector, leaving M.2 as the choice for consumer motherboards moving forward. It was therefore only a matter of time before a triple-M.2 motherboard was launched, and that just recently happened – Behold the Gigabyte Z170X-SOC Force!
This new motherboard sits at the high end of Gigabyte’s lineup, with a water-capable VRM cooler and other premium features. We will be passing this board onto Morry for a full review, but this piece will be focusing on one section in particular:
I have to hand it to Gigabyte for this functional and elegant design choice. The space between the required four full length PCIe slots makes it look like it was chosen to fit M.2 SSDs in-between them. I should also note that it would be possible to use three U.2 adapters linked to three U.2 Intel SSD 750s, but native M.2 devices makes for a significantly more compact and consumer friendly package.
With the test system set up, let’s get right into it, shall we?
Excellent coverage of triple
Excellent coverage of triple RAID NVMEs..
I’m looking for a microATX board with dual M.2 slots for RAID.
Any available to your knowledge ?
Thx in advance
Could this be used for VOD
Could this be used for VOD server? I was thinking of 3 pcie ssd cards with 1.5TB of total amount of space(raid 5), so it would need about 2TB of pcie SSD storage… And it would also need 2 gigabith ethernet cards…
I wonder how this will fare
I wonder how this will fare against the upcoming Intel Optane SSD.
Will it still take a good chance?
I have a question for you
I have a question for you guys. I bought 3 950 PRO M.2 SSD. I want the best performance in my PC so which motherboard and processor should I buy. What is the best option for me? I plan to install one or two graphics cards in SLI.
Your article is a few months old, so maybe there are better products available .
I worry about full data loss
I worry about full data loss running on RAID0 if one of the SSDs fails.
Can you do RAID5 with the 3 m.2 slots populated, and do you have any performance #s?
Thanks 🙂
Nevermind,
I answered my own
Nevermind,
I answered my own question by reading the full article 😛
Thanks again 🙂
Hi Allyn
So in the video
Hi Allyn
So in the video around 9:20 are you saying that the “snappiness” of adding more SSDs is similar to hyper threading for Intel processors? The workload gets spread out across all drives.
I set about building a PC for
I set about building a PC for video production and the top priority was HDD speed in order to capture up to raw 4k. In my search I found this great review and it convinced me to go with this motherboard and (2) 950 SSDs. I put all my faith in RAID0 because I backup regularly and archive to RAID1. My downfall was that I also used the RAID0 as a boot drive. I am now re-installing windows for the 3rd time, but learned my lesson this time and using another SATA drive for my boot device.
The problem I discovered is the BIOS will decide to reset CSM to enabled which in turn disables Intel RST and breaks the RAID.
The first time was my doing when I installed a video card that did not support UEFI. The second time was after not using the PC for a week. After booting up, my RAID was marked as failed. Checking the BIOS and it decided again to reset CSM to enabled for what reason I do not know. The only option was to delete the RAID and create a new volume. This does not recover the drive contents, but I found a utility that let me recover the partitions and get my data, but it still was not bootable until a re-install.
Does anyone know of a way to lock down that CSM so it will not change on its own?
Archie177
Do you also do
Archie177
Do you also do video editing? Timeline scrubbing and rendering can really use lots of I/O in both cache and source disks…
What do you think of the idea of configuring your system so that you’re booting from a regular SATA SSD, pointing your NLE software cache to a RAID 0 of 2x M.2 950s, employing the third M.2 950 to hold all of the project source files (raw video, audio, and media, and finally, having 2x HDDs in Raid 0 to catch the transcoded video files?
Or… this is more straightforward: one m.2 for cache, one for source, and one for the target.
dayoldy.
I do video editing also.
I do video editing also. After my multiple RAID failures, I reconfigured my system to use one SATA as the boot drive, two M.2 as RAID0 for capturing and temporary working drives, then another SATA to move completed work to. I lost trust in the M.2 drives as RAID0 (more so in the BIOS), so nothing important stays on those drives prior to shutting down.
I did discover something interesting while working with different configurations. When I first installed the two M.2 drives, I put them in two adjacent slots. This defeated a majority of my SATA ports. I did some research about theshared hardware on the motherboard, then moved the drives to the outside M.2 slots. This gave me use of faster SATA ports.
Exactly.
I love being right
Exactly.
I love being right despite being a newb~.
Its philosophy.
dont be greedy.
a; simple, cheaper, raid0 nvme pair, & very conceivably, a 4GBps read AND write storage~ resource that u just gotta have – but dont be dumb and complicate things by making it a boot drive.
leave what aint broke alone (or boot on the system/mobo nvme), add this awesome discrete raid 0 resource to u pc, and find ways of profitably using it, just as you have done sir.
The raid array is not something u can pluck from u system and confidently run on another pc, like a sata drive can.
Its a great scratch file tho, as u say.
I am using this motherboard
I am using this motherboard with 3 950 pro’s in raid 0 can i use 2 samsung 850 pro in raid 0 with the sata ports as well?
Marcus100868
Hi Allyn,
I’m trying to find
Hi Allyn,
I’m trying to find the best (value) high power setup for 3D content creation. I’m thinking the i7-5820k is the best value and I want as fast as possible application startup/speed so it sounds like a couple 512G 950 Pros in RAID0 would be the best option (also considering RAM disk). I’ll be using a GTX1080 as soon as the price settles down :).
Is this motherboard the best option for 2x 950Pros in RAID0? Am I gaining significant performance in application startup/speed with such a setup or is a single 950 Pro adequate?
Thanks!
j.
asrock z170 oc formula has 3
asrock z170 oc formula has 3 m.2 slots and has everything except 4way sli and even will have left 4 sata3 ports after all m.2s as it has 2 asmedia controllers 2 more than this and if u want wifi it also has a place for those laptop wifi cards(both dont come with wifi by default) and biggest factor is it comes for $200~250 half of what this costs and it even supports tridentz 4300mhz ram this doesnt so i dont see the benefit of this board over asrock’s
Thanks!! I’ll check out the
Thanks!! I’ll check out the Asrock. Sounds like exactly what I’m after.
Do you know if setting up 2 512G Samsung 950 Pros in RAID0 is pretty straightforward with the Asrock? I’m not very knowledgeable about PCI lanes and all that so I’m hoping I just plug in the drives, configure the BIOS and I”m done!
Thanks much for the info!
Best,
j.
Where I see this being useful
Where I see this being useful is in a VMware lab, using the 3x m.2 cards to be the caching tier of an all flash vSAN nested on one box with extreme performance would be incredible.
what drivers were used on the
what drivers were used on the OS side, intel, samsung or a mix of both?
Used your guide to do a
Used your guide to do a triple m.2 raid 0 stripe on my gigabyte z170x soc force motherboard, as the boot drive. Worked great, super fast, until I updated the bios now it tells me “reboot and select proper boot device or insert boot media in selected boot device and press a key”. I committed the ultimate sin and do not have a backup of my drive. I don’t want to lose my info. Is there any way to fix this? By re doing the raid 0.
Need your help
Thank you
Ps you might want to do a video on this, as I’m sure others with a raid 0 setup have made the same mistake
MSI claims double performance
MSI claims double performance up to 64Gbps with M.2. I tried Raid0 with Intel RST and I get the same results as you.. maxing out at about 25.6Gbps. Any idea what MSI is talking about or how to go beyond 32Gbps?
Maybe I should try running them both as single drives simultaneously, or do software raid.
The configuration in this
The configuration in this article is not the fastest RAID setup possible. The CPU has too few PCIe lanes. You need a 40 lane CPU (Enthusiast line).
While I cannot boot from it, I have three Samsung 951 AHCI drives in Windows software RAID 0 and I get 6.6GB/s sequential read seed. My system boots from a fourth M.2 drive on the motherboard’s M.2 slot. All my software and games are installed on the RAID volume and all have very short load times.
Yep, i couldnt be fagged
Yep, i couldnt be fagged re-reading, but it didnt look like each drive was getting plenty of pcie3 1GB lanes to me either.
But an 8x pcie3 lane 2 x m.2 socket adaptor & an 8 lane pcie3 gpu is doable on ~any pc, yielding ~4.5GB read and WRITE from a raid0 pair, judging from your results.
The latest samsung 500GB drives individually max out at 3.5GB~ now, so speeds are now dramatically improved.
Why use a $400 motherboard to
Why use a $400 motherboard to test this, when HP and Dell deliver a method for splitting the x16 lane into 4 times a x4 lane that these 950pros actually use: Dell 4x m2 and the hp z-turbo quad pro boards (it will not allow me to place links)
And guess what, they also solve the thermal throttling issue at the same time.
This would be an awesome
This would be an awesome system for my Oracle 12 Enterprise Database!!!!
Has anyone attempted running
Has anyone attempted running 2 raid 0 arrays (1x Sata & 1x m.2 nvme) using the z170 Chipset? My current setup has a 960 Evo 256 GB for OS and a WD BLACK 1tb HDD for storage. I’d love to double my storage but if I could do so while adding increased performance that would just be icing on the cake. Unfortunately, this is my first pc with an SSD and I’m a little green when it comes to raid arrays but if anyone has any input it would be greatly appreciated. I’m planning on starting this sometime in may so hopefully I will be able to figure with out by then. 🙂
SO:
The hard yards have been
SO:
The hard yards have been covered using a raid0 pair. 3 is dubious value for most – an increment in queue depth & heat benefits.
The killer advantage of raid0 is write speed. At 32kb+ block size (as per above charts), write goes from being the half as fast laggard, to ~as fast as the (much improved) raid0 READ speed.
i hear rumours that ssd is v reliable, & the risk of raid 0 is far less than is historically perceived.
Impressive as they are, None of these results maxes out the 4GBps bandwidth of a mere 4 x of the PCs scarce pcie3 lanes.
So, a 4x pcie3 lane card w/ 2 x ports for r/w speeds of 4GBps in raid 0 would be a boon – a magic number. Software raid on 8C cpuS should be fine.
Looking for a mother board
Looking for a mother board that will accept and support two M.2 SSDs and four SATA-3 HDDs; and one Video Card and one Blu-Ray DVD; and still have several USB 3.1