Choosing the Right Platform
As me migrate from 1080p video production to 4K, we needed a significant hardware upgrade.
Despite what most people may think, our personal workstations here at the PC Perspective offices aren’t exactly comprised of cutting edge hardware. Just as in every other production environment, we place a real benefit on stability with the machines that we write, photo edit, and in this case, video edit on.
The current video editing workstation for PC Perspective offices is quite old when you look at the generations upon generations of hardware we have reviewed in the years since it was built. In fact, it has hardly been touched since early 2011. Built around the then $1000 Intel Core-i7 990X, 24GB of DDR3, a Fermi-based NVIDIA Quadro 5000, and a single 240gb SandForce 2 based SSD, this machine has edited a lot of 1080p video for us with little problems.
However, after starting to explore the Panasonic GH4 and 4K video a few months ago, the age of this machine became quite apparent. Real-time playback of high bit rate 4K content was choppy at best, and scrubbing through the timeline next to impossible. Transcoding to a lower resolution mezzanine file, or turning down the playback quality in Premiere Pro worked to some extent, but made the visual quality we gained more difficult to deal with. It was clear that we were going to need a new workstation sooner than later.
The main question was what platform to build upon. My initial thought was to build using the 8-core Intel Core i7-5960X and X99 platform. The main application we use, Adobe Premiere Pro (and it’s associated Media Encoder app) are very multithreaded. Going from 6-cores with the i7-990X to 8-cores with the i7-5960S with modest improvement in IPC didn’t seem like a big enough gain nor very future proof.
Luckily, we had a pair of Xeon E5-2680v2’s around from another testbed that had been replaced. These processors each provide 10 cores (Hyperthreading enabled for a resulting 20 threads each) at a base frequency of 2.8GHz, with the ability to boost up to 3.6GHz. By going with two of these processors in a dual CPU configuration, we will be significantly increasing our compute power and hopefully providing some degree of future proofing. Plus, we already use the slightly higher clocked Xeon E5-2690v2’s in our streaming server, so we have some experience with a very similar setup.
Continue reading an overview of our 2015 Editing Workstation Upgrade!!
There are some definite disadvantages to going with these Xeons for a workstation though. Based upon the now aging Ivy Bridge-EP platform, these processors are limited to compatibility with the Intel C600/602 chipset (the server equivalent of X79). That means that a lot of modern features aren’t natively supported by the Intel chipset, USB 3.0 being the biggest example. However, we decided that given the sheer amount of PCIe lanes available from these processors (80 total!), this could largely be corrected by the use of add-in cards if necessary down the road.
Even after deciding what processors we wanted to use, there was still a lot of unanswered questions. Not only did we not have a compatible dual-socket motherboard, we didn’t even have a case that would fit the SSI-EEB form factor that these boards come in. While we didn’t want to deal with a massive consumer-level case like the Cosmos II which our current dual CPU streaming server sits in, nor a loud rackmount case, we were out of ideas.
Not sure which way to go, we contacted our friends over at Supermicro for some advice.
After talking to us about some of our needs, they pointed us towards the SuperWorkstation 7047A-T barebones kit. Even though it’s based around a 4U Server Chassis and the Supermicro Super X9DAi motherboard, the 7047A-T is extremely well suited for workstation use.
Whereas most 4U chassis are filled to the brim with high RPM and loud fans (for good reason), the 7047A-T aims to strike a balance between optimal cooling and noise. Quiet operation, along with the ability to orient the chassis in a vertical position to fit next to my desk made this option very compelling.
Though we may be PC enthusiasts at heart, the idea of buying a barebones server chassis was too much to pass up. Component compatibility with server platforms can be very sketchy, and Supermicro has a history of using high quality parts so leaving the decisions up to them seemed like a great idea. Not having to worry about physical compatibility between the motherboard, coolers, and chassis, as well as electrical compatibility with the power supply made this build less stressful on us.
As far as the other components, we tried to keep our theme of future proofing going. While we wanted to use a 400GB Intel 750 Series PCIe SSD as our only solid state storage in this workstation, the older C602 chipset does not support NVMe booting. As a work around we installed the operating system to a 128GB ADATA SP610 SATA SSD, and relegated the SSD 750 purely to dealing with video files and active projects. After a project is finished, it is moved over to a RAID 1 array of 3TB Western Digital Red Hard Drives, transitioned over from the old editing machine.
Graphics was a tougher choice. Even though this is a workstation, we don’t really do many actions that are GPU accelerated. GPU accelerated decode and encode in Adobe Premiere Pro via the Mercury Engine is great, but it doesn’t exactly require a lot of compute horsepower. The NVIDIA Quadro K5200 we went with was mostly out of availability. While we could have opted for a Maxwell-based Quadro card like the M5000, the K5200 based off of a slightly cut down GK110 GPU provides more than enough power for what we are doing, and we had it on-hand. Reusing parts is always a positive when it works out well.
64GB of ECC Registered DDR3 memory rounds out our build, and ensures RAM hungry applications like Adobe After Effects will be happy.
Makes you wonder if you’ll
Makes you wonder if you’ll use another editing program that will use ALL of the resources…
Or just stick it out as is…?
I doubt other software
I doubt other software packages would provide better multithreaded support, even if they did I imagine you’d be compromising a lot of productivity options from switching from CC.
I would simply sit tight and wait for Adobe to work on expanding the multithreaded support for the encoding engine, could simply be that one format which doesn’t have enough threads available rather than the PP CC mercury engine.
If you’re only getting 60%
If you’re only getting 60% utilisation, doesn’t that mean there’s a bottleneck elsewhere on the system?
More than likely we are
More than likely we are seeing issues with Adobe Premiere's ability to access 20 cores across two CPU sockets.
Yea 40 threads isn’t exactly
Yea 40 threads isn’t exactly a normal thing out there. 😀
HI Ryan in the interest of
HI Ryan in the interest of disclosure. Did you buy these product yourself, like anyone else would
Or did you offer to do a review/placement of all the stuff in exchange for the parts for free?
Adobe for years has not been
Adobe for years has not been great about making sure that their code utilizes all the resources available to it. In our office we have done per Core monitoring and Adobe After Effects will not use more than half our systems cores even if the others are free and the preferences in After Effects tell it to use all free cores.
Its funny that barebone got
Its funny that barebone got horrible review on amazon, are those accurate?
Those reviews are odd to me –
Those reviews are odd to me – we are using SSDs and HDDs on the same controller, no issues.
Also, its true that BIOS/firmware updates are slow to non-existent on these systems. But for server/workstation hardware, that is the norm.
I wonder how something more
I wonder how something more normal would compare?
Something like any X99 based motherboard with like a E5 2696 v3 (yes it do no exist but you can get one on ebay) 18 core CPU.
you can still use ECC memory even on X99 based motherboards. you can probably find a MB that can boot from the NVMe.
you loose dual socket but how much faster is two E5-2680v2’s compared to one E5 2696 v3?
With dual processor, and 64
With dual processor, and 64 GB ram, it’s worth pointing out that there’s only 32 GB per processor. That’s just not very much.
I’d expect for some video processing that 64GB in an X-99 with 10 threads would be better than 20 threads and 32 GB each.
You’d be wrong. It takes
You’d be wrong. It takes very, very specific uses to really push for higher performance going from 32GB > 64GB > 128GB of RAM. LinusTechTips even did a test on this a few months ago testing under a similar setup and once again your maximum benefit with most Adobe products is 32-64GB of RAM. Anything higher was pretty much useless.
Video Editing isn’t that demanding on RAM either. Really depends on your case and scenario though. You can do quite a bit with just 16-32GB.
What about using the Quadro
What about using the Quadro K5200 to accelerate the video encoding/decoding it has way more cores than any CPU so what about accelerating the work on the GPU. Adobe After Effects should be able to make more use of the GPU and take the load off of the CPU cores/threads, and I would think that once Vukan/DX12 usage becomes more commonplace that more asynchronous workloads could be done on the GPU’s cores and that even Nvidia’s partially in software asynchronous not in the hardware asynchronous compute could still run circles around any CPU for heavy encoding/decoding work. Maybe Adobe After Effects is not making good use of the GPU, HSA style, for accelerated processing.
Nice build guys…….Linus
Nice build guys…….Linus would be proud….just kidding…
I’d be interested to see what
I’d be interested to see what the performance is like with hyper threading turned OFF. It’s be easy to test. Considering that Premiere is having such a difficult time using so many threads, it might be worthwhile to reduce them and see if performance improves.
60% utilization…almost a complete waste of an entire processor.
Just my $0.02.