Disappointed, I went back to OCZ

OCZ was worried. The last time I reviewed one of their SSDs I was truthful about it, and it hurt their sales considerably. Customers were returning drives, and to OCZ’s credit, they stepped up and even accepted some returns themselves - something that most manufacturers wouldn’t have done. Regardless what they had told me, there was some admission of fault there. Those JMicron drives were nothing short of crap.

As soon as OCZ started getting word that I wasn’t pleased with Vertex, they went into a state of panic. These drives all do very well in synthetic HDD tests like HDTach and ATTO, that’s generally all they’re reviewed in, so that’s all they’re tested in. But now OCZ was hearing that the Vertex wasn’t passing some of my tests and they had no idea what it was failing or why.

I tend to do a good job of keeping what tests I run secret until the review is published, so there isn’t any unfair optimization. I purposefully introduce new tests to our performance suites to help keep manufacturers honest and optimizing for real world usage scenarios rather than specific benchmarks. OCZ had no idea what I was running, but they knew that the Vertex wasn’t doing well.

Summit on the other hand was performing just fine, but that’s an expensive drive. Vertex was supposed to be good, it should’ve been good, there’s no reason for it to be performing this poorly. I ran the infamous iometer test to see what was going on:

Iometer 4KB Random Writes, IOqueue=1, 8GB sector space

IOs per second

MB/s

Average Latency

Maximum Latency

Original Pre-release OCZ Vertex

20.7

0.08 MB/s

48.2 ms

484.5 ms

How on earth is this acceptable at all? Average latency of 48.2ms and a maximum latency as bad as the Apex and G.Skill Titan drives? I’ve heard some SSD vendors dismiss the iometer results but let me caution you against that. What these numbers are telling us is that on average, when your OS goes to write a 4KB file somewhere on your drive, it’ll take nearly 50ms. That’s 4.5x longer than a 5400 RPM 2.5” notebook drive and that’s the average case. What part of that sounds acceptable? Anyone who tells you otherwise is delusional.

I thought for sure that the drive was broken and that we’d made no progress since last fall. But the drive hadn’t launched yet, while there were glowing reviews of it, no one had wasted any money. I wrote an email to Ryan Petersen, OCZ’s CEO. I described my findings and told him that while the Vertex’s performance was better than any of the JMicron solutions, it was unacceptable for anything other than perhaps extremely light, single-tasking usage.

I told him it sucked. He said that wasn’t fair. We argued over email but he came back and asked me what I needed to see to make the drive better.

I told him I’d need an average response time in the sub-1ms range and a max latency no worse than Intel’s 94ms. I didn’t think it would be possible. I was prepared for OCZ to hate me once more. He told me to give him a couple of days.

Post Your Comment

236 Comments

Really impressive and well done article ! Will stay tune for further developments and reviews. Thank you so much :)

Also... very impressed by OCZ's respond and commitment upon end users needs and product quality assurance (unfortunately not so commun by large this days among other companies). Certanly will buy from them my next SSDs to reward and support their healty policy.

This is one of the best tech articles I have ever read, I created an account just to post this comment. I've been a fan of Anandtech for years and articles like this (and the RV700 article from a while back) show the truly unique perspective and access that Anand has that simply no other tech site can match. GREAT WORK!!! Reply

I just got the Apex. I'd probably cough up more dough for the Vertex after reading this. However, I've run it for two days as my system disk in MacPro and haven't noticed any issues, it's really fast. But I guess I'll get Vertex for my Windows 7 build.

What I find intriguing about this article is that these smaller manufacturers do not do real world internal testing for these things. They should not need 3rd parties like you to figure this shit out for them. Maybe now OCZ will learn what they need to do for the future. Reply

It's too bad Windows and applications don't let you select where all the data that needs to be updated and saved to is stored. If that was an option a SSD could be used to only load data (EXE files and support files) and a HDD could be used to store files that are updated frequently, like a web browser for example, their constantly caching files, from the sound of this article that would kill the performance of a SSD in no time.