The SSD Anthology: Understanding SSDs and New Drives from OCZ
by Anand Lal Shimpi on March 18, 2009 12:00 AM EST- Posted in
- Storage
Latency vs. Bandwidth: What to Look for in a SSD
It took me months to get my head wrapped around it, but I think I finally get it. We often talk about the concepts of bandwidth and latency but rarely are they as tangible as they are here today.
When I speak of latency I’m talking about how long it takes to complete a request, or fetch a block of data. When I mention bandwidth, I’m talking about how much you can read/write at once. Think of latency as the speed limit and bandwidth as the number of lanes on a high way.
If you’re the only car on the highway, you’re going to notice the impact of latency more than bandwidth. A speed limit of 70 mph instead of 35 is going to impact you much more than if you added more lanes to the road.
If you’re a city planner however and your only concern is getting as many people to work and back, you’re going to notice the impact of bandwidth more than latency. It doesn’t matter how fast a single car can move, what matters is how many cars you can move during rush hour traffic.
I’d argue that if you’re a desktop user and you’re using an SSD as a boot/application drive, what will matter most is latency. After you’ve got your machine setup the way you want it, the majority of accesses are going to be sequential reads and random reads/writes of very small file sizes. Things like updating file tables, scanning individual files for viruses, writing your web browser cache. What influences these tasks is latency, not bandwidth.
If you were constantly moving large multi-gigabyte files to and from your disk then total bandwidth would be more important. SSDs are still fairly limited in size and I don’t think you’ll be backing up many Blu-ray discs to them given their high cost per GB. It’s latency that matters here.
Obviously I’ll be testing both latency and bandwidth, but I wanted to spend a moment talking about the synthetic latency tests.
Iometer is a tool that can simulate any combination of disk accesses you can think of. If you know how an application or OS hits the disk, iometer can simulate it. While random disk accesses are the reason that desktop/notebook hard drives feel so slow, the accesses are generally confined to particular areas of the disk. For example, when you’re writing a file the OS needs to update a table mapping the file you’re writing to the LBAs it allocated for the file. The table that contains all of the LBA mapping is most likely located far away from the file you’re writing, thus the process of writing files to the same area can look like random writes to two different groups of LBAs. But the accesses aren’t spread out across the entire drive.
In my original X25-M article I ran a 4KB random write test over the entire span of the drive. That’s a bit more ridiculous than even the toughest user will be on his/her desktop. For this article I’m limiting the random write test to an 8GB space of the drive; it makes the benchmark a little more realistic for a desktop/notebook workload.
The other thing I’ve done is increased the number of outstanding IOs from 1 to 3. I’ve found that in a multitasking user environment Vista will generally have a maximum of 3 or 4 outstanding IOs (read/write requests).
The combination of the two results in a 100% random file write of 4KB files with 3 outstanding IOs to an 8GB portion of the drive for 3 minutes. That should be enough time to get a general idea of how well these drives will perform when it comes to random file write latency in a worst case, but realistic usage scenario.
250 Comments
View All Comments
Franco1 - Wednesday, March 18, 2009 - link
I've been waiting a long time for this review. It was certainly worth the wait! I would love to see some benchmarks with 2+ drives in RAID configurations via onboard and add-on controller cards. Maybe another follow up?Howard - Wednesday, March 18, 2009 - link
Looks like the Vertex is the drive to get, especially once the user base expands a bit.MagicalMule - Wednesday, March 18, 2009 - link
Thanks for the article. Everyone is critiquing grammar and all this nonsense it seems, but I really enjoyed the article.It was very thorough and very informative.
Keep up the good work. =).
futrtrubl - Wednesday, March 18, 2009 - link
You missed out a VERY significant step that causes the greater part of the slowdown associated with your scenario. After the block is read out to cache the block has to be erased before it can be written to again and as you pointed out earlier an erase cycle, and thus the entire read/modify+erase/write cycle, takes a relatively LONG time, much longer than a simple read/modify/write.Edward
DrKlahn - Wednesday, March 18, 2009 - link
I've worked in IT for 15 years and have played with very fast arrays and know a fair amount about storage. 2 months ago I replaced my Raptor boot/gaming drive with a GSkill Titan. In day to day use I have no stuttering. The only stutter I have seen was while installing a large patch, surfing with multiple windows/tabs open and using Outlook. It wasn't even a second. I did align the partition, turned off drive indexing and defragmentation, and turned on caching. In day to day use it simply kills the Raptor. Games and applications load in a fraction of the time. Vista boot time has decreased dramatically.This isn't a case of purchase justification. If the drive was a dud I would have moved it to a secondary machine, reinstalled the Raptor, and chalked it up as a bad decision. I simply have not run into any scenario in daily use that it performs worse than the drive it replaced and I have not seen any real stuttering in daily use.
Gary Key - Wednesday, March 18, 2009 - link
I have a GSkill Titan drive also and really like it. However, my experiences while positive overall, do not compare with yours when it comes to stuttering (yes, all optimizations have been done to the drive and OS). I still have significant stuttering problems when using multiple IM programs and having multiple windows/tabs open at the same time. I literally have to wait a few seconds when texting colleagues if more than two conversations are occurring at the same time as the system pauses, hitches, and stutters in this scenario. It is especially aggravating when on Skype and trying to text, speak, and transfer files at the same time. This does not occur on the Intel drive in my testing. Apparently, it is no longer a problem on the OCZ Vertex or Summit drives. Except for my example above, I would certainly use the Titan drive over my Raptor any day of the week.druc0017 - Wednesday, March 18, 2009 - link
great article, keep up the good work, cant wait to see more updates, thxmikeblas - Wednesday, March 18, 2009 - link
Is the Velociraptor really "World's fastest hard drive", as this article states? Faster than the Hitachi SAS drives?Gary Key - Wednesday, March 18, 2009 - link
We have changed those statements to "...fastest consumer desktop hard drive...", that was the original intent of the statement, just clarified now. :)7Enigma - Wednesday, March 18, 2009 - link
I think the majority of us understood that. People just like to nit-pick.