• Home
  • About
    • Stephen Foskett
      • My Publications
        • Urban Forms in Suburbia: The Rise of the Edge City
      • Storage Magazine Columns
      • Whitepapers
      • Multimedia
      • Speaking Engagements
    • Services
    • Disclosures
  • Categories
    • Apple
    • Ask a Pack Rat
    • Computer History
    • Deals
    • Enterprise storage
    • Events
    • Personal
    • Photography
    • Terabyte home
    • Virtual Storage
  • Guides
    • The iPhone Exchange ActiveSync Guide
      • The iPhone Exchange ActiveSync Troubleshooting Guide
    • The iPad Exchange ActiveSync Guide
      • iPad Exchange ActiveSync Troubleshooting Guide
    • Toolbox
      • Power Over Ethernet Calculator
      • EMC Symmetrix WWN Calculator
      • EMC Symmetrix TimeFinder DOS Batch File
    • Linux Logical Volume Manager Walkthrough
  • Calendar

Stephen Foskett, Pack Rat

Understanding the accumulation of data

You are here: Home / Everything / Enterprise storage / Nimble Storage Rolls Out an All-Flash Array

Nimble Storage Rolls Out an All-Flash Array

February 24, 2016 By Stephen 1 Comment

As of today, there’s one more all-flash storage array on the market: Nimble Storage convened a big San Francisco shindig to roll out their own “AF” array, complete with lots of XtremIO and Pure Storage comparisons. Finally, Nimble no longer has to suffer the competitive digs and nasty rumors about this missing product, but there’s a lot more to this launch than an array sans disk!

Suresh Vasudevan and Varun Mehta unveil Nimble's all-flash AF7000 storage array
Suresh Vasudevan and Varun Mehta unveil Nimble’s all-flash AF series array

Not Just Another All-Flash Array

Many of us in the storage industry wondered if the day would ever come that Nimble would introduce an all-flash array. What took them so long? Was there some legal impediment to them introducing an all-flash storage array? Was it some kind of internal resistance from this hybrid array standard-bearer? Or was there a technical issue?

Even after spending hours with the executives and founders of Nimble, I can’t answer those questions. But I can say that none of this matters anymore. Nimble finally has an all-flash array to sell.

Every time a company comes out with a new all-flash storage array, I fear I’ll have to point out that it’s just a regular disk array with SSDs swapped in. This criticism is inevitable when an all-flash array shares the same codebase as a disk-based storage array. Just ask NetApp (AFF), HP (3PAR), and Dell (Compellent) how often they hear this kind of jab. Then ask them to explain why it’s not fair in their case.

I must point out that Nimble’s AF series retains much of the same code from their existing hybrid arrays, so we all know what EMC (XtremIO) and Pure Storage sales reps are going to be saying. But Nimble will certainly counter that this is a proven platform with mature enterprise features and that their all-flash solution integrates seamlessly with existing disk-based arrays. Unlike the feature-light all-flash arrays from some competitors.

If they’re smart, Nimble will also point out a few novel elements of the AF series:

  • The Nimble InfoSight analytics platform allowed the company to design their all-flash array based on real-world customer usage patterns
  • Nimble added in-line data deduplication to the array but implemented it in a clever way that doesn’t use as much memory as competing products (more on this below)
  • The familiar Nimble write sequentialization technique has been tuned for SSD, allowing them to use bigger/cheaper SSD’s without losing performance or longevity
  • The Nimble approach to clustering arrays (which I’d rather call “pooling”) means you can seamlessly migrate data between all-flash and hybrid arrays

Is this just another “rip out the disks” array? I don’t think so. Nimble deserves credit for some serious engineering.

Some Cool Details About the AF Series

I spent some time with Nimble founder and VP of Engineering, Varun Mehta in an attempt to figure out what’s cool about this array. Our wide-ranging and honest discussion brought up quite a few interesting details, which I’ll try to summarize here.

It is clear that Nimble was concerned on locating the areas of technological inefficiency in storage array design. Varun pointed out that the amount of RAM available on a controller tends to limit overall array scalability, especially when data deduplication is used, and that the cost of these controllers has remained high even as the cost of NAND flash capacity has dropped dramatically. He also noted that most of the price drop for NAND is in low-end MLC, not the enterprise flash some arrays use. As Nimble set about developing an all-flash offering, they focused on optimizing the system around these limits.

Let’s start with the controllers. When designing an all-flash array, there is a temptation to cut out the SSD and try directly to integrate flash chips. After all, flash is not disk and ought to work better when treated as such. But every flash implementation needs specialized code and processors to function, not to mention physical carriers and connectors. Why not leverage the vast economies of scale by using SSD’s rather than chips directly? This is what most mainstream flash-based storage arrays do, and it’s what Nimble chose to do too.

Since flash remains fairly expensive relative to disk capacity, Nimble decided to use cheaper 3D NAND in their array. But cheaper NAND has less longevity and different performance characteristics. In an attempt to “protect” the chips in these SSD’s from excessive wear, Nimble applied a write cache and sequentialization strategy similar to the CASL concept from their hybrid arrays. Incoming writes are committed to NVRAM and then written sequentially to the SSD’s in whole blocks. Nimble believes that this will allow their 3D NAND drives to last many years longer than their competition.

One challenge for implementing data deduplication is the amount of memory it requires. The “map” of block “fingerprints” takes up quite a bit of space on every controller in the cluster. This is the main reason many all-flash arrays with inline deduplication can only support tens of terabytes of SSD. Nimble’s solution to this problem is to “page out” parts of the deduplication map to SSD and aggressively pre-fetch what is likely to be needed based on proprietary algorithms.

This is a novel approach, but it remains to be seen if it will impact performance. I can already hear the XtremIO competitive analysis folks thinking up ways to explain deterministic latency! But this trick allows Nimble to support five times the amount of storage capacity per array compared to Pure or XtremIO. For the sake of Nimble’s AF customers, I hope it works!

Nimble’s clustering approach really works to their advantage in environments with both all-flash and hybrid arrays. Unlike most symmetrical clusters, Nimble’s act as a virtualized pool. A LUN can be moved transparently between the arrays participating in the cluster, regardless of whether they are all-flash or hybrid. Clones and snapshots can also be stored on a hybrid array, where capacity costs 1/3 as much. This is a tremendous differentiator for customers, and I expect to hear a lot about it from Nimble in the coming year.

See also:

  • Nimble Storage Announces Predictive Flash Platform by Dan Frith
  • Nimble Storage All-Flash, late but right by Enrico Signoretti
  • Nimble Storage announced their Predictive All Flash Arrays by Vipin V.K

Stephen’s Stance

It took longer than I expected for Nimble Storage to introduce an all-flash array, but their AF series looks to be a very credible offering. They’re targeting XtremIO and Pure with their marketing, but I expect HP, Dell, and especially NetApp to be cross-shopped more frequently. In that fight, I expect the Nimble AF series to be very attractive indeed!

Disclaimer: Nimble Storage flew me to San Francisco for this product launch and they’re a frequent Tech Field Day presenter. In fact, they launched the company at Tech Field Day 3 back in 2010! But no one can force me to write about them on my blog.

You might also want to read these other posts...

  • Infinidat’s Solution For the I/O Blender: Math
  • Waves of Storage Innovation
  • The Four Horsemen of Storage System Performance Are…
  • Plexistor Integrates NVDIMM for Every Application
  • Every Device Can Speak SMB Protocol Thanks To…

Filed Under: Enterprise storage, Everything, Features Tagged With: 3D XPoint, 3PAR, all-flash array, Compellent, data deduplication, de-duplication, deduplication, Dell, HP, NAND, NetApp, NetApp AFF, Nimble, Nimble Storage, Pure Storage, XtremIO

The same thing can be identified by many different terms, and the same term may mean many different things.

Douglas John Foskett

Subscribe via Email

Subscribe via email and you will receive my latest blog posts in your inbox. No ads or spam, just the same great content you find on my site!
 New posts (daily)
 Where's Stephen? (weekly)

Download My Book


Download my free e-book:
Essential Enterprise Storage Concepts!

Recent Posts

Add a Mirror to an Existing ZFS Drive

December 11, 2017

How To Remove Raw Images From Apple Photos and iCloud

How To Remove Raw Images From Apple Photos and iCloud

July 24, 2017

Recalling An HP MediaSmart Server To Active Duty

Recalling An HP MediaSmart Server To Active Duty

July 21, 2017

Go Get a ProtonMail Account and Protect Your Online Life!

Go Get a ProtonMail Account and Protect Your Online Life!

July 19, 2017

ZFS Is the Best Filesystem (For Now…)

ZFS Is the Best Filesystem (For Now…)

July 10, 2017

Co-Processors, GPGPU, and Heterogeneous Computing

Co-Processors, GPGPU, and Heterogeneous Computing

June 26, 2017

What is OCuLink?

What is OCuLink?

June 22, 2017

Storage is Getting Cloudier!

Storage is Getting Cloudier!

June 21, 2017

Where Have All The GPU’s Gone? Cryptocurrency Mining!

Where Have All The GPU’s Gone? Cryptocurrency Mining!

June 11, 2017

Turn Off Error Recovery in RAID Drives: TLER, ERC, and CCTL

Turn Off Error Recovery in RAID Drives: TLER, ERC, and CCTL

May 30, 2017

Symbolic Links

  • Keeping Yourself on Track and Avoiding Burnout as a Programmer

  • IRL Analogies Explaining Digital Concepts are Terrible

  • Hass.io 2018

  • Describing Network Automation: Automate the Coffee

  • Cisco’s Latest AP is Mind-Blowing (and a quick history lesson)

Featured Posts

Scaling Storage Is Hard To Do

June 4, 2013

Go Get a ProtonMail Account and Protect Your Online Life!

July 19, 2017

New England Takes On Seattle To Determine Who’s Number 2 … In Tech!

January 19, 2015

It’s Time To Speak Out Against Sexism In IT Recruiting

May 6, 2013

Making a Case For (and Against) Software-Defined Storage

January 9, 2014

Replacing Google Reader With Feedbin and Reeder

May 5, 2013

The Rack Endgame: A New Storage Architecture For the Data Center

September 3, 2014

Review: Blue Snowball USB Microphone

March 31, 2010

What More Could Alan Turing Have Accomplished?

October 7, 2012

My Core i7 Macintosh SE

May 25, 2017

Copyright © 2018 · Log in