• Skip to main content
  • Skip to primary sidebar
  • Home
  • About
    • Stephen Foskett
      • My Publications
        • Urban Forms in Suburbia: The Rise of the Edge City
      • Storage Magazine Columns
      • Whitepapers
      • Multimedia
      • Speaking Engagements
    • Services
    • Disclosures
  • Categories
    • Apple
    • Ask a Pack Rat
    • Computer History
    • Deals
    • Enterprise storage
    • Events
    • Personal
    • Photography
    • Terabyte home
    • Virtual Storage
  • Guides
    • The iPhone Exchange ActiveSync Guide
      • The iPhone Exchange ActiveSync Troubleshooting Guide
    • The iPad Exchange ActiveSync Guide
      • iPad Exchange ActiveSync Troubleshooting Guide
    • Toolbox
      • Power Over Ethernet Calculator
      • EMC Symmetrix WWN Calculator
      • EMC Symmetrix TimeFinder DOS Batch File
    • Linux Logical Volume Manager Walkthrough
  • Calendar

Stephen Foskett, Pack Rat

Understanding the accumulation of data

You are here: Home / Everything / Enterprise storage / Infinidat’s Solution For the I/O Blender: Math

Infinidat’s Solution For the I/O Blender: Math

September 22, 2015 By Stephen 2 Comments

I’ve talked a lot about the I/O blender in the last decade or so.1 I’ve always said that information is the solution, allowing arrays to de-multiplex data. But a new enterprise storage company, Infinidat, claims that they can beat the I/O blender using math. Here’s their concept.

You should check out my I/O Blender series: History, Virtualization, and Demultiplexing

As you will recall, the I/O blender is what happens when data is passed through the tall I/O stack, from application to filesystem to volume manager to storage protocol to controller to cache to disk. At each step, critical context (metadata) is lost. By the time the data hits the disk, it’s just a blend of undifferentiated blocks, challenging the ability of the array to do all the cool jobs it was hired for.

That's one cool-looking lab!
That’s one cool-looking lab!

Infinidat Activity Vectors

Infinidat’s technical briefing focused on their unique solution to the I/O blender. Where most systems try to pull in context from higher up in the stack, Infinidat applies complex math to statistically determine what I’ll call “proximity” of data. They then place this “like” data together on disk and prime the cache with it.

They claim this gives them the best-possible performance, but more importantly that this architecture “eliminates the I/O blender”. But is it true?

First off, Infinidat’s “InfiniBox” array is itself not an I/O blender. Rather than slapping data down on disk willy-nilly, they take a structured and mathematical approach. All incoming data is divided into 64 KB “sections” in the controller which are then tagged with an “Activity Vector”. This is where the magic happens.

Infinidat’s Activity Vector acts like a proximity and activity score, with each block’s AV part of a massive matrix within the controller. As the system is used, this matrix continually refines the implied relationship between AV’s, and thus the data sections they refer to. So the array, a triple-redundant hybrid, spreads data as wide as possible but keeps related data together.

In theory, this should strike the mathematically-best balance between wide data placement and sequential I/O. This balance is critical but these are conflicting demands: It’s best for aggregate performance, redundancy, and disk rebuild to spread data across as many spindles as possible, yet it’s best for the performance of individual operations to keep like data together.

What About The Other Blenders?

I agree that Infinidat’s in-box blender is head and shoulders superior (in theory) to anything else I’ve heard of. But all this work does not solve the challenge of the various I/O blenders that exist higher up in the stack! The hypervisor’s own file system and volume manager chops up and anonymizes data, too, as does every file system and application.

Let’s get specific. In a virtual server environment, which Infiniblox claims is their top application, an InfiniBox ought to offer great day-to-day performance but still can’t offload snapshots or replication without higher-level protocols like VAAI getting involved. So their AV architecture is only one component of a larger I/O blender-beating combination.

I’m pleased to see that Infinidat does indeed support VAAI. 2. And their unique data placement solution means that snapshots are very impressive: “InfiniSnap” is pointer-based solution that allows infinite, quick, and efficient snapshots to be created on the fly. VAAI+InfiniSnap sounds like a match made in heaven!

But Infinidat doesn’t support VVOL yet, and their papers claim they don’t need to, since VAAI works so well. I’m not convinced. VVOL is a hinting mechanism, telling the array which blender-ized blocks belong together as a virtual LUN. This information would be massively valuable in creating useful Activity Vectors, and it’s essential to enabling full offload of storage operations (clones, snapshots, replication) to the array.

Stephen’s Stance

Infinidat has built a true enterprise-class storage array, and their sales claims are impressive. They’re converting EMC Symmetrix customers for open systems applications, and promise mainframe support in the future. While the rest of the market is focused on data awareness, flash integration, and secondary storage, Infinidat is taking on the big guys in the heart of the data center.

Although not part of this release, I expect that Infinidat will embrace VVOL very soon. It’s just too nice of a complement for the impressive system they’ve created! Their Activity Vector and InfiniSnap technology sounds great, and the overall system (along with VAAI and VVOL) should be a killer answer to the I/O blender challenge.

Disclaimer: I was pre-briefed by Infinidat twice this year, and they’re presenting at my Storage Field Day 8 event in October. But no one can buy an article on my blog at any price.

Note: The photo above came from the Infinidat Twitter account since I couldn’t find any usable imagery on their web site and their presentations are all marked “confidential” and “internal use only”.

  1. I’ve even been told I invented the term! ↩
  2. At least for block storage. I don’t see VAAI listed on their newly-released NFS paper. ↩

You might also want to read these other posts...

  • Electric Car Over the Internet: My Experience Buying…
  • GPS Time Rollover Failures Keep Happening (But…
  • What You See and What You Get When You Follow Me
  • Tortoise or Hare? Nvidia Jetson TK1
  • Liberate Wi-Fi Smart Bulbs and Switches with Tasmota!

Filed Under: Enterprise storage Tagged With: enterprise storage, I/O blender, Infinidat, mainframe, snapshot, Storage Field Day, VAAI, vVol

Primary Sidebar

Imagine if every Thursday your shoes exploded if you tied them the usual way. This happens to us all the time with computers, and nobody thinks of complaining.

Jef Raskin

Subscribe via Email

Subscribe via email and you will receive my latest blog posts in your inbox. No ads or spam, just the same great content you find on my site!
 New posts (daily)
 Where's Stephen? (weekly)

Download My Book


Download my free e-book:
Essential Enterprise Storage Concepts!

Recent Posts

Electric Car Over the Internet: My Experience Buying From Vroom

November 28, 2020

Powering Rabbits: The Mean Well LRS-350-12 Power Supply

October 18, 2020

Tortoise or Hare? Nvidia Jetson TK1

September 22, 2020

Running Rabbits: More About My Cloud NUCs

September 21, 2020

Introducing Rabbit: I Bought a Cloud!

September 10, 2020

Remove ROM To Use LSI SAS Cards in HPE Servers

August 23, 2020

Test Your Wi-Fi with iPerf for iOS

July 9, 2020

Liberate Wi-Fi Smart Bulbs and Switches with Tasmota!

May 29, 2020

What You See and What You Get When You Follow Me

May 28, 2019

GPS Time Rollover Failures Keep Happening (But They’re Almost Done)

April 6, 2019

Symbolic Links

    Featured Posts

    How Smart Is the Mondaine Helvetica Smart Watch?

    December 30, 2015

    Co-Processors, GPGPU, and Heterogeneous Computing

    June 26, 2017

    GPS Time Rollover Failures Keep Happening (But They’re Almost Done)

    April 6, 2019

    Edward Snowden Is Right: We Must Protect The Internet

    March 19, 2014

    Introducing Rabbit: I Bought a Cloud!

    September 10, 2020

    Rocking Out With the Topping VX1 Desktop/Bookshelf Amplifier

    October 6, 2015

    Deduplication Coming to Primary Storage

    September 16, 2008

    United Boeing 787 Dreamliner: Butt-In-Seat Economy Plus Review!

    November 13, 2012

    The Four Horsemen of Storage System Performance: The Rule of Spindles

    August 25, 2010

    From Kipling’s Dirigibles to the Jet Age

    May 13, 2012

    Copyright © 2021 · Log in