• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
  • Home
  • About
    • Stephen Foskett
      • My Publications
        • Urban Forms in Suburbia: The Rise of the Edge City
      • Storage Magazine Columns
      • Whitepapers
      • Multimedia
      • Speaking Engagements
    • Services
    • Disclosures
  • Categories
    • Apple
    • Ask a Pack Rat
    • Computer History
    • Deals
    • Enterprise storage
    • Events
    • Personal
    • Photography
    • Terabyte home
    • Virtual Storage
  • Guides
    • The iPhone Exchange ActiveSync Guide
      • The iPhone Exchange ActiveSync Troubleshooting Guide
    • The iPad Exchange ActiveSync Guide
      • iPad Exchange ActiveSync Troubleshooting Guide
    • Toolbox
      • Power Over Ethernet Calculator
      • EMC Symmetrix WWN Calculator
      • EMC Symmetrix TimeFinder DOS Batch File
    • Linux Logical Volume Manager Walkthrough
  • Calendar

Stephen Foskett, Pack Rat

Understanding the accumulation of data

You are here: Home / Everything / Enterprise storage / Making a Case For (and Against) Software-Defined Storage

Making a Case For (and Against) Software-Defined Storage

January 9, 2014 By Stephen 4 Comments

Storage is turning up everywhere these days!

Everyone is talking about “software-defined” everything lately, so it was only a matter of time before industry buzz turned to software-defined storage. VMware and EMC really stoked the flames with a constant barrage of marketing directed in this direction. But how exactly do you software-define storage? And what does this mean?

It’s always amusing to see how others react when one company comes up with a new innovation in buzz: Some obediently hop on board, others claim they’ve always been there, and a few deride the whole thing as just more hot air. Analysts and end users tend to align with these viewpoints, too, as if it’s a requirement to pick a side on every issue.

Clearly, VMware has a lot to gain in a software-defined data center (SDDC). If VMware can successfully leverage their hypervisor dominance to become the controller for network and storage devices, they will cement their position in the enterprise for another decade. This is what VMware’s SDDC strategy is all about: Put VMware in the driver’s seat, controlling network and storage resources in real time to enable new levels of integration and flexibility in the datacenter.

VMware has made a credible case for software-defined network (SDN) integration thanks to their purchase of Nicira and introduction of the NSX product. Using this technology, VMware can dynamically “reprogram” an Ethernet network made up of both virtual and physical switches in reaction to topology changes caused by the mobility of virtual machines. Networks lend themselves to this sort of orchestration by virtue of their transient nature: Once a packet has traversed a switch, no trace of its path needs to remain. An SDN controller leverages this transience to create a dynamic network topology.

So what about software-defined storage (SDS)? Some would argue that any storage device with an open management interface is already “software-defined”. Others claim it is sufficient for a storage system to be made up entirely of software, as opposed to the traditional specialized hardware model. But viewed in light of the highly configurable and flexible nature of SDN, it seems clear that neither of these is sufficient.

True software-defined storage must be extremely flexible, responsive to a standard controller and deeply integrated with the virtual environment, and capable of dramatic reconfiguration, including data distribution and changes in scale.

  • Flexibility demands movement, and this is a key issue for storage systems. Data has inertia, requiring substantial amounts of time, bandwidth, and system resources to move. And most storage systems are not flexible enough to enable the kind of “read and write anywhere and everywhere” access a true SDDC vision requires.
  • Standardization is a long-standing bugbear in the storage industry. For decades, industry groups have labored to create standard interface and management protocols while entrenched vendors dragged their feet or adopted an “embrace and extend” strategy to avoid losing market share. Even incessant customer demand for VMware-integrated storage has resulted in haphazard delivery of products. How can we expect SDS to be any different?
  • This is an era of innovation in scale-out storage, yet most established vendors face extreme technical hurdles to delivering products that can grow dynamically. Existing protocols and architectures were simply not designed to allow growth and distribution of data across multiple loosely-coupled nodes.

This is not to say that software-defined storage is impossible. On the contrary, many recent developments suggest that the SDS vision will be productized and delivered by VMware and others in the coming years. But these SDS products will look very different from the storage arrays customers are used to buying, and many existing systems will never get there. This will be a critical limiter to VMware’s grab at storage domination, since much of the industry will be incapable of being integrated into this vision.

VMware themselves have offered two key storage platforms to enable software-defined storage. vSAN is not a SAN at all, but rather a distributed storage software layer that promises to enable dynamic data movement without impacting daily operations. Numerous other companies have introduced distributed storage concepts in recent years, including EMC ScaleIO and Maxta, and established names like Symantec and IBM should not be counted out either. Nutanix and SimpliVity are already delivering virtualization-integrated distributed storage deserving of the SDS name.

VMware has also announced vVOL, an enhancement to traditional protocols that would make conventional storage arrays more responsive and capable as demands change. Again, many other companies are working on flexible and scalable integrated storage, from Tintri and Coho Data (which gets bonus points for leveraging SDN as well) to established players like EMC, HP, and Dell. All of these are likely to release vVOL-capable products once VMware is ready to bring that product concept to market.

A dark horse is the evolution of today’s caching software companies like Proximal Data, PernixData, Infinio, SanDisk FlashSoft and Avere into a virtual distributed storage layer or scale-out storage gateway. VMware’s recent purchase of Virsto gives them another avenue to software-define storage, though it is not clear what they intend to do with this team long-term.

And what of Microsoft? Although a distant number two in virtual datacenter mindshare, Hyper-V has made great strides recently, both in terms of technical capabilities and market share. Although Microsoft has introduced their own storage integration options (SMB3, ODX, etc) and software storage solutions (scale-out file server), they have not yet articulated a wide-ranging SDDC vision. They have been reluctant to talk about their intentions for SDN, let alone delved into SDS beyond their own Hyper-V/Windows file server combination.

If this article has piqued your interest in software-defined storage, pro or con, I urge you to join me for my Interop Las Vegas session, “Software-Defined Storage: Reality or BS?” I’ll discuss the topic in greater detail, presenting the reality and limits of SDS as well as the promise and prospects of this concept. And I especially look forward to a vigorous question and answer time at the end! I’m also doing a half-day workshop at Interop, “The Realities of Enterprise Cloud Storage“

You might also want to read these other posts...

  • Electric Car Over the Internet: My Experience Buying From…
  • How To Connect Everything From Everywhere with ZeroTier
  • Introducing Rabbit: I Bought a Cloud!
  • Tortoise or Hare? Nvidia Jetson TK1
  • Powering Rabbits: The Mean Well LRS-350-12 Power Supply

Filed Under: Enterprise storage, Features, Virtual Storage Tagged With: Avere, Coho Data, EMC, Hyper-V, IBM, Infinio, Interop, Maxta, Microsoft, Nicira, NSX, Nutanix, PernixData, Proximal Data, ScaleIO, SDDC, sdn, SimpliVity, software-defined, software-defined datacenter, Software-Defined Storage, Symantec, Tintri, Virsto, VMware, vSAN, vVol

Primary Sidebar

The same thing can be identified by many different terms, and the same term may mean many different things.

Douglas John Foskett

Subscribe via Email

Subscribe via email and you will receive my latest blog posts in your inbox. No ads or spam, just the same great content you find on my site!
 New posts (daily)
 Where's Stephen? (weekly)

Download My Book


Download my free e-book:
Essential Enterprise Storage Concepts!

Recent Posts

How To Install ZeroTier on TrueNAS 12

February 3, 2022

Scam Alert: Fake DMCA Takedown for Link Insertion

January 24, 2022

How To Connect Everything From Everywhere with ZeroTier

January 14, 2022

Electric Car Over the Internet: My Experience Buying From Vroom

November 28, 2020

Powering Rabbits: The Mean Well LRS-350-12 Power Supply

October 18, 2020

Tortoise or Hare? Nvidia Jetson TK1

September 22, 2020

Running Rabbits: More About My Cloud NUCs

September 21, 2020

Introducing Rabbit: I Bought a Cloud!

September 10, 2020

Remove ROM To Use LSI SAS Cards in HPE Servers

August 23, 2020

Test Your Wi-Fi with iPerf for iOS

July 9, 2020

Symbolic Links

    Featured Posts

    What is VMware VASA? Not Much (Yet)

    November 11, 2011

    It’s Time To Move Beyond Passwords (Especially On Web Sites)

    January 8, 2016

    Instapaper for iPad and iPhone Enhances My Web World

    June 1, 2010

    Why You Should Never Again Utter The Word, “CIFS”

    February 16, 2012

    What’s (Still) Wrong With Dropbox For Business

    April 17, 2013

    What’s the Difference Between a Jailbroken and an Unlocked Phone?

    May 5, 2012

    Ten Terrible Apple Products

    June 14, 2012

    Faster Ethernet Gets Weird

    June 19, 2015

    A Watch Guy’s Review of the Apple Watch

    April 27, 2015

    Scaling Storage Is Hard To Do

    June 4, 2013

    Footer

    Legalese

    Copyright © 2022 · Log in