A Consultant’s View Of The Enterprise Storage Market

Posted on Sep 21, 2008 by Stephen

This is part of an ongoing series of longer articles I will be posting every Sunday as part of an experiment in offering more in-depth content.

I am not the typical enterprise storage user. In fact, I am not an enterprise storage user at all – I am a consultant focused for over a decade on assisting enterprises with their storage architecture and strategy, working with businesses of all sizes. My background is both a blessing and a curse – I have seen far more enterprise storage environments in much more detail than most people, but I am unable to truly empathize with my corporate storage compatriots since it’s not really my gear and data that I am working with.

Based on this experience, what does the future hold? Where is enterprise storage heading? Read on for my thoughts.

Fibre Channel

Although the commoditizing storage market would seem ripe for stagnation, the opposite is happening. In fact, the enterprise storage market has continued to diversify, with iSCSI recently expanding the options for storage connectivity to a new market and FC seeing rapid uptake in the virtual server arena. Fibre Channel over Ethernet (FCoE), whether or not part of the datacenter Ethernet push, is joining virtualized I/O technology based on InfiniBand as the next wave in connectivity. Simply put, the market is not standing still.

Focus on the new world of storage area network (SAN) connectivity can take away from the basics, however. Traditional switched Fibre Channel (FC) remains the healthy market leader, and the recent upgrade to 8 Gb speed has attracted customer attention. Although they are unlikely to run out and perform a mass upgrade, 8 Gb FC is as as much of an inevitability as 4 and 2 Gb before it. The switch will be made, and customers will upgrade organically.

One of the big beneficiaries of 8 Gb FC will be those with virtual servers. This new hardware is coming just as N_Port ID virtualization (NPIV) is maturing, and this technology, which enables multiple servers to share a single FC interface, in combination with a doubling of bandwidth will make modern Fibre Channel tech extremely attractive to virtual server shops.

Even those who do not adopt 8 Gb FC connectivity in their SAN will benefit from the upshift in throughput, as native 8 Gb disks appear and enterprise arrays are redesigned to accept them, just as devices like the DMX-4 from EMC benefited from 4 Gb FC back ends.

IP Storage: iSCSI and NAS

As far as iSCSI goes, those of us who saw the promise of this technology can finally declare victory. Every storage device that matters offers iSCSI as a connectivity option, and most buyers are considering adopting it. It is being weighed fairly against FC, and the promise of reduced heterogeneity and cost are proving attractive to many. In fact, it is wrong to continually compare it against FC, since many iSCSI buyers would never adopt an FC SAN due to concerns about cost or learning curve. Indeed, much of the uptake in iSCSI comes from areas where SAN was never adopted, and iSCSI’s growth can be partly attributed to these happy customers spreading the technology wider than originally intended.

A hidden benefit of iSCSI adoption is the technologies and techniques that have come along with it. Clustering of smaller storage systems has become a common option for scalability, and has proven itself against old modular “head/shelf” arrays. Although the rate of adoption for security technologies like CHAP and IPsec in iSCSI remains low, they are far more common than their FC relatives. And Microsoft’s simplified and universal iSCSI drivers, which include multi-path and snapshot technologies, have been much more successful than their proprietary equivalents.

Let us not forget humble old network attached storage (NAS), either. File server consolidation to NAS filers continues to be a healthy (but less flashy) market, and NAS virtualization is on the rise as these devices proliferate. And some in the server virtualization community are beginning to consider NFS for their servers, especially when it comes to VMware. NAS definitely still has life and legs and will benefit from the shift to 10 Gb Ethernet just like iSCSI and FCoE.

The Future

As for the future, it is clear that most storage vendors are lining up behind Fibre Channel over Ethernet (FCoE) . Although true I/O virtualization, as envisioned by datacenter Ethernet (DCE) and InfiniBand, may not gain traction outside the largest data centers, FCoE seems to be the inevitable next generation for massive enterprise storage. Just about every vendor is committed to it, and the customers I have spoken to accept it as the future. Although 8 Gb FC might delay FCoE in some cases, it will almost certainly be the predominant SAN connectivity mechanism for large block storage devices within five years.