Granularity: The Hidden Challenge of Storage Management

This is part of an ongoing series of longer articles I will be posting every Sunday as part of an experiment in offering more in-depth content.

Many storage challenges focus on correlating high-level uses of data (such as applications) with the nuts and bolts of storage infrastructure. These discussions often revolve around the conflict between data management, which demands an ever-smaller unit of management, and storage management, which benefits most from consolidation. Developing data management capability that is both granular enough for applications and scalable enough for storage is one key to the future of storage.

Continue Reading »

Computer history
Enterprise storage
Virtual Storage

Comments (0)

Permalink

Storage Decisions New York 2008 Feedback

Another Storage Decisions has come and gone, and 2008’s New York show did not disappoint. TechTarget always recruits an excellent set of conferencegoers, and not even the Wall Street crisis could dampen attendance. Even Spike Lee, Richard Gere, Dian Lane, Keira Knightley, John McCain, and Sarah Palin made appearances at this year’s show! (No, seriously, they were really there!)

Although my email archiving session always attracts a smaller crowd, they are all a dedicated bunch. One pertinent suggestion from an attendee was to ingest PST files into a special separate archive in order to ensure that messages recovered from it are treated with the proper skepticism. Questions after the session focused on the trick of engaging legal and business people in the decisions around email policy, truly a challenge. I suggested that an on-site mini-seminar for the relevant folks might help to break the logjam and illustrate the issues, something that I would be happy to arrange!

My storage virtualization session was once again placed in the main room, and a much larger group attended it. I was interested to hear just how great the impact of VMware’s VDC-OS had been. In just a week, a dozen or more folks in the audience had heard, comprehended, and strategized about the concept. It’s really that big! Others were very interested in the topic of green metrics for data center usage. How does one monitor and report the real “green” savings (power, carbon, cooling, space) for a virtualized environment? Although storage greenness is debatable, the savings from a virtualized server environment are real, and these often bundle in some of the storage numbers, too.

These topics are top of mind to me as well, and I will continue to investigate (and speculate) about them in the coming year. If you missed the show (or the handouts), I will be posting them here soon! Get my email address or head to LinkedIn by clicking the links in the sidebar (at top left).

Watch this space, and consider coming to my virtualization seminar in Charlotte on October 21 or to the Storage Decisions show in San Francisco, held November 17 to 19.

Enterprise storage
Personal
Virtual Storage

Comments (1)

Permalink

A Consultant’s View Of The Enterprise Storage Market

This is part of an ongoing series of longer articles I will be posting every Sunday as part of an experiment in offering more in-depth content.

I am not the typical enterprise storage user. In fact, I am not an enterprise storage user at all - I am a consultant focused for over a decade on assisting enterprises with their storage architecture and strategy, working with businesses of all sizes. My background is both a blessing and a curse - I have seen far more enterprise storage environments in much more detail than most people, but I am unable to truly empathize with my corporate storage compatriots since it’s not really my gear and data that I am working with.

Based on this experience, what does the future hold? Where is enterprise storage heading? Read on for my thoughts.

Continue Reading »

Computer history
Enterprise storage
Virtual Storage

Comments (0)

Permalink

What is VMware VDC-OS vStorage?

Hopefully vCloud, vClient, and VDC-OS are a little more solid (not to mention closer) than the Three Pillars of Creation in the Eagle Nebula

Hopefully, VMware's three pillars (vCloud, vClient, and VDC-OS) are a little more solid (not to mention closer) than the Three Pillars of Creation in the Eagle Nebula

VMware packed a lot into their 2008 VMworld conference, including an outline of their “three pillars” strategy, focused on vClient, vCloud, and something they are calling the Virtual Datacenter Operating System. While it is debatable if this last item really is an operating system, it’s certainly a major strategic change in messaging.

VDC-OS is divided into four “vServices” (Management, Cloud, Application, and Infrastructure), and one core Infrastructure vService is vStorage. Since my focus is enterprise storage, I thought I would take a moment to examine the current and future status of vStorage.

EMC’s Chad Sakac has taken up the challenge of communicating vStorage to the world, in a post to his blog, a pair of YouTube videos (multipathing, I/O dedupe), and (apparently) a session or two at VMworld. But I’m not sure it’s really entirely clear just what vStorage is and what this means to existing and future VMware storage developments. So let’s dive in and take a look.

Continue Reading »

Enterprise storage
Virtual Storage

Comments (1)

Permalink

Geeksplosion! iPhone to Manage VMware!

I sure hope the iPhone is ready for the enterprise! VMware CTO, Stephen Herrod, just announced at VMworld that a new version of VMware Infrastructure Client was being developed for the iPhone and “other mobile devices”. This software allows an administrator to manage virtual machines hosted on VirtualCenter servers.

I’m sure I’m not the only one who has been using apps like pTerm (SSH), Remote Desktop (RDP), and Mocha (VNC) to manage my network devices. Throw in VI Client and you have a formidable mobile management device!

I’m glad I wasn’t the only one thinking of keen uses for the accelerometer in system management…

Apple
Virtual Storage

Comments (0)

Permalink

VMware Virtual Datacenter Operating System: Heavyweight or Hot Air?

Paul Maritz of VMware dropped a bomb on Las Vegas today, introducing their Virtual Datacenter Operating System concept. But is VDC-OS a nuclear strike at the heart of the data center, scattering everyone from Microsoft to Cisco to (big daddy) EMC? Or is it just more hot air, conflating the latest big thing into a mirage of an operating system rather than a real challenger?

It could be big. There is no denying the effect VMware has had on the modern data center - nearly everyone I talk to in the IT industry considers server virtualization a fundamental element of modern infrastructure strategy. And server virtualization has done more for the deployment of enterprise storage and other high availability technologies, than any other movement, from green computing to services-based infrastructure. And it has encompassed these movements, becoming the way, not just a technology.

But is VDC really an OS? And will it conquer the data center? And would this be a good thing? There’s the rub.

First, the obligatory description. Virtual Data Center effectively re-badges lots of things VMware (and the server virtualization industry in general) have been working on as “vServices”. They divide these up into Application vServices, Infrastructure vServices, Cloud vServices, and Management vServices.

These four elements, in fact, do sound like a post-modern definition of an operating system, much more so than Google Chrome. VMware includes the ability to share resources, execute applications, and store data in a managed way. And the cloud component is reminiscent of how the old client/server architecture has evolved into our modern connected world. In this way, VDC really is an operating system for the enterprise data center, and extends it into a cloud beyond those doors.

This is the most compelling and realistic post-datacenter world I have heard of, thoroughly trouncing shared infrastructure, the (Amazon/Google) cloud, SaaS, Java or Linux everywhere, Sun’s containers, and Microsoft’s world of Windows. For the first time, we are talking about an infrastructure that could actually be built, wouldn’t require a forklift (or shipping container) or the migration to an entirely new software environment, and reflects the diversity of modern IT systems.

Certainly, VMware has heavyweights in their corner. Cisco provides the connectivity, EMC provides the storage, Intel provides the CPU, Dell provides the servers, and so on. But it’s not that simple. Like Microsoft, VMware will have to manage the “input” from every networking, storage, CPU, and server provider, not to mention the vast ecosystem of software components. It’s much more like Windows than Macintosh in this respect, with VDC being a loosely-federated OS rather than a closed monoculture.

I predict that how well VMware handles the divergent parties trying to play in their OS will determine the future not just of VDC, but of VMware itself.

Oh, and VMware also introduced View, perhaps the future of the desktop.

Enterprise storage
Virtual Storage

Comments (2)

Permalink

Deduplication Coming to Primary Storage

This is a follow-up to my story, De-Duplication Goes Mainstream

Although deduplication of storage is nothing new, with Data Domain and other making hay with the technique for years, it has never been ready for prime time - reduction of active primary storage applications like email and databases. Instead, deduplication has been relegated to second- or third-tier status, deduplicating archives and backup data. But change is in the air, and deduplication vendors are starting to bustle towards the bright lights of primary storage.

Continue Reading »

Computer history
Enterprise storage
Virtual Storage

Comments (1)

Permalink

Sun’s Excellent VirtualBox Goes 2.0

Today, Sun released VirtualBox 2.0, a major revision to the (partially open source) desktop virtualization software. I have long used VirtualBox on my Windows machines as my virtualization product of choice due to its compactness, functionality, and low impact on the host system. Although I’m happy with VMware Fusion on the Mac, I intend to try out VirtualBox there, too, to see how it compares.

If you haven’t already tried VirtualBox, you ought to. It works very well, virtualizing Windows and Linux guests on Windows, Linux, Solaris, and Mac hosts with respectable performance. One thing I really love about it is that it doesn’t bog down my Vista system like VMware with installed drivers and services. It just installs and works and gets out of the way when you’re not using it.

VirtualBox supports shared folders, USB, and has guest additions for Windows and Linux to provide resolution independence and performance boosts. The new 2.0 version adds 64-bit guest OS support for 64-bit hosts along with performance and stability fixes. The Mac version now has a native look and feel and better networking, too.

One really interesting twist for folks interested in desktop virtualization (aka VDI on VMware) is integration with remote desktop protocol (RDP). VirtualBox guests can be configured to act as RDP servers, with thin(ish) clients accessing them over a network and even sharing their USB devices seamlessly. I’m getting pretty excited about the desktop virtualization concept - I’ll be keeping my eyes on companies like stealthy Old Road Computing Virtual Computer to see what they’re up to!

Apple
Virtual Storage

Comments (0)

Permalink

3PAR’s Thin Un-Provisioning is Slightly Less Bad


3PAR just introduced their third-generation storage hardware, bringing a novel feature to the world of thin provisioning: Hardware-assisted “zero-detection” to convert standard storage to thin provisioning. Although only certain special-case users will benefit from this technology, it’s nice to see someone working on one of the pitfalls of the technology - that it’s really hard to convert from “fat” to thin, let alone to un-provision storage.

Continue Reading »

Enterprise storage
Virtual Storage

Comments (4)

Permalink

Xen 3.3 Update Brings Paravirtualized SCSI

One of the new features in Xen 3.3, released this week, caught my eye: Paravirtualized SCSI (PVSCSI), which allows a guest OS to directly interact with a SCSI (or Fibre Channel) HBA. This should allow more specialized applications to be virtualized in Xen environments that use SCSI or FC storage without requiring the addition of a dedicated physical storage port per guest.

 

PVSCSI gives virtual machines direct access to SCSI and FC HBAs, and plays nicely with NPIV (Xensummit diagram by Fujitsu)

PVSCSI gives virtual machines direct access to SCSI and FC HBAs, and plays nicely with NPIV (Xensummit diagram by Fujitsu)

Functionally similar to VMware’s Physical Compatibility Mode for Raw Device Mode (RDM) volumes, PVSCSI enables certain applications that require direct SCSI communication to function in a virtual environment. Examples include Oracle RMAN, backup applications, and potentially SAN management software.

PVSCSI plays nicely with N_Port ID Virtualization (NPIV), too, so you don’t need to assign a physical HBA port to each guest - they can all share a port or two, and each would have his own N_Port on the Fibre Channel fabric.

In their Xensummit presentation about PVSCSI, Fujitsu showed impressive performance numbers, demonstrating that the technology doesn’t cause much of a performance hit even though it is substantially more complicated than the alternative approaches. I do wonder how PVSCSI managed to outperform Dom0 with 128k writes, but let’s chalk that up to insignificant variations in timing…

Now if only Xen would update the (3.2-era) readme files on their download page!

Enterprise storage
Virtual Storage

Comments (0)

Permalink