Stepping out of a subway car is an entirely different matter when it's moving!

Mobility of virtual machines is a sticky wicket. As open systems infrastructure becomes increasingly virtualized, administrators and managers wish to use the technology to balance workload, ease migration, and provide better availability. Although technology is improving, actually moving virtual machines is not always a piece of cake. Let’s lay down a baseline of information so we may begin a discussion on the true nature of virtual machine mobility.

Mobility of What?

Let us consider first the question of what exactly is being moved. Systems administrators often focus on “the machine”, which encompasses the operating system and configured state of the virtual machine itself. But the true “mass” of the system is its stored data. Hypervisor vendors have come up with different techniques of moving these two essential elements, reflecting the unique characteristics of each.

• The virtual machine is an instance of an operating system along with its state and configuration. Mobility of virtual machines requires all of this to be preserved, along with any I/O channels. Live migration of virtual machine requires that any active network sessions be maintained, along with RAM content, registers and buffers, and so many other elements.
• The virtual machine image (commonly referred to as “storage”) is the static content addressed by a virtual machine. Typically a VMDK or similar virtual disc image, it must be accessible to the virtual machine at all times. Live migration of a virtual machine image is tricky, but perhaps not quite as complex as live migration of a running operating system.

VMware, Microsoft, and others recognize these 2 distinct elements to be migrated, and have come up with a variety of complementary technologies for each:

• vMotion is VMware’s virtual machine migration solution, and has continually evolved with each iteration of the hypervisor. DRS leverages vMotion to automate mobility. VMware has also created Storage vMotion and Storage DRS as complements to handle mobility of virtual machine images.
• Microsoft Hyper-V Live Migration is conceptually similar to vMotion, though newer and less full-featured. With Hyper-V 3.0, Microsoft will introduce Storage Live Migration as a complementary technology akin to Storage vMotion. Most other virtual machine managers also support some form of live migration, though live migration of storage is less common.

Mobility in What State?

One of the key benefits of virtual machine technology is the ability to “run anywhere” on dissimilar hardware. From the very beginning, hypervisors have provided the ability to create a universal virtual machine image that would run on a variety of supported platforms.

This leads to one of the key values of server virtualization in the data center: Disaster recovery. The ability to take a virtual machine image and system state and bring it online after a disaster is a true revolution for open systems IT. The benefits of the single usage of server virtualization technology easily justify the investment to many businesses.

But this sort of “cold” migration seems passé when compared to the live or “hot” migration possible with technologies like VMware vMotion. Live migration is much more difficult, since active client sessions must be preserved in activity must not be greatly interrupted.

This is the second great question that must be asked when considering virtual machine mobility: In what state will the virtual machine be moved? Will it be a cold, powered down image of the system? A suspended or paused operating system image? Or a full, running machine?

Mobility to Where?

Once we have decided whether we are discussing virtual machine migration or movement of storage resources, we must consider the scope of the movement. The ability to move a virtual machine from one member of the cluster to another has now become fairly common. But what about systems that are not related in a cluster? Or that are spread over great distances?

• The nice thing about clusters is that they share resources before and after a virtual machine is moved. It is practical to move the running virtual machine, its storage, or both independently and to expect that performance will not dramatically suffer as a result. The cluster can also preserve network connections, and even I/O state, without much impact on clients or other external elements.
• It is a bit more difficult to move systems within a data center, since one must maintain the I/O connections that might be interrupted. It is fairly trivial to configure an IP network and storage array to allow multiple machines to access the same iSCSI or NFS storage resources. It is a little more difficult to configure Fibre Channel (and, by extension, FCoE) SAN’s to handle this sort of dynamic movement, but it is not impossible. Although moving a running machine from one network port to another could cause client access to be interrupted, technologies like VXLAN allow these sessions to continue, and improved network switching technology should reduce performance impact.
• Moving the machine to a different data center is another matter entirely. Stretching a layer-2 Ethernet LAN or Fibre Channel SAN across a metro or greater distance, while possible, will always be problematic. IP routing is flexible, but it takes time for changes to propagate when live machines are moved. And it is difficult to keep storage in sync over long distances due to the amount of time it takes for information to transit. Again, all of these challenges are being addressed in various ways, but they’re still hard!

Stephen’s Stance

Moving cold virtual machine images from system to system, or even across great distances, is one of the main selling points of server virtualization. But it becomes much more difficult to manage movement of virtual machines that are still running, especially outside cluster or across WAN links. When talking about virtual machine mobility, it is important to consider what is being moved, the state it is in, and where it is going.

Note: This discussion is part of “Building Virtual Infrastructure”, my new seminar series with Truth in IT.

© sfoskett for Stephen Foskett, Pack Rat, 2012. | Virtual Machine Mobility: Of What, and to Where and in What State?
This post was categorized as Enterprise storage, Features, Gestalt IT, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

It isn't always easy to get where you need to go!

Consider the following situation: You go to lunch with your good friends, John and Mary. Halfway through a rousing discussion of the latest Hollywood movie, Mary starts talking about the fantastic action sequences while John criticizes the romantic angle. You realize something mine-bending has happened: John now has Mary’s personality, and vice versa. It’s like they have switched brains or something!

This truly weird situation isn’t likely to happen in person, but occurs all the time in the data center. Virtualization of server, network, and storage services eliminates the fixed link between physical resources and functional applications. A running virtual machine can instantly move from one server, network adapter, HBA, or LUN to another. And when it happens, traditional components have no idea how to react.

The Challenges of Mobility

Mobility is perhaps the “killer app” of virtualization, but it is also the killer of traditional IT systems. Let’s consider the challenges of this “Twilight Zone” moment.

• The operating system expects a consistent hardware environment, which is exactly what the hypervisor creates
• The LAN must be prepared to redirect all network traffic instantly and seamlessly to one or more new physical interfaces
• The SAN similarly must be able to reroute all I/O to a new pair of HBA’s without missing a beat
• The storage array must be able to re-present capacity to a new physical device, and must maintain snapshots and other configurations
• The backup system must also be able to maintain consistency over time even as machines relocate to different server and storage locations

All of this must be done while maintaining quality of service (QoS), access control, reporting, and appropriate segmentation at all levels. This is an incredibly challenging task, and no conventional protocol (IP, Ethernet, NFS, SCSI, Fibre Channel, etc.) is anymore ready then you are when your good friends switch personalities.

Two Paths

So much of the development that is currently taking place in IT focuses on accommodating this “mobility issue”. Two key approaches have emerged to take on this challenge:

• “In a vacuum” technologies (like VXLAN) assume that no other changes will be made, so the focus is on maintaining complete compatibility in front and behind
• “Clean sheet” technologies (usually from startups) take a different approach, throwing out compatibility in favor of technical elegance

Both of these approaches have merit. Attempting to maintain compatibility only works so far (just ask a Windows API programmer), but it leverages the existing environment and recognizes that most people are not ready for wholesale change. Clean sheet designs always make more sense, but they rarely attain mass acceptance. Nearly every technology we rely on today is full of bolt-ons in the name of compatibility. Some, like Ethernet and x86, actually work pretty well, too.

The Stack of Lies

The difference between virtualization and cloud computing is exactly this same distinction. Hypervisors, NPV, NAT, thin provisioning, and so many other virtualization technologies exist mainly to maintain compatibility in a vacuum. In contrast, true cloud computing dispenses with the entire stack and creates a new platform for applications.

This is, perhaps, the reason that cloud computing is not taken off in the enterprise. Simply put, IT is not prepared to ditch everything they have ever used even in the face of a demonstrably superior alternative. Currently, the highest use of cloud is behind gateways and virtualization engines that bring it back down to earth.

This brings us to the stack of lies called server virtualization. Any “modern” virtualized data center is built on lie after lie, with each level telling the other what it wants to hear. The volume manager lies to the operating system; the hypervisor lies to the volume manager; and the storage array lies to the hypervisor. The same sad state of affairs allows networking and even memory to function in a virtual world.

But these shaky stacks of lies have difficulty adapting to motion, since no level truly “knows” the reality of the world around. The depressing truth is that a bowl of spaghetti like VXLAN is perhaps the highest form of art we can expect in a virtual data center.

Stephen’s Stance

As a techie, I am always drawn to clean sheet designs that offer technical elegance along with functionality. But I know that, realistically, products that assume nothing about the world around them and bend over backward to maintain compatibility are more likely to succeed. Still, I maintain hope that the issues of virtual machine mobility will be solved in an elegant way, rather than adding to the “stack of lies”.

© sfoskett for Stephen Foskett, Pack Rat, 2011. | The Terrifying True Story Of Virtual Machine Mobility
This post was categorized as Enterprise storage, Features, Gestalt IT, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

2011 will look pretty much like 2010 apart from the differences...

Prognostication is a perilous business, but pundits are drawn to the topic in the month of December. The fact that most predictions fall on their faces demonstrates the intoxicating mix of hope, dreams, and irrationality that mark both geniuses and fools. I am neither, so I like to make predictions after the fact! But this year I’ve been asked to look to the future, so I’ll stick with the safe road and pick current trends rather than guessing what I hope will come.

Five Trends For Everyone

1 – Ubiquitous Connectivity

I named mobility as the mega-trend of the last decade, noting that it’s hard to spot a trend from the middle and harder still from the start. But I feel vindicated on that 2009 call, and will take it one further: 2011 will see ubiquitous connectivity become mainstream. With “MiFi” entering the vernacular, a proliferation of “4G” networks and integrated wireless data, and free WiFi having already become passe, I’d say “online everywhere” is here. Although incredibly challenging from both a technical and business perspective, I expect everyone and everything to be online-capable.

2 – The iPad and Foes

Steve Jobs’ bizarre claim that the overgrown iPhone tablet was the most important thing he ever did is starting to look prescient. A new generation is coming of age without windowing GUIs, mice, and keyboards thanks to gaming consoles, smartphones, iPods, and (finally) tablets. 2011 will finally see serious Android, WebOS, and Windows tablets, but the iPad (and forthcoming iPad 2) are the platform to beat, and Apple is firing on all cylinders. This war will be all-consuming next year.

3 – Wave “Hi” to Kinect!

Microsoft has a serious hit on their hands with the Kinect add-on to the Xbox 360. The gaming system is the best thing to come out of Redmond in a long time, and it continues the “no controller” concept of the iPad, finally kicking the Wii to the curb. The massive success of the Xbox will lead Microsoft shareholders to abandon their calls for Ballmer’s head, instead asking for a spin-out or IPO of the gaming division. Expect PCs to include Kinect-like features in the coming years as well.

4 – Facebook Is the Internet

Now boasting a quarter of all web pageviews. Facebook is looking increasingly like AOL for the rest of us. 2011 will see Facebook’s gravity pull in content from everywhere, and its satellites sprout all over the Internet. It will become the single sign-on, the central “like”, the address book, and the meeting place. But fear not, Facebook-phobes: Nothing is permanent, and this too shall pass.

5 – The Internet Changes and No One Notices

The IP address space is exhausted, BGP and DNS security lapses rise, and net neutrality falls by the wayside but Farmville still works so no one cares. The Internet is changing, and controversies over key components are coming coming to a head. I imagine the network engineers will be busy keeping ahead of catastrophe, but they’ll manage somehow. I’m not sure if IPv6 will finally take off or if the carrier gambit will succeed, but I’m confident we’ll still have an Internet at the heart of the technology world!

Five Trends For the Datacenter

6 – Clouds Gather Quietly

“Cloud” was the buzzword of the last two years, but now it’s getting down to work. Traditional IT staff still won’t see much of it outside of blogs and conferences, but non-traditional systems are all heading that way. Look for major uptake of cloud platforms and services from the home to enterprise applications and everywhere in between. Ironically, the “c-word” itself will soon be dropped from these successful services just as it gains acceptance in IT shops.

7 – Virtual Everything

The impact of server virtualization hasn’t been as great as supporters claim, but widespread acceptance of hypervisor-centric data centers is here. There’s really no reason not to deploy every datacenter server as a virtual machine and lots of resulting benefits. Expect to see mission-critical apps finally move to VMware ESX and Microsoft Hyper-V in 2011. And expect to see the resulting infrastructure called “cloud”!

8 – Farewell, Fast Hard Drives

Storage I/O performance is now the realm of solid state, not spinning disk. SSDs have reached the level of performance, capacity, availability, and sophistication that we no longer need 15k rpm enterprise hard disk drives. You’ll use SSD if you want IOPS, but you’ll still need spinning platters for capacity and maximum throughput for a long while. Don’t expect hard disk drives to disappear, but the fastest will exit at the end of the year.

9 – Not-So-Converged I/O (Yet)

DCB ain’t ready, folks. Neither is FCoE. Although Ethernet will eventually sideline InfiniBand and Fibre Channel, that’s not a 2011 topic. I expect to hear a lot of noise about converged network and storage I/O, including high-profile customer adoption stories, but we’re still a few years short of actual impact and serious market share movement. Practical application starts in 2011, though, and it’ll get major coverage and big-money action in the vendor space.

10 – RAID is (Finally) Dead!

There won’t be much ink spilled in memoriam outside storage blogs like this one, but conventional mirroring and parity has finally met its maker. Today’s hard disk drives are too big to rebuild singly, and alternatives like wide striping, erasure coding, and touch-me-not disk packs are taking over.

And One More For Me

11 – The Internet is Shiva

Every business will be permanently changed as Internet-enabled platforms destroy profitable monopolies and build new opportunities. Google conquered advertising and destroyed traditional publishing but enabled a flowering of democratic dialog. PayPal and Square will do the same to banking in 2011, but their own come-uppance might come sooner than they like. No matter your business, someone has their sights set on you and the Internet is their tool. The trick is to keep dancing, keep innovating, and love the paradox.
The text to appear after expiration date.
Image Credit: Eleven by Wetsun

© sfoskett for Stephen Foskett, Pack Rat, 2010. | Eleven Tech Trends To Watch In 2011
This post was categorized as Apple, Computer History, Enterprise storage, Everything, Personal, Terabyte home, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

I love using TripIt, but is Pro worth the price?

Without a doubt, TripIt is one of the best online travel tools I’ve come across. With very little effort, TripIt creates consolidated travel itineraries including air, hotel, and car, enabling automatic calendar integration and sharing. They even introduced an iPhone app, putting the itinerary, along with helpful links to maps and flight tracking, right in your pocket whether online or off. The company cleverly combs forwarded confirmation emails from just about every travel company and web site, extracting the pertinent bits.

I’ve become a TripIt ambassador, inviting all of my co-workers and close friends to join in. But free services have their limits, and I have long wondered how TripIt would monetize their business. The company has been partnering with airlines (like Virgin America) and airport shuttle services, but partnerships don’t keep the lights on. Eventually the company would have to find a way to make money.

The answer arrived in my inbox this morning. TripIt is introducing an optional “TripIt Pro” version which adds automatic monitoring of itineraries, notifying if your flight is delayed, for example, as well as mobile alerts. This version will cost end-users $9.95 per month (once the trial period ends).

Although I love TripIt, I’m not sure if this upgrade is worth nearly $120 per year. Airlines already send alerts of delayed or cancelled flights to my phone via email or SMS. I trust that TripIt’s alerts will be more uniform and helpful, but I doubt they’ll be that much better. For now, I’m holding off on TripIt Pro.

The company does have plans to add alternate flight options in the future, which might start adding serious value. If they can say “go to the Delta counter within the next 10 minutes to get re-booked to Boston” I’d be all over it! I’d also like to see better integration with Exchange and iPhone calendars than the current simple ICS subscription. But let’s think bigger than this.

As a frequent flier, I’d love it if TripIt could help manage my airline and hotel mileage accounts. What if it suggested ways of maximizing their value, keeping track of upgrade “stickers” and the like? What if the company monitored the latest mileage promotions? I’d also love it if they included airport tips, like which restaurant at Chicago O’Hare serves edible food (Maccaroni Grill near gate K2) and where to find a power outlet (in the outermost corridor between E and F). TripIt already points to SeatGuru’s amazing aircraft information, but how about integrating this information right into the itinerary? And I’d love to see a combination of TripIt and Kayak!

What do you think? What can TripIt add to make its Pro service worthwhile to the frequent flier?

© sfoskett for Stephen Foskett, Pack Rat, 2009. | TripIt Goes Pro To Monetize Travel Itinerary Management
This post was categorized as Apple, Personal. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

IT infrastructure is following consumer technology out of the data center glass house and into the wide world

Dave Hitz over at NetApp poses a very interesting question: What is the ten-year trend in information technology that we are currently building to? He supplies these historical examples:

• 1982-1992: A computer on every (business) desk
• 1990s: Networking all those computers

He then goes on to suggest three ten-year trends that we might currently be living through:

1. Cloud/Outsourced Computing
2. Server Virtualization
3. Flash Memory

Although I agree on the importance of these three to enterprise IT, I don’t think they’ll be seen as the megatrends of this decade in hindsight. I suggest that, more than anything, we are witnessing a wholesale shift from information tied to place/device to information mobility. Cloud computing, server virtualization, and even flash memory are all contributors to this massive trend, along with the user-side trends of the post-PDA mobile phone, 3G data, social web services, and connected home.

What Is Mobility?

The meaning of mobility, to me, is expansive. It doesn’t just refer to taking a copy of your data with you, ubiquitous connectivity, or portable devices. Mobility is a new paradigm of computing.

• Your data no longer “sits” in one place – your data lives out there in the network!
• Your applications no longer “live” on this device or that – your applications live out there in the network!
• Your productivity environment no longer requires a particular piece of hardware – you expect to be productive everywhere on every device!

This doesn’t sound strange to the modern Internet user. We have completely accepted the role of Google, Facebook, Yahoo, Wikipedia and the rest in our personal lives. Just as they did in the early days of the PC, business people have transitioned these concepts into the professional world – witness Salesforce and LinkedIn! In all cases, we have endorsed the idea that certain types of information want to live in the cloud because it makes them better!

Once you’ve used these services, old-fashioned email, contact management, encyclopedias, maps, and the rest seem incredibly limiting. A GPS system that can’t update its maps seems antiquated, and we want it to have real-time traffic data, too. An iPod that needs to be physically connected to a PC to add music or applications is simply unacceptable. Time- and place-shifting technologies like TiVo To Go, over-the-air podcast downloads, and Slingboxes reset our expectations about availability and choice of entertainment, but they are mere symptoms of our changing perceptions. We want mobility of data, applications, and platforms, and we are getting it.

Consider two truly revolutionary platforms: the iPhone and the netbook. In both cases, we knowingly accept limitations in the name of portability, knowing that the cloud will give us what we can’t hold in our hands. These devices are limited in ways that would seem inconceivable just a few years ago: Apple has locked their platform up tighter than any in history, and netbooks are too small, underpowered, and cheap in all senses of the word. But we love them because they get us where we want to go, which is up and out!

Mobility and Enterprise IT

The concept of mobile data, applications, and devices is just as applicable to enterprise IT infrastructure as it is to personal technology. Some enterprise data must be kept close to the vest, especially where privacy laws and litigation concerns are applicable. But there is certainly a vast pool of corporate data that wants to be out working in the field! Setting this data free is the enterprise equivalent of the mobility megatrend!

Cloud computing is hype. Server virtualization is hype. Flash storage is hype. XaaS is hype. Web 2.0 is hype. But once the cloud of hype passes, we will be left with solid technologies to enable mobility and transform corporate computing. Why should corporate email have to punch through your firewall? Why should the intranet be limited to internal or VPN users? Why can’t customers interact with a (limited/controlled) set of your corporate records? Salesforce showed us that roaming users (sales teams) need greater access than most IT staff were ready to build. What if we applied the same ideas to other data types?

Many companies are already doing this. Microsoft offers a variety of internal/external services for their customers through Live (see Connect, for example). Many companies are using mail and productivity applications in the cloud from Google, MessageOne, and Zimbra. Backup and archiving as a service to mobile users is widespread (see Iron Mountain Connected and Mozy). And more and more corporate PR relies on blogs, twitter, and social networking sites. Corporate security and legal types are worried about data “escaping” from the eggshell of control they exert, but this cat is out of the bag. Enterprise IT will never be the same!

It comes down to a single core question that IT folks ought to have been asking themselves all along: What should be held internally and what should be let loose? We already “outsource” many non-core corporate functions. Sometimes we do this for cost reasons. But the most effective outsourcing decision is when a third party will do a better job, offering levels of expertise or service that an internal group could never realistically reach. We already buy enterprise software to leverage outside development (remember, this was not always the case!), so why not also buy enterprise services? Corporate-grade outsourced email, groupware, sales automation, and the like is not only more robust and less expensive than internal systems, they enable a disconnected, mobile workforce.

Today, I Was Angry

I bought a new album from Amazon, but I forgot to sync my iPhone with my laptop, so it was sitting at home when I wanted to listen to it in the car. Then I couldn’t find a colleague’s phone number because he moved to a new company and my address book didn’t automatically update. And I couldn’t review a presentation because I needed a special account to access a corporate document system behind a firewall.

These little accomplishments would have seemed like miracles just a few years ago: I remember the joy I felt ten years ago when I could read a web page offline on my Palm Pilot using AvantGo; I was amazed when I first fired up 802.11a wireless networking and could work anywhere in the office; I was gleeful to be able to take 5 GB of music with me on the train. But all this is past. Today, I want to access my portable data and work anywhere. We are in the midst of a revolution in the mobility and ubiquity of computing.

See my posts on Gestalt IT for similar enterprise IT infrastructure commentary

© sfoskett for Stephen Foskett, Pack Rat, 2009. | Ten-Year Trend: Mobility
This post was categorized as Apple, Computer History, Enterprise storage, Everything, Personal, Terabyte home, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.