This regular series features highlights from the week.

• Things I wrote:
  • What is Application Performance Monitoring?
  • Thoughts On A Dell Acquisition Of Compellent
  • My Light Peak series
    • Is Everyone Wrong About Light Peak?
    • Light Peak + USB 3.0 = Awesome!
    • What If Light Peak Was Electrical Rather Than Optical?
  • My HP AirPrint series
    • Which AirPrint Printer Is Best?
    • AirPrint-Compatible: HP Photosmart e-All-in-One Line
    • AirPrint-Compatible: HP’s Sexy Envy 100 and Photosmart eStation Printers
  • Is The iPad Compatible With SDXC and ExFAT Cards?
• Other Enterprise IT links:
  • Wireless Field Day is getting me to know lots of great wireless techies:
    • Twitter for the WLAN Professional
    • Gestalt IT Wireless Field Day March 17-18 2011 SJC
    • Wi-Fi Frequencies: An Overview
    • Wireless Field Day
    • NFC Smartphones Could Mean Greater Customer Influence
  • Microsoft’s cloud plays, in English
  • SSP Failure to Cloud Storage Success – What a Difference a Decade Makes
  • The different QoS capabilities of the VMware vSwitch’s
  • Is a whitebox or branded box better for a VMware lab?
  • Devops: The Re-emergance of Systems Engineering as a Discipline
  • Virtualizing the PCIe bus with Aprius
  • Unimpressed by Zettar
  • Virtualization and High Bandwidth Datacenter–How the Datacenter Landscape Is Changing
• Geeky techie links:
  • The Next Thing I Loved Today – Dell’s Social Media Command Center
  • The problems with digital audio archives
  • Taking a WikiLeak
  • Full Body Scanners: What’s Next?

Subscribe to my Google Reader feed or follow me on Twitter to see these in real-time.

© sfoskett for Stephen Foskett, Pack Rat, 2010. | Back From the Pile: Interesting Links, December 10, 2010
This post was categorized as Apple, Enterprise storage, Everything, Terabyte home, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

2011 will look pretty much like 2010 apart from the differences...

Prognostication is a perilous business, but pundits are drawn to the topic in the month of December. The fact that most predictions fall on their faces demonstrates the intoxicating mix of hope, dreams, and irrationality that mark both geniuses and fools. I am neither, so I like to make predictions after the fact! But this year I’ve been asked to look to the future, so I’ll stick with the safe road and pick current trends rather than guessing what I hope will come.

Five Trends For Everyone

1 – Ubiquitous Connectivity

I named mobility as the mega-trend of the last decade, noting that it’s hard to spot a trend from the middle and harder still from the start. But I feel vindicated on that 2009 call, and will take it one further: 2011 will see ubiquitous connectivity become mainstream. With “MiFi” entering the vernacular, a proliferation of “4G” networks and integrated wireless data, and free WiFi having already become passe, I’d say “online everywhere” is here. Although incredibly challenging from both a technical and business perspective, I expect everyone and everything to be online-capable.

2 – The iPad and Foes

Steve Jobs’ bizarre claim that the overgrown iPhone tablet was the most important thing he ever did is starting to look prescient. A new generation is coming of age without windowing GUIs, mice, and keyboards thanks to gaming consoles, smartphones, iPods, and (finally) tablets. 2011 will finally see serious Android, WebOS, and Windows tablets, but the iPad (and forthcoming iPad 2) are the platform to beat, and Apple is firing on all cylinders. This war will be all-consuming next year.

3 – Wave “Hi” to Kinect!

Microsoft has a serious hit on their hands with the Kinect add-on to the Xbox 360. The gaming system is the best thing to come out of Redmond in a long time, and it continues the “no controller” concept of the iPad, finally kicking the Wii to the curb. The massive success of the Xbox will lead Microsoft shareholders to abandon their calls for Ballmer’s head, instead asking for a spin-out or IPO of the gaming division. Expect PCs to include Kinect-like features in the coming years as well.

4 – Facebook Is the Internet

Now boasting a quarter of all web pageviews. Facebook is looking increasingly like AOL for the rest of us. 2011 will see Facebook’s gravity pull in content from everywhere, and its satellites sprout all over the Internet. It will become the single sign-on, the central “like”, the address book, and the meeting place. But fear not, Facebook-phobes: Nothing is permanent, and this too shall pass.

5 – The Internet Changes and No One Notices

The IP address space is exhausted, BGP and DNS security lapses rise, and net neutrality falls by the wayside but Farmville still works so no one cares. The Internet is changing, and controversies over key components are coming coming to a head. I imagine the network engineers will be busy keeping ahead of catastrophe, but they’ll manage somehow. I’m not sure if IPv6 will finally take off or if the carrier gambit will succeed, but I’m confident we’ll still have an Internet at the heart of the technology world!

Five Trends For the Datacenter

6 – Clouds Gather Quietly

“Cloud” was the buzzword of the last two years, but now it’s getting down to work. Traditional IT staff still won’t see much of it outside of blogs and conferences, but non-traditional systems are all heading that way. Look for major uptake of cloud platforms and services from the home to enterprise applications and everywhere in between. Ironically, the “c-word” itself will soon be dropped from these successful services just as it gains acceptance in IT shops.

7 – Virtual Everything

The impact of server virtualization hasn’t been as great as supporters claim, but widespread acceptance of hypervisor-centric data centers is here. There’s really no reason not to deploy every datacenter server as a virtual machine and lots of resulting benefits. Expect to see mission-critical apps finally move to VMware ESX and Microsoft Hyper-V in 2011. And expect to see the resulting infrastructure called “cloud”!

8 – Farewell, Fast Hard Drives

Storage I/O performance is now the realm of solid state, not spinning disk. SSDs have reached the level of performance, capacity, availability, and sophistication that we no longer need 15k rpm enterprise hard disk drives. You’ll use SSD if you want IOPS, but you’ll still need spinning platters for capacity and maximum throughput for a long while. Don’t expect hard disk drives to disappear, but the fastest will exit at the end of the year.

9 – Not-So-Converged I/O (Yet)

DCB ain’t ready, folks. Neither is FCoE. Although Ethernet will eventually sideline InfiniBand and Fibre Channel, that’s not a 2011 topic. I expect to hear a lot of noise about converged network and storage I/O, including high-profile customer adoption stories, but we’re still a few years short of actual impact and serious market share movement. Practical application starts in 2011, though, and it’ll get major coverage and big-money action in the vendor space.

10 – RAID is (Finally) Dead!

There won’t be much ink spilled in memoriam outside storage blogs like this one, but conventional mirroring and parity has finally met its maker. Today’s hard disk drives are too big to rebuild singly, and alternatives like wide striping, erasure coding, and touch-me-not disk packs are taking over.

And One More For Me

11 – The Internet is Shiva

Every business will be permanently changed as Internet-enabled platforms destroy profitable monopolies and build new opportunities. Google conquered advertising and destroyed traditional publishing but enabled a flowering of democratic dialog. PayPal and Square will do the same to banking in 2011, but their own come-uppance might come sooner than they like. No matter your business, someone has their sights set on you and the Internet is their tool. The trick is to keep dancing, keep innovating, and love the paradox.
The text to appear after expiration date.
Image Credit: Eleven by Wetsun

© sfoskett for Stephen Foskett, Pack Rat, 2010. | Eleven Tech Trends To Watch In 2011
This post was categorized as Apple, Computer History, Enterprise storage, Everything, Personal, Terabyte home, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

IT is crossing a chasm, and we may not be prepared for the new direction we are taking

I’m an IT revolutionary. I talk all the time about the quaint backwards “state of the art” in enterprise IT, what with its (many) decades old protocols, paradigms, and practices. What we call modern is really just a charade of faked-out old-fashioned open systems infrastructure: Pretend servers talking to fake disks over frankenstein networking technology.

What is Flexible IT?

I’ll be doing a “Twitterview” about Flexible IT today with NetApp. While I’m sure most companies would like to define flexible IT as “what we have in our product catalog,” I’m not going to play that game. IT has to change its ways or The Techie/Business Schismwill get us all.

I see the roadmap ahead as one journey over two paths:

1. Tactically, IT infrastructure groups must immediately begin implementing technologies that are responsive to user needs and focused on improving the performance of the business applications they support. This is what NetApp is calling Flexible IT.
2. Strategically, IT infrastructure must change entirely, implementing revolutionary platforms to support the next-generation apps that are being widely developed. Call this “cloud” if you must, but just about everything we take for granted today will lose significance in this new era.

Flexible IT (as it stands today) is tactical. IT infrastructure must be entirely virtualized to enable “right now” provisioning and reconfiguration. This means embracing enabling technologies like server-side hypervisors, blade computing, converged networking and I/O, and advanced storage technologies.

What Does it Mean to be a Service Provider?

Automobiles used to be raw and mechanical, but today the mechanical elements are obscured by a covering of user-friendliness and hands-off service

But real IT flexibility will mean higher-level abstraction. The next applications won’t want to run on “a server” – even a very flexible one. These apps will require a programming platform that abstracts away the entire concept of “server.” Although there will always be servers and disks and such, they will fade into the background, hidden under a layer of application services.

You know how some people like to think of themselves as “service providers”? They’re on the right track, though I’m not sure that they (yet) grasp the full significance of that concept.

A service provider has to provide the services required by consumers or it will fail. This means IT infrastructure has to prepare the environment demanded by IT application developers, rather than just shuffling around the chairs and tables and hoping customers will stream in.

What happens when the IT applications group asks the IT infrastructure manager to implement Microsoft’s Azure Services Platform? What if they want to run on App Engine or Force.com? The head-scratching in the VMware community about SpringSource is a sign that IT infrastructure just doesn’t comprehend what’s happening (yet).

Stephen’s Stance

This is a strategic shift, and we have to be ready. Being ready means changing not just what we do but also how we do it. The systems we employ in a decade might look familiar inside, but the process of delivering services on them will be entirely different. Making this shift requires real flexibility from IT, not just another round virtualization fake-outs.

Image credits: Highway construction Guizhou S0404 by sweart, VW engine by Grant Foskett

© sfoskett for Stephen Foskett, Pack Rat, 2010. | Flexible IT and the Path to the Services Future
This post was categorized as Computer History, Enterprise storage, Gestalt IT, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

Enterprise Storage

• HDS’ HAM-Fisted Announcement did not impress, with many wondering (So Long And Thanks For All The Fish) what exactly the company had announced. But by week’s end (USP-V and Hitachi High Availability Manager) we had figured out How It Works and even had some time for jokes.
• What should be in the cloud? How about some profiling questions nobody’s asking re: cloud applications
• Want your own iSCSI array? StarWind has responded to your comments, 2TB at no cost!
• What Is a Backup? Some great discussion (Backup to the Future) and a solution: When Is A Copy A Backup?
• Howard Marks is also doing a great job with backup and archiving: See Of Backups and Archives, Storing Archival Data – Part Deux, and All Archive Data is Not Alike
• I joined Chris Evans, Marc Farley, and Greg Knierieman for Infosmack Episode #6 – HDS USP-V announcement, EMC non-competes and changes at VMworld
• ‘Nuff said: And people wonder why I hate HP, Google Could Learn a Thing or Two from EMC, Virtualization: Why Microsoft cares

Misc

• Tim O’Reilly took a look at a technology I just didn’t get, but changed my mind with Google Wave: What Might Email Look Like If It Were Invented Today?
• Want a crazy car to get your mind off of GM and Chrysler? How about the 500-hp Ariel Atom 500 V8
• A wonderfully long and detailed article: Lessons from the Vaccine–Autism Wars
• Finally, take a look at this amazing video: Louis CK “Everything’s amazing, nobody’s happy”

© sfoskett for Stephen Foskett, Pack Rat, 2009. | Back From The Pile: May 30, 2009
This post was categorized as Enterprise storage, Personal, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

The highlight of the show was Monday’s keynote by Roman Stanek of Good Data. His company’s eponymous analytics product lives entirely in the cloud, scaling as needed to meet customer demand. He led us through the thought process that led to this architecture, demonstrating why it’s simply the only sensible choice for applications like his. Nearly all of Good Data’s service expense is operational rather than capital in nature: Leveraging the OPEX advantage of infrastructure as a service allowed them to take in less money, giving less control to venture capitalists. The geographically-dispersed workforce uses laptop computers and the internet with no computer room or servers. Cloud computing is true SOA for the first time. As Roman told me, he couldn’t preach the virtues of the cloud without adopting it internally!

My discussions with the Expo attendees focused on where exactly this momentum will take us. Expo emcee, Jeremy Geelan, summed it up: Cloud computing will eventually be called nothing. It’s just computing. When it has no name, we will know that it has become a success. Many of my discussions came to this point, that the cloud computing movement is already underway, already taking hold both in consumer and corporate spheres, and will quietly take its place alongside more conventional in-house paradigms.

Among the many ideas worth considering:

• We may eventually see time-variable pricing, with rates going up at periods of peak demand and down at other times. This will lead to spot pricing and futures contracts.
• One follow-on idea was the possibility of deep discounts for those who can tolerate “best effort” services. Would you pay 10% extra for a non-guaranteed extra copy “most of the time”?
• Service providers will compete not just on price, but scalability, efficiency, and SLAs.
• Private clouds may not be clouds at all, since they don’t offer the same CAPEX/OPEX tradeoff and flexibility advantages. But private clouds could lead to a peer-to-peer public cloud, something that is already happening with DR systems today!
• How many public clouds will there be and who will run these? Will it be the usual suspects like Amazon and Google? The telephone companies? The software providers? Or corporate peers, as mentioned above?
• Flexibility to relocate applications in the cloud is an excellent idea, and one that will spur adoption, but “ye canna change the laws of physics” when it comes to bandwidth. This means that it’s a lot harder to migrate cloud storage to a new provider than cloud application instances!
• With each country adopting different laws, it becomes incredibly important to consider which legal system governs your cloud computing system. This has important implications for privacy and accountability, but many fail to think about it.

Although I missed out on the fellowship of the EMC World Bloggers’ Lounge, I think I learned much more from the cloud community in Prague!

© sfoskett for Stephen Foskett, Pack Rat, 2009. | Lessons From the Cloud Computing Conference and Expo Prague 2009
This post was categorized as Enterprise storage, Gestalt IT, Personal, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

There is still time to register and attend the Expo, and I’d love to meet up with readers and new friends. I’ll also be in New York on Saturday May 16th and London on Wednesday May 20th. Drop me a line! Sadly, this schedule means I’ll be missing everyone at EMC World, but I think they will get along without me somehow!

The Benefits of Cloud Storage

The demand for storage has increased, placing significant stress on “in house” storage infrastructures and costly overcapacity build-outs Factoring in our current economic state and the pressures of power, space, capital expenditures, global performance, and availability issues, companies are faced with an exploding challenges and costs. Cloud storage platforms enable Enterprises to cut-cost and focus on more important aspects of business, but with many competitors in the marketplace it’s hard for businesses to decide which option is best. This session will teach attendees about the uses of cloud storage within Enterprise levels of deployment and shed some light on the current solutions available today. (Monday, May 18, 5:05 PM)

How Does Virtualization Change Storage?

The virtualization of servers destroys everything that storage folks thought they knew about I/O and throws in a new layer of abstraction to boot. Creating storage for virtualization is not the same as storage for most other apps, and storage virtual servers on a SAN or NAS is not the same as using internal disk. There is synergy between the two fields, though, if we look for it. This sesskion will walk through what virtualization changes about storage, the various storage options, pros and cons, and what the future looks like with FCoE, UCS, 10 GbE, and VMware vStorage APIs. (Tuesday, May 19, 6:30 PM)

© sfoskett for Stephen Foskett, Pack Rat, 2009. | Preparing For Cloud and Virtualization Expo in Prague
This post was categorized as Enterprise storage, Personal, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

My presentation on Monday evening focuses on the emergence of cloud storage in the enterprise space: Why it’s important, what it is, and how to act on it. I start by talking about the drivers, including the unexpectedly high cost of storage and the failures of tiered storage so far. I then suggest a new paradigm for the enterprise, leveraging solid state disks and the cloud. I reality check this against McKinsey’s recent cloud model and demonstrate some TCO goodness. Finally, I talk about the reasons folks might be concerned about bringing cloud storage into their environments.

© sfoskett for Stephen Foskett, Pack Rat, 2009. | My Cloud Slam Topic: Enterprise Storage (Predictable?)
This post was categorized as Enterprise storage, Personal. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

Sun is getting into the cloud services business, but which market is their target?

While the bulk of Sun-related news this week relates to reported talks of a buyout by IBM, the company took a break from negotiations to introduce their own cloud computing and storage infrastructure, challenging Amazon, Google, Rackspace, and perhaps VMware, Microsoft, and Nirvanix.

Sun is leveraging the assets they acquired from Q-layer earlier this year on top of OpenSolaris, MySQL, ZFS, and just about everything else in their arsenal to offer their own virtual data center (VDC) strategy. The Sun Cloud will be a private (inside the firewall) environment offering mobility of virtual machines. Q-layer had partnerships with both VMware and Microsoft and functioned with Windows, OpenSolaris, and Linux, suggesting that this will be quite a full-featured offering. Suddenly Sun’s free OpenSolaris offering on Amazon EC2 makes a lot more sense – it provides a gateway to take virtual computing business from the Bezos team!

One very nifty angle Sun is taking is enabling VirtualBox system images to be saved to (and presumably run in) their cloud. I wonder about monetization, since VirtualBox is more of a desktop virtualization system than VMware ESX and Microsoft Hyper-V, but the prospect of clicking “Upload to Cloud” is intriguing! OpenOffice will also allow cloud storage, a foil to Google Apps.

The Sun Cloud also includes a managed storage service. Sun apparently has three storage protocols: A proprietary Sun Cloud Storage API, WebDAV, and an object API likely leveraging Amazon’s AWS. The company claims that they are API-compatible with AWS, allowing applications written with Amazon in mind to be easily ported to their cloud storage service.

One key point to consider with all of this cloud talk, however, is how prepared each company is to support enterprise computing needs. Long-term viability depends on paying customers, and only the largest systems can attract enough end-user nickels and dimes to survive. Enterprise solutions are where the real money is, and questions remain about how prepared companies like Amazon, Google, and Rackspace are to support the needs of corporate users.

There are really three cloud markets: Shared clouds for small developers and enterprise customers and private cloud systems. Amazon was strong from the start with the little guys, Web 2.0 startups and end-user services like Jungle Disk, and Rackspace/Mosso and Google are challenging them in this space. Sun’s focus on AWS compatibility and VirtualBox suggests that they plan to play in this sandbox.

But the enterprise cloud is another matter entirely. Nirvanix stands strong in shared managed storage services, racking up win after win with big customers. EMC, VMware, Microsoft and others are positioning themselves as private alternatives in this space. Will Sun try to compete here, too? They are certainly talking about private clouds and the virtual data center, but there is a serious risk that they will lose focus trying to take on too many roles, and enterprise users won’t tolerate poor pre- and post-sales support! 

© sfoskett for Stephen Foskett, Pack Rat, 2009. | Sun Launches Their Own Cloud, But For Which Market?
This post was categorized as Enterprise storage, Gestalt IT, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

IT infrastructure is following consumer technology out of the data center glass house and into the wide world

Dave Hitz over at NetApp poses a very interesting question: What is the ten-year trend in information technology that we are currently building to? He supplies these historical examples:

• 1982-1992: A computer on every (business) desk
• 1990s: Networking all those computers

He then goes on to suggest three ten-year trends that we might currently be living through:

1. Cloud/Outsourced Computing
2. Server Virtualization
3. Flash Memory

Although I agree on the importance of these three to enterprise IT, I don’t think they’ll be seen as the megatrends of this decade in hindsight. I suggest that, more than anything, we are witnessing a wholesale shift from information tied to place/device to information mobility. Cloud computing, server virtualization, and even flash memory are all contributors to this massive trend, along with the user-side trends of the post-PDA mobile phone, 3G data, social web services, and connected home.

What Is Mobility?

The meaning of mobility, to me, is expansive. It doesn’t just refer to taking a copy of your data with you, ubiquitous connectivity, or portable devices. Mobility is a new paradigm of computing.

• Your data no longer “sits” in one place – your data lives out there in the network!
• Your applications no longer “live” on this device or that – your applications live out there in the network!
• Your productivity environment no longer requires a particular piece of hardware – you expect to be productive everywhere on every device!

This doesn’t sound strange to the modern Internet user. We have completely accepted the role of Google, Facebook, Yahoo, Wikipedia and the rest in our personal lives. Just as they did in the early days of the PC, business people have transitioned these concepts into the professional world – witness Salesforce and LinkedIn! In all cases, we have endorsed the idea that certain types of information want to live in the cloud because it makes them better!

Once you’ve used these services, old-fashioned email, contact management, encyclopedias, maps, and the rest seem incredibly limiting. A GPS system that can’t update its maps seems antiquated, and we want it to have real-time traffic data, too. An iPod that needs to be physically connected to a PC to add music or applications is simply unacceptable. Time- and place-shifting technologies like TiVo To Go, over-the-air podcast downloads, and Slingboxes reset our expectations about availability and choice of entertainment, but they are mere symptoms of our changing perceptions. We want mobility of data, applications, and platforms, and we are getting it.

Consider two truly revolutionary platforms: the iPhone and the netbook. In both cases, we knowingly accept limitations in the name of portability, knowing that the cloud will give us what we can’t hold in our hands. These devices are limited in ways that would seem inconceivable just a few years ago: Apple has locked their platform up tighter than any in history, and netbooks are too small, underpowered, and cheap in all senses of the word. But we love them because they get us where we want to go, which is up and out!

Mobility and Enterprise IT

The concept of mobile data, applications, and devices is just as applicable to enterprise IT infrastructure as it is to personal technology. Some enterprise data must be kept close to the vest, especially where privacy laws and litigation concerns are applicable. But there is certainly a vast pool of corporate data that wants to be out working in the field! Setting this data free is the enterprise equivalent of the mobility megatrend!

Cloud computing is hype. Server virtualization is hype. Flash storage is hype. XaaS is hype. Web 2.0 is hype. But once the cloud of hype passes, we will be left with solid technologies to enable mobility and transform corporate computing. Why should corporate email have to punch through your firewall? Why should the intranet be limited to internal or VPN users? Why can’t customers interact with a (limited/controlled) set of your corporate records? Salesforce showed us that roaming users (sales teams) need greater access than most IT staff were ready to build. What if we applied the same ideas to other data types?

Many companies are already doing this. Microsoft offers a variety of internal/external services for their customers through Live (see Connect, for example). Many companies are using mail and productivity applications in the cloud from Google, MessageOne, and Zimbra. Backup and archiving as a service to mobile users is widespread (see Iron Mountain Connected and Mozy). And more and more corporate PR relies on blogs, twitter, and social networking sites. Corporate security and legal types are worried about data “escaping” from the eggshell of control they exert, but this cat is out of the bag. Enterprise IT will never be the same!

It comes down to a single core question that IT folks ought to have been asking themselves all along: What should be held internally and what should be let loose? We already “outsource” many non-core corporate functions. Sometimes we do this for cost reasons. But the most effective outsourcing decision is when a third party will do a better job, offering levels of expertise or service that an internal group could never realistically reach. We already buy enterprise software to leverage outside development (remember, this was not always the case!), so why not also buy enterprise services? Corporate-grade outsourced email, groupware, sales automation, and the like is not only more robust and less expensive than internal systems, they enable a disconnected, mobile workforce.

Today, I Was Angry

I bought a new album from Amazon, but I forgot to sync my iPhone with my laptop, so it was sitting at home when I wanted to listen to it in the car. Then I couldn’t find a colleague’s phone number because he moved to a new company and my address book didn’t automatically update. And I couldn’t review a presentation because I needed a special account to access a corporate document system behind a firewall.

These little accomplishments would have seemed like miracles just a few years ago: I remember the joy I felt ten years ago when I could read a web page offline on my Palm Pilot using AvantGo; I was amazed when I first fired up 802.11a wireless networking and could work anywhere in the office; I was gleeful to be able to take 5 GB of music with me on the train. But all this is past. Today, I want to access my portable data and work anywhere. We are in the midst of a revolution in the mobility and ubiquity of computing.

See my posts on Gestalt IT for similar enterprise IT infrastructure commentary

© sfoskett for Stephen Foskett, Pack Rat, 2009. | Ten-Year Trend: Mobility
This post was categorized as Apple, Computer History, Enterprise storage, Everything, Personal, Terabyte home, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.

Great! But I thought the new era for IT was a cloud with choice, mobility, and application support, as trumpeted by EMC’s VMware subsidiary! Wasn’t Cloud vServices from VDC-OS supposed to be the prototype cloud strategy for the datacenter?

What we have here is a simple clash of marketing amusingly taking place at (nearly) the same company. VMware figured out how to extend their server virtualization products outside the confines of the data center, and laid that technology out as a strategy with the trendy “cloud” name. Meanwhile, mother EMC is working on next-generation content storage software and decides to roll that out as a strategy and also jumps on the “cloud” meme. What’s an IT manager to do?

Defining Atmos

As predicted, EMC’s Atmos (code-name Maui) is a distributed software layer to handle the storage and management of data objects across geographically-dispersed storage devices. EMC’s Chuck Hollis demonstrates Atmos with a simple, practical example, perhaps making it sound too much like Akamai but generally getting the point across. You have a data object, write it to Atmos through REST/SOAP or CIFS/NFS, assign some metadata, and the software takes care of data placement for you. It’ll add local copies, replicate for availability and performance, compress or deduplicate, manage versions, and all sorts of goodies (if you ask it to).

But EMC already has a capable object storage platform, the Centera. We’ve just got used to the content-addressable storage (CAS) label for object storage (even though this name misses the point of object storage, in my opinion) and now EMC wants us to learn a new label for a somewhat-similar device? Steve Todd, EMC’s object guy extraordinaire, lays it out:

SAN Value = Centralized, secure multi-tenancy for blocks.

NAS Value = Centralized, secure multi-tenancy for files.

CAS Value = Centralized, secure multi-tenancy for objects (content + metadata).

COS Value = Globalized, secure multi-tenancy for content with rich policies.

Ok, so the defining capabilities of Atmos are its global scale and rich policies. And the fact that “objects” has become “content”, presumably since Atmos can handle traditional NAS (CIFS/NFS) chores as well.

Prayers Answered?

It sounds like EMC is answering my prayers for a storage revolution, delivering a highly-capable object storage platform that transcends the old limits of blocks, directories, and files. Steve Todd points out that Atmos handles five policy categories out of the box:

• Replication
• Compression
• Spin-down
• Object de-dup
• Versioning

So we write some data to Atmos, using either traditional NAS or webby dubby protocols like SOAP, and can then apply policies in any of these five categories to that data. One can also extend the Atmos to accept other policies, but the absence (out of the box) of concepts like encryption, secure deletion, retention, and access control are surprising.

I am quite puzzled about how practical these policy capabilities will be in the real world. How exactly would an application say “I want you to compress that file I wrote over NFS just now?” Hitachi’s HCAP platform, for example, also has policy capabilities and a NAS front end, and although archiving applications can communicate their policy needs, I don’t see lots of current general-purpose applications using it.

Strategic Storage?

This brings me to my puzzlement: The default Atmos policies are all general-purpose, production computing ideas, not the special-purpose, archiving and retention needs served by Centera, HCAP, and the rest. So the Atmos is clearly intended to be a production data storage system, not an archiving system to compete with Centera.

Since mainstream business applications currently don’t have any capability to specify policies like these when writing files, and since NAS protocols lack any means to communicate them even if the apps want to, we can conclude that EMC expects that Atmos users will write special applications to take advantage of it.

EMC certainly doesn’t expect that the NAS-capable Atmos will simply replace today’s distributed NAS solutions. NAS is a sideshow for Atmos. The real action will be in the REST/SOAP webby dubby applications that will be written with the platform in mind and will take full advantage of these capabilities.

If this is true, and I and others suspect that it is, then Atmos really isn’t a game-changing platform unless you change your game. If you write new applications to store data with SOAP, Atmos is a nice in-house alternative to Amazon S3 or Nirvanix, and offers a very compelling set of data management capabilities. And if you want to set up shop to compete with those service providers, Atmos is a dream come true with built-in multi-tenancy.

Datacenter Strategy

So EMC alone has two seemingly competitive datacenter strategies. And then there’s Microsoft, which announced its Azure cloud platform recently, and Amazon and the other cloud providers.

So let’s say you’re a CIO for a large corporation. Which of the following strategies is more compelling:

1. Use VMware VDC-OS to add capabilities and Cloud vServices extend your current virtual infrastructure geographically
2. Recompile and tweak your Windows applications to leverage Microsoft Azure
3. Develop new applications to take advantage of the impressive storage capabilities of an in-house EMC Atmos system
4. Point your new applications at a third-party cloud provider like Amazon or Nirvanix

IT people are practical. Although we love new technology, we tend to be cautious. We also hate massive software development efforts, and only sanction them when they’re absolutely necessary. Given these personality traits, I’d say VDC-OS and perhaps Cloud vServices still stands out as the most likely and practical scenario for the majority of applications and businesses.

This is not to say that EMC Atmos will be a flop. I’m impressed by the technology, and expect that Atmos will find buyers, just as Centera did. And Atmos might even replace Centera once EMC adds retention policies to it and scales it down as well as up and out. But Atmos will not redefine the datacenter. We’re stuck with blocks and files, and VMware’s practical strategy is a winner in that world.

Update: Marc Farley compares Atmos to WAFS, with ominous implications, and echos my recent question on what is and is not innovative.

Update 2: Chuck Hollis, Storagezilla, and Len Devanna have all come right out and said that this is only intended for certain customers with massive distributed storage needs, and is not intended as a new datacenter strategy. Even the “cloudfella” says “ciao”:

Update 3: More great information, including a reply regarding VDC-OS and Atmos from the one and only Chad Sakac, more great detail about the inner workings of Atmos from Steve Todd, and even more info from Dave Graham. Finally, although I think that Cloudfellas video is cute, I wouldn’t categorize it as viral. But those Mozy ads are awesome!

See my posts on Gestalt IT for similar enterprise IT infrastructure commentary

© sfoskett for Stephen Foskett, Pack Rat, 2008. | EMC Atmos Versus VMware VDC-OS: Will The Real Cloud Strategy Please Stand Up?
This post was categorized as Enterprise storage, Virtual Storage. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.