<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	xmlns:series="http://unfoldingneurons.com/"
	>

<channel>
	<title>Stephen Foskett, Pack Rat &#187; CIFS Archives  &#8211; Stephen Foskett, Pack Rat</title>
	<atom:link href="http://blog.fosketts.net/tag/cifs/feed/" rel="self" type="application/rss+xml" />
	<link>http://blog.fosketts.net</link>
	<description>Understanding the accumulation of data</description>
	<lastBuildDate>Fri, 10 Feb 2012 17:40:43 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=</generator>
<atom:link rel="hub" href="http://pubsubhubbub.appspot.com" />
	<atom:link rel="hub" href="http://superfeedr.com/hubbub" />
			<item>
		<title>Granularity: The Hidden Challenge of Storage Management</title>
		<link>http://blog.fosketts.net/2011/04/19/granularity-challenge-storage-management/</link>
		<comments>http://blog.fosketts.net/2011/04/19/granularity-challenge-storage-management/#comments</comments>
		<pubDate>Tue, 19 Apr 2011 13:00:59 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Computer History]]></category>
		<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[Acopia]]></category>
		<category><![CDATA[AFP]]></category>
		<category><![CDATA[Amazon]]></category>
		<category><![CDATA[BlueArc]]></category>
		<category><![CDATA[CIFS]]></category>
		<category><![CDATA[data management]]></category>
		<category><![CDATA[DFS]]></category>
		<category><![CDATA[F5]]></category>
		<category><![CDATA[Google]]></category>
		<category><![CDATA[Hyper-V]]></category>
		<category><![CDATA[Microsoft]]></category>
		<category><![CDATA[NAS]]></category>
		<category><![CDATA[NetApp]]></category>
		<category><![CDATA[network storage]]></category>
		<category><![CDATA[NFS]]></category>
		<category><![CDATA[ONStor]]></category>
		<category><![CDATA[RAID]]></category>
		<category><![CDATA[SAN]]></category>
		<category><![CDATA[storage area network]]></category>
		<category><![CDATA[storage management]]></category>
		<category><![CDATA[storage virtualization]]></category>
		<category><![CDATA[Sunday series]]></category>
		<category><![CDATA[updated]]></category>
		<category><![CDATA[VMFS]]></category>
		<category><![CDATA[VMware]]></category>
		<category><![CDATA[VSS]]></category>
		<category><![CDATA[Xen]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/2008/09/28/granularity-the-hidden-challenge-of-storage-management/</guid>
		<description><![CDATA[Many storage challenges focus on the conflict between data management, which demands an ever-smaller unit of management, and storage management, which benefits most from consolidation. Developing data management capability that is both granular enough for applications and scalable enough for storage is one key to the future of storage.]]></description>
			<content:encoded><![CDATA[<div id="attachment_785" class="wp-caption aligncenter" style="width: 310px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><img class="size-medium wp-image-785 " title="Mueslix" src="http://blog.fosketts.net/wp-content/uploads/2008/09/d0bcd18ed181d0bbd0b8-300x224.png" alt="" width="300" height="224" /><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">How granular is your storage? This question is just as relevant today as when I first published this article in 2008!</p></div>
<p>Many storage challenges focus on correlating high-level uses of data (such as applications) with the nuts and bolts of storage infrastructure. These discussions often revolve around the conflict between <em>data management</em>, which demands an ever-smaller unit of management, and <em>storage management</em>, which benefits most from consolidation. Developing data management capability that is both granular enough for applications and scalable enough for storage is one key to the future of storage.</p>
<h3>Storage Management: Scaling Up</h3>
<p>As I discussed in a previous <a href="http://blog.fosketts.net/tag/Sunday-series/"  target="_self">Sunday Series</a> piece, <a href="http://blog.fosketts.net/2008/09/14/turning-page-raid/"  target="_self"><em>Turning the Page on RAID</em></a>, the data storage industry has traditionally focused on reducing granularity. Disk capacity has expanded, and RAID technology has multiplied this by combining multiple physical drive mechanisms into a single virtual one. Storage virtualization technologies, from the SAN to the server, have also often been touted primarily as a mechanism to reduce heterogeneity. From a technical perspective, therefore, granularity has been an obstacle to overcome.</p>
<p>The core organizational best practice for storage management is the reduction of complexity and the enforcement of standardization. Consolidation of storage arrays and file servers is a common goal, as IT seeks to benefit from economies of scale. The goal of both initiatives is the creation of a storage utility or managed storage service. This mirrors efforts on the server and network sides to consolidate and virtualize hardware.</p>
<p>Although both technological and organizational factors have traditionally driven granularity out of storage, this does not have to be the case. Virtual pools of storage are ideal for providing storage on demand, as disk-focused RAID groups give way to more flexible sub-disk storage arrangements. And an operational focus on standardized storage service offerings has the potential to enable scalable management of these smaller units.</p>
<h3>Filing Service</h3>
<p>File-based protocols would seem to have more potential for granular storage management, but they have been undermined by the hierarchical nature of modern file storage. Whether the connection to a file server uses NFS, CIFS, or AFP, the key unit of management is actually the shared directory, not the file. All files in the share \\firefly\backups would be located on the same server and would be managed as a unit.</p>
<p>NAS virtualization can change this somewhat, as can more specialized NAS servers. Although Microsoft DFS enables consolidation and virtualization of NAS shares, it does not allow subdivision of shares below the directory level &#8211; all files in a directory must be placed on the same server. Tricks like stubbing and links allow for some movement, but these do not solve the core issue. Specialized virtual NAS devices from F5 (the ARX, nee Acopia), NetApp, BlueArc, Symantec, and others have the ability to move files individually, providing as much a virtualized storage environment as any block-focused enterprise array. Avere is also beginning to talk about granular file management.</p>
<p>But even an ideal virtualized file server lacks the kind of granularity demanded by users. They care about data, not files, and most applications consolidate their data storage into a few files. Consider a database, for example, where users want each record treated uniquely but storage devices see just a few much larger files. <a href="http://blog.fosketts.net/2008/09/28/we-need-storage-revolution/"  target="_self">We need a storage revolution</a>, where someone creates an ideal storage platform in which each individual record or object includes custom metadata and is managed independently. This would truly be a massive change, however, and it is not clear that all applications will follow the object storage model of Google and Amazon.</p>
<h3>Small is Beautiful</h3>
<p>Barring a revolution in data management, our best hope is to allow greater granularity in storage management. As mentioned above, virtualization technology has the potential to enable management and protection of any unit of storage, right down to the individual block or record. But the reality of storage virtualization has not matched its promise.</p>
<p>What is needed is greater integration. Each layer of virtualization (file system, volume manager, hypervisor, network, array, and RAID) also hides necessary details from lower layers. Consider the case of a virtual server snapshot: The application and filesystem must be in a quiesced state to allow a snapshot to be taken at the storage level, but the storage array has no intrinsic information about how its capacity is used. A given LUN might contain dozens of servers on a shared VMFS volume, so all must be snapped together.</p>
<p>Integration can be enabled by sharing more information through APIs. VMware leverages <a href="http://blog.fosketts.net/2008/07/28/storage-fixes-vmware-esx-server-35-update-2/"  target="_self">Microsoft Volume Shadow Copy Service (VSS) integration for shared storage</a> so a VMFS snapshot can call the operating system and even applications (Windows Server 2003 only, for now) to prepare the data. Similarly, VSS can communicate directly with supported iSCSI and Fibre Channel arrays, calling a snapshot at the right moment. And Microsoft is, no doubt, enhancing VSS as we speak.</p>
<p>As virtualization technology matures, expect this type of integration to improve. We hope to see more APIs exposed by VMware and Microsoft, allowing communication up and down the stack to break through the information barrier. Imagine a future where a standard API like VSS can pass a message through VMware, Xen, and Hyper-V to the underlying storage array to initiate a snap. I predict that this kind of integration-enabled granularity is not too far off.</p>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2011/04/30/storage-revolution/"  rel="bookmark" class="crp_title">We Need a Storage Revolution</a></li><li><a href="http://blog.fosketts.net/2011/04/23/virtualization-data-center-infrastructure/"  rel="bookmark" class="crp_title">Where Will Virtualization of Data Center Infrastructure Take Us?</a></li><li><a href="http://blog.fosketts.net/2008/02/21/volume-management-virtualizing-host-storage/"  rel="bookmark" class="crp_title">Volume Management: Virtualizing Host Storage</a></li><li><a href="http://blog.fosketts.net/2011/04/24/changing-it-organization-roles/"  rel="bookmark" class="crp_title">Changes in Technology Drive Changes in IT Organizations and Roles</a></li><li><a href="http://blog.fosketts.net/2007/07/26/storage-management-integrated-with-server-virtualization-wheres-emc/"  rel="bookmark" class="crp_title">Storage Management Integrated with Server Virtualization (Where&#8217;s EMC?)</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2011/04/19/granularity-challenge-storage-management/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2011. |
<a href="http://blog.fosketts.net/2011/04/19/granularity-challenge-storage-management/">Granularity: The Hidden Challenge of Storage Management</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/computerhistory/" title="View all posts in Computer History" rel="category tag">Computer History</a>, <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2011/04/19/granularity-challenge-storage-management/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
		</item>
		<item>
		<title>Why Do I Ignore NAS?</title>
		<link>http://blog.fosketts.net/2010/05/07/i-ignore-nas/</link>
		<comments>http://blog.fosketts.net/2010/05/07/i-ignore-nas/#comments</comments>
		<pubDate>Fri, 07 May 2010 15:53:02 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Apple]]></category>
		<category><![CDATA[Computer History]]></category>
		<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Gestalt IT]]></category>
		<category><![CDATA[Terabyte home]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[AFP]]></category>
		<category><![CDATA[best practices]]></category>
		<category><![CDATA[BlueArc]]></category>
		<category><![CDATA[Celerra]]></category>
		<category><![CDATA[CIFS]]></category>
		<category><![CDATA[cloud storage]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[iSCSI]]></category>
		<category><![CDATA[Microsoft]]></category>
		<category><![CDATA[NAS]]></category>
		<category><![CDATA[NetApp]]></category>
		<category><![CDATA[REST]]></category>
		<category><![CDATA[Samba]]></category>
		<category><![CDATA[SCSI]]></category>
		<category><![CDATA[SMB]]></category>
		<category><![CDATA[Storage Decisions]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=3077</guid>
		<description><![CDATA[Why does network-attached storage (NAS) have such a poor reputation? This isn't what the vendors want to be talking about, but some recent product announcements and discussions led to this thought. IT folks as a whole don't trust NAS for real work, and 20 years of effort from big names like Sun, Microsoft, NetApp, IBM, and the rest hasn't changed that.]]></description>
			<content:encoded><![CDATA[<p><strong>Why does network-attached storage (NAS) have such a poor reputation?</strong> This isn&#8217;t what the vendors want to be talking about, but some recent product announcements and discussions led to this thought. IT folks as a whole don&#8217;t trust NAS for real work, and 20 years of effort from big names like Sun, Microsoft, NetApp, IBM, and the rest hasn&#8217;t changed that.</p>
<h3>Fear</h3>
<p>Back when I used to teach the &#8220;Storage 101&#8243; session at Storage Decisions, I was consistently amazed to find little awareness of enterprise NAS systems. People complained about LUNs and Fibre Channel but when I suggested using <a rel="nofollow" href="http://en.wikipedia.org/wiki/Network_File_System_(protocol)"  target="_blank">NFS</a> or <a rel="nofollow" href="http://en.wikipedia.org/wiki/Server_Message_Block"  target="_blank">SMB</a> their heads almost exploded. <strong>&#8220;We would never use that for application storage,&#8221; they shouted. &#8220;File servers are for home directories, not data center stuff!&#8221;</strong> Clearly, NAS faces an uphill battle.</p>
<p>In a recent piece I wrote, I referred to what I consider to be <strong>the prime best practice: Use the right tool for the job</strong>. It&#8217;s a simple statement, and one that resonates beyond IT and the technology world. But it can be devilishly difficult to see what the right tool is sometimes. Why not use NAS for virtual machine storage? NetApp has been beating that drum for years, yet NAS has a very small footprint in VMware. How about databases on NFS? Exchange over SMB? Block storage has a massive lead over NAS in all of these areas.</p>
<blockquote><p>Rear this &#8220;best practices&#8221; piece, <em><a href="http://blog.fosketts.net/2010/04/27/process-solutions-process-problems-technical-solutions-technical/" >Use Process Solutions For Process Problems, Technical Solutions For Technical Ones</a></em></p></blockquote>
<p>IT folks seem downright fearful of file-level storage protocols. Has NFS really burned them that badly over the decades? Can SMB/CIFS really be as bad as they think?</p>
<h3>Loathing</h3>
<p>I wonder if this terror has more to do with the products people have used than the fundamental concept of file services. <strong>Many NAS servers (and clients) are barely functional</strong>. Sadly, NFS and SMB are easy to get 80% right, but the 20% corner case interaction takes decades to overcome. My daily storage consulting work exposes me to a myriad of NAS configurations, and few of the multi-platform combinations end well.</p>
<blockquote><p>Note: Although it has long been known by a variety of names, <strong>the Windows NAS protocol is currently called Server Message Block or SMB</strong>. Common Internet File System (CIFS) was a failed mid-1990&#8242;s attempt by Microsoft to make this protocol standard on the Internet.</p></blockquote>
<p>Consider the Mac. Apple added <a rel="nofollow" href="http://support.apple.com/kb/ht1568"  target="_blank">an SMB client</a> to OS X in 2001 but, despite many updates, it is far from reliable. <strong>Mac users in general loathe connecting to Windows file servers</strong>, and business users have located numerous bugs in the handling of Mac-specific file types. It&#8217;s bad enough that one company, GroupLogic, created an entire <a href="http://www.grouplogic.com/products/extremeZ-IP/"  target="_blank">AFP server for Windows</a> just to solve these tricky issues.</p>
<p>This situation often happens in reverse, too. <strong>Windows admins are justifiably cautious when deploying non-Windows SMB servers</strong>, whether software (Samba, Novell, etc) or system (NetApp, Celerra, BlueArc, etc). As a very early NetApp user, I watched their CIFS/SMB server evolve over a decade and a half into a fairly robust solution, but the early years were downright painful.</p>
<p>Lest you throw rocks at Redmond, know that SMB is not alone with functionality problems. The interoperability of NFS servers and clients is a bit better thanks to open(ish) standards and open source implementations, but its reputation is just as bad. And Apple&#8217;s proprietary <a rel="nofollow" href="http://en.wikipedia.org/wiki/Apple_Filing_Protocol"  target="_blank">AFP</a> protocol is downright notorious.</p>
<p>I&#8217;ve been there myself many times. I tried to set up a home server based on open source software (Linux, FreeBSD, <a href="http://www.samba.org/"  target="_blank">Samba</a>, <a rel="nofollow" href="http://netatalk.sourceforge.net/"  target="_blank">Netatalk</a>, etc) but <strong>rejected it outright</strong> after many frustrating years. Today I use a Mac Mini for file sharing in OS X and serving iTunes music and movies (goodbye, <a href="http://www.fireflymediaserver.org/"  target="_blank">Firefly</a>!) And years of fighting with Samba in enterprise environments taught me two things: <strong>It&#8217;s possible to get it running well with Windows clients but it&#8217;s astonishingly easy to get it wrong</strong>.</p>
<h3>Enterprise NAS?</h3>
<p>We all know that <strong>interoperability is devilishly difficult</strong>. I don&#8217;t envy the NetApp and EMC engineers that have to tweak and tune their server for every possible client, bugs and all. And I am impressed that, after probably millions of man-hours of work, they were able to come up with something stable for a subset of use cases. But this just makes me even more cautious about third-party NAS servers.</p>
<p>I talk to storage vendors all the time, and many of their new products support NFS and SMB. But <strong>my internal alarms start going off when I hear about these products</strong>. There are two simple reasons for this:</p>
<ol>
<li>As mentioned above, <strong>NAS is rare in primary data center applications</strong>. It may be common for user files (euphemistically called &#8220;unstructured data&#8221;) and certain distributed applications (simulation, rendering, etc), but most use cases still call for block SCSI (FC/iSCSI) storage.</li>
<li>As further mentioned, <strong>getting NAS right takes a massive amount of effort</strong>. New and small vendors tend to slap Samba on their (Linux-based) box and call it a day. This is very, very far from being sufficient for enterprise use.</li>
</ol>
<p>This is why <strong>I usually ignore NAS functionality in storage systems except for long-tenured and deep-pocketed vendors</strong>. Although the world is turning to &#8220;Unified Storage&#8221; and multi-protocol support, I&#8217;m focusing primarily on block (SCSI) and cloud (REST) capability because the former has proven somewhat easier than NAS to get working and the latter is both simple and &#8220;green field&#8221; with no legacy concerns.</p>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2007/06/25/storage-history-the-3server/"  rel="bookmark" class="crp_title">Storage History: The 3Server</a></li><li><a href="http://blog.fosketts.net/2010/04/27/process-solutions-process-problems-technical-solutions-technical/"  rel="bookmark" class="crp_title">Use Process Solutions For Process Problems, Technical Solutions For Technical Ones</a></li><li><a href="http://blog.fosketts.net/2010/09/24/fundamental-practices-enterprise/"  rel="bookmark" class="crp_title">Four Fundamental Best Practices for Enterprise IT</a></li><li><a href="http://blog.fosketts.net/2010/11/24/automatic-provisioning-overcoming-limits-thin-provisioning/"  rel="bookmark" class="crp_title">Overcoming The Limits Of Thin Provisioning With Automatic Provisioning!</a></li><li><a href="http://blog.fosketts.net/2008/03/31/key-technical-differences-between-email-archiving-products/"  rel="bookmark" class="crp_title">Key Technical Differences Between Email Archiving Products?</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2010/05/07/i-ignore-nas/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2010. |
<a href="http://blog.fosketts.net/2010/05/07/i-ignore-nas/">Why Do I Ignore NAS?</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/apple/" title="View all posts in Apple" rel="category tag">Apple</a>, <a href="http://blog.fosketts.net/category/everything/computerhistory/" title="View all posts in Computer History" rel="category tag">Computer History</a>, <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/gestaltit/" title="View all posts in Gestalt IT" rel="category tag">Gestalt IT</a>, <a href="http://blog.fosketts.net/category/everything/terabytehome/" title="View all posts in Terabyte home" rel="category tag">Terabyte home</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2010/05/07/i-ignore-nas/feed/</wfw:commentRss>
		<slash:comments>4</slash:comments>
		</item>
		<item>
		<title>Of Emulated Fibre Channel, Virtualization, And The Right Tool For The Job</title>
		<link>http://blog.fosketts.net/2008/12/12/emulated-fibre-channel-virtualization/</link>
		<comments>http://blog.fosketts.net/2008/12/12/emulated-fibre-channel-virtualization/#comments</comments>
		<pubDate>Fri, 12 Dec 2008 17:00:44 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Computer History]]></category>
		<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Gestalt IT]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[3PAR]]></category>
		<category><![CDATA[Alex McDonald]]></category>
		<category><![CDATA[Apple]]></category>
		<category><![CDATA[cache]]></category>
		<category><![CDATA[Celerra]]></category>
		<category><![CDATA[Chuck Hollis]]></category>
		<category><![CDATA[CIFS]]></category>
		<category><![CDATA[CLARiiON]]></category>
		<category><![CDATA[Compellent]]></category>
		<category><![CDATA[Data General]]></category>
		<category><![CDATA[Dell]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[EqualLogic]]></category>
		<category><![CDATA[FAS]]></category>
		<category><![CDATA[Fibre Channel]]></category>
		<category><![CDATA[HADA]]></category>
		<category><![CDATA[iSCSI]]></category>
		<category><![CDATA[Kostadis Russos]]></category>
		<category><![CDATA[NetApp]]></category>
		<category><![CDATA[NFS]]></category>
		<category><![CDATA[RAID]]></category>
		<category><![CDATA[Storagebod]]></category>
		<category><![CDATA[Symmetrix]]></category>
		<category><![CDATA[Tony Asaro]]></category>
		<category><![CDATA[WAFL]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=1226</guid>
		<description><![CDATA[EMC&#8217;s Chuck Hollis is one smart guy, and a very verbose blogger. As usual, he sparked a bit of a storm recently when comparing unified storage on EMC&#8217;s Celerra NX4 to NetApp&#8217;s multiprotocol FAS2020 filer. But it was one phrase in particular that got the attention of Alex McDonald and Kostadis Russos of NetApp, Martin/Storagebod, and Tony [...]]]></description>
			<content:encoded><![CDATA[<p>EMC&#8217;s Chuck Hollis is one smart guy, and a very verbose blogger. As usual, he sparked a bit of a storm recently when <a href="http://chucksblog.emc.com/chucks_blog/2008/12/dell-emc-and-the-new-nx4.html"  target="_blank">comparing unified storage on EMC&#8217;s Celerra NX4 to NetApp&#8217;s multiprotocol FAS2020 filer</a>. But it was one phrase in particular that got the attention of <a href="http://blogs.netapp.com/shadeofblue/2008/12/mad-blog-the-e.html"  target="_blank">Alex McDonald</a> and <a href="http://blogs.netapp.com/extensible_netapp/2008/12/mad-blog-chuck.html"  target="_blank">Kostadis Russos</a> of NetApp, <a rel="nofollow" href="http://storagebod.typepad.com/"  target="_blank">Martin/Storagebod</a>, and <a href="http://contemplatingit.com/"  target="_blank">Tony Asaro</a>: &#8220;just because a vendor says they can emulate FC SAN behavior doesn&#8217;t mean it&#8217;s a real FC SAN.&#8221;</p>
<p>What was he getting at? Read <a href="http://chucksblog.emc.com/chucks_blog/2008/12/dell-emc-and-the-new-nx4.html"  target="_blank">the comments</a> in Chuck&#8217;s post and you&#8217;ll understand his implication: Chuck suggests that NetApp &#8220;emulates&#8221; Fibre Channel in their FAS/OnTap devices on top of the WAFL &#8220;file system&#8221;, while EMC&#8217;s AX storage (behind the NX4) uses &#8220;real&#8221; Fibre Channel, so it&#8217;s better. He goes on to say that EMC is doing a brisk business replacing misfit NetApp FC arrays with real FC kit from EMC. But, as is so often the case, the truth is a little more complex than this: <strong>All enterprise storage arrays &#8220;emulate&#8221; Fibre Channel drives to one extent or another, and using the wrong tool for the job will always lead to trouble</strong>.</p>
<p><span id="more-1226"></span></p>
<h3 class="post-subhead">Is It Real Or Is It Virtual?</h3>
<p>Let&#8217;s knock one thing out right away: Chuck is right, <strong>NetApp </strong><em><strong>is</strong></em><strong> emulating Fibre Channel drives</strong> with their FAS arrays. They really <em>do</em> lay out chunks of storage on something kind of like a file system with a bunch of logic mixed in and then pretend that this space is a plain-jane SCSI drive connected over Fibre Channel. And I&#8217;ll add to the &#8220;scandal&#8221; by pointing out that NetApp does exactly the same thing with their iSCSI drives!</p>
<p>Now let&#8217;s move on to an even more important point: <strong>All modern storage arrays emulate SCSI drives</strong>! That&#8217;s right, every enterprise storage array is lying, pretending to serve up basic drives but really slicing and dicing them in the background for their own nefarious purposes!</p>
<p>Who is responsible for this deceit? I place the blame on a few: <a rel="nofollow" href="http://www.eecs.berkeley.edu/Pubs/TechRpts/1987/CSD-87-391.pdf"  target="_blank">Patterson, Gibson, and Katz</a> started the game with their so-called RAID concept, which kicked things off by allowing a few drives to pretend to be a single one. Data General implemented this with cache in their oh-so-clever <a href="http://blog.fosketts.net/2008/11/15/top-ten-storage-hardware/"  target="_blank">HADA</a>, further separating us from The True Disk. But the worst was EMC, with their fully-virtualized Symmetrix array, where there was no definite relationship at all between the LUNs presented to servers and the disks that do all the real work. Some folks would even go so far as to praise this type of <a href="http://blog.fosketts.net/2008/09/14/turning-page-raid/"  target="_self">post-RAID</a> virtualized storage as <a href="http://blog.fosketts.net/2008/11/15/top-ten-storage-hardware/"  target="_blank">innovative</a>!</p>
<p>NetApp takes this &#8220;automated lying&#8221; to the extreme, forcing their innocent hardware to take honest, well-laid-out blocks of <a href="http://blogs.netapp.com/dave/2008/12/is-wafl-a-files.html"  target="_blank">intelligent WAFL space</a> and twist them into vast tracts of dumb pretend-disks. <strong>The nerve!</strong> Compellent, 3PAR, Dell/EqualLogic, and the rest are just as bad, scattering blocks of data willy-nilly across their disks in so-called &#8220;<a href="http://www.storagerap.com/2008/12/basics-of-wide-striping-laying-out-data-in-chunklets.html"  target="_blank">wide stripes</a>&#8220;. But don&#8217;t let Chuck&#8217;s misdirection fool you: EMC is just as guilty with each of their different storage platforms, masquerading as disk drives or file servers and intelligently managing storage underneath! And don&#8217;t get me started on the twisted things VMware does to storage!</p>
<p>Modern? Feh! Let&#8217;s all hope Apple starts producing their <a href="http://blog.fosketts.net/2008/02/19/apple-revs-xsan-and-kills-xserve-raid/"  target="_self">no-feature Xserve RAID</a> again!</p>
<h3 class="post-subhead">Waiting On Angels</h3>
<p>So every modern array emulates disks. What was Chuck&#8217;s point again? Oh yeah, that the AX Fibre Channel storage used by EMC&#8217;s NX4 is superior to the integrated Fibre Channel capability of the NetApp FAS2020! I&#8217;m sure he&#8217;s right for some use cases and wrong for others. FC on the FAS2020 is a perfect match for some, and the NX4/AX wins in a landslide in some circumstances.</p>
<p>The crux of the argument is the fact that NetApp does all sorts of stuff behind the scenes build and support an FC LUN that the EMC AX FC array doesn&#8217;t do. So, although it wouldn&#8217;t be fair to say that one was &#8220;emulated&#8221; and another was not, Chuck would be correct in saying that an FC LUN on an AX is more &#8220;real&#8221; than one on a NetApp FAS. <strong>But arguing over technicalities like this is all <a href="http://www.straightdope.com/columns/read/1008/did-medieval-scholars-argue-over-how-many-angels-could-dance-on-the-head-of-a-pin"  target="_blank">angels and pins</a> and doesn&#8217;t matter in the real world</strong>!</p>
<p>What does matter? In block storage, latency is king. Generally speaking, more cogs and wheels leads to more latency. This is why storage arrays rely so much on large, intelligent caches and vendors are experimenting with all sorts of <a href="http://blogs.netapp.com/storage_nuts_n_bolts/2008/08/performance-acc.html"  target="_blank">cool caching technology</a>. But, ignoring cache, <strong>high-end arrays generally have worse latency than low-end ones</strong> because they have all sorts of translation and virtualization going on in the background. In any I/O situation, increased latency hurts throughput and the perception of performance. And there comes a point when block applications give up waiting and it&#8217;s &#8220;game over, man!&#8221;</p>
<p>I remember migrating from an old CLARiiON 3100 to a brand new Symmetrix 3930 and watching the Symmetrix choke on the incoming data stream. It just couldn&#8217;t write fast enough to handle full streaming reads from the (old-tech) CLARiiON. But once everything was migrated and running, the Symmetrix, with its massive (for the time) 16 GB of cache, widely-spaced data layout, and multiple internal channels, completely destroyed the CLARiiON in real-world performance. This pattern continues today, with devices like the DMX and USP offering much better real-world performance than benchmarks or theoretical techno-arguments would suggest.</p>
<h3 class="post-subhead">So Which Is Better?</h3>
<p>But Chuck and the rest were not talking about high-end stuff here. They are comparing the architecture of entry-level enterprise kit and drawing conclusions about which is best. I personally don&#8217;t care what the internals of the system look like. I care how well it works.</p>
<p>I have personally seen Microsoft Exchange running on low-end FC-connected NetApp FAS arrays, and it worked great. I also helped a customer migrate off of EMC AX that didn&#8217;t give them the performance they needed for their databases. In truth, <strong>lower-end gear is often over-sold</strong> and unable to deliver the performance, features, and reliability specified on data sheets and in vendor presentations.</p>
<p>That&#8217;s right, there&#8217;s more to this picture than raw performance. Consider manageability, for one. NetApp is offering a single-interface integrated system with all protocols (CIFS, NFS, iSCSI, and FC) available from one device. They also offer similar levels of integration for their (really nice) snapshot, replication, and deduplication technology. WAFL is busy doing a lot of great stuff, so I really wouldn&#8217;t be surprised if EMC&#8217;s less-integrated NX/AX offering beats them on performance at the same price point. <strong>Which is more important to you, integration, performance, or features</strong>? And I bet that, if you spent a bit more on a higher-end NetApp box, you could have it all.</p>
<p>On the flip side, EMC is offering a really compelling entry-enterprise combination at a nice price point. The latest NX should be on everyone&#8217;s NAS short list, and I&#8217;m sure the simple FC of the AX array would work well in a smallish Exchange, VMware, or SQL Server environment. It&#8217;s not as unified as NetApp&#8217;s offering management- or feature-wise, but it&#8217;s still pretty good.</p>
<p>Pick the right tool for the job, though. Neither the NX4 nor the FAS2020 is a good fit for a high-I/O application, and that&#8217;s a fact!</p>
<blockquote><p>This post can also be found on <a href="http://gestaltit.com"  target="_blank">Gestalt IT</a>: <a href="http://gestaltit.com/tech/storage/stephen/of-emulated-fibre-channel-virtualization-and-the-right-tool-for-the-job/" >Of Emulated Fibre Channel, Virtualization, And The Right Tool For The Job</a></p>
</blockquote>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2008/08/28/grapples-tangelos-impossible-compare-fairly/"  rel="bookmark" class="crp_title">Grapples and Tangelos: Why it&#8217;s Impossible to Compare Fairly</a></li><li><a href="http://blog.fosketts.net/2009/02/05/difference-integration-frankenstein/"  rel="bookmark" class="crp_title">The Difference Between &#8220;Integration&#8221; and &#8220;Frankenstein&#8221;</a></li><li><a href="http://blog.fosketts.net/2008/07/18/which-storage-protocol-vmware-2/"  rel="bookmark" class="crp_title">Which Storage Protocol For VMware?</a></li><li><a href="http://blog.fosketts.net/2008/10/16/fcoe-versus-iscsi/"  rel="bookmark" class="crp_title">Is the FCoE Starting Pistol Aimed at iSCSI?</a></li><li><a href="http://blog.fosketts.net/2008/02/22/vmware-storage-tidbits/"  rel="bookmark" class="crp_title">VMware Storage Tidbits</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2008/12/12/emulated-fibre-channel-virtualization/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2008. |
<a href="http://blog.fosketts.net/2008/12/12/emulated-fibre-channel-virtualization/">Of Emulated Fibre Channel, Virtualization, And The Right Tool For The Job</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/computerhistory/" title="View all posts in Computer History" rel="category tag">Computer History</a>, <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/gestaltit/" title="View all posts in Gestalt IT" rel="category tag">Gestalt IT</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2008/12/12/emulated-fibre-channel-virtualization/feed/</wfw:commentRss>
		<slash:comments>21</slash:comments>
		</item>
		<item>
		<title>Top Ten Coolest Enterprise Storage Flops</title>
		<link>http://blog.fosketts.net/2008/12/06/top-ten-coolest-enterprise-storage-flops/</link>
		<comments>http://blog.fosketts.net/2008/12/06/top-ten-coolest-enterprise-storage-flops/#comments</comments>
		<pubDate>Sat, 06 Dec 2008 16:00:33 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Computer History]]></category>
		<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[3Com]]></category>
		<category><![CDATA[3PAR]]></category>
		<category><![CDATA[3Server]]></category>
		<category><![CDATA[Allegro]]></category>
		<category><![CDATA[Amazon]]></category>
		<category><![CDATA[AutoRAID]]></category>
		<category><![CDATA[CASA]]></category>
		<category><![CDATA[CDP]]></category>
		<category><![CDATA[Centriplex]]></category>
		<category><![CDATA[CIFS]]></category>
		<category><![CDATA[Compaq]]></category>
		<category><![CDATA[Compellent]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[EqualLogic]]></category>
		<category><![CDATA[EVA]]></category>
		<category><![CDATA[Harmonix]]></category>
		<category><![CDATA[HDS]]></category>
		<category><![CDATA[HP]]></category>
		<category><![CDATA[IBM]]></category>
		<category><![CDATA[Ice Cube]]></category>
		<category><![CDATA[ISE]]></category>
		<category><![CDATA[MangoSoft]]></category>
		<category><![CDATA[Microsoft]]></category>
		<category><![CDATA[NetWare]]></category>
		<category><![CDATA[Nirvanix]]></category>
		<category><![CDATA[Orion]]></category>
		<category><![CDATA[Pirus]]></category>
		<category><![CDATA[Revivio]]></category>
		<category><![CDATA[SANLink]]></category>
		<category><![CDATA[Seagate]]></category>
		<category><![CDATA[Storage Tank]]></category>
		<category><![CDATA[StorageApps]]></category>
		<category><![CDATA[StorageNetworks]]></category>
		<category><![CDATA[Sun]]></category>
		<category><![CDATA[Symmetrix]]></category>
		<category><![CDATA[top ten]]></category>
		<category><![CDATA[VersaStor]]></category>
		<category><![CDATA[VSS]]></category>
		<category><![CDATA[WinFS]]></category>
		<category><![CDATA[Xiotech]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=1035</guid>
		<description><![CDATA[This is the second entry in my Top-Ten in Storage series. Not every innovative product can succeed in the market, and no matter how good some ideas seem, they can fail to make much of an impact. The truth is, people buy solutions, not technologies. This list includes products so cool, so ahead of their [...]]]></description>
			<content:encoded><![CDATA[<blockquote><p>This is the second entry in my <a href="http://blog.fosketts.net/tag/top-ten/"  target="_blank">Top-Ten in Storage</a> series.</p>
</blockquote>
<p>Not every innovative product can succeed in the market, and no matter how good some ideas seem, they can fail to make much of an impact. The truth is, people buy solutions, not technologies.</p>
<p>This list includes products so cool, so ahead of their time, that they just couldn&#8217;t fail. But they did.</p>
<p><span id="more-1035"></span></p>
<h3 class="post-subhead">1988 EMC Orion/Allegro</h3>
<p>EMC&#8217;s RAM-based storage array predated and presaged its Symmetrix, offering lightning-quick I/O for very small workloads. But the Orion had a few serious drawbacks: It was astonishingly expensive, offered tiny capacity, and was never available for open systems. EMC&#8217;s initial offerings in the open systems market, Centriplex and Harmonix, also deserve mention though the company proved its worth with its &#8220;<a href="http://blog.fosketts.net/2008/11/15/top-ten-storage-hardware/"  target="_blank">best</a>&#8221; Symmetrix a few years later.</p>
<h3 class="post-subhead">1985 3COM 3Server</h3>
<p>I&#8217;ve written about <a href="http://blog.fosketts.net/2007/06/25/storage-history-the-3server/"  target="_blank">the 3Server</a> before, but let&#8217;s sum up: Before RAID, SAN, and NAS, and even before NetWare and NFS became entrenched, 3COM introduced a flexible multi-disk network storage and print server called the 3Server. It was an innovative combination of hardware and software, but it lost out to NetWare on open PC hardware in the market. Although the 3Server lasted just a few years, it made a lasting contribution to the field: Its 3+Share software became 3+Open, then LAN Manager, and was finally absorbed by Microsoft to become SMB/CIFS.</p>
<h3 class="post-subhead">HP AutoRAID (High Availability Disk Array Model 12)</h3>
<p>The first post-RAID virtual sprang fully-formed from the big brains at HP to challenge the industry-leading modular offerings from Data General&#8217;s CLARiiON and DEC/Compaq&#8217;s StorageWorks. It one-upped everyone with automatic relocation of LUNs between different RAID levels based on workload about a decade before Compellent, EqualLogic, and 3PAR had anything of the sort. But the AutoRAID had two key drawbacks: Like mama bear, it wasn&#8217;t big enough for big companies but was too big and expensive for little ones, and it was SCSI-only (though a Fibre Channel bridge was a common accessory). Some of the concepts lived on in the HP EVA line, but AutoRAID didn&#8217;t last long.</p>
<h3 class="post-subhead">Microsoft Object File System (OFS)/Relational File System (RFS)/WinFS</h3>
<p>Microsoft shoulda-coulda-woulda revolutionized file storage with nearly every major operating system release. It looks the same every time: A database/filesystem hybrid that would add structure to the vast unstructured file world. Despite the hype, we haven&#8217;t seen it yet. </p>
<h3 class="post-subhead">MangoSoft Medley</h3>
<p>Consider the typical LAN: Lots of clients with lots of hard drive space connected to a server with yet more disk capacity. Wouldn&#8217;t it be nice if the space on these clients could be used as a virtual network server? Well that&#8217;s just what MangoSoft announced in 1997, gaining much attention in the PC press. Sadly, the idea never really caught on, although MangoSoft continued. But distributed network storage has become the industry&#8217;s <a rel="nofollow" href="http://en.wikipedia.org/wiki/Brigadoon"  target="_blank">Brigadoon</a>, trotted out as a new idea year after year.</p>
<h3 class="post-subhead">StorageNetworks</h3>
<p><em>This is my flop &#8211; I worked for StorageNetworks from 1999 through 2001.</em></p>
<p>StorageNetworks was launched in 1998 to provide off-premise storage and backup as an on-demand service for enterprise customers. They sought to take advantage of the emergence of high-speed Fibre Channel connectivity over metro distances to commoditize storage capacity. But only Houston (where I worked) had an acceptable infrastructure for the service, so the company changed focus to hosting centers. Then off-site backup. Then software. Nothing worked apart from vendor-independent services, and the (now public) company was shy to base its revenues on that. StorageNetworks was gone in 2003, but does the service remind anyone of Amazon S3 or Nirvanix? Maybe it was just ahead of its time.</p>
<h3 class="post-subhead">Compaq VersaStor</h3>
<p>Announced in 1999, VersaStor would have been a revolution in Fibre Channel SANs, a full out of band virtualization solution leveraging specialized HBAs directing traffic. It was continually pushed back, finally being &#8220;merged&#8221; (after Compaq) with HP&#8217;s StorageApps in-band SANLink to become CASA. But then EMC sued HP over virtualization patents, derailing CASA, and the whole mess was permanently shelved at the end of 2003.</p>
<h3 class="post-subhead">IBM Ice Cube/Collective Intelligent Bricks Hardware</h3>
<p>IBM rocked the storage press in 2003 with their announcement of Almaden Research&#8217;s Ice Cube concept. Instantly dubbed &#8220;Lego brick storage&#8221; (trademarks be damned!), the storage units could be stacked in two dimensions, scaling without limit. Coolest of all (literally), the bricks were chilled with water! Although the concept progressed, we still haven&#8217;t seen it. But this didn&#8217;t stop Seagate from developing a similar concept, ISE, which is now Xiotech&#8217;s main offering. IBM&#8217;s Storage Tank and VSS could have been nominated, too, but I&#8217;m not a sadist.</p>
<h3 class="post-subhead">Revivio CDP</h3>
<p>Revivio was the pioneer of continuous data protection (CDP), with great technology and people. But no one (other than Symantec, eventually) bought it.</p>
<h3 class="post-subhead">Pirus</h3>
<p>Little Pirus was working on a small but scalable virtualized target when it was acquired by Sun in September of 2002. Their technology was launched as the StorEdge 6920, a mini alternative to the HDS USP in 2004, but (<a href="http://searchstorage.techtarget.com/news/article/0,289142,sid5_gci1245572,00.html"  target="_blank">according to insiders</a>) it didn&#8217;t exactly light the world on fire. Sun finally pulled the plug on the 6920 in early 2007, with HDS taking over continuing support for anyone who bought the moribund product.</p>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2007/06/25/storage-history-the-3server/"  rel="bookmark" class="crp_title">Storage History: The 3Server</a></li><li><a href="http://blog.fosketts.net/2008/11/05/real-innovation/"  rel="bookmark" class="crp_title">Real Innovation</a></li><li><a href="http://blog.fosketts.net/2008/11/15/top-ten-storage-hardware/"  rel="bookmark" class="crp_title">Top Ten Innovative Enterprise Storage Hardware Products</a></li><li><a href="http://blog.fosketts.net/2008/12/12/emulated-fibre-channel-virtualization/"  rel="bookmark" class="crp_title">Of Emulated Fibre Channel, Virtualization, And The Right Tool For The Job</a></li><li><a href="http://blog.fosketts.net/2008/11/08/flash-forward-flash-back/"  rel="bookmark" class="crp_title">Flash Forward or Flash Back?</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2008/12/06/top-ten-coolest-enterprise-storage-flops/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2008. |
<a href="http://blog.fosketts.net/2008/12/06/top-ten-coolest-enterprise-storage-flops/">Top Ten Coolest Enterprise Storage Flops</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/computerhistory/" title="View all posts in Computer History" rel="category tag">Computer History</a>, <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2008/12/06/top-ten-coolest-enterprise-storage-flops/feed/</wfw:commentRss>
		<slash:comments>12</slash:comments>
		</item>
		<item>
		<title>EMC Atmos Versus VMware VDC-OS: Will The Real Cloud Strategy Please Stand Up?</title>
		<link>http://blog.fosketts.net/2008/11/10/emc-atmos-vmware-vdc-os-cloud-strategy/</link>
		<comments>http://blog.fosketts.net/2008/11/10/emc-atmos-vmware-vdc-os-cloud-strategy/#comments</comments>
		<pubDate>Mon, 10 Nov 2008 16:03:42 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[Amazon]]></category>
		<category><![CDATA[Atmos]]></category>
		<category><![CDATA[Azure]]></category>
		<category><![CDATA[CAS]]></category>
		<category><![CDATA[Centera]]></category>
		<category><![CDATA[Chuck Hollis]]></category>
		<category><![CDATA[CIFS]]></category>
		<category><![CDATA[cloud]]></category>
		<category><![CDATA[cloud storage]]></category>
		<category><![CDATA[Cloud vServices]]></category>
		<category><![CDATA[compression]]></category>
		<category><![CDATA[COS]]></category>
		<category><![CDATA[deduplication]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[HCAP]]></category>
		<category><![CDATA[Hitachi]]></category>
		<category><![CDATA[Maui]]></category>
		<category><![CDATA[Microsoft]]></category>
		<category><![CDATA[NAS]]></category>
		<category><![CDATA[nas storage]]></category>
		<category><![CDATA[network attached storage]]></category>
		<category><![CDATA[network storage]]></category>
		<category><![CDATA[NFS]]></category>
		<category><![CDATA[Nirvanix]]></category>
		<category><![CDATA[replication]]></category>
		<category><![CDATA[REST]]></category>
		<category><![CDATA[SOAP]]></category>
		<category><![CDATA[Steve Todd]]></category>
		<category><![CDATA[VDC-OS]]></category>
		<category><![CDATA[VMware]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=1075</guid>
		<description><![CDATA[As I guessed on Friday, EMC has officially announced their Maui Atmos software layer today, calling it the &#8220;industry&#8217;s first COS (cloud-optimized storage) offering&#8221;, &#8220;a new era for IT&#8221;, and &#8220;a new category of storage.&#8221; So the new era for IT is a cloud with globally-distributed object stores with policy management? Great! But I thought [...]]]></description>
			<content:encoded><![CDATA[<p><a href="http://blog.fosketts.net/2008/11/07/emc-maui/"  target="_blank">As I guessed on Friday</a>, EMC has officially announced their <span style="text-decoration: line-through;">Maui</span> Atmos software layer today, <a href="http://www.emc.com/products/category/subcategory/cloud-optimized-storage.htm?CMP=ILC-carHP&amp;panel=harnessing+cloud+computin"  target="_blank">calling</a> it the &#8220;industry&#8217;s first COS (cloud-optimized storage) offering&#8221;, &#8220;a new era for IT&#8221;, and &#8220;a new category of storage.&#8221; So the new era for IT is a cloud with globally-distributed object stores with policy management?</p>
<p>Great! But I thought the new era for IT was a cloud with choice, mobility, and application support, as <a href="http://www.vmware.com/technology/virtual-datacenter-os/cloud-vservices/"  target="_blank">trumpeted</a> by EMC&#8217;s VMware subsidiary! Wasn&#8217;t Cloud vServices from VDC-OS supposed to be the <a href="http://blog.fosketts.net/2008/09/16/vmware-virtual-datacenter-operating-system-vdc-os/"  target="_blank">prototype cloud strategy</a> for the datacenter?</p>
<p>What we have here is <strong>a simple clash of marketing</strong> amusingly taking place at (nearly) the same company. VMware figured out how to extend their server virtualization products outside the confines of the data center, and laid that technology out as a strategy with the trendy &#8220;cloud&#8221; name. Meanwhile, mother EMC is working on next-generation content storage software and decides to roll that out as a strategy and also jumps on the &#8220;cloud&#8221; meme. What&#8217;s an IT manager to do?<span id="more-1075"></span></p>
<h3 class="post-subhead">Defining Atmos</h3>
<p>As predicted, EMC&#8217;s Atmos (code-name Maui) is a <a href="http://www.theregister.co.uk/2008/11/10/emc_launches_maui_as_atmos/"  target="_blank">distributed software layer</a> to handle the storage and management of data objects across geographically-dispersed storage devices. EMC&#8217;s Chuck Hollis <a href="http://chucksblog.emc.com/chucks_blog/2008/11/emc-atmos-maui-is-here.html"  target="_blank">demonstrates Atmos</a> with a simple, practical example, perhaps making it sound too much like Akamai but generally getting the point across. You have a data object, write it to Atmos through REST/SOAP or CIFS/NFS, assign some metadata, and the software takes care of data placement for you. It&#8217;ll add local copies, replicate for availability and performance, compress or deduplicate, manage versions, and all sorts of goodies (if you ask it to).</p>
<p>But EMC already has a capable object storage platform, the Centera. We&#8217;ve just got used to the content-addressable storage (CAS) label for object storage (even though this name misses the point of object storage, in my opinion) and now EMC wants us to learn a new label for a somewhat-similar device? Steve Todd, EMC&#8217;s object guy extraordinaire, <a rel="nofollow" href="http://stevetodd.typepad.com/my_weblog/2008/11/atmos-cloud-optimized-storage.html"  target="_blank">lays it out</a>:</p>
<blockquote><p>SAN Value = Centralized, secure multi-tenancy for blocks.</p>
<p><strong><span style="font-weight: normal;">NAS Value = Centralized, secure multi-tenancy for files.</span></strong></p>
<p><strong><span style="font-weight: normal;">CAS Value = Centralized, secure multi-tenancy for objects (content + metadata).</span></strong></p>
<p><strong><span style="font-weight: normal;">COS Value = </span><em><span style="font-weight: normal;">Globalized</span></em><span style="font-weight: normal;">, secure multi-tenancy for content with </span><em><span style="font-weight: normal;">rich policies</span></em><span style="font-weight: normal;">.</span></strong></p>
</blockquote>
<p>Ok, so <strong>the defining capabilities of Atmos are its global scale and rich policies</strong>. And the fact that &#8220;objects&#8221; has become &#8220;content&#8221;, presumably since Atmos can handle traditional NAS (CIFS/NFS) chores as well.</p>
<h3 class="post-subhead">Prayers Answered?</h3>
<p>It sounds like EMC is answering <a href="http://blog.fosketts.net/2008/09/28/we-need-storage-revolution/"  target="_blank">my prayers for a storage revolution</a>, delivering a highly-capable object storage platform that transcends the old limits of blocks, directories, and files. Steve Todd points out that Atmos handles five policy categories out of the box:</p>
<ul>
<li>Replication</li>
<li>Compression</li>
<li>Spin-down</li>
<li>Object de-dup</li>
<li>Versioning</li>
</ul>
<p>So we write some data to Atmos, using either traditional NAS or <a rel="nofollow" href="http://en.wikipedia.org/wiki/Web_2.0"  target="_blank">webby dubby</a> protocols like <a rel="nofollow" href="http://en.wikipedia.org/wiki/SOAP_(protocol)"  target="_blank">SOAP</a>, and can then apply policies in any of these five categories to that data. One can also extend the Atmos to accept other policies, but the absence (out of the box) of concepts like encryption, secure deletion, retention, and access control are surprising.</p>
<p>I am quite puzzled about how practical these policy capabilities will be in the real world. How exactly would an application say &#8220;I want you to compress that file I wrote over NFS just now?&#8221; Hitachi&#8217;s HCAP platform, for example, also has policy capabilities and a NAS front end, and although archiving applications can communicate their policy needs, <strong>I don&#8217;t see lots of current general-purpose applications using it</strong>.</p>
<h3 class="post-subhead">Strategic Storage?</h3>
<p>This brings me to my puzzlement: The default Atmos policies are all general-purpose, production computing ideas, not the special-purpose, archiving and retention needs served by Centera, HCAP, and the rest. So <strong>the Atmos is clearly intended to be a production data storage system</strong>, not an archiving system to compete with Centera.</p>
<p>Since mainstream business applications currently don&#8217;t have any capability to specify policies like these when writing files, and since NAS protocols lack any means to communicate them even if the apps want to, we can conclude that <strong>EMC expects that Atmos users will write special applications to take advantage of it</strong>.</p>
<p>EMC certainly doesn&#8217;t expect that the NAS-capable Atmos will simply replace today&#8217;s distributed NAS solutions. <strong>NAS is a sideshow for Atmos</strong>. The real action will be in the REST/SOAP webby dubby applications that will be written with the platform in mind and will take full advantage of these capabilities.</p>
<p>If this is true, and I <a rel="nofollow" href="http://storagebod.typepad.com/storagebods_blog/2008/11/i-like-a-party-with-a-atmosphere.html"  target="_blank">and others</a> suspect that it is, then <strong>Atmos really isn&#8217;t a game-changing platform unless you change your game</strong>. If you write new applications to store data with SOAP, Atmos is a nice in-house alternative to Amazon S3 or Nirvanix, and offers a very compelling set of data management capabilities. And if you want to set up shop to compete with those service providers, Atmos is a dream come true with <a rel="nofollow" href="http://storagezilla.typepad.com/storagezilla/2008/11/building-emc-atmos.html"  target="_blank">built-in multi-tenancy</a>.</p>
<h3 class="post-subhead">Datacenter Strategy</h3>
<p>So EMC alone has two seemingly competitive datacenter strategies. And then there&#8217;s Microsoft, which announced its <a href="http://dcsblog.burtongroup.com/data_center_strategies/2008/10/waiting-for-the-other-shoe-to-drop.html"  target="_blank">Azure cloud platform</a> recently, and Amazon and the other cloud providers.</p>
<p>So let&#8217;s say you&#8217;re a CIO for a large corporation. Which of the following strategies is more compelling:</p>
<ol>
<li>Use <strong>VMware VDC-OS</strong> to add capabilities and <strong>Cloud vServices</strong> extend your current virtual infrastructure geographically</li>
<li>Recompile and tweak your Windows applications to leverage <strong>Microsoft Azure</strong></li>
<li>Develop new applications to take advantage of the impressive storage capabilities of an in-house <strong>EMC Atmos </strong>system</li>
<li>Point your new applications at a third-party cloud provider like Amazon or Nirvanix</li>
</ol>
<p>IT people are practical. Although we love new technology, we tend to be cautious. We also hate massive software development efforts, and only sanction them when they&#8217;re absolutely necessary. Given these personality traits, I&#8217;d say VDC-OS and perhaps Cloud vServices still stands out as the most likely and practical scenario for the majority of applications and businesses.</p>
<p>This is not to say that EMC Atmos will be a flop. I&#8217;m impressed by the technology, and expect that Atmos will find buyers, just as Centera did. And Atmos might even replace Centera once EMC adds retention policies to it and scales it down as well as up and out. But Atmos will not redefine the datacenter. We&#8217;re stuck with blocks and files, and VMware&#8217;s practical strategy is a winner in that world.</p>
<p><strong>Update:</strong> <a href="http://www.storagerap.com/2008/11/atmos-dead-or-not-dead-innovative-or-repetitive.html"  target="_blank">Marc Farley compares Atmos to WAFS</a>, with ominous implications, and echos my recent question on what is and is not innovative.</p>
<p><strong>Update 2:</strong> Chuck Hollis, Storagezilla, and <a rel="nofollow" href="http://lensblog.typepad.com/ebiz/2008/11/emc-announces-atmos.html"  target="_blank">Len Devanna</a> have all come right out and said that this is only intended for certain customers with massive distributed storage needs, and is not intended as a new datacenter strategy. Even the &#8220;cloudfella&#8221; says &#8220;ciao&#8221;:</p>
<p>
<object width="425" height="344" data="http://www.youtube.com/v/eaqklyv3yrg&amp;hl=en&amp;fs=1" type="application/x-shockwave-flash"><param name="allowFullScreen" value="true" /><param name="allowscriptaccess" value="always" /><param name="src" value="http://www.youtube.com/v/eaqklyv3yrg&amp;hl=en&amp;fs=1" /><param name="allowfullscreen" value="true" /></object>
</p>
<p><strong>Update 3:</strong> More great information, including <a rel="nofollow" href="http://virtualgeek.typepad.com/virtual_geek/2008/11/whats-the-relat.html"  target="_blank">a reply regarding VDC-OS and Atmos</a> from the one and only Chad Sakac, more great detail about <a rel="nofollow" href="http://stevetodd.typepad.com/my_weblog/2008/11/atmos-policy-under-the-hood.html"  target="_blank">the inner workings of Atmos</a> from Steve Todd, and <a href="http://flickerdown.com/?p=268"  target="_blank">even more info</a> from Dave Graham. Finally, although I think that Cloudfellas video is cute, I wouldn&#8217;t categorize it as viral. But <a rel="nofollow" href="http://lensblog.typepad.com/ebiz/2008/11/beware-flaming-appliances-from-the-sky.html"  target="_blank">those Mozy ads</a> are awesome!</p>
<blockquote><p>See my posts on <a href="http://gestaltit.com/author/stephen/"  target="_blank">Gestalt IT</a> for similar <a href="http://gestaltit.com"  target="_blank">enterprise IT infrastructure commentary</a></p>
</blockquote>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2008/11/07/emc-maui/"  rel="bookmark" class="crp_title">EMC About To Take Us To Maui&#8230;</a></li><li><a href="http://blog.fosketts.net/2010/10/26/caringo-castor-cloud-storage/"  rel="bookmark" class="crp_title">Caringo Bulks Up CAStor For Cloud Services</a></li><li><a href="http://blog.fosketts.net/2008/09/16/vmware-virtual-datacenter-operating-system-vdc-os/"  rel="bookmark" class="crp_title">VMware Virtual Datacenter Operating System: Heavyweight or Hot Air?</a></li><li><a href="http://blog.fosketts.net/2009/03/19/sun-cloud/"  rel="bookmark" class="crp_title">Sun Launches Their Own Cloud, But For Which Market?</a></li><li><a href="http://blog.fosketts.net/2011/04/24/changing-it-organization-roles/"  rel="bookmark" class="crp_title">Changes in Technology Drive Changes in IT Organizations and Roles</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2008/11/10/emc-atmos-vmware-vdc-os-cloud-strategy/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2008. |
<a href="http://blog.fosketts.net/2008/11/10/emc-atmos-vmware-vdc-os-cloud-strategy/">EMC Atmos Versus VMware VDC-OS: Will The Real Cloud Strategy Please Stand Up?</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2008/11/10/emc-atmos-vmware-vdc-os-cloud-strategy/feed/</wfw:commentRss>
		<slash:comments>14</slash:comments>
		</item>
	</channel>
</rss>

