<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	xmlns:series="http://unfoldingneurons.com/"
	>

<channel>
	<title>Stephen Foskett, Pack Rat &#187; PowerPath Archives  &#8211; Stephen Foskett, Pack Rat</title>
	<atom:link href="http://blog.fosketts.net/tag/powerpath/feed/" rel="self" type="application/rss+xml" />
	<link>http://blog.fosketts.net</link>
	<description>Understanding the accumulation of data</description>
	<lastBuildDate>Fri, 10 Feb 2012 17:40:43 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=</generator>
<atom:link rel="hub" href="http://pubsubhubbub.appspot.com" />
	<atom:link rel="hub" href="http://superfeedr.com/hubbub" />
			<item>
		<title>VMware PSP and SATP in Plain English</title>
		<link>http://blog.fosketts.net/2011/06/06/vmware-esx-vsphere-satp-psp-support-matrix/</link>
		<comments>http://blog.fosketts.net/2011/06/06/vmware-esx-vsphere-satp-psp-support-matrix/#comments</comments>
		<pubDate>Mon, 06 Jun 2011 15:20:56 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Everything]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[ALUA]]></category>
		<category><![CDATA[Celerra]]></category>
		<category><![CDATA[CLARiiON]]></category>
		<category><![CDATA[Dell]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[EqualLogic]]></category>
		<category><![CDATA[ESX]]></category>
		<category><![CDATA[esxcli]]></category>
		<category><![CDATA[HDLM]]></category>
		<category><![CDATA[HDS]]></category>
		<category><![CDATA[IBM]]></category>
		<category><![CDATA[Invista]]></category>
		<category><![CDATA[LSI]]></category>
		<category><![CDATA[Microsoft]]></category>
		<category><![CDATA[MPIO]]></category>
		<category><![CDATA[MPP]]></category>
		<category><![CDATA[multipath I/O]]></category>
		<category><![CDATA[multipathing]]></category>
		<category><![CDATA[NetApp]]></category>
		<category><![CDATA[PowerPath]]></category>
		<category><![CDATA[PSA]]></category>
		<category><![CDATA[PSP]]></category>
		<category><![CDATA[SATP]]></category>
		<category><![CDATA[SVC]]></category>
		<category><![CDATA[Symmetrix]]></category>
		<category><![CDATA[VMkernel]]></category>
		<category><![CDATA[VMware]]></category>
		<category><![CDATA[VPLEX]]></category>
		<category><![CDATA[vSphere 4]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=5616</guid>
		<description><![CDATA[I am often questioned during my Storage for Virtual Environments seminar presentations about VMware's Pluggable Storage Architecture (PSA). This system is fairly straightforward and concept: VMware provides native multipathing support for a variety of storage arrays, and allows third parties to substitute their own plug-ins at various points in the stack. But the profusion of acronyms and third-party options makes it difficult for end-users to figure out what is going on.]]></description>
			<content:encoded><![CDATA[<div id="attachment_5617" class="wp-caption aligncenter" style="width: 310px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2011/06/VMware-PSA-Diagram.png" ><img class="size-medium wp-image-5617" title="VMware PSA Diagram" src="http://blog.fosketts.net/wp-content/uploads/2011/06/VMware-PSA-Diagram-300x127.png" alt="" width="300" height="127" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">VMware&#39;s PSA is awash in abbreviations and options</p></div>
<p>I am often questioned during my Storage for Virtual Environments seminar presentations about VMware&#8217;s Pluggable Storage Architecture (PSA). This system is fairly straightforward and concept: VMware provides native multipathing support for a variety of storage arrays, and allows third parties to substitute their own plug-ins at various points in the stack. But the profusion of acronyms and third-party options makes it difficult for end-users to figure out what is going on. In an effort to help, I present here another entry in my “VMware storage features in plain English” series.</p>
<blockquote><p>Note: I am more of a storage guy than a virtualization expert. I consider myself one of those end-users who have had trouble figuring out what&#8217;s going on with PSA specifically, in VMware storage features in general. I welcome comments and suggestions for corrections or improvements to this and all of my articles. Thanks for your help!</p></blockquote>
<h3>Introducing Pluggable Storage Architecture (PSA)</h3>
<p>Pluggable storage architecture was one of the major enhancements introduced in vSphere 4. Functionally similar to Microsoft&#8217;s MPIO stack for Windows, PSA includes native multipathing support and allows vendors to plug in their own advanced features.</p>
<div id="attachment_5618" class="wp-caption aligncenter" style="width: 310px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2011/06/My-PSA-Diagram.jpg" ><img class="size-medium wp-image-5618" title="My PSA Diagram" src="http://blog.fosketts.net/wp-content/uploads/2011/06/My-PSA-Diagram-300x79.jpg" alt="" width="300" height="79" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">I find the VMware diagram confusing. Is mine more or less accurate and readable?</p></div>
<p>The ESX kernel (VMkernel) walks down through three layers when communicating with storage:</p>
<ol>
<li>In the <strong>top layer</strong>, VMware native NMP or third-party MPP software decides which SATP to use, or whether to use the native interface. MASK_PATH also operates at this layer.</li>
<li>The <strong>SATP layer</strong> includes native generic path selection (active/active, active/passive), standard ALUA, as well as allowing third-party plugins (SATP) to override its behavior. The SATP monitors these paths, reports changes, and initiates fail-over on the array as needed.</li>
<li>At the <strong>PSP layer</strong>, software decides which physical channel to use for I/O requests.</li>
</ol>
<p>There are three types of PSA plugins for vSphere 4:</p>
<ol>
<li>Storage Array Type Plug-In (SATP)</li>
<li>Path Selection Plug-in (PSP)</li>
<li>A complete third-party multipathing software stack (MPP)</li>
</ol>
<p>As is the case with VAAI, VMware includes a number of third-party plug-ins in the ESXi install. Users can simply activate many of these according to their needs, though some require additional fees and licensing.</p>
<h3>Storage Array Type Plug-in (SATP) List</h3>
<p>Storage Array Type Plug-Ins (SATPs) to the VMware Pluggable Storage Architecture multipathing solution for the specific characteristics of the storage array. This is very important, since each storage array design differs substantially in detail and support, especially when it comes to load-balancing and failover between controllers, ports, and paths. So it is critical for VMware to have developed a standard interface to communicate with arrays.</p>
<p>SATPs allow load balancing across multiple paths, intelligent path selection, and over troubled conditions such as “chatter”, when passed rapidly fail back and forth between controllers.</p>
<p>The SATP has critical tasks to perform in the PSA stack:</p>
<ol>
<li>Decide which method of communication to use with the storage (PSA or native)</li>
<li>Monitor the health of the physical I/O channels or paths</li>
<li>Report any changes in the state of the paths up the stack</li>
<li>Perform actions required to fail over storage between controllers on the array</li>
</ol>
<p>VMware vSphere includes a variety of generic plugins for storage arrays. I&#8217;ve identified the following:</p>
<ul>
<li>VMW_SATP_LOCAL &#8211; Local SATP for direct-attached devices</li>
<li>VMW_SATP_DEFAULT_AA – Generic for active/active arrays</li>
<li>VMW_SATP_DEFAULT_AP – Generic for active/passive arrays</li>
<li>VMW_SATP_ALUA – Asymmetric Logical Unit Access-compliant arrays</li>
</ul>
<p>Although I have sometimes seen other SATP plug-ins mentioned, the following plug-ins are all that are listed in the <a href="http://vmware.com/go/hcl" >VMware ESX Hardware Compatibility List</a>.</p>
<ul>
<li>VMW_SATP_LSI – LSI/NetApp arrays from Dell, HDS, IBM, Oracle, SGI</li>
<li>VMW_SATP_SVC – IBM SVC-based systems (SVC, V7000, Actifio)</li>
<li>VMW_SATP_CX – EMC/Dell CLARiiON  and Celerra (also VMW_SATP_ALUA_CX)</li>
<li>VMW_SATP_SYMM – EMC Symmetrix DMX-3/DMX-4/VMAX, Invista</li>
<li>VMW_SATP_INV – EMC Invista and VPLEX</li>
<li>VMW_SATP_EQL – Dell EqualLogic systems</li>
</ul>
<p>EMC PowerPath and HDS HDLM also support a variety of storage arrays, but I would classify these as full MPP replacements for PSA, rather than SATP plug-ins.</p>
<p>You can see which SATP plug-ins are available using the following esxcli command:</p>
<blockquote><p>esxcli nmp satp list</p></blockquote>
<h3>Path selection plug-in (PSP) List</h3>
<p>In contrast to the diversity of VAAI and SATP plug-ins, the universe of path selection plug-ins is fairly small. Most storage arrays are supported with either Most Recently Used (MRU) or Fixed path selection approaches. Many also support Round Robin (RR) path selection. The only vendor with a specific PSP that is not also part of a full MPP (like EMC PowerPath or HDS HDLM) is Dell, which offers a special routed path selection plug-in for the EqualLogic iSCSI arrays.</p>
<ul>
<li>VMW_PSP_MRU – Most-Recently Used (MRU) – Supports hundreds of storage arrays</li>
<li>VMW_PSP_FIXED – Fixed &#8211; Supports hundreds of storage arrays</li>
<li>VMW_PSP_RR – Round-Robin &#8211; Supports dozens of storage arrays</li>
<li>DELL_PSP_EQL_ROUTED – Dell EqualLogic iSCSI arrays</li>
</ul>
<p>As mentioned, EMC PowerPath also offers path selection as a plug-in in addition to the full MPP stack. Many other vendors offer unique path selection plug-ins, over 100 in total, but these are not specifically called out in the VMware HCL apart from their existence. I would love to learn more about them, however.</p>
<p>You can see which SATP plug-ins are available using the following esxcli command:</p>
<blockquote><p>esxcli nmp psp list</p></blockquote>
<h3>Tell Me More About PSA!</h3>
<p>As mentioned above, I am by no means an expert in VMware Pluggable Storage Architecture. Rather, I am interested in learning more and passing on this knowledge to others. I welcome your comments and feedback, and especially your corrections to the information presented here. I will try to keep this page updated as new versions of vSphere are introduced and as I learn more about this technology. Thank you for your help and understanding!</p>
<p>Further Reading:</p>
<ul>
<li><a href="http://www.vmware.com/files/pdf/Storage-with-VMware-vSphere.pdf" >What&#8217;s New in VMware vSphere 4: Storage</a></li>
<li><a href="http://download3.vmware.com/vmworld/2006/tac9564.pdf" >Next-Generation ESX Storage: A Pluggable Core Storage Architecture</a></li>
<li><a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/" >Storage Changes in the VMware  vSphere 4 Family</a></li>
<li><a href="http://www.yellow-bricks.com/2009/03/19/pluggable-storage-architecture-exploring-the-next-version-of-esxvcenter/" > Pluggable Storage Architecture, exploring the next version of ESX/vCenter</a></li>
<li><a rel="nofollow" href="http://geeksilver.wordpress.com/2010/08/17/vmware-vsphere-4-1-psa-pluggable-storage-architecture-understanding/" >Vmware vSphere 4.1 PSA (Pluggable Storage Architecture) Understanding</a></li>
<li><a rel="nofollow" href="http://virtuallanger.wordpress.com/2010/10/11/explain-the-pluggable-storage-architecture-psa-layout/" >Explain the Pluggable Storage Architecture (PSA) Layout</a></li>
</ul>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2009/04/22/emc-powerpath-vmware-hyperv/"  rel="bookmark" class="crp_title">PowerPath To The Virtual People</a></li><li><a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/"  rel="bookmark" class="crp_title">Storage Changes in the VMware vSphere 4 Family</a></li><li><a href="http://blog.fosketts.net/2011/09/01/falconstor-nss-vmware-vaai/"  rel="bookmark" class="crp_title">FalconStor Brings VAAI Support To Every Storage Array</a></li><li><a href="http://blog.fosketts.net/2011/07/16/vmware-vsphere-5-storage/"  rel="bookmark" class="crp_title">Storage Changes in VMware vSphere 5</a></li><li><a href="http://blog.fosketts.net/2011/05/09/ibm-adds-vaai-support-xiv-svc/"  rel="bookmark" class="crp_title">IBM Adds VAAI Support to XIV and SVC</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2011/06/06/vmware-esx-vsphere-satp-psp-support-matrix/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2011. |
<a href="http://blog.fosketts.net/2011/06/06/vmware-esx-vsphere-satp-psp-support-matrix/">VMware PSP and SATP in Plain English</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/everything/" title="View all posts in Everything" rel="category tag">Everything</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2011/06/06/vmware-esx-vsphere-satp-psp-support-matrix/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
	
		<series:name><![CDATA[VMware storage features]]></series:name>
	</item>
		<item>
		<title>Multipath: Active/Passive, Dual Active, and Active/Active</title>
		<link>http://blog.fosketts.net/2010/03/30/multi-pathing-dual-active-passive/</link>
		<comments>http://blog.fosketts.net/2010/03/30/multi-pathing-dual-active-passive/#comments</comments>
		<pubDate>Tue, 30 Mar 2010 20:41:14 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Computer History]]></category>
		<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Everything]]></category>
		<category><![CDATA[Gestalt IT]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[active active]]></category>
		<category><![CDATA[active passive]]></category>
		<category><![CDATA[clustering]]></category>
		<category><![CDATA[DMP]]></category>
		<category><![CDATA[dual-active]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[HP]]></category>
		<category><![CDATA[multipath I/O]]></category>
		<category><![CDATA[multipathing]]></category>
		<category><![CDATA[path management]]></category>
		<category><![CDATA[PowerPath]]></category>
		<category><![CDATA[PVlinks]]></category>
		<category><![CDATA[SCSI]]></category>
		<category><![CDATA[Symmetrix]]></category>
		<category><![CDATA[Veritas]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=2737</guid>
		<description><![CDATA[Although it's rare in the PC world, multipath I/O is not new in enterprise IT. I've been juggling paths to storage and networks as long as I've been a systems administrator, and that's a bit longer than I care to admit. But the proliferation of technologies has made it difficult to understand path management. What's the difference between "dual active" and "active/active"? Is "active/passive" really that bad?]]></description>
			<content:encoded><![CDATA[<p>Although it&#8217;s rare in the PC world, multipath I/O is not new in enterprise IT. I&#8217;ve been juggling paths to storage and networks as long as I&#8217;ve been a systems administrator, and that&#8217;s a bit longer than I care to admit. But the proliferation of technologies has made it difficult to understand path management. What&#8217;s the difference between &#8220;dual active&#8221; and &#8220;active/active&#8221;? Is &#8220;active/passive&#8221; really that bad?</p>
<h3>What is Multipath? And Why?</h3>
<div id="attachment_2844" class="wp-caption aligncenter" style="width: 410px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2010/03/Single-path.jpg" ><img class="size-full wp-image-2844" title="Single path" src="http://blog.fosketts.net/wp-content/uploads/2010/03/Single-path.jpg" alt="" width="400" height="205" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">The good old days: One device, one path</p></div>
<p>In the beginning, computers connected to peripherals and other computers through a single bus or channel and life was easy. Although one might mistake the names of the dominant printer connection (parallel) for some kind of multipath system when compared to the modem connection (serial), this was not the case. Only the bits traveled in parallel &#8211; the logical connection was a simple single path.</p>
<div id="attachment_2843" class="wp-caption aligncenter" style="width: 250px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2010/03/Daisy-chain-1.jpg" ><img class="size-full wp-image-2843 " title="Daisy-chain 1" src="http://blog.fosketts.net/wp-content/uploads/2010/03/Daisy-chain-1.jpg" alt="" width="240" height="175" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">Early-90&#39;s servers might confuse admins with two SCSI connections to a single device</p></div>
<p>Then things got complicated. The SCSI protocol allowed for multiple devices in a chain, and even for two different &#8220;initiators&#8221; (computers or controllers) to interact with these &#8220;targets&#8221;. Some folks even dual-attached devices to a single computer with multiple controllers.</p>
<p>Why would one device and one computer need more than one connection? It boils down to two factors:</p>
<ol>
<li><strong>Performance</strong> &#8211; I/O channels have typically been slower than the computer could handle, so multiple channels might be used to increase the amount of data that can flow in and out.</li>
<li><strong>Reliability</strong> &#8211; If one connection failed, the other might still be usable, reducing the risk of an outage.</li>
</ol>
<div id="attachment_2842" class="wp-caption aligncenter" style="width: 290px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2010/03/Multiple-paths.jpg" ><img class="size-full wp-image-2842 " title="Multiple paths" src="http://blog.fosketts.net/wp-content/uploads/2010/03/Multiple-paths.jpg" alt="" width="280" height="175" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">Late-90&#39;s enterprise systems might have four or more paths to a single storage array</p></div>
<p>Pretty soon, enterprise computer architecture had gotten incredibly complex. I remember connecting a massive HP V-class server to an EMC Symmetrix with eight separate Fibre Channel cables. Each disk &#8220;LUN&#8221; showed up twice, and we had hundreds of them. We managed all of these virtual storage paths using HP&#8217;s PVLinks dynamic multipathing software. We used Veritas DMP and EMC PowerPath to do pretty much the same thing on Solaris and other UNIX systems.</p>
<h3>Active/Passive to Active/Active</h3>
<p>The earliest path management software provided two incredibly important functions: It figured out which of the SCSI targets it saw were actually different names for the same one, and it allowed the operating system to choose one and fail over to the other in case of an interruption. These were <strong>Active/Passive</strong> links &#8211; no matter how many paths were presented (and Fibre Channel switches sometimes presented eight or more), only one was active at any one time.</p>
<div id="attachment_2841" class="wp-caption aligncenter" style="width: 410px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2010/03/Switched-Fabric.jpg" ><img class="size-full wp-image-2841" title="Switched Fabric" src="http://blog.fosketts.net/wp-content/uploads/2010/03/Switched-Fabric.jpg" alt="" width="400" height="282" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">Modern systems have abstracted and virtual I/O channels, making path management much more important</p></div>
<p>But the EMC Symmetrix and similar high-end storage systems changed all this. Symmetrix storage was fully virtualized &#8211; the presentation of LUNs to servers was entirely disconnected from the actual disks and RAID sets in the array. This meant the Symmetrix could handle I/O requests across different paths and controllers for the same LUN. EMC and the rest responded with <strong>Active/Active</strong> path management software, allowing I/O to travel in parallel for the first time.</p>
<h3>How is Dual Active Different?</h3>
<p>Not everything called Active/Active is created equal. In fact, many supposed Active/Active setups really shouldn&#8217;t be called that since they don&#8217;t use both paths for all data. Instead, I like to call these <strong>Dual Active</strong> &#8211; both paths are active but with different data.</p>
<p>Consider the differences between the following two solutions:</p>
<div id="attachment_2845" class="wp-caption aligncenter" style="width: 410px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2010/03/Switched-Fabric-Active-Active.jpeg" ><img class="size-full wp-image-2845" title="Switched Fabric Active Active" src="http://blog.fosketts.net/wp-content/uploads/2010/03/Switched-Fabric-Active-Active.jpeg" alt="" width="400" height="282" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">A true active/active setup uses all paths for all data all the time</p></div>
<div id="attachment_2846" class="wp-caption aligncenter" style="width: 410px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2010/03/Switched-Fabric-Dual-Active.jpeg" ><img class="size-full wp-image-2846" title="Switched Fabric Dual Active" src="http://blog.fosketts.net/wp-content/uploads/2010/03/Switched-Fabric-Dual-Active.jpeg" alt="" width="400" height="282" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">A &quot;dual active&quot; setup uses both paths, but each target is directed to one or the other</p></div>
<p>See the difference? Although the paths are active in both cases, they are not the same. Both approaches have merit, and neither is inherently superior, but they should have different names applied. Even active/passive has its place, since simplicity is often a virtue.</p>
<h3>Dual Active Outside Storage</h3>
<p>These same concepts apply outside the field of storage and I/O. Many server clustering systems use the same terminology, right down to the misapplication of &#8220;active/active&#8221; when &#8220;dual active&#8221; is more appropriate. It&#8217;s easy to miss the significance of this difference, but it can make more of an impact in clustering since CPU workloads are harder to balance.</p>
<p>Let me know what you think. If there is interest, I might dive into path management strategies like round robin!</p>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2011/06/06/vmware-esx-vsphere-satp-psp-support-matrix/"  rel="bookmark" class="crp_title">VMware PSP and SATP in Plain English</a></li><li><a href="http://blog.fosketts.net/2012/01/31/nimbus-eclass-big-redundant-allflash-enterprise-array/"  rel="bookmark" class="crp_title">Nimbus E-Class: The First Big, Redundant, All-Flash Enterprise Array</a></li><li><a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/"  rel="bookmark" class="crp_title">Storage Changes in the VMware vSphere 4 Family</a></li><li><a href="http://blog.fosketts.net/2009/05/05/windows-storage-server-2008/"  rel="bookmark" class="crp_title">I Can Finally Talk About Windows Storage Server 2008!</a></li><li><a href="http://blog.fosketts.net/2010/10/27/4-horsemen-io/"  rel="bookmark" class="crp_title">The Four Horsemen of Storage System Performance: I/O As a Chain of Bottlenecks</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2010/03/30/multi-pathing-dual-active-passive/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2010. |
<a href="http://blog.fosketts.net/2010/03/30/multi-pathing-dual-active-passive/">Multipath: Active/Passive, Dual Active, and Active/Active</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/computerhistory/" title="View all posts in Computer History" rel="category tag">Computer History</a>, <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/everything/" title="View all posts in Everything" rel="category tag">Everything</a>, <a href="http://blog.fosketts.net/category/gestaltit/" title="View all posts in Gestalt IT" rel="category tag">Gestalt IT</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2010/03/30/multi-pathing-dual-active-passive/feed/</wfw:commentRss>
		<slash:comments>6</slash:comments>
		</item>
		<item>
		<title>PowerPath To The Virtual People</title>
		<link>http://blog.fosketts.net/2009/04/22/emc-powerpath-vmware-hyperv/</link>
		<comments>http://blog.fosketts.net/2009/04/22/emc-powerpath-vmware-hyperv/#comments</comments>
		<pubDate>Thu, 23 Apr 2009 03:48:49 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Computer History]]></category>
		<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Gestalt IT]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[ATF]]></category>
		<category><![CDATA[Chad Sakac]]></category>
		<category><![CDATA[Chuck Hollis]]></category>
		<category><![CDATA[CLARiiON]]></category>
		<category><![CDATA[Conley]]></category>
		<category><![CDATA[DMP]]></category>
		<category><![CDATA[EMC]]></category>
		<category><![CDATA[ESX]]></category>
		<category><![CDATA[HDLM]]></category>
		<category><![CDATA[HP-UX]]></category>
		<category><![CDATA[Hyper-V]]></category>
		<category><![CDATA[iSCSI]]></category>
		<category><![CDATA[latency]]></category>
		<category><![CDATA[Microsoft]]></category>
		<category><![CDATA[MPIO]]></category>
		<category><![CDATA[performance]]></category>
		<category><![CDATA[PowerPath]]></category>
		<category><![CDATA[PowerPath/VE]]></category>
		<category><![CDATA[PVlinks]]></category>
		<category><![CDATA[SDD]]></category>
		<category><![CDATA[Veritas]]></category>
		<category><![CDATA[VMware]]></category>
		<category><![CDATA[vSphere]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=1731</guid>
		<description><![CDATA[Hiding in the shadow of the huge VMware vSphere 4 announcement was a very interesting introduction by EMC: PowerPath/VE. As I mentioned in my post on storage changes in vSphere 4, PowerPath/VE plugs into the new pluggable storage architecture (PSA) found in vSphere 4 versions of ESX and takes over the decision-making and heavy-lifting tasks related to communicating with storage systems.D]]></description>
			<content:encoded><![CDATA[<p>Hiding in the shadow of the huge VMware vSphere 4 announcement was a very interesting introduction by EMC: <strong>PowerPath/VE</strong>. As I mentioned in my post on storage changes in vSphere 4, PowerPath/VE plugs into the new pluggable storage architecture (PSA) found in vSphere 4 versions of ESX and takes over the decision-making and heavy-lifting tasks related to communicating with storage systems.<span id="more-1731"></span></p>
<h3 class="post-subhead">Driving Massive I/O</h3>
<p>Chuck Hollis treated us to a discussion of <a href="http://chucksblog.emc.com/chucks_blog/2009/04/vsphere-as-an-io-engine.html" >vSphere as an I/O Engine</a> on his blog this morning with some background on multipath IO (MPIO for short), but I&#8217;m not sure he did the topic justice. In my opinion, server virtualization is <strong>the greatest I/O driver ever brought into the data center</strong>, and it messes with all of our preconceived notions about I/O at the same time.</p>
<p>What&#8217;s so special about server virtualization?</p>
<ol>
<li><strong>Hypervisors concentrate I/O</strong>, shifting loads that were formerly distributed to a large number of I/O channels into a far fewer channels. Picture 10 servers doing what they do. Now put all 10 in a single physical box. All of their storage access must now share a bus, a host adapter, a cable, and perhaps a LUN on the storage system. <strong>It&#8217;s the difference between lemonade and lemon juice!</strong></li>
<li><strong>Hypervisors randomize I/O</strong>, chunking everything up and mixing it together. Forget about the carefully-designed read-ahead algorithms and caching used in enterprise storage &#8211; VMware, Hyper-V and the rest throw those expectations out the window! <strong>Virtualization is a blender &#8211; it grinds up your lemons, skin, seeds, and all!</strong></li>
<li><strong>Hypervisors demand low I/O latency</strong>, forcing infrastructure to get quicker, not just faster. This is one reason that caching, solid state disks, and 10 GbE are going to be huge in virtual environments &#8211; all reduce latency by orders of magnitude! As any car guy will tell you, <strong>quick and fast are two very different things!</strong></li>
</ol>
<p>The upshot of all of this is that virtual servers are very very hard to satisfy when it comes to I/O. And the &#8220;back end&#8221; has always been a bit of a bottleneck for virtualization software. Now we have VMware claiming that <strong>vSphere 4 can push over 300,000 I/O operations per second (IOPS)</strong> without resorting to VMDirectPath and similar &#8220;cheater&#8221; measures. Of course not all IOPS are equal, and I doubt that that 300k number would hold up with a real-world workload, but it&#8217;s impressive nonetheless!</p>
<h3 class="post-subhead">A Brief History of MPIO</h3>
<p>Let&#8217;s turn back to multipath I/O. PowerPath/VE is just the latest in a long line of path managers, not all of which have been well-loved. Back in my HP-UX days I learned to make the most of PVlinks, the native path management on that operating system. It wasn&#8217;t always easy to get it to work well, but it sure was nice to have a path manager built into the operating system! Veritas also offered a multi-platform path manager, DMP, which worked with a variety of array types. Back in the day, both were limited to simple failover and lacked the &#8220;intelligence&#8221; to deal with the peculiarities of the weird storage arrays we learned to not hate.</p>
<p>Array-specific path managers from storage vendors were much more successful. CLARiiONs used ATF, Hitachi arrays used HDLM, IBM had SDD, and of course EMC had PowerPath. EMC introduced PowerPath in 1997, the software reportedly having been developed by Conley Corporation, which EMC acquired the next year and turned into its Cambridge (MA) development center. After acquiring Data General, EMC <a rel="nofollow" href="http://stevetodd.typepad.com/my_weblog/2008/09/power-to-the-pa.html"  target="_blank">adapted PowerPath to support CLARiiON</a>, pushing ATF off stage right. Then they kept right on developing the software, adding support for IBM, HDS, and HP arrays and data migration.</p>
<p>Meanwhile, Microsoft decided that HP and Veritas were on to something when they developed standard path management software, so they began working on a <a href="http://blog.fosketts.net/2008/03/10/microsoft-the-a-rod-of-storage/"  target="_blank">standard multi-path IO (MPIO) driver for Windows</a>. But Microsoft learned a thing or two from the mediocre device support in those old solutions, so they decided to allow vendors to plug their own smarts into the standard Windows Server 2000/2003 MPIO framework. Microsoft provided basic failover capability and third parties, including EMC, wrote their own device-specific modules (DSMs). This MPIO support evolved and spread, standard on Microsoft&#8217;s iSCSI initiator and Hyper-V virtualization platform. PowerPath 5.2.1 for Windows already supported Hyper-V thanks to this.</p>
<h3 class="post-subhead">PowerPath and VMware PSA</h3>
<p>VMware also learned a thing or two from HP and Microsoft. Although basic path failover support has been included in ESX for years, vSphere 4 takes it to a new level with pluggable storage architecture (PSA). Every version of ESX 4 includes native multipathing (NMP), but Enterprise Plus licensees can use vendor-supplied plugins to enable more advanced path management. As I noted on Tuesday, <a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/"  target="_blank">there are </a><a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/"  target="_blank"><span style="text-decoration: line-through;">two</span></a><a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/"  target="_blank"> three different levels of path selection</a>: Basic path-selection plugins (PSPs), more advanced storage array type plugins (SATPs), and complete multi-path plugins (MPPs).</p>
<p>This is what EMC has introduced: An MPP for vSphere 4 called PowerPath/VE. Like the DSM for Windows MPIO, PowerPath/VE for vSphere slots right into an existing MPIO framework and enables advanced path selection and load balancing without mucking with the internals of the hypervisor. PowerPath/VE has all sorts of smarts in it. It has eight different predictive load balancing policies, proactive disconnect, bus testing, and HBA monitoring.</p>
<p>Super VMware guy <a rel="nofollow" href="http://virtualgeek.typepad.com/virtual_geek/"  target="_blank">Chad Sakac</a> <a href="http://canada.emc.com/collateral/demos/microsites/mediaplayer-video/vsphere-chad-sakac-powerpath.htm"  target="_blank">described PowerPath/VE</a> as part of the launch. He notes that EMC is first out of the gate with a multipathing plugin for vSphere, but I suspect that just about every vendor will release similar functionality pretty quickly. In particular I expect support to come from NetApp and 3PAR, since they&#8217;re so interested in VMware support.</p>
<h3 class="post-subhead">Licensing Questions</h3>
<p>One thing really stuck out in the vSphere launch: <strong>PSA is only included in the top-of-the-line Enterprise Plus license</strong>. Presumably, this means that, in addition to paying for a PowerPath/VE license, users will have to spring for maximum ESX, too. This is a dumb move, if you ask me. Microsoft made MPIO successful by giving it away with every copy of Windows. They even included it in the free iSCSI initiator download. VMware, in contrast, seems to be actively limiting PSA&#8217;s usefulness to the top tier of users. If it was up to me, I would <strong>set the VMware MPIO free</strong>!</p>
<p>I&#8217;m working with EMC and VMware to determine the extent of the NMP/PSA/PowerPath licensing mess. I&#8217;ll update this post as I find out the answers!</p>
<ol>
<li>Does every edition of ESX 4 include the basic VMware native multipathing (NMP)?</li>
<li>Can one use a vendor-supplied PSA plugin like PowerPath/VE without an enterprise plus license?</li>
<li>Does it matter (to licensing) if the plugin is a PSP or an SATP?</li>
<li>If &#8220;no&#8221; to 2 or 3, can PSA be added separately without the plus license if someone wants to use something like PowerPath/VE?</li>
</ol>
<p><strong>Update:</strong> I received a nice email from an EMC engineer correcting me about the plugin types. This kind of open communication is why the web is so great! It turns out that PowerPath/VE is a sort of super plugin called an MPP, not &#8220;just&#8221; an SATP or PSP. I&#8217;ve updated the section above!</p>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2011/06/06/vmware-esx-vsphere-satp-psp-support-matrix/"  rel="bookmark" class="crp_title">VMware PSP and SATP in Plain English</a></li><li><a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/"  rel="bookmark" class="crp_title">Storage Changes in the VMware vSphere 4 Family</a></li><li><a href="http://blog.fosketts.net/2008/09/19/what-vmware-vdc-os-vstorage/"  rel="bookmark" class="crp_title">What is VMware VDC-OS vStorage?</a></li><li><a href="http://blog.fosketts.net/2008/03/10/microsoft-the-a-rod-of-storage/"  rel="bookmark" class="crp_title">Microsoft: The A-Rod of Storage</a></li><li><a href="http://blog.fosketts.net/2009/01/26/essential-vmware-esx-iscsi/"  rel="bookmark" class="crp_title">Essential Reading for VMware ESX iSCSI Users!</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2009/04/22/emc-powerpath-vmware-hyperv/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2009. |
<a href="http://blog.fosketts.net/2009/04/22/emc-powerpath-vmware-hyperv/">PowerPath To The Virtual People</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/computerhistory/" title="View all posts in Computer History" rel="category tag">Computer History</a>, <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/gestaltit/" title="View all posts in Gestalt IT" rel="category tag">Gestalt IT</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2009/04/22/emc-powerpath-vmware-hyperv/feed/</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
		<item>
		<title>Storage Changes in the VMware vSphere 4 Family</title>
		<link>http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/</link>
		<comments>http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/#comments</comments>
		<pubDate>Tue, 21 Apr 2009 19:24:55 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Gestalt IT]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[ESX]]></category>
		<category><![CDATA[featured]]></category>
		<category><![CDATA[licensing]]></category>
		<category><![CDATA[PowerPath]]></category>
		<category><![CDATA[PowerPath/VE]]></category>
		<category><![CDATA[PSA]]></category>
		<category><![CDATA[PSP]]></category>
		<category><![CDATA[PVSCSI]]></category>
		<category><![CDATA[SATP]]></category>
		<category><![CDATA[Storage VMotion]]></category>
		<category><![CDATA[thin provisioning]]></category>
		<category><![CDATA[VCB]]></category>
		<category><![CDATA[vCenter]]></category>
		<category><![CDATA[VMDirectPath]]></category>
		<category><![CDATA[VMFS]]></category>
		<category><![CDATA[VMware]]></category>
		<category><![CDATA[vSphere]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=1775</guid>
		<description><![CDATA[VMware officially launched their next-generation (version 4) enterprise family of products today under the "vSphere 4" name. As I've been doing for the last few major ESX releases, I'm focusing this post on the storage changes present in vSphere 4.]]></description>
			<content:encoded><![CDATA[<p>VMware officially <a href="http://www.vmware.com/landing_pages/nextgen.html"  target="_blank">launched</a> their next-generation (version 4) enterprise family of products today under the &#8220;vSphere 4&#8243; name. As I&#8217;ve been doing for the last few major ESX releases, I&#8217;m focusing this post on the storage changes present in vSphere 4.</p>
<blockquote><p>For more information on earlier updates, see my articles:</p>
<ul>
<li><em><a href="http://blog.fosketts.net/2008/07/28/storage-fixes-vmware-esx-server-35-update-2/"  target="_self">Storage Fixes in VMware ESX Server 3.5 Update 2</a></em></li>
<li><em><a href="http://blog.fosketts.net/2008/11/07/storage-vmware-esx-update-3/"  target="_blank">Storage Changes in VMware ESX 3.5 Update 3</a></em></li>
<li><em><a href="http://blog.fosketts.net/2009/03/31/storage-vmware-esx-35-update-4/" >Storage Changes in VMware ESX 3.5 Update 4</a><br />
 </em></li>
</ul>
</blockquote>
<p>One first step is VMware&#8217;s whitepaper, &#8220;<a href="http://www.vmware.com/files/pdf/VMW_09Q1_WP_vSphereStorage_P10_R1.pdf"  target="_blank">What&#8217;s New in VMware vSphere 4: Storage</a>&#8220;.<span id="more-1775"></span></p>
<h3 class="post-subhead">Licensing and Availability of Features</h3>
<p>The most important change at a glance is in the licensing model for VMware.</p>
<ul>
<li>A new low-end &#8220;standard&#8221; level includes all of the components a small business might need, including thin provisioning of storage, at a very attractive price.</li>
<li>The &#8220;advanced&#8221; level includes advances in the area of data protection.</li>
<li>At the &#8220;enterprise&#8221; level, live migration of storage is enabled.</li>
<li>Top of the heap is &#8220;enterprise plus&#8221;, which enables the intriguing plug-in third-party multipathing support previously rumored.</li>
<li>Enterprise customers with current support will get vStorage thin provisioning and data protection when they upgrade.</li>
</ul>
<div id="attachment_1777" class="wp-caption aligncenter" style="width: 529px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2009/04/vspher4.jpg" ><img class="size-full wp-image-1777" title="vspher4" src="http://blog.fosketts.net/wp-content/uploads/2009/04/vspher4.jpg" alt="Each step up the licensing ladder enables important new storage features" width="519" height="444" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">Each step up the licensing ladder enables important new storage features (source: VMware)</p></div>
<h3 class="post-subhead">Thin Provisioning</h3>
<p>One of the most widespread storage features is native thin provisioning. VMware <strong>ESX 4 will allocate storage in 1 MB chunks</strong> as capacity is used. This isn&#8217;t really completely new &#8211; similar support was enabled by default for virtual disks on NFS in VI 3, and thin provisioning could be enabled on the command line for block-based storage as well. It was also present in VMware&#8217;s desktop products, including my own copy of Fusion. And <strong>ESX allows thick-to-thin conversion</strong> during Storage VMotion.</p>
<p>The difference with vSphere 4 is that thin provisioning is fully supported and integrated into every version of ESX. Although <a href="http://blog.fosketts.net/tag/thin-provisioning"  target="_blank">many storage arrays now also offer thin storage</a>, the addition of native, integrated thin provisioning right in ESX is huge. This alone will be a major capacity (and thus, cost) savings feature! VMware claims 50% storage savings in their lab tests.</p>
<h3 class="post-subhead">Dynamic Expansion of VMFS Volumes</h3>
<p>VMFS volumes can now grow (and, in some cases, shrink) online without resorting to spanning to a new LUN. Under vSphere 4, VMFS volumes can grow to take advantage of expanded LUNs (up to 2 TB per LUN). The old method still works as well, and multi-LUN spanned VMFS volumes can grow when any of their LUNs is expanded.</p>
<h3 class="post-subhead">Enhanced Storage VMotion</h3>
<p>Like thin provisioning, Storage VMotion has been elevated to first-class status, supported just about everywhere you&#8217;d want it. It&#8217;s in all the likely spots within vCenter.</p>
<p>Storage VMotion gives serious storage flexibility now, enabling (almost) any-to-any migration of VMFS volumes: Pick up a Fibre Channel, iSCSI, or NFS disk image and move it to another datastore running any of those protocols to convert live. And you can do thick-to-thin provisioning at the same time.</p>
<p>Under the hood, the whole infrastructure has been revised. Storage VMotion leverages VMware&#8217;s change block tracking instead of disk snapshots now, speeding up the migration process and reducing the (formerly excessive) memory and CPU requirements of Storage VMotion in 3.5. This is the same technology leveraged by vSphere&#8217;s High Availability features, by the way.</p>
<h3 class="post-subhead">Pluggable Storage Architecture (PSA)</h3>
<p>Only &#8220;Enterprise Plus&#8221; licensees will get to use it, but the vSphere family also sports a new <a href="http://www.yellow-bricks.com/2009/03/19/pluggable-storage-architecture-exploring-the-next-version-of-esxvcenter/"  target="_blank">pluggable storage architecture (PSA)</a> which will initially be leveraged to deliver vendor-specific multipath support. Note that the native multipath support in vSphere continues to be a basic round-robin or fail-over system &#8211; it will not dynamically load balance I/O across multiple paths or make more intelligent decisions about which paths to use.</p>
<div id="attachment_1779" class="wp-caption aligncenter" style="width: 518px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2009/04/picture-1.png" ><img class="size-full wp-image-1779" title="picture-1" src="http://blog.fosketts.net/wp-content/uploads/2009/04/picture-1.png" alt="vSphere 4's Pluggable Storage Architecture allows third-party developers to replace ESX's storage I/O stack" width="508" height="224" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">vSphere 4&#39;s Pluggable Storage Architecture allows third-party developers to replace ESX&#39;s storage I/O stack (source: VMware)</p></div>
<p>As you may gather from this VMware illustration (but would probably miss since it&#8217;s not all that comprehensible), there are two classes of third-party plug-ins:</p>
<ol>
<li>Basic path-selection plugins (PSPs) will merely optimize the choice of which path to use, ideal for active/passive type arrays</li>
<li>Full storage array type plugins (SATPs) will allow load balancing across multiple paths in addition to path selection for active/active arrays</li>
</ol>
<p>EMC also announced <strong><a href="http://chucksblog.emc.com/chucks_blog/2009/04/vsphere-as-an-io-engine.html"  target="_blank">PowerPath/VE</a></strong><a href="http://chucksblog.emc.com/chucks_blog/2009/04/vsphere-as-an-io-engine.html"  target="_blank"> for vSphere</a>, integrating their popular multi-platform path management software directly into ESX. It&#8217;s not clear at this point whether PowerPath will require an Enterprise Plus license (or if it will come with one) or if it will work with all editions, but I&#8217;m sure that will be clarified soon. My EMC contacts do tell me that PowerPath/VE is licensed on a per-socket basis (like VMware of yore) and that EMC sales reps have some room to get creative on licensing.</p>
<h3 class="post-subhead">iSCSI Software Initiator Enhancements</h3>
<p>It&#8217;s harder to claim it as a new feature, but the iSCSI software initiator has also been tweaked and tuned to use less CPU time and deliver better throughput. The iSCSI configuration process has also been smoothed out so one no longer needs to have a live Service Console connection in order to communicate with an iSCSI target. And changes made in the general tab are now global, so they&#8217;ll propagate down to each target. Bi-directional CHAP is also added, so the target can now be authenticated in addition to the initiator.</p>
<p>vSphere also includes a paravirtualized iSCSI driver (PVSCSI) which works like vmxnet to present a higher-performance iSCSI adapter within certain supported guest OSes.</p>
<p>More information on multipathing iSCSI can be found at <a href="http://www.yellow-bricks.com/2009/03/18/iscsi-multipathing-with-esxcliexploring-the-next-version-of-esx/"  target="_blank">Yellow Bricks</a> and in Chad Sakac&#8217;s <a rel="nofollow" href="http://virtualgeek.typepad.com/virtual_geek/2009/01/a-multivendor-post-to-help-our-mutual-iscsi-customers-using-vmware.html"  target="_blank">mega-post</a> on the topic.</p>
<h3 class="post-subhead">High-Performance I/O</h3>
<p>vSphere really pours on the I/O power. They claim a 3x increase, to &#8220;over 300,000 I/O operations per second&#8221;, but mentioned in the launch that they&#8217;ve gotten to 400,000 in some workloads. This is really amazing, and if it&#8217;s true in real-world use means that VMware ESX can now host just about any application you can think of.</p>
<p>It&#8217;s funny, but just a few weeks before the announcement VMware&#8217;s Chief Data Center architect, Scott Davis, told me at Storage Networking World that vSphere would double I/O performance. I thought this was a bold statement at the time, but VMware went further in their official documents, claiming 3x improvement. Now we have an on-stage admission that it could be up to 4x! This is serious stuff, folks: <strong>Can VMware really do 400,000 IOPS</strong>?</p>
<p>One question is whether these IOPS improvements require the new VMDirectPath I/O for Storage, which binds a physical Fibre Channel HBA to a single guest OS, or if they&#8217;re generalized across all systems.</p>
<h3 class="post-subhead">vCenter Improvements</h3>
<p>vCenter now includes <a href="http://www.yellow-bricks.com/2009/04/20/storage-views-exploring-the-next-version-of/"  target="_blank">more storage information</a>:</p>
<ul>
<li>Each VM and ESX in the inventory has a tab showing storage information and allowing users to set alarms on storage use &#8211; setting capacity alarms becomes extremely important when thin provisioning is used!</li>
<li>vCenter inventory has a view showing datastore details</li>
<li>There&#8217;s also a nice storage topology map</li>
</ul>
<h3 class="post-subhead">Data Protection APIs (Updated)</h3>
<p>VMware also enhanced the APIs for consolidated backup (VCB) into &#8220;vStorage Data Protection&#8221;. <span style="text-decoration: line-through;">Available only with Advanced or Enterprise licenses</span>, these APIs allow enterprise backup vendors to develop specific integration with VMware without VCB in the middle.  All versions of ESX include this vStorage API and boast VCB support. Standard and Essentials licenses do not include vCenter Data Recovery, a standalone disk-to-disk backup capability for virtual machines.</p>
<h3 class="post-subhead">Conclusion</h3>
<p>vSphere is loaded with storage improvements, though many seem like incremental updates rather than new features. Admins will welcome thin provisioning support, and the full integration of Storage VMotion is certainly welcome, but I think the changes to vCenter will be most noticeable. I&#8217;ll be looking into EMC&#8217;s PowerPath/VE and the amazing I/O improvements as we move forward and learn more about the next ESX!</p>
<p>Duncan Epping posted much more <a href="http://www.yellow-bricks.com/2009/04/21/vsphere-linkage/" >vSphere Linkage</a> on his Yellow Bricks blog if you&#8217;re interested in non-storage features. I also suggest reading Chris Evans&#8217; outline of <a href="http://thestoragearchitect.com/2009/04/21/enterprise-computing-vmware-announce-vsphere-4/"  target="_blank">vSphere storage changes</a>.</p>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2011/07/16/vmware-vsphere-5-storage/"  rel="bookmark" class="crp_title">Storage Changes in VMware vSphere 5</a></li><li><a href="http://blog.fosketts.net/2011/06/06/vmware-esx-vsphere-satp-psp-support-matrix/"  rel="bookmark" class="crp_title">VMware PSP and SATP in Plain English</a></li><li><a href="http://blog.fosketts.net/2009/04/22/emc-powerpath-vmware-hyperv/"  rel="bookmark" class="crp_title">PowerPath To The Virtual People</a></li><li><a href="http://blog.fosketts.net/2011/11/11/vmware-vasa/"  rel="bookmark" class="crp_title">What is VMware VASA? Not Much (Yet)</a></li><li><a href="http://blog.fosketts.net/2009/01/26/essential-vmware-esx-iscsi/"  rel="bookmark" class="crp_title">Essential Reading for VMware ESX iSCSI Users!</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2009. |
<a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/">Storage Changes in the VMware vSphere 4 Family</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/gestaltit/" title="View all posts in Gestalt IT" rel="category tag">Gestalt IT</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/feed/</wfw:commentRss>
		<slash:comments>6</slash:comments>
		</item>
		<item>
		<title>What is VMware VDC-OS vStorage?</title>
		<link>http://blog.fosketts.net/2008/09/19/what-vmware-vdc-os-vstorage/</link>
		<comments>http://blog.fosketts.net/2008/09/19/what-vmware-vdc-os-vstorage/#comments</comments>
		<pubDate>Fri, 19 Sep 2008 17:37:36 +0000</pubDate>
		<dc:creator>Stephen</dc:creator>
				<category><![CDATA[Enterprise storage]]></category>
		<category><![CDATA[Virtual Storage]]></category>
		<category><![CDATA[I/O deduplication]]></category>
		<category><![CDATA[linked clones]]></category>
		<category><![CDATA[multipathing]]></category>
		<category><![CDATA[PowerPath]]></category>
		<category><![CDATA[server virtualization]]></category>
		<category><![CDATA[site recovery manager]]></category>
		<category><![CDATA[snapshots]]></category>
		<category><![CDATA[thin provisioning]]></category>
		<category><![CDATA[VCB]]></category>
		<category><![CDATA[VDC-OS]]></category>
		<category><![CDATA[Virtual datacenter]]></category>
		<category><![CDATA[VMFS]]></category>
		<category><![CDATA[VMware]]></category>
		<category><![CDATA[VMworld]]></category>
		<category><![CDATA[vServices]]></category>
		<category><![CDATA[vStorage]]></category>

		<guid isPermaLink="false">http://blog.fosketts.net/?p=647</guid>
		<description><![CDATA[VMware packed a lot into their 2008 VMworld conference, including an outline of their &#8220;three pillars&#8221; strategy, focused on vClient, vCloud, and something they are calling the Virtual Datacenter Operating System. While it is debatable if this last item really is an operating system, it&#8217;s certainly a major strategic change in messaging. VDC-OS is divided [...]]]></description>
			<content:encoded><![CDATA[<div id="attachment_648" class="wp-caption alignright" style="width: 310px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; float: right;"><a rel="nofollow" href="http://commons.wikimedia.org/wiki/Image:Eagle_nebula_pillars.jpg" ><img class="size-medium wp-image-648" title="Eagle Nebula Pillars" src="http://blog.fosketts.net/wp-content/uploads/2008/09/eagle_nebula_pillars-300x295.png" alt="Hopefully vCloud, vClient, and VDC-OS are a little more solid (not to mention closer) than the Three Pillars of Creation in the Eagle Nebula" width="300" height="295" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">Hopefully, VMware&#39;s three pillars (vCloud, vClient, and VDC-OS) are a little more solid (not to mention closer) than the Three Pillars of Creation in the Eagle Nebula</p></div>
<p>VMware packed a lot into their 2008 VMworld conference, including an outline of their &#8220;three pillars&#8221; strategy, focused on vClient, vCloud, and something they are calling the <a href="http://blog.fosketts.net/2008/09/16/vmware-virtual-datacenter-operating-system-heavyweight-or-hot-air/"  target="_self">Virtual Datacenter Operating System</a>. While it is debatable if this last item really is an operating system, it&#8217;s certainly a major strategic change in messaging.</p>
<p>VDC-OS is divided into four &#8220;vServices&#8221; (Management, Cloud, Application, and Infrastructure), and <a href="http://www.vmware.com/company/news/releases/vmware_ready_storage.html"  target="_blank">one core Infrastructure vService is vStorage</a>. Since my focus is enterprise storage, I thought I would take a moment to examine the current and future status of vStorage.</p>
<p>EMC&#8217;s Chad Sakac has taken up the challenge of communicating vStorage to the world, in <a rel="nofollow" href="http://virtualgeek.typepad.com/virtual_geek/2008/09/so-what-does-vs.html"  target="_blank">a post to his blog</a>, a pair of YouTube videos (<a rel="nofollow" href="http://www.youtube.com/watch?v=ZhR5kwffJyk"  target="_blank">multipathing</a>, <a rel="nofollow" href="http://www.youtube.com/watch?v=pmxJV-_PqdM"  target="_blank">I/O dedupe</a>), and (apparently) a session or two at VMworld. But I&#8217;m not sure it&#8217;s really entirely clear just what vStorage is and what this means to existing and future VMware storage developments. So let&#8217;s dive in and take a look.</p>
<p><span id="more-647"></span></p>
<p><strong>vStorage = Storage vService for VMware Infrastructure</strong></p>
<p>Let&#8217;s get one thing out of the way immediately: VDC-OS is not a new product &#8211; it&#8217;s a framework to organize VMware&#8217;s existing and future datacenter-targeted products like ESX. The company is sweeping away the current hodgepodge of server product elements and placing them all into a more-organized structure called VDC-OS.</p>
<p>As such, the whole thing is not fully baked at present &#8211; there are lots of missing elements, and these point to future products from VMware and others. I applaud the organization, and feel that this is the first really viable next-generation datacenter vision that I have seen. It accurately reflects the current reality of the corporate data center and includes a migration path to take it to a compelling new level.</p>
<div id="attachment_652" class="wp-caption aligncenter" style="width: 510px;  border: 1px solid #dddddd; background-color: #f3f3f3; padding-top: 4px; margin: 10px; text-align:center; display: block; margin-right: auto; margin-left: auto;"><a href="http://blog.fosketts.net/wp-content/uploads/2008/09/cloud_diagram_510x272.gif" ><img class="size-full wp-image-652" title="VMware Cloud Diagram" src="http://blog.fosketts.net/wp-content/uploads/2008/09/cloud_diagram_510x272.gif" alt="VMware shows the whole puzzle in this diagram" width="500" height="266" /></a><p style=' padding: 0 4px 5px; margin: 0;'  class="wp-caption-text">VMware has a realistic approach to bringing current datacenter elements into the future</p></div>
<p>As we can see in VMware&#8217;s diagram (above), the Virtual Datacenter OS is made up of VMware Infrastructure, with application vServices resting on infrastructure vServices or the cloud. This last bit is the fundamental breakthrough that makes VDC-OS more than just slideware &#8211; <em>if it works</em>, applications (virtual appliances) can transparently move from local infrastructure to cloud infrastructure owned and operated by others. It&#8217;s transformative, and if they pull it off, this could usher in a new datacenter world.</p>
<p>vStorage is one of the core infrastructure services, along with vCompute and vNetwork. Although it&#8217;s not entirely clear at this point, vStorage presumably includes all existing VMware storage technologies as well as the new APIs for multipathing and I/O deduplication highlighted at the show. I envision a future in which vStorage is a set of APIs for everything from I/O to device management, and VMware even includes virtual storage appliances in this umbrella.</p>
<p><strong>vStorage: What&#8217;s In It?</strong></p>
<p>At the very least, <a href="http://www.vmware.com/technology/virtual-datacenter-os/infrastructure.html"  target="_blank">vStorage includes the following</a>:</p>
<ul>
<li>VMFS for shared storage</li>
<li>Thin Provisioning support in VMware Infrastructure is <a rel="nofollow" href="http://storagezilla.typepad.com/storagezilla/2008/09/powerpath-for-vmware-and-a-few-random-thoughts.html"  target="_blank">apparently coming</a> in 2009, but is also <a href="http://blog.scottlowe.org/2008/09/17/very-brief-thoughts-on-the-keynote/"  target="_blank">apparently incompatible</a> with fault tolerance.</li>
<li>Linked Clones is another desktop technology coming to VI 2009.</li>
<li>The <a rel="nofollow" href="http://chucksblog.typepad.com/chucks_blog/2008/09/does-storage-vi.html"  target="_blank">Site Recovery Manager API has also become part of vStorage</a>, though this isn&#8217;t getting much press.</li>
<li>VMware Consolidated Backup (VCB) will also <a href="http://www.yellow-bricks.com/2008/09/18/future-version-of-vcb-not-an-installable-anymore/"  target="_blank">apparently</a> be a vStorage API.</li>
<li>The existing snapshot API will also presumably included.</li>
<li>The new API for Multipathing covers the old generic native multipathing (NMP) from ESX as well as <a rel="nofollow" href="http://stevetodd.typepad.com/my_weblog/2008/09/power-to-the-pa.html"  target="_blank">EMC&#8217;s most excellent PowerPath</a>. The latter is presumably an extra-cost option that enables lots of niftiness, <a rel="nofollow" href="http://virtualgeek.typepad.com/virtual_geek/movies/PowerPathDemo_2_Short.wmv"  target="_blank">as demonstrated by Chad in this video</a>.</li>
<li>Another new API claims to deduplicate I/O, reducing traffic for certain supported disk operations, <a rel="nofollow" href="http://virtualgeek.typepad.com/virtual_geek/movies/vstorage_offload_2.wmv"  target="_blank">as demonstrated in Chad&#8217;s second video</a>.</li>
</ul>
<p>What is in and what is out is still kind of up in the air. But you can see that vStorage includes most of our old favorites (VMFS, SRM, VCB), some desktop elements (thin volumes, linked clones), and some new surprises (PowerPath, I/O dedupe). There is enough meat here to separate this from traditional slideware: VDC-OS has legs!</p>
<div id="crp_related"><h3>You might also want to read these other posts...</h3><ul><li><a href="http://blog.fosketts.net/2008/09/16/vmware-virtual-datacenter-operating-system-vdc-os/"  rel="bookmark" class="crp_title">VMware Virtual Datacenter Operating System: Heavyweight or Hot Air?</a></li><li><a href="http://blog.fosketts.net/2009/04/21/storage-vmware-vsphere-4/"  rel="bookmark" class="crp_title">Storage Changes in the VMware vSphere 4 Family</a></li><li><a href="http://blog.fosketts.net/2008/11/10/emc-atmos-vmware-vdc-os-cloud-strategy/"  rel="bookmark" class="crp_title">EMC Atmos Versus VMware VDC-OS: Will The Real Cloud Strategy Please Stand Up?</a></li><li><a href="http://blog.fosketts.net/2007/08/01/srm-for-vmware-thank-god/"  rel="bookmark" class="crp_title">SRM For VMware (Thank God!)</a></li><li><a href="http://blog.fosketts.net/2009/04/22/emc-powerpath-vmware-hyperv/"  rel="bookmark" class="crp_title">PowerPath To The Virtual People</a></li></ul></div><script src="http://feeds.feedburner.com/~s/sfoskett?i=http://blog.fosketts.net/2008/09/19/what-vmware-vdc-os-vstorage/" type="text/javascript" charset="utf-8"></script><hr />
<p><small>© sfoskett for <a href="http://blog.fosketts.net">Stephen Foskett, Pack Rat</a>, 2008. |
<a href="http://blog.fosketts.net/2008/09/19/what-vmware-vdc-os-vstorage/">What is VMware VDC-OS vStorage?</a>
<br/>
This post was categorized as <a href="http://blog.fosketts.net/category/everything/enterprisestorage/" title="View all posts in Enterprise storage" rel="category tag">Enterprise storage</a>, <a href="http://blog.fosketts.net/category/everything/virtualstorage/" title="View all posts in Virtual Storage" rel="category tag">Virtual Storage</a>. Each of my categories has its own feed if you'd like to filter out or focus on posts like this.<br/>
</small></p>]]></content:encoded>
			<wfw:commentRss>http://blog.fosketts.net/2008/09/19/what-vmware-vdc-os-vstorage/feed/</wfw:commentRss>
		<slash:comments>2</slash:comments>
<enclosure url="http://virtualgeek.typepad.com/virtual_geek/movies/PowerPathDemo_2_Short.wmv" length="8230039" type="video/x-ms-wmv" />
<enclosure url="http://virtualgeek.typepad.com/virtual_geek/movies/vstorage_offload_2.wmv" length="5098057" type="video/x-ms-wmv" />
		</item>
	</channel>
</rss>

