Transcription

1 January VERITAS Software - Storage Foundation for Windows Dynamic Multi-Pathing Performance Testing Test report prepared under contract from VERITAS Software Corporation Executive summary VERITAS Software Corporation ( VERITAS ) commissioned VeriTest, a division of Lionbridge Technologies Inc., to conduct a series of performance tests between VERITAS Dynamic Multi-Pathing and EMC PowerPath in a Microsoft Cluster Server environment with an EMC Clariion CX600 storage array. The VERITAS Dynamic Multi-Pathing is part of VERITAS Storage Foundation for Windows software, previously VERITAS Volume Manager, and provides transparent, redundant paths to disk drives from the server. PowerPath is a stand-alone product from EMC that provides transparent redundant paths to disk drives from the server. Key findings In our test configurations, we found that VERITAS Dynamic Multi-Pathing generated better Tpm scores compared to the EMC PowerPath product in both the out-of-box and vendor recommended HBA configurations. In our test configurations, we found that VERITAS Dynamic Multi-Pathing generated better TpmC scores compared to the EMC PowerPath product in both the out-of-box and vendor recommended HBA configurations. During configuration and testing, we liked the fact that we were able to perform all operations using the GUI interface provided with VERITAS Storage Foundation for Windows. Installing the EMC PowerPath product required that we make use of the command line interface. For these tests, we configured identical testbeds for both products. East testbed consisted of a Dell PowerEdge 4400 configured with dual 1GHz Pentium III Xeon processors, 2GB of RAM and running Windows Server 2003 Enterprise Edition with all latest updates. We installed a Qlogic QLA-2342 Host Bus Adapter ( HBA ) in the PowerEdge 4400 and connected it to the EMC CX600 using a Brocade Gb 16-port switch. Additionally, we set up four identical Dell OptiPlex GX115 client systems configured with a single 866Mhz Pentium III processor and 256MB of RAM for use as load generation and monitoring systems. Finally, we used Microsoft Cluster Server Software to create a highly-available server environment. To measure the performance using the products above, we executed a series of Microsoft Benchcraft TPC-C tests. The Benchcraft software is provided as part of the Microsoft SQL Server TPC-C Benchmark Kit. We conducted these tests using an out-of-box configuration as well as a vendor-recommended configuration that consisted primarily of modifying the default HBA settings to those recommended by VERITAS and EMC for their respective products. The Benchcraft TPC-C software generates two different metrics, namely Tpm and TpmC. Tpm is defined as transactions per minute and is the number of total transactions, new orders, payments, delivery, stock level and order status that the system is able to process in one minute. TpmC is defined as transactions per minute order entry. This is the numbers of new orders the system is able to process in one minute. Please refer to the Test Methodology section of this report for complete details on how we conducted these tests.

2 Figure 1 below compares the results of the TpmC testing for both the VERITAS Dynamic Multi-Pathing and EMC PowerPath products using out-of-box and vendor-recommended HBA configurations. Testing with our configurations showed that VERITAS Dynamic Multi-Pathing outperformed EMC PowerPath in the out-of-box HBA configurations as well as after tuning the HBA using the vendor-recommended guidelines. Additionally, we found that using the EMC vendor-recommended HBA tunings had no impact on the performance generated using the VERITAS Dynamic Multi-Pathing product. TpmC Scores Out-of-Box HBA Configuration Vendor-Recommended HBA Configuration VERITAS Dynamic Multi- Pathing EMC PowerPath Figure 1. TpmC Scores Out-of-Box and Vendor-Recommended HBA Configurations Figure 2 below compares the results of the Tpm testing for both the VERITAS Dynamic Multi-Pathing and EMC PowerPath products using out-of-box and vendor-recommended HBA configurations. Testing with our configurations showed that VERITAS Dynamic Multi-Pathing outperformed EMC PowerPath in the out-of-box HBA configurations as well as after tuning the HBA using the vendor-recommended guidelines. Additionally, we found that using the EMC vendor-recommended HBA tunings had no significant impact on the performance generated using VERITAS Dynamic Multi-Pathing. Tpm Scores Out-of-Box HBA Configuration Vendor-Recommended HBA Configuration VERITAS Dynamic Multi- Pathing EMC PowerPath Figure 2. Tpm Scores Out-of-Box and Vendor-Recommended HBA Configurations VERITAS Software - SFW Dynamic Multi-Pathing Performance Testing 2

3 Testing methodology VERITAS Software Corporation ( VERITAS ) commissioned VeriTest, a division of Lionbridge Technologies Inc., to conduct a series of performance tests between VERITAS Dynamic Multi-Pathing and EMC PowerPath in a Microsoft Cluster Server environment with an EMC Clariion CX600 storage array. The VERITAS Dynamic Multi-Pathing is part of the VERITAS Storage Foundation for Windows software and provides transparent, redundant paths to disk drives from the server. EMC PowerPath is a stand-alone product from EMC that provides transparent, redundant paths to disk drives from the server. The testing consisted of installing both products under test on identical testbeds consisting of server-class systems, four load-generating clients and an EMC CX600 system used as an SQL database repository. We then used Microsoft s Benchcraft TPC-C software to measure the performance of both products under test. The Benchcraft software is provided as part of the Microsoft SQL Server TPC-C Benchmark Kit. There are significant parameters that EMC recommends be applied to the Qlogic HBA when used with PowerPath that are not required by VERITAS when using VERITAS Dynamic Multi-Pathing. Therefore, the decision was made to run two different tests. The first with the Qlogic HBA in an out-of-box configuration, or the way the HBA comes configured from the factory. Running two separate tests enables us to see what effect, if any, the parameters make to either environment. Figure 3 below shows both the default Qlogic settings, as well as those recommended by EMC. These parameters were taken directly from the EMC Fibre Channel with Qlogic Host Bus Adapters in the Windows environment guide, P/N REV A03. Parameter QLogic Default Setting Recommended EMC Setting Data Rate 0 (1 Gb/s) 2 (Auto Select) Execution Throttle Connection options (topology) 2 (Loop preferred, otherwise point-to-point) 1 (point to point only) Enable LIP Full Login Yes Yes Enable Target Reset No Yes Port Down Retry Count 8 45 Luns Per Target Adapter Hard Loop ID Enabled Disabled Hard Loop ID Descending Search LoopID 0 1 Figure 3. Default and EMC-Recommended Qlogic HBA Settings Testbed Configuration Details This section describes the details of the testbeds used in these tests for both products under test. We configured identical testbeds for both products. Please refer to Appendix A for a graphic depiction of the testbeds we used. Each testbed consisted of a Dell PowerEdge 4400 configured with dual 1GHz Pentium III Xeon processors, 2GB of RAM and running Windows Server 2003 Enterprise Edition with all latest updates. Additionally, we set up four identical Dell OptiPlex GX115 client systems configured with a single 866Mhz Pentium III processor, 256MB of RAM and running Windows Server 2000 and Service Pack 4 for use as loadgeneration and monitoring systems. We connected the server and client systems using 100 Mbps full duplex network connections. We installed a Qlogic QLA-2342 Host Bus Adapter in the PowerEdge 4400 and connected it to the EMC CX600 using a Brocade Gb 16-port switch. Finally, we used Microsoft Cluster Server Software to create a highly-available server environment. VERITAS Software - SFW Dynamic Multi-Pathing Performance Testing 3

4 When testing with VERITAS Dynamic Multi-Pathing, we connected the PowerEdge 4400 server running Windows 2003 Enterprise Server using the VERITAS-recommended topology as detailed in the VERITAS Storage Foundation for Windows Implementations Guide. We installed Windows 2003 Enterprise Server with VERITAS Storage Foundation for Windows as detailed in the VERITAS Storage Foundation for Windows Administration Guide (VERITAS part number N102768) and applied the most current patch level as of January 19, MSCS was installed and configured to work in conjunction with VERITAS Storage Foundation for Windows. MS SQL Server was installed with the Latin1_General_Binary collation option as a virtual server in MSCS and patched with SP3a. When testing with EMC PowerPath, we connected the PowerEdge 4400 server running Windows 2003 Enterprise Server using the EMC-recommended topology as detailed in the EMC PowerPath Version 3.0 Installation and Administration Guide for Windows P/N REV A-03. We installed Windows 2003 Enterprise Server with EMC PowerPath and applied the most current patch level as of January 19, MSCS was installed and configured to work in conjunction with EMC PowerPath. MS SQL Server was installed with the Latin1_General_Binary collation option as a virtual server in MSCS and patched with SP3a. After setting up the testbeds for each product as shown above, we created and configured a set of LUNs on the CX600 for use during the testing. This configuration was identical for each of the products under test and is shown in figure 4 below. All LUNs created on the CX600 were multi-pathed. Testing using this configuration allows the SQL log LUN to have a dedicated channel to the array during testing. The transaction log is critical to database performance. As only cold backups were performed during testing, the SQL log LUNs were not in use at the same time as the backup LUNs. Finally, the EMC PowerPath connections to the CX600 were identical to those used for the VERITAS Dynamic Multi-Pathing configuration with the exception that both service processor ports 0 and 1 are connected to the fabric in accordance with EMC s documentation. Volume ID Volume Size Usage LUN # Storage Processor / Port Disk Configuration Q 500MB Quorum 1 A / 0 Disk Group1 - Single Disk J 5GB SQL Core 2 A / 0 Disk Group1 - Single Disk K 40GB SQL Data 3 A / 0 Disk Group2-6 disk RAID 0 L 20GB SQL Logs 4 B / 0 Disk Group3-6 disk RAID 1 Y 150GB Backup 1 5 B / 0 Disk Group4-4+1 RAID 5 Z 150GB Backup 2 6 B / 0 Disk Group4-4+1 RAID 5 Figure 4. CX600 LUN Configuration for All Testing Configuring and Running Benchcraft TPC-C To measure the performance using the products above, we executed a series of Microsoft Benchcraft TPC-C tests. The Benchcraft software is provided as part of the Microsoft SQL Server TPC-C Benchmark Kit. We conducted these tests using an out-of-box configuration as well as a vendor-recommended configuration that consisted primarily of modifying the default HBA settings to those recommended by VERITAS and EMC for their respective products. The Benchcraft TPC-C software generates two different metrics, namely Tpm and TpmC. Tpm is defined as Transactions per minute and is the number of total transactions, new orders, payments, delivery, stock level and order status that the system is able to process in one minute. TpmC is defined as Transactions per minute order entry. This is the numbers of new orders the system is able to process in one minute. For more information or additional detail on TPC-C benchmarking tests please visit the Transaction Processing Performance Council s website at We modified the Benchcraft SQL scripts to conform to the current environment. This primarily entailed changing pathnames in the 800.war setup files to match the current environment. The TPCC SQL database was created using Benchcraft s supplied GUI, with the supplied default operations. In addition to the default VERITAS Software - SFW Dynamic Multi-Pathing Performance Testing 4

5 operations, we selected the configure SQL Server option. This allows Benchcraft to set up SQL Server as recommended. After configuring the Benchcraft software for use with SQL Server, we configured the set of four Dell Optiplex GX-115 clients for use in the testing as follows: Performed a complete installation of the Benchcraft software on Client 1. This included the Master, Slave and Processor options. All test configuration and execution was performed from this system. Performed a slave-only Benchcraft installation on the remaining three clients. Two of these were actively used during the testing and the third was redundant. We created two driver engines for each client specifying a unique log file name, default parameter set, a Connect Rate of zero and a Start Rate of zero. Additionally, we configured each driver engine using the following parameters as shown in figure 5 below Client Emulator Connect Method Warehouse Users Connect Rate/Min Start Rate/Min client2 dvra ODBC after start 500 after Connect dvrb ODBC after start 500 after Connect client3 dvra ODBC after start 500 after Connect dvrb ODBC after start 500 after Connect client4 dvra ODBC after start 500 after Connect dvrb ODBC after start 500 after Connect Figure 5. Benchcraft Load Client Emulator Parameters After completing the test configurations and before conducting the final tests, we performed basic interoperability testing including basic I/O testing utilizing the Benchcraft product in order to verify the functionality and stability of all related software and test tools. The test was executed with no special settings or configuration parameters. The servers used were configured as stated above. Additionally, we conducted a Benchcraft test with no multi-pathing software installed and confirmed there were no errors. After verifying that the test configuration was operating correctly we conducted the tests using Benchcraft for each product using the following steps: Double-checked the Rates to verify both connect and start rates were set to zero. Selected all drivers. o We activated all of the drivers and waited until they were fully active. (The drivers start in a paused state.) o We changed the connect rate to 500 connections per minute and we allowed all simulated users to connect to the database. o After all users were connected, we changed the start rate to 500 users per minute. o Finally, after all simulated users had started transactions, we verified the number of connections and the number of active users to be Once all users were active, we monitored the test using the Benchcraft monitoring facility. After the test ran for the allotted time, we stopped the test. We then gathered and analyzed the test results. Two tests were executed with the out-of-box HBA configuration. The best result of the two tests was kept and the other discarded. The same test was performed after vendor-recommended HBA settings were applied. The tests were allowed to execute for enough time to generate stable results. The initial and final 10 minutes of each test s results were discarded during reporting. This further eliminated test startup and shutdown anomalies and provided more accurate results. Benchcraft s reporting tools facilitated the generation of the results detailed in this report. VERITAS Software - SFW Dynamic Multi-Pathing Performance Testing 5

12 VeriTest ( the testing division of Lionbridge Technologies, Inc., provides outsourced testing solutions that maximize revenue and reduce costs for our clients. For companies who use high-tech products as well as those who produce them, smoothly functioning technology is essential to business success. VeriTest helps our clients identify and correct technology problems in their products and in their line of business applications by providing the widest range of testing services available. VeriTest created the suite of industry-standard benchmark software that includes WebBench, NetBench, Winstone, and WinBench. We've distributed over 20 million copies of these tools, which are in use at every one of the 2001 Fortune 100 companies. Our Internet BenchMark service provides the definitive ratings for Internet Service Providers in the US, Canada, and the UK. Under our former names of ZD Labs and etesting Labs, and as part of VeriTest since July of 2002, we have delivered rigorous, objective, independent testing and analysis for over a decade. With the most knowledgeable staff in the business, testing facilities around the world, and almost 1,600 dedicated network PCs, VeriTest offers our clients the expertise and equipment necessary to meet all their testing needs. For more information us at or call us at Disclaimer of Warranties; Limitation of Liability: VERITEST HAS MADE REASONABLE EFFORTS TO ENSURE THE ACCURACY AND VALIDITY OF ITS TESTING, HOWEVER, VERITEST SPECIFICALLY DISCLAIMS ANY WARRANTY, EXPRESSED OR IMPLIED, RELATING TO THE TEST RESULTS AND ANALYSIS, THEIR ACCURACY, COMPLETENESS OR QUALITY, INCLUDING ANY IMPLIED WARRANTY OF FITNESS FOR ANY PARTICULAR PURPOSE. ALL PERSONS OR ENTITIES RELYING ON THE RESULTS OF ANY TESTING DO SO AT THEIR OWN RISK, AND AGREE THAT VERITEST, ITS EMPLOYEES AND ITS SUBCONTRACTORS SHALL HAVE NO LIABILITY WHATSOEVER FROM ANY CLAIM OF LOSS OR DAMAGE ON ACCOUNT OF ANY ALLEGED ERROR OR DEFECT IN ANY TESTING PROCEDURE OR RESULT. IN NO EVENT SHALL VERITEST BE LIABLE FOR INDIRECT, SPECIAL, INCIDENTAL, OR CONSEQUENTIAL DAMAGES IN CONNECTION WITH ITS TESTING, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN NO EVENT SHALL VERITEST'S LIABILITY, INCLUDING FOR DIRECT DAMAGES, EXCEED THE AMOUNTS PAID IN CONNECTION WITH VERITEST'S TESTING. CUSTOMER S SOLE AND EXCLUSIVE REMEDIES ARE AS SET FORTH HEREIN. VERITAS Software - SFW Dynamic Multi-Pathing Performance Testing 12

WHITE PAPER OCTOBER 2008 Total cost of ownership (TCO) of Dell, HP, and TCO comparison Dell Inc. (Dell) commissioned Principled Technologies (PT) to compare the total cost of ownership (TCO) of three blade

SIMPLIFYING SERVER PROVISIONING WITH CISCO UCS DIRECTOR Provisioning servers getting them ready for operation under your organization s specific guidelines requires a number of considerations and a significant

New!! - Higher performance for Windows and UNIX environments The IBM TotalStorage Network Attached Storage Gateway 300 (NAS Gateway 300) is designed to act as a gateway between a storage area network (SAN)

IMPROVE YOUR SUPPORT EXPERIENCE WITH DELL PREMIUM SUPPORT WITH SUPPORTASSIST TECHNOLOGY For anyone who hates spending time on the phone with tech support when you have a problem with your laptop, tablet,

Best Practices Best Practices for Installing and Configuring the Hyper-V Role on the LSI CTS2600 Storage System for Windows 2008 Installation and Configuration Guide 2010 LSI Corporation August 13, 2010

LOAD BALANCING IN THE MODERN DATA CENTER WITH BARRACUDA LOAD BALANCER FDC T740 Balancing Web traffic across your front-end servers is key to a successful enterprise Web presence. Web traffic is much like

Analysis of VDI Storage Performance During Bootstorm Introduction Virtual desktops are gaining popularity as a more cost effective and more easily serviceable solution. The most resource-dependent process

I/O PERFORMANCE COMPARISON OF VMWARE VCLOUD HYBRID SERVICE AND AMAZON WEB SERVICES Businesses are rapidly transitioning to the public cloud to take advantage of on-demand resources and potential cost savings.

BETTER PUBLIC CLOUD PERFORMANCE WITH SOFTLAYER The public cloud service provider you select to host your organization s applications can have a big impact on performance. Even when you choose similar resource

TOTAL COST COMPARISON SUMMARY: VMWARE VSPHERE VS. MICROSOFT HYPER-V Total cost of ownership (TCO) is the ultimate measure to compare IT infrastructure platforms, as it incorporates the purchase and support

TECHNICAL NOTE VMware Infrastructure 3 SAN Conceptual and Design Basics VMware ESX Server can be used in conjunction with a SAN (storage area network), a specialized high speed network that connects computer

Proliance System Requirements Guide Version 5.5 September 2012 Contacting Meridian Systems Support Services Meridian Systems makes every effort to ensure that Proliance functions at its optimal capacity.

MANAGING CLIENTS WITH DELL CLIENT INTEGRATION PACK 3.0 AND MICROSOFT SYSTEM CENTER CONFIGURATION MANAGER 2012 With so many workstations and notebooks assigned to employees for work, enterprises seek an

Fibre Channel HBA and VM Migration Guide for Hyper-V and System Center VMM2008 FC0054605-00 A Fibre Channel HBA and VM Migration Guide for Hyper-V and System Center VMM2008 S Information furnished in this

DATABASE PERFORMANCE COMPARISON OF VMWARE VCLOUD AIR, AMAZON WEB SERVICES, AND MICROSOFT AZURE Businesses are rapidly transitioning to the public cloud to take advantage of on-demand resources and potential

V2.7.x Installation on a Database Server Note: This document is to be used on a new database server installation. REVISION A DATE: 10/01/2009 CA3000 Software Installation Procedure Continental Access and

A Principled Technologies deployment guide commissioned by Dell Inc. TABLE OF CONTENTS Table of contents... 2 Introduction... 3 About the components... 3 About the Dell PowerEdge VRTX...3 About the Dell

Symantec Backup Exec 2010 R2 Quick Installation Guide 20047221 The software described in this book is furnished under a license agreement and may be used only in accordance with the terms of the agreement.

Very Large Enterprise Network, Deployment, 25000+ Users Websense software can be deployed in different configurations, depending on the size and characteristics of the network, and the organization s filtering