Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric Part Number: AA-RQ6NB-TE Second Edition (November 2001) This document describes the configuration rules for Director Fabric (StorageWorks SAN Director 64 and McDATA ED-5000) switches in a heterogeneous open SAN. This document replaces Chapter 5 of the Heterogeneous Open SAN Design Reference Guide, 2nd edition (AA-RMPNC-TE). Obtain the latest version of the Heterogeneous Open SAN Design Reference Guide through this link: http://www.compaq.com/products/storageworks/san/documentation.html For the latest version of this Addendum and other heterogeneous open SAN documentation, visit the Compaq storage website at: http://www.compaq.com/san b 2001 Compaq Computer Corporation. Compaq, the Compaq logo, and StorageWorks Registered in U. S. Patent and Trademark Office. SANworks, Tru64, and OpenVMS are trademarks of Compaq Information Technologies Group, L.P. in the United States and other countries. Microsoft, Windows, and Windows NT are trademarks of Microsoft Corporation in the United States and other countries. UNIX is a trademark of The Open Group in the United States and other countries. All other product names mentioned herein may be trademarks of their respective companies. Confidential computer software. Valid license from Compaq required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. Compaq shall not be liable for technical or editorial errors or omissions contained herein. The information in this document is provided "as is" without warranty of any kind and is subject to change without notice. The warranties for Compaq products are set forth in the express limited warranty statements accompanying such products. Nothing herein should be construed as constituting an additional warranty. Compaq service tool software, including associated documentation, is the property of and contains confidential technology of Compaq Computer Corporation. Service customer is hereby licensed to use the software only for activities directly relating to the delivery of, and only during the term of, the applicable services delivered by Compaq or its authorized service provider. Customer may not modify or reverse engineer, remove, or transfer the software or make the software or any resultant diagnosis or system management data available to other parties without Compaq's or its authorized service provider's consent. Upon termination of the services, customer will, at Compaq's or its service provider's option, destroy or return the software and associated documentation in its possession. Printed in the U.S.A. Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric Second Edition (November 2001) Par t Number: AA-RQ6NB-TE 2 Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric Addendum Contents Addendum Contents This addendum covers the following topics: SAN Configuration Rules with SAN Director 64 -- Overview -- SNIA SSF Configurations -- StorageWorks SAN Director 64 -- McDATA Enterprise Director 5000 -- McDATA ED-5000 and SAN Director 64 Configurations -- Supplemental Information Intended Audience This document is intended for customers who have purchased the Compaq StorageWorks SAN Director 64 or the McDATA ED-5000 and who wish to incorporate them into a heterogeneous open SAN. Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric 3 SAN Configuration Rules with SAN Director 64 SAN Configuration Rules with SAN Director 64 Overview The Compaq StorageWorks SAN Director 64 provides high performance Fibre Channel switching suitable for use in SAN fabrics where high port count and high reliability are required. The SAN Director 64 is compatible with the McDATA Enterprise Director 5000. Compaq supports the SAN Director 64 and McDATA ED-5000 in configurations with up to four switches. A four switch SAN Director 64 configuration may have up to 253 user ports, depending on the interconnection topology. SNIA SSF Configurations Compaq supports the SAN Director 64 and the McDATA ED-5000 in SAN configurations that are compliant with the guidelines defined by the SNIA Supported Solution Forum. The Storage Networking Industry Association (SNIA) sponsors the Supported Solutions Forum (SSF). SSF is a storage industry program that improves the interoperability of Fibre Channel products. Compaq is a member of SNIA and SSF. SSF has defined two configurations with heterogeneous servers and heterogeneous storage systems. One configuration uses a Fibre Channel fabric made of Brocade switches, and the other configuration uses a fabric of McDATA switches. Compaq supports both configurations. For additional information on this program, refer to http://www.snia.org/English/Forums/Supported_Solutions/Supported_Solutions_FS.html StorageWorks SAN Director 64 Product Description The StorageWorks SAN Director 64 is a highly reliable Fibre Channel SAN switch designed to accommodate today's storage protocols and emerging SAN protocols. It provides non-blocking switching between 64 ports, each operating at a 1 Gbps signaling speed. Product Features The SAN Director 64 supports connections to application servers running Microsoft Windows, Compaq OpenVMS, Compaq Tru64 UNIX, and Sun Solaris operating systems. It supports connections to the StorageWorks HSG80 family of disk array storage systems. The SAN Director 64 offers features that improve switch availability. All field-replaceable units are hot-swappable for uninterrupted operation. New firmware images can be downloaded while the unit is online, and the new firmware can be activated while frames are in flight with no disruption to the traffic flow. The SAN Director 64 supports remote campuses up to 100 km away with long wave transceivers and use of repeaters. The supported distance depends on the use of various different cables and repeaters: Shortwave: Up to 500 m (1,600 ft) Longwave: Up to 20 km (12 mi) With Repeaters: Up to 100 km (63 mi) Fibre Channel loop devices are not supported. 4 Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric SAN Configuration Rules with SAN Director 64 Zoning Features The SAN Director 64 supports Fibre Channel zoning functions that prevent specific N_Ports connected to the switch from communicating with one another. This feature provides a level of security against accidental erroneous traffic that might cause server failure or other SAN problems. Soft zoning is supported. Soft zoning is managed fabric-wide and is compatible with the ED-5000 zone feature implementation. All zone configurations are maintained on the Product Manager, however, a copy of the active zone configuration is maintained in the non-volatile memory of each switch. Soft zoning is a mechanism for managing the connections between attached devices by utilizing the Name Server information. Essentially, the attached devices are provided only with the information about the other devices in a common zone. Zone management is performed using the SDC Manager. The Name Server hides information about N_Ports that are not in a common zone with the requesting N_Port; thus, a Name Server "zone" is simply a set of N_Ports that are visible to each other. A "zone set" is a set of zones that may be active on the switch at a given time. The functional details of zoning are as follows: An N_Port belonging to a soft "zone" is permitted to query the Name Server and learn about all other N_Ports in a common zone, but not about N_Ports outside of its zones. The active zone and zone set are configurable and stored in nonvolatile memory on the switch. Changes to the active configuration will not take affect until the configuration is explicitly enabled, or an initial machine load (IML) reset is performed on the switch. An implicit "default soft zone" exists containing all N_Ports that do not explicitly belong to any active zone. The default zone can be disabled, but is enabled by default. An N_Port can belong to multiple Name Server zones. Soft zone members may be specified by the worldwide name of the attached port. All N_Ports that have registered to receive Registered State Change Notifications (RSCN) from the switch receive only RSCNs for N_Ports that are in a common zone. When the membership of an active zone changes due to a zone configuration change, RSCNs are sent to all registered N_Ports. Fabrics may be connected together to make larger fabrics. The zone definitions used in the two fabrics will usually be different. When the two fabrics are merged, each fabric should acquire the other's zoning data. If you do not have conflicts between the zone definitions in the two fabrics, the zone definitions are unique and may be merged together. This process occurs automatically when the fabrics are connected, and does not disrupt fabric traffic. If the zone definitions in the two fabrics have conflicting information, then the fabrics cannot be merged automatically. The switches do not have the ability to automatically resolve the zone definition conflicts. In this case, the two fabrics will not connect together, and the result is a segmented fabric. In the event of zoning conflicts (and the resulting fabric segmentation), you should insure no duplicate zone names exist between the two fabrics. If duplicate names exist, you can rename one of the zones using the SANworks Director Connectivity Manager utility. Once the duplicate zone names are correct, you can merge the fabrics. Zoning Rules Compaq supports fabric configurations in which each type of operating system is located in a separate zone. Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric 5 SAN Configuration Rules with SAN Director 64 SAN Director 64 Connectivity Management Utility The SAN Director 64 is managed using the SANworks Director Connectivity Manager (SDCM) utility. This application provides a user-friendly interface with graphical displays and real time interactive displays of operational status and performance statistics. The management tool runs on the SDCM server, a notebook. The SDCM server and the switches are connected to a 10/100 Mbps Ethernet LAN for management communication. The SAN Director 64 provides three management access methods: SANworks Director Connectivity Manager (SDCM) using the notebook PC server. SAN Director 64 web interface on the enterprise LAN. Simple Network Management Protocol (SNMP). SDCM Server SDCM contains the SAN Director 64 Product Manager as well as additional McDATA product managers. The SDCM server (or network access to the Director's embedded web server application) is required to install, configure, and manage the Director. Although the Director operates normally without an SDCM server, the server is required to monitor Director operation, log events and configuration changes, and report failures via Compaq's Proactive Service application. SDCM implements an inband management agent that is addressed via the well-known hexadecimal address FF FF FA. The SDCM server provides a central point of control for up to 48 LAN-connected Directors. The server is mounted in a slide-out drawer in the SAN Director 64 cabinet. The SDCM server is dedicated to performing SDCM tasks. Embedded Web Server An Embedded Web Server (EWS) provides browser access to the switch via the Ethernet interface. EWS supports both the Netscape and IE browsers. The enterprise LAN connection allows the SAN Director 64web browser interface to be viewed by any computer on the LAN. Password protection is provided to maintain management security. The web server provides a subset of the functionality provided by the SDCM Product Manager. The web interface provides the following basic user administration functions for the SAN Director 64. Switch View. The switch view provides basic operational information about the switch. Port View. The port view provides statistics about each port . Administration/Setup. The administration/setup panel provides the ability to set or modify the operational characteristics of the switch. The web server provides access to statistics on demand. These statistics are provided as a snap shot of the operation and do not reflect activity relative to time. SNMP Agent An SNMP agent embedded in the switch is a secondary management interface that is connected via the Ethernet interface. All of the management interfaces coexist in the switch; however, SNMP defaults to read-only and must be configured to allow updating of MIB variables (for example, read-write mode). The SNMP agent within the switch supports the SNMPv1 protocol and data formats as defined in RFCs 1157 and 1155, respectively. 6 Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric SAN Configuration Rules with SAN Director 64 MIB variables managed by the SNMP agent are accessible to management stations belonging to SNMP communities known to the switch. The SNMP agent signals operational state changes and failure conditions in an unsolicited manner by sending SNMP Trap messages to one or more management stations as configured through the Product Manager. Maintenance Port The SAN Director 64 has an RS232 maintenance port that can be connected to a standard PC running an ASCII terminal emulator program. This interface provides command line access to switch maintenance operations. All online maintenance port functionality is password protected to prevent unauthorized use. Use of the maintenance port is restricted to the following user domain: Manufacturing: Used for factory download of the switch firmware, for running offline diagnostics, and for initializing FRU and system vital product data. Service: Used for running offline diagnostics. In addition, commands are provided to configure the physical address, IP address and subnet mask of the SD-64 Ethernet port. Engineering: Used for monitoring internal switch operations, debugging operational software, and analyzing problems. Test: Used for fault injection, automated test scripts, and other testing techniques. Security The SAN Director 64 provides a high level of data security. Access to management functions is controlled by passwords, and unauthorized attempts to change device parameters are prevented by the configuration management tools. Since the communication between the management tools and the SAN Director 64 is by an Ethernet LAN connection, security issues that may exist on an existing LAN must be reviewed to insure the integrity of the configuration management interface. For example, the SAN Director 64 management interface should not be connected to a LAN that has unrestricted access by Internet users. The included management PC is provided with two Network Interface Cards (NICs), one for connection to a private LAN that connects to the switch and one that optionally may be used for connection to the enterprise LAN in the computer room or office area. This dual network approach isolates the switches from potential security and network issues (such as Internet virus programs) that may exist on the enterprise LAN. Maximize the configuration security of the SAN Director 64 by using a dedicated LAN for communicating between the management station and the switches. McDATA Enterprise Director 5000 Product Description The ED-5000 provides 32-port switched connectivity between Fibre Channel servers and devices in a storage area network (SAN) environment. The ED-5000 implements Fibre Channel technology that provides scalable bandwidth (1.0625 gigabits per second), redundant switched data paths, high availability, fault detection and isolation, and continuous uptime. Product Support Method McDATA sells the ED-5000. There is no Compaq part number. McDATA provides service and support of ED-5000 switches. A bilateral Customer Support Agreement (CSA) between Compaq and McDATA has been formalized to reduce the time needed to resolve customer issues. Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric 7 SAN Configuration Rules with SAN Director 64 Supported ED-5000 Configurations Support for the ED-5000 switch in Compaq SAN environments is limited to the server platforms, operating systems, and layered products shown in Table 3. McDATA ED-5000 and SAN Director 64 Configurations The McDATA ED-5000 and the Compaq StorageWorks SAN Director 64 may be used in the same SAN. The configuration rules in the following sections must be followed. Software Configurations Refer to Table 2 and Table 3 for information on supported operating system versions, driver versions, host bus adapter firmware versions, switch firmware versions, and array controller versions. Hardware Configurations The following platforms and storage systems are supported: Compaq Proliant servers Compaq servers with the OpenVMS operating system Compaq servers with the Tru64 UNIX operating system Sun Microsystems servers with the Solaris operating system StorageWorks HSG80 storage systems The following fabric and storage configurations are supported: Up to four switches in each fabric, with any combination of Compaq StorageWorks SAN Director 64 switches and McDATA ED-5000 switches Only WWID zoning is supported Servers must be in zones so that each operating system type is in its own zone All logical units must be selectively presented to the host servers using SSP A maximum of three hops is allowed per fabric Supported Combinations of Switches Each fabric must consist exclusively of switches manufactured by McDATA. Permissible switches include the StorageWorks SAN Director 64, the McDATA ED-5000, and the EMC Connectrix. The firmware version specified in the Supplemental Tables must be used in all cases. Refer to http://www.compaq.com/products/storageworks/san/documentation.html for the latest version of the Supplemental Tables, which contain information on supported operating system drivers, host adapters, and microcode versions. Cabling Rules The SAN Director 64 provides industry standard "LC" connectors for the Fibre Channel optical connections. Note that these are smaller than the "SC" connectors used in previous Compaq optical Fibre Channel storage products. The ED-5000 provides "SC" connectors. Cables are available with SC connectors on one end and LC connectors on the other end. Adapters are also available. Refer to the SAN Director 64 QuickSpecs document for additional information. 8 Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric SAN Configuration Rules with SAN Director 64 Multifabric SANs To maximize data availability, Compaq recommends that two or more independent fabrics be used in all Compaq SAN designs. This approach provides a redundant communication path between servers and storage systems, which protects against the failure of a host adapter, a fabric, or an array controller port. In order to maintain independence, you cannot have an ISL connection between the fabrics. Refer to the chapters on SAN topologies and on best practices in the Heterogeneous Open SAN Design Reference Guide for additional information on multifabric SAN design issues. The two fabrics should be similar in size and topology. Because the application server failover software does not recognize the concept of "primary" and "secondary" ports, you cannot balance the load between two dissimilar fabrics. Figure 1 shows a dual fabric SAN, each with one SAN Director 64. Notice that there is no Fibre Channel connection between the two fabrics. Fabri c Fabric Figure 1: Dual Fabric SAN Topology Limits Compaq supports any combination of up to four SAN Director 64 or McDATA ED-5000 switches in a single Fibre Channel fabric. Use no more than a maximum of three hops (ISLs that must be used to get from any given port to any other given port) in a fabric. This limit allows any of the supported StorageWorks SAN topologies to be used. With four switches, the maximum possible number of hops is three, regardless of how the switches are connected. There is no restriction on fabric topology: The fabric may be a ring, a cascade, or a mesh. Refer to Chapters 2 and 10 of the Heterogeneous Open SAN Design Guide for additional information on SAN topologies. Compaq does not support interconnection between the SAN Director 64 and the SAN Switch family of switches (SAN Switch 8, 8EL, 16, and 16EL). The ED-5000 and SAN Director 64 may be used in any combination that meets the other restrictions described here. Each SAN Director 64 has upto 64 Fibre Channel ports. Of these, up to 32 ports may be used for connections to ISLs. Any combination of ports may be used for ISL connections. Up to four ports per connection to any one switch on an ED-5000 may be used for ISLs. Up to 12 total ports may be used for ISL connections in a 4-switch fabric. Mixed configurations that include both SAN Director 64 and ED-5000 switches must remain within these limits. The illustrations below show some typical fabric configurations. Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric 9 SAN Configuration Rules with SAN Director 64 Figure 2: Four SAN Director 64s in a Mesh Fabric Figure 2 shows four SAN Director 64 units in a mesh. A total of six Inter-Switch Links (ISLs) is shown for each switch, but up to 32 are supported. Figure 3: Three SAN Director 64s and a McDATA ED-5000 in a Cascade Fabric 10 Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric SAN Configuration Rules with SAN Director 64 Figure 3 shows a Fibre Channel fabric consisting of three SAN Director 64s and one McDATA ED-5000 in a cascade topology. Note that there is no restriction on the location of the ED-5000, and that the configuration could have consisted of any other combination of the two types of switches. Figure 4: Four SAN Director 64s in a Ring Fabric Figure 4 shows a Ring configuration. Because each SAN Director 64 supports up to 32 ISL connections, each ISL shown in this figure could be replaced by 16 ISLs. Since the four switches have a total of 64 ports, 128 ports are available for server and storage connections in this case. EBS, DRM, EVM, and Microsoft Cluster Support Compaq supports these software products in SANs using the McDATA ED-5000 or the SAN Director 64. Refer to the product documentation for additional configuration restrictions or limitations. EBS, DRM, EVM, and Cluster Support Compaq supports certain SANworks software products in SANs using the McDATA ED-5000 or the SAN Director 64. Table 1 shows the currently supported configurations. Refer to the product documentation for additional configuration restrictions or limitations. Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric 11 SAN Configuration Rules with SAN Director 64 Table 1: Supported SANworks Software Applications SANworks Software Product S uppor t DRM Not Supported EVM Fully Supported NetWork View Suppor ted; see the application note: Managing Compaq StorageWorks SAN Director 64 Switch in Network View Version 2.0 Clustering Refer to Table 2 for Specific Operating System EBS MDR Firmware: V1185 Tape Libraries: ESL9326 ESL9198 MSL5026 TL895 Backup Applications: Veritas Netbackup Veritas Backup Exec Legato NetWorker CA Arcserve Supplemental Information The following tables contain revision information for operating systems and hardware supported in a McDATA SAN. Table 2 shows the required switch firmware versions and the required versions for the SDCM management software. Table 2: Switch Firmware Management Software Switch Switch Firmware Version Version McDATA ED-5000 3.01.00 Build 17 SANworks Director Configuration Manager (SDCM) 4.1.2 Build 14 SAN Director 64 1.2.2 Build 6 SANworks Director Configuration Manager (SDCM) 4.1.2 Build 14 Table 3 shows the required software versions for the supported operating systems and storage systems. 12 Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric SAN Configuration Rules with SAN Director 64 Table 3: ACS 8.5 and ACS 8.6-1 Platform/Storage System SAN Attachment Summary with HBA Drivers and Firmware Revisions for SAN Director 64 and McDATA ED-5000 Installations HBA Driver / MA6000, MA8000, RA8000, Platform or Operating Platform HBA Firmware Rev. EMA12000/16000, ESA12000 Storage System SAN Attachment (Minimum) Controller SAN Attachment Compaq OpenVMS KGPSA-BC Embedded F_Por t using FABRIC Topology V7.2.1H1 Tima v300, in O/S Multiple-Bus Failover Mode Compaq OpenVMS V7.2.2, F_Por t /FW v3.20x7 SCSI-3 Mode Compaq OpenVMS V7.3 Connection name OS parameter type: KGPSA-CA Embedded VMS in O/S 168794-B21 Unit Identifier Required /FW v3.18.a4 F_Por t Tru64 UNIX V4.0G KGPSA-BC v1.29 F_Por t using FABRIC technology /FW v3.20X7 Transparent or Multiple-Bus Failover F_Por t SCSI-2 Mode Command Console LUN Enabled or Disabled KGPSA-CA v1.29 SCSI-3 Mode /FW v3.81a4 Connection name OS parameter: F_Por t TRU64_UNIX Tru64 UNIX 5.1 w/ Patch KGPSA-BC v1.29 F_Por t using FABRIC technology Kit 3 /FW v3.20X7 Transparent or Multiple-Bus Failover TruCluster Software F_Por t SCSI-2 Mode Command Console LUN Version 5.1 Enabled or Disabled KGPSA-CA v1.29 SCSI-3 Mode /FW v3.81a4 Connection name OS parameter: F_Por t TRU64_UNIX Tru64 UNIX 5.1A, KGPSA-BC v1.32 F_Por t using FABRIC technology TruCluster Software /FW v3.20X7 Transparent or Multiple-Bus Failover Version 5.1A REV 1312 F_Por t SCSI-2 Mode Command Console LUN Enabled or Disabled KGPSA-CA v1.32 SCSI-3 Mode /FW v3.81a4 Connection name OS parameter: F_Por t TRU64_UNIX Microsoft Windows NT 4.0 KGPSA-CB V4-4.52a9 F_Por t using FABRIC Topology SP6A Single System 168794-B21 /FW v3.81a1 Transparent or Multiple-Bus Failover Secure Path 3.1a F_Por t SCSI-2 Mode Command Console LUN Disabled SCSI-3 Mode Connection name OS parameter: WINNT Microsoft Windows NT 4.0 KGPSA-CB V5-4.52a9 F_Por t using FABRIC Topology SP6A Clustered Systems 168794-B21 /FW v3.81a1 Transparent or Multiple-Bus Failover Secure Path 3.1a F_Por t SCSI-2 Mode Command Console LUN Disabled SCSI-3 Mode Connection name OS parameter: WINNT Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric 13 SAN Configuration Rules with SAN Director 64 Table 3: ACS 8.5 and ACS 8.6-1 Platform/Storage System SAN Attachment Summary with HBA Drivers and Firmware Revisions for SAN Director 64 and McDATA ED-5000 Installations (Continued) HBA Driver / MA6000, MA8000, RA8000, Platform or Operating Platform HBA Firmware Rev. EMA12000/16000, ESA12000 Storage System SAN Attachment (Minimum) Controller SAN Attachment Microsoft Windows 2000 KGPSA-CB V5-4.52a9 F_Por t using FABRIC Topology SP1 Single System 168794-B21 /FW v3.81a1 Transparent or Multiple-Bus Failover Secure Path 3.1a F_Por t SCSI-2 Mode Command Console LUN Disabled SCSI-3 Mode Connection name OS parameter: WINNT Microsoft Windows 2000 KGPSA-CB V5-4.52a9 F_Por t using FABRIC Topology SP1 Clustered Systems 168794-B21 /FW v3.81a1 Transparent or Multiple-Bus Failover Secure Path 3.1a F_Por t SCSI-2 Mode Command Console LUN Disabled SCSI-3 Mode Connection name OS parameter: WINNT Sun Solaris 2.6 (32 bit), 380576-001 V3.0.3 F_Por t using FABRIC Topology Secure Path 2.1d V3.0, (32 bit) /FW v13.3.7 Transparent or Multiple-Bus Failover Sun Clusters 2.2, JNI 1063 PCI V2.3d Kit SCSI-2 Mode Command Console LUN Veritas Clusters 1.2.1, F_Por t Disabled Veritas Volume Manager SCSI-3 Mode 123503-001 V13.3.7 v3.0.4 (64 bit) Connection name OS parameter: SUN /FW v13.3.7 Sun Solaris 7 (32/64 bit), JNI 1063 SBUS Secure Path 2.1d, V2.3d Kit Sun Clusters 2.2, F_Por t Veritas Clusters 1.2.1, 380575-001 V13.3.7 Veritas Volume Manager (32 bit) /FW v13.3.7 v3.0.4 JNI 1063 SBUS V2.3d Kit Sun Solaris 8 (32/64 bit), F_Por t Secure Path 2.1d, Veritas Volume Manager v3.0.4 14 Addendum - Heterogeneous Open SAN Design Reference Guide - Director Fabric
| 123503-001 168794-B21 380575-001 380576-001 AA-RMPNC-TE AA-RQ6NB-TE |