Configuration Overview Order Number: EK-S64ML-CD. A01 Created by the Custom Configuration Documentation Group EXPORT STATEMENT OF ASSURANCE Products and technical data obtained under this agreement may be subject to U.S. and other government exports control regulations. Customer assures that it will comply with those regulations whenever it exports or re-exports controlled products or technical data obtained from COMPAQ or any product produced directly from the controlled technical data. 2001 Compaq Computer Corporation. COMPAQ, the Compaq logo, AlphaServer, StorageW orks. Registered in U.S. Patent and Trademark Office. OpenVMS, TRU64, and are trademarks and/or service marks of Compaq Information Technologies Group, L.P. All other product names mentioned herein may be trademarks or registered trademarks of their respective companies. Compaq shall not be liable for technical or editorial errors or omissions contained herein. The information in this document is subject to change without notice. The information in this publication is subject to change without notice and is provided "AS IS" W ITHOUT W ARRANTY OF ANY KIND. THE ENTIRE RISK ARISING OUT OF THE USE OF THIS INFORMATION REMAINS W ITH RECIPIENT. IN NO EVENT SHALL COMPAQ BE LIABLE FOR ANY DIRECT, CONSEQUENTIAL, INCIDENTAL, SPECIAL, PUNITIVE OR OTHER DAMAGES W HATSOEVER (INCLUDING W ITHOUT LIMITATION, DAMAGES FOR LOSS OF BUSINESS PROFITS, BUSINESS INTERRUPTION OR LOSS OF BUSINESS INFORMATION), EVEN IF COMPAQ HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. THE FOREGOING SHALL APPLY REGARDLESS OF THE NEGLIGENCE OR OTHER FAULT OF EITHER PARTY AND REGARDLESS OF W HETHER SUCH LIABILITY SOUNDS IN CONTRACT, NEGLIGENCE, TORT, OR ANY OTHER THEORY OF LEGAL LIABILITY, AND NOTW ITHSTANDING ANY FAILURE OF ESSENTIAL PURPOSE OF ANY LIMITED REMEDY. The limited warranties for Compaq products are exclusively set forth in the documentation accompanying such products. Nothing herein should be construed as constituting a further or additional warranty. Printed in USA Revision History DATE DOCUMENT NUMBER REV DESCRIPTION / SUMMARY Initial Release of ML770 February 22, 2001 EK-S64ML-CD. A01 Configuration Overview Responsible Department: Value-added Implementation Service / Custom Configuration Document Group Contents 1.0 Product Description ............................................................................................................. 1 2 . 0 S c o p e . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. . . . . . . . . . . . . . 1 3.0 Audience ............................................................................................................................... 1 4.0 Introduction ................................................................................................................ ........... 1 5.0 Compaq ProLiant ML770 Server ......................................................................................... 2 5.1 ProLiant ML770 System Cabinet......................................................................................................................... 2 5.1.1 Level A01 Fans Cabinet Front View .......................................................................................................... 4 5.1.2 Level A02 Operator Control Panel............................................................................................................. 5 5.1.3 Level A02 AC Power Entry ........................................................................................................................ 6 5.1.4 Level A04 Power Supplies Front Cabinet View ......................................................................................... 7 5.1.5 Level A04 Power Supplies Rear Cabinet View.......................................................................................... 8 5.1.6 Level A05 System Controller ..................................................................................................................... 9 5.1.7 Level A05 Logic Front Cabinet View ....................................................................................................... 10 5.1.8 Level A05 Logic Rear Cabinet View ........................................................................................................ 11 5.1.9 Memory Storage Unit (MSU) ................................................................................................................... 12 5.1.10 ProLiant ML770 PCI Direct I/O Bridges Front ....................................................................................... 14 5.1.11 ProLiant ML770 PCI Direct I/O Bridges Rear ........................................................................................ 15 5.1.12 Standard PCI Options ........................................................................................................................... 16 5.2 Configuration Guidelines for I/O ........................................................................................................................ 17 5.2.1 ProLiant ML770 Servers--32 Processors: (32x1) Partition..................................................................... 18 5.2.1.1 Nonbooting NIC Adapters, 32 Processors: (32x1) Partition ......................................................... 18 5.2.1.2 Gigabit Upgrade Modules, 32 Processors: (32x1) Partition ......................................................... 19 5.2.1.3 Nonbooting SCSI, 32 Processors: (32x1) Partition ...................................................................... 20 5.2.1.4 Nonbooting Fibre Adapters, 32 Processors: (32x1) Partition ....................................................... 21 5.2.2 ProLiant ML770 Servers--32 Processors: (16x2) Partitions ................................................................... 22 5.2.2.1 Nonbooting NIC Adapters, 32 Processors: (16x2) Partitions ....................................................... 22 5.2.2.2 Gigabit Upgrade Modules, 32 Processors: (16x2) Partitions ....................................................... 23 5.2.2.3 Nonbooting SCSI, 32 Processors, (16x2) Partitions..................................................................... 24 5.2.2.4 Nonbooting Fibre Adapters, 32 Processors, (16x2) Partitions ..................................................... 25 5.2.3 ProLiant ML770 Servers--32 Processors: (16x1) and (8x2) Partitions .................................................. 26 5.2.3.1 Nonbooting NIC Adapters, 32 Processors: (16x1) and (8x2) Partitions ....................................... 26 5.2.3.2 Gigabit Upgrade Modules, 32 Processors: (16x1) and (8x2) Partitions ....................................... 27 5.2.3.3 Nonbooting SCSI, 32 Processors: (16x1) and (8x2) Partitions .................................................... 28 5.2.3.4 Nonbooting Fibre Adapters, 32 Processors: (16x1) and (8x2) Partitions ..................................... 29 5.2.4 ProLiant ML770 Servers--32 Processors: (8x4) Partitions ..................................................................... 30 5.2.4.1 Nonbooting NIC Adapters, 32 Processors: (8x4) Partitions ......................................................... 30 5.2.4.2 Gigabit Upgrade Modules, 32 Processors: (8x4) Partitions ......................................................... 31 5.2.4.3 Nonbooting SCSI, 32 Processors, (8x4) Partitions....................................................................... 32 5.2.4.4 Nonbooting Fibre Adapters, 32 Processors: (8x4) Partitions ....................................................... 33 5.2.5 ProLiant ML770 Servers--16 Processors: (16x1) Partition..................................................................... 34 5.2.5.1 Nonbooting NIC Adapters, 16 Processors: (16x1) Partition ......................................................... 34 5.2.5.2 Gigabit Upgrade Modules, 16 Processors: (16x1) Partition ......................................................... 35 5.2.5.3 Nonbooting SCSI, 16 Processors: (16x1) Partition ...................................................................... 36 5.2.5.4 Nonbooting Fibre Adapters, 16 Processors: (16x1) Partition ....................................................... 37 5.2.6 ProLiant ML770 Servers--16 Processors: (8x2) Partitions ..................................................................... 38 5.2.6.1 Nonbooting NIC Adapters, 16 Processors: (8x2) Partitions ......................................................... 38 5.2.6.2 Gigabit Upgrade Modules, 16 Processors: (8x2) Partitions ......................................................... 39 5.2.6.3 Nonbooting SCSI, 16 Processors: (8x2) Partitions....................................................................... 40 5.2.6.4 Nonbooting Fibre Adapters, 16 Processors: (8x2) Partitions ....................................................... 41 5.3 Support Cabinet Front ....................................................................................................................................... 42 5.3.1 Peripheral Cabinet Rear .......................................................................................................................... 43 vii 5.3.2 TFT5000 Monitor ..................................................................................................................................... 44 5.3.3 Nortel 24-Port Ethernet Switch ................................................................................................................ 45 5.3.4 ProLiant DL360 MIP ................................................................................................................................ 46 5.3.5 SCSI Disk Shelves. ................................................................................................................................. 48 5.3.6 Power Controllers .................................................................................................................................... 49 5.4 Data Interconnect Diagram Left Side ................................................................................................................ 50 5.5 Data Interconnect Diagram Right Side.............................................................................................................. 51 5.6 Power Interconnect Diagram ............................................................................................................................. 52 6.0 ProLiant ML770 Foot Print and Cutout Information ........................................................ 53 6.1 ProLiant ML770 Server Cabinet Footprint and Cutouts .................................................................................... 53 7.0 Compaq Recommended Specifications Operating Environment .................................. 54 7.1 Voltage .............................................................................................................................................................. 54 7.2 Voltage Unbalance ............................................................................................................................................ 54 7.3 Voltage Transients ............................................................................................................................................ 54 7.4 Voltage Harmonic Distortion ............................................................................................................................. 54 7.5 Frequency ......................................................................................................................................................... 54 7.6 Phase Angle Unbalance .................................................................................................................................... 54 7.7 Phase Rotation .................................................................................................................................................. 54 7.8 Current Unbalance ............................................................................................................................................ 55 7.9 Magnetic Fields ................................................................................................................................................. 55 7.10 Electric Fields .................................................................................................................................................. 55 7.11 Operating Environment ................................................................................................................................... 56 7.12 Shipping and Storage in Shipment Containers for Less than 60 Days ........................................................... 56 7.13 Storage in Shipment Containers for More than 60 Days ................................................................................. 56 7.14 Altitude ............................................................................................................................................................ 56 7.15 Airflow Rate Range ......................................................................................................................................... 56 7.16 Vibration .......................................................................................................................................................... 56 8.0 Reference Documentation ................................................................................................. 57 viii Figures Figure 5-1: ProLiant ML770 Cabinet Front ................................................................................................................... 2 Figure 5-2: ProLiant ML770 Cabinet Rear .................................................................................................................... 3 Figure 5-3: Level A01 Fans Front ................................................................................................................................. 4 Figure 5-4: Level A02 Operator Control Panel.............................................................................................................. 5 Figure 5-5: Level A02 AC Entry .................................................................................................................................... 6 Figure 5-6: Level A04 Power Supplies Front ................................................................................................................ 7 Figure 5-7: Level A04 Power Supplies Rear Cabinet ................................................................................................... 8 Figure 5-8: System Controller ....................................................................................................................................... 9 Figure 5-9: Level A05 Logic Front Cabinet ................................................................................................................. 10 Figure 5-10: Level A05 Logic Rear Cabinet ................................................................................................................ 11 Figure 5-11: Main Memory Front ................................................................................................................................ 12 Figure 5-12: Main Memory Rear ................................................................................................................................. 13 Figure 5-13: ProLiant ML770 PCI Direct I/O Bridges Front ........................................................................................ 14 Figure 5-14: ProLiant ML770 PCI Direct I/O Bridges Rear ......................................................................................... 15 Figure 5-15: Standard PCI Options ............................................................................................................................ 16 Figure 5-16: Peripheral Cabinet Front ........................................................................................................................ 42 Figure 5-17: Peripheral Cabinet Rear ......................................................................................................................... 43 Figure 5-18: TFT5000 Monitor .................................................................................................................................... 44 Figure 5-19: Nortel 24-Port Ethernet Switch ............................................................................................................... 45 Figure 5-20: ProLiant DL360 MIP Front ...................................................................................................................... 46 Figure 5-21: ProLiant DL360 MIP Rear ...................................................................................................................... 47 Figure 5-22: SCSI Disk Shelf Front ............................................................................................................................ 48 Figure 5-23: Power Controllers Cabinet Rear ............................................................................................................. 49 Figure 5-24: Data Interconnect Diagram, Left Side .................................................................................................... 50 Figure 5-25: Data Interconnect Diagram, Right Side .................................................................................................. 51 Figure 5-26: Power Interconnect Diagram .................................................................................................................. 52 Figure 6-1: ProLiant ML770 Cabinet Footprint and Cutouts ....................................................................................... 53 Tables Table 5-1: I/O Cage View Front--Nonbooting NIC Adapters, 32 Processors: (32x1) Partition .................................. 18 Table 5-2: I/O Cage View Rear--Nonbooting NIC Adapters, 32 Processors: (32x1) Partition .................................. 18 Table 5-3: I/O Cage View Front--Gigabit Upgrade Modules, 32 Processors: (32x1) Partition .................................. 19 Table 5-4: I/O Cage View Rear--Gigabit Upgrade Modules, 32 Processors: (32x1) Partition ................................... 19 Table 5-5: I/O Cage View Front--Nonbooting SCSI Adapters, 32 Processors: (32x1) Partition ................................ 20 Table 5-6: I/O Cage View Rear--Nonbooting SCSI Adapters, 32 Processors: (32x1) Partition ................................ 20 Table 5-7: I/O Cage View Front--Nonbooting Fibre Adapters, 32 Processors: (32x1) Partition ................................ 21 Table 5-8: I/O Cage View Rear--Nonbooting Fibre Adapters, 32 Processors: (32x1) Partition ................................ 21 Table 5-9: I/O Cage View Front--Nonbooting NIC Adapters, 32 Processors: (16x2) Partitions ................................ 22 Table 5-10: I/O Cage View Rear--Nonbooting NIC Adapters, 32 Processors: (16x2) Partitions ............................... 22 Table 5-11: I/O Cage View Front--Gigabit Upgrade Modules, 32 Processors: (16x2) Partitions .............................. 23 Table 5-12: I/O Cage View Rear--Gigabit Upgrade Modules, 32 Processors: (16x2) Partitions ............................... 23 Table 5-13: I/O Cage View Front--Nonbooting SCSI Adapters, 32 Processors: (16x2) Partitions ............................ 24 Table 5-14: I/O Cage View Rear--Nonbooting SCSI Adapters, 32 Processors: (16x2) Partitions ............................ 24 Table 5-15: I/O Cage View Front--Nonbooting Fibre Adapters, 32 Processors: 16x2 Partitions .............................. 25 Table 5-16: I/O Cage View Rear--Nonbooting Fibre Adapters, 32 Processors: (16x2) Partitions ............................. 25 Table 5-17: I/O Cage View Front--Nonbooting NIC Adapters, 32 Processors: (16x1) and (8x2) Partitions .............. 26 Table 5-18: I/O Cage View Rear--Nonbooting NIC Adapters, 32 Processors: (16x1) and (8x2) Partitions .............. 26 Table 5-19: I/O Cage View Front--Gigabit Upgrade Modules, 32 Processors: (16x1) and (8x2) Partitions .............. 27 Table 5-20: I/O Cage View Rear--Gigabit Upgrade Modules, 32 Processors: (16x1) and (8x2) Partitions ............... 27 Table 5-21: I/O Cage View Front--Nonbooting SCSI, 32 Processors: (16x1) and (8x2) Partitions ........................... 28 Table 5-22: I/O Cage View Rear--Nonbooting SCSI, 32 Processors: (16x1) and (8x2) Partitions ............................ 28 Table 5-23: I/O Cage View Front--Nonbooting Fibre Adapters, 32 Processors: (16x1) and (8x2) Partitions ............ 29 Table 5-24: I/O Cage View Rear--Nonbooting Fibre Adapters, 32 Processors: (16x1) and (8x2) Partitions ............ 29 Table 5-25: I/O Cage View Front--Nonbooting NIC Adapters, 32Processors: (8x4) Partitions ................................. 30 ix Table 5-26: I/O Cage View Rear--Nonbooting NIC Adapters, 32 Processors: (8x4) Partitions ................................. 30 Table 5-27: I/O Cage View Front--Gigabit Upgrade Modules, 32 Processors: (8x4) Partitions ................................ 31 Table 5-28: I/O Cage View Rear--Gigabit Upgrade Modules, 32 Processors: (8x4) Partitions ................................. 31 Table 5-29: I/O Cage View Front--Nonbooting SCSI, 32 Processors: (8x4) Partitions ............................................. 32 Table 5-30: I/O Cage View Rear--Nonbooting SCSI, 32 Processors: (8x4) Partitions .............................................. 32 Table 5-31: I/O Cage View Front--Nonbooting Fibre Adapters, 32 Processors: (8x4) Partitions .............................. 33 Table 5-32: I/O Cage View Rear--Nonbooting Fibre Adapters, 32 Processors: (8x4) Partitions ............................... 33 Table 5-33: I/O Cage View Front--Nonbooting NIC Adapters, 16 Processors: (16x1) Partition ................................ 34 Table 5-34: I/O Cage View Front--Gigabit Upgrade Modules, 16 Processors: (16x1) Partition ................................ 35 Table 5-35: I/O Cage View Front--Nonbooting SCSI, 16 Processors: (16x1) Partition ............................................. 36 Table 5-36: I/O Cage View Front--Nonbooting Fibre Adapters, 16 Processors: (16x1) Partition .............................. 37 Table 5-37: I/O Cage View Front--Nonbooting NIC Adapters, 16 Processors: (8x2) Partitions ................................ 38 Table 5-38: I/O Cage View Front--Gigabit Upgrade Modules, 16 Processors: (8x2) Partitions ................................ 39 Table 5-39: I/O Cage View Front--Nonbooting SCSI, 16 Processors: (8x2) Partitions ............................................. 40 Table 5-40: I/O Cage View Front--Nonbooting Fibre Adapters, 16 Processors: (8x2) Partitions .............................. 41 APPENDIX A Cabinet Wiring x Compaq ProLiant ML770 Servers Configuration Overview 1.0 Product Description The Compaq ProLiantTM ML770 server is an enterprise-class computer system that supports Microsoft W indows 2000 Datacenter software. The ProLiant ML770 series represents the next step in the evolution of computer enterprise servers. Based on innovative cellular multiprocessing (CMP) technology, the ProLiant ML770 server establishes the first Intel-based system capable of supporting large scale, ecommerce, and mission-critical applications. 2.0 Scope This document provides an overview and covers a cursory description of each major assembly detailing hardware interconnects. 3.0 Audience This document is for system administrators, system operators, and Compaq customer service engineers. 4.0 Introduction A ProLiant ML770 server can be configured as a single 32-processor partition, or it can be divided in up to four partitions with each isolating a separate operating system. The system hardware is divided into five levels: Level A01 contains the cabinet fans. Level A02 contains the Operator Control Panel (OCP) and the AC Power Entry. Level A04 contains the power supplies for the two power domains. Level A05 contains the system logic, which can accept up to 32 Intel Processors in groups of four. Level A06 contains the PCI I/O buses--twelve slots per PCI bridge. Note: There is no level A03. Configuration Overview EK-S64ML-CD. A01 1 Compaq ProLiant ML770 Servers Configuration Overview 5.0 Compaq ProLiant ML770 Server The system cabinet is shown with the cabinet doors removed. 5.1 ProLiant ML770 System Cabinet Figure 5-1: ProLiant ML770 Cabinet Front 2 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview Figure 5-2: ProLiant ML770 Cabinet Rear Configuration Overview EK-S64ML-CD. A01 3 Compaq ProLiant ML770 Servers Configuration Overview 5.1.1 Level A01 Fans Cabinet Front View Six fans ensure full cooling redundancy, however large the configuration. Each fan delivers 380 cubic feet per minute of cool air. All fans are powered by both power domains. Individual cooling components can be inserted while the system is powered up. Figure 5-3: Level A01 Fans Front 4 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.1.2 Level A02 Operator Control Panel The operator control panel is the only active element in the front of this level. All other compartments remain unused. Figure 5-4: Level A02 Operator Control Panel Configuration Overview EK-S64ML-CD. A01 5 Compaq ProLiant ML770 Servers Configuration Overview 5.1.3 Level A02 AC Power Entry Compaq requires that uninterruptible power supplies (UPS) be used as sources of AC input. The 3-phase AC power controllers are divided into two power domains. Each power control domain consists of up to two Memory Storage Units (MSUs), two Processors (PODs), and four PCI DIBS. Figure 5-5: Level A02 AC Entry 6 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.1.4 Level A04 Power Supplies Front Cabinet View The Multi-Output Power Supplies (MOPS) supply different levels of DC power to the hardware components. The MOPS are divided into two power domains. MOPS 1-4 power components are located in power domain 0. MOPS 5-8 power components are located in power domain 1. Figure 5-6: Level A04 Power Supplies Front Configuration Overview EK-S64ML-CD. A01 7 Compaq ProLiant ML770 Servers Configuration Overview 5.1.5 Level A04 Power Supplies Rear Cabinet View MOPS 1-4 power components are located in power domain 1. MOPS 5-8 power components are located in power domain 0. Figure 5-7: Level A04 Power Supplies Rear Cabinet 8 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.1.6 Level A05 System Controller Figure 5-8: System Controller The system controller is comprised of the following assemblies: The common scan engine (CSE) JTAG interfaces between the service processor (also called a Maintenance Interface Processor) and the hardware components (the IEEE 1149.1 TAP interface). The ProLiant DL360 Service Processor is the Maintenance Interface Processor (MIP). The DB9 serial (RS232) interfaces are used by the MIPs to communicate with the power control logic in the system. There are two interfaces, one for each power domain. The system oscillator supplies the appropriate system clocks and timing signals to all hardware components that require them. Configuration Overview EK-S64ML-CD. A01 9 Compaq ProLiant ML770 Servers Configuration Overview 5.1.7 Level A05 Logic Front Cabinet View Each Processor Module (POD) consists of two subPODS that contains crossbar logic to interface with the system centerplane. The PODs have a private first-level cache memory for each processor, a private second-level cache memory for each processor, and a shared third-level cache for all processors installed in a subPOD. Each subPOD contains four Intel processors. The Memory Storage Units (MSU) contain memory controller logic and dual inline memory modules (DIMMs). The MSUs also interface with the crossbar interconnect (CI), which allows each Intel processor access to main memory in a partition. Figure 5-9: Level A05 Logic Front Cabinet All processors in a single subPOD must have identical steppings and second-level cache. SubPODs assigned to partitions must contain processors from the same family. 10 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.1.8 Level A05 Logic Rear Cabinet View Each Processor Module (POD) consists of two subPODS that contains crossbar logic to interface with the system centerplane. The PODs have a private first-level cache memory for each processor, a private second-level cache memory for each processor, and a shared third-level cache for all processors installed in a subPOD. Each subPOD contains four Intel processors. The Memory Storage Units (MSU) contain memory controller logic and dual inline memory modules (DIMMs). The MSUs also interface with the crossbar interconnect (CI), which allows each Intel processor access to main memory in a partition. Figure 5-10: Level A05 Logic Rear Cabinet All processors in a single subPOD must have identical steppings and second-level cache. SubPODs assigned to partitions must contain processors from the same family. Configuration Overview EK-S64ML-CD. A01 11 Compaq ProLiant ML770 Servers Configuration Overview 5.1.9 Memory Storage Unit (MSU) The ProLiant ML770 system memory is built around the Memory Storage Unit (MSU) and can be up to 32 GB, with a bandwidth of up to 20 GB/s. Each MSU board supports up to 32 dual in-line memory modules (DIMMs). The DIMMs are installed in pairs, or expansion sets. Each MSU supports up to 16 expansion sets. DIMMs are available in 128 MB, 256 MB, and 512 MB sizes. Figure 5-11: Main Memory Front 12 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview Figure 5-12: Main Memory Rear Configuration Overview EK-S64ML-CD. A01 13 Compaq ProLiant ML770 Servers Configuration Overview 5.1.10 ProLiant ML770 PCI Direct I/O Bridges Front Each PCI direct I/O bridge (DIB) module connects the PCI subsystem to the crossbar interconnect and supports three PCI bus modules comprised of four slots each. There are two proprietary PCI bus modules that support partitions: The Console Manager board provides the keyboard, VGA, and mouse support necessary to establish a system console for independent partitions. The Compatibility PCI board contains components that make it possible to boot an unchanged operating system in a partition. A fully configured server contains up to 64 PCI standard controllers. See Section 5.2, for guidelines to populate the I/O subsystem. Figure 5-13: ProLiant ML770 PCI Direct I/O Bridges Front 14 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.1.11 ProLiant ML770 PCI Direct I/O Bridges Rear Each PCI Direct I/O Bridge (DIB) module connects the PCI subsystem to the crossbar interconnect and supports three PCI bus modules comprised of four slots each. There are two proprietary PCI bus modules that support partitions: The Console Manager board provides the keyboard, VGA, and mouse support necessary to establish a system console for independent partitions. The Compatibility PCI board contains components that make it possible to boot an unchanged operating system in a partition. A fully configured server contains up to 64 PCI standard controllers. See Section 5.2, for guidelines to populate the I/O subsystem. Figure 5-14: ProLiant ML770 PCI Direct I/O Bridges Rear Configuration Overview EK-S64ML-CD. A01 15 Compaq ProLiant ML770 Servers Configuration Overview 5.1.12 Standard PCI Options Four direct I/O bridges (DIBs): 0-0, 1-0, 2-0, and 3-0 are configured standard with the following PCI options to support each of four separate partitions: Diskette drive General purpose I/O board: keyboard, mouse, and Universal Serial Bus (USB) ports General purpose I/O board: Serial and parallel port Ethernet and Ultra-SCSI combination board: One 10BaseT port, one serial port, and one single-ended Ultra-SCSI port Ultra-SCSI interface board: Two single-ended Ultra-SCSI interfaces Figure 5-15: Standard PCI Options 16 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.2 Configuration Guidelines for I/O Guidelines to populate options in the PCI I/O slots of the ProLiant ML770 servers: Populate the I/O slots first with NIC adapters, then Gigabit Upgrade Modules, then Nonbooting SCSI, then Nonbooting Fibre Adapters. Do not place an I/O adapter in a slot that corresponds to an empty gray area of the table (see the next section). I/O slots that correspond to a numbered gray area of the table are reserved for the base system configuration. Populate I/O adapters in the system corresponding to the slot ranking as shown in the tables by a number in parentheses. If a slot is already occupied by an adapter, place the adapter in the next numerically ranked slot. Configuration Overview EK-S64ML-CD. A01 17 Compaq ProLiant ML770 Servers Configuration Overview 5.2.1 ProLiant ML770 Servers--32 Processors: (32x1) Partition 5.2.1.1 Nonbooting NIC Adapters, 32 Processors: (32x1) Partition The maximum number of NIC adapters in a partition is 10. A NIC must reside in slot 0, 1, or 2 of a subDIB. A NIC should be placed in the lowest numbered slot, if possible (use slot 0 before slot 1; slot 1 before slot 2). Only one NIC can reside in the middle subDIB of the boot DIB. Table 5-1: I/O Cage View Front--Nonbooting NIC Adapters, 32 Processors: (32x1) Partition Power Domain 0 Power Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage (1) (16) (2) (15) subDIB 2 (17) BOOT (18) BOOT (middle) (29) 2 (30) 2 3 3 3 3 I/O cage (3) (6) (4) (5) subDIB 3 (19) (20) (21) (22) (bottom) (31) (32) (33) (34) 3 3 3 3 T able 5-2: I/O Cage View Rear--Nonbooting NIC Adapters, 32 Processors: (32x1) Partition Power Domain 1 Power Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage (7) (13) (8) (14) subDIB 2 (23) BOOT (24) BOOT (middle) (35) 2 (36) 2 3 3 3 3 I/O cage (9) (10) (11) (12) subDIB 3 (25) (26) (27) (28) (bottom) (37) (38) (39) (40) 3 3 3 3 18 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.2.1.2 Gigabit Upgrade Modules, 32 Processors: (32x1) Partition A maximum of four Gigabit adapters can be present. A Gigabit adapter must reside only in slot 0 of a subDIB. A Gigabit adapter cannot reside in any subDIB of the boot DIB. Table 5-3: I/O Cage View Front--Gigabit Upgrade Modules, 32 Processors: (32x1) Partition Power Domain 0 Power Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage (1) slot 0 (2) slot 0 subDIB 2 1 BOOT 1 BOOT (middle) 2 2 2 2 3 3 3 3 I/O cage (3) (6) (4) (5) subDIB 3 1 1 (bottom) 2 2 2 2 3 3 3 3 Table 5-4: I/O Cage View Rear--Gigabit Upgrade Modules, 32 Processors: (32x1) Partition Power Domain 1 Power Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage (7) slot 0 (8) slot 0 subDIB 2 1 BOOT 1 BOOT (middle) 2 2 2 2 3 3 3 3 I/O cage (9) (11) (10) (12) subDIB 3 1 1 1 1 (bottom) 2 2 2 2 3 3 3 3 Configuration Overview EK-S64ML-CD. A01 19 Compaq ProLiant ML770 Servers Configuration Overview 5.2.1.3 Nonbooting SCSI, 32 Processors: (32x1) Partition A maximum of eight SCSI adapters can be present in each partition. Nonbooting SCSI adapter cards cannot be present in slot 0 of any subDIB; they can be in slots 1, 2, or 3. A storage controller is defined as any controller in the following classes: SCSI adapters, RAID adapters, or Fibre adapters. A total of three storage controller adapter cards can be present in any subDIB. A maximum of two of the same type of controller adapter card can be present in any subDIB. Table 5-5: I/O Cage View Front--Nonbooting SCSI Adapters, 32 Processors: (32x1) Partition Domain 0 Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage slot 0 slot 0 slot 0 slot 0 subDIB 2 (1) BOOT (2) BOOT (middle) (9) (31) (10) (32) (17) (39) (18) (40) I/O cage slot 0 slot 0 slot 0 slot 0 subDIB 3 (3) (25) (4) (26) (bottom) (11) (29) (12) (30) (19) (37) (20) (38) Table 5-6: I/O Cage View Rear--Nonbooting SCSI Adapters, 32 Processors: (32x1) Partition Domain 1 Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage slot 0 slot 0 slot 0 slot 0 subDIB 2 (5) BOOT (6) BOOT (middle) (13) (35) (14) (36) (21) (43) (22) (44) I/O cage slot 0 slot 0 slot 0 slot 0 subDIB 3 (7) (27) (8) (28) (bottom) (15) (33) (16) (34) (23) (41) (24) (42) 20 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.2.1.4 Nonbooting Fibre Adapters, 32 Processors: (32x1) Partition A maximum of 10 Fibre controllers can be present in each partition. Nonbooting Fibre adapter cards cannot be present in slot 0 of any subDIB; they can be in slots 1, 2, or 3. A storage controller is defined as any controller in the following classes: SCSI adapters, RAID adapters, or Fibre adapters. A total of three storage controller adapter cards can be present in any subDIB. A maximum of two of the same type of controller adapter cards can be present in any subDIB. Table 5-7: I/O Cage View Front--Nonbooting Fibre Adapters, 32 Processors: (32x1) Partition Domain 0 Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage slot 0 slot 0 slot 0 slot 0 subDIB 2 (1) BOOT (2) BOOT (middle) (9) (31) (10) (32) (17) (39) (18) (40) I/O cage slot 0 slot 0 slot 0 slot 0 subDIB 3 (3) (25) (4) (26) (bottom) (11) (29) (12) (30) (19) (37) (20) (38) Table 5-8: I/O Cage View Rear--Nonbooting Fibre Adapters, 32 Processors: (32x1) Partition Domain 1 Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage slot 0 slot 0 slot 0 slot 0 subDIB 2 (5) BOOT (6) BOOT (middle) (13) (35) (14) (36) (21) (43) (22) (44) I/O cage slot 0 slot 0 slot 0 slot 0 subDIB 3 (7) (27) (8) (28) (bottom) (15) (33) (16) (34) (23) (41) (24) (42) Configuration Overview EK-S64ML-CD. A01 21 Compaq ProLiant ML770 Servers Configuration Overview 5.2.2 ProLiant ML770 Servers--32 Processors: (16x2) Partitions 5.2.2.1 Nonbooting NIC Adapters, 32 Processors: (16x2) Partitions The maximum number of NIC adapters in a partition is 10. A NIC must reside in slot 0, 1, or 2 of a subDIB. A NIC should be placed in the lowest numbered slot, if possible (use slot 0 before slot 1; slot 1 before slot 2). Only one NIC can reside in the middle subDIB of the boot DIB. Table 5-9: I/O Cage View Front--Nonbooting NIC Adapters, 32 Processors: (16x2) Partitions Domain 0 Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 subDIB 1 1 1 (top) 2 2 3 3 I/O cage A(1) A(8) B(1) B(8) subDIB 2 A(9) BOOT B(9) BOOT (middle) A(15) 2 B(15) 2 3 3 3 3 I/O cage A(2) A(7) B(2) B(7) subDIB 3 A(10) A(14) B(10) B(14) (bottom) A(16) A(20) B(16) B(20) 3 3 3 3 Table 5-10: I/O Cage View Rear--Nonbooting NIC Adapters, 32 Processors: (16x2) Partitions Domain 1 Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage B(3) B(6) A(3) A(6) SubDIB 2 B(11) BOOT A(11) BOOT (middle) B(17) 2 A(17) 2 3 3 3 3 I/O cage B(4) B(5) A(4) A(5) SubDIB 3 B(12) B(13) A(12) A(13) (bottom) B(18) B(19) A(18) A(19) 3 3 3 3 22 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.2.2.2 Gigabit Upgrade Modules, 32 Processors: (16x2) Partitions A maximum of four Gigabit adapters can be present in a partition. A Gigabit adapter must reside only in slot 0 of a subDIB. A Gigabit adapter cannot reside in any subDIB of the boot DIB. Table 5-11: I/O Cage View Front--Gigabit Upgrade Modules, 32 Processors: (16x2) Partitions Domain 0 Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage A(1) slot 0 B(1) slot 0 SubDIB 2 1 BOOT 1 BOOT (middle) 2 2 2 2 3 3 3 3 I/O cage A(2) A(6) B(2) B(6) SubDIB 3 1 1 (bottom) 2 2 2 2 3 3 3 3 Table 5-12: I/O Cage View Rear--Gigabit Upgrade Modules, 32 Processors: (16x2) Partitions Domain 1 Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage B(3) slot 0 A(3) slot 0 SubDIB 2 1 BOOT 1 BOOT (middle) 2 2 2 2 3 3 3 3 I/O cage B(4) B(5) A(4) A(5) SubDIB 3 1 1 1 1 (bottom) 2 2 2 2 3 3 3 3 Configuration Overview EK-S64ML-CD. A01 23 Compaq ProLiant ML770 Servers Configuration Overview 5.2.2.3 Nonbooting SCSI, 32 Processors, (16x2) Partitions Nonbooting SCSI adapter cards cannot be present in slot 0 of any subDIB; they can be in slots 1, 2, or 3. A maximum of eight SCSI adapters can be present in each partition. A storage controller is defined as any controller in the following classes: SCSI adapters, RAID adapters, or Fibre adapters. A total of three storage controller adapter cards can be present in any subDIB. A maximum of two of the same type of controller adapter card can be present in any subDIB. Table 5-13: I/O Cage View Front--Nonbooting SCSI Adapters, 32 Processors: (16x2) Partitions Domain 0 Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage slot 0 slot 0 slot 0 slot 0 SubDIB 2 A(1) BOOT B(1) BOOT (middle) A(6) A(21) B(6) B(21) A(12) A(22) B(12) B(22) I/O cage slot 0 slot 0 slot 0 slot 0 SubDIB 3 A(2) A(18) B(2) B(18) (bottom) A(7) A(19) B(7) B(19) A(13) A(20) B(13) B(20) Table 5-14: I/O Cage View Rear--Nonbooting SCSI Adapters, 32 Processors: (16x2) Partitions Domain 1 Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage slot 0 slot 0 slot 0 slot 0 SubDIB 2 B(3) BOOT A(3) BOOT (middle) B(8) B(9) A(8) A(9) B(14) B(15) A(14) A(15) I/O cage slot 0 slot 0 slot 0 slot 0 SubDIB 3 B(4) B(5) A(4) A(5) (bottom) B(10) B(11) A(10) A(11) B(16) B(17) A(16) A(17) 24 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.2.2.4 Nonbooting Fibre Adapters, 32 Processors, (16x2) Partitions A maximum of 10 Fibre controllers can be present in each partition. Nonbooting Fibre adapter cards cannot be present in slot 0 of any subDIB; they can be in slots 1, 2, or 3. A storage controller is defined as any controller in the following classes: SCSI adapters, RAID adapters, or Fibre adapters. A total of three storage controller adapter cards can be present in any subDIB. A maximum of two of the same type of controller adapter card can be present in any subDIB. Table 5-15: I/O Cage View Front--Nonbooting Fibre Adapters, 32 Processors: 16x2 Partitions Domain 0 Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage slot 0 slot 0 slot 0 slot 0 SubDIB 2 A(1) BOOT B(1) BOOT (middle) A(6) A(21) B(6) B(21) A(12) A(22) B(12) B(22) I/O cage slot 0 slot 0 slot 0 slot 0 SubDIB 3 A(2) A(18) B(2) B(18) (bottom) A(7) A(19) B(7) B(19) A(13) A(20) B(13) B(20) Table 5-16: I/O Cage View Rear--Nonbooting Fibre Adapters, 32 Processors: (16x2) Partitions Domain 1 Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage slot 0 slot 0 slot 0 slot 0 SubDIB 2 B(3) BOOT A(3) BOOT (middle) B(8) B(9) A(8) A(9) B(14) B(15) A(14) A(15) I/O cage slot 0 slot 0 slot 0 slot 0 SubDIB 3 B(4) B(5) A(4) A(5) (bottom) B(10) B(11) A(10) A(11) B(16) B(17) A(16) A(17) Configuration Overview EK-S64ML-CD. A01 25 Compaq ProLiant ML770 Servers Configuration Overview 5.2.3 ProLiant ML770 Servers--32 Processors: (16x1) and (8x2) Partitions 5.2.3.1 Nonbooting NIC Adapters, 32 Processors: (16x1) and (8x2) Partitions The maximum number of NIC adapters in a partition is 10. A NIC must reside in slot 0, 1, or 2 of a subDIB. A NIC should be placed in the lowest numbered slot, if possible (use slot 0 before slot 1; slot 1 before slot 2). Only one NIC can reside in the middle subDIB of the boot DIB. Table 5-17: I/O Cage View Front--Nonbooting NIC Adapters, 32 Processors: (16x1) and (8x2) Partitions Domain 0 Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage A(1) A(8) B(1) B(4) SubDIB 2 A(9) BOOT B(5) BOOT (middle) A(15) 2 B(8) 2 3 3 3 3 I/O cage A(2) A(7) B(2) B(3) SubDIB 3 A(10) A(14) B(6) B(7) (bottom) A(16) A(20) B(9) B(10) 3 3 3 3 Table 5-18: I/O Cage View Rear--Nonbooting NIC Adapters, 32 Processors: (16x1) and (8x2) Partitions Domain 1 Domain 0 DIB 3-1 DIB 3-0 DIB 2-1 DIB 2-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage C(1) C(4) A(3) A(6) SubDIB 2 C(5) BOOT A(11) BOOT (middle) C(8) 2 A(17) 2 3 3 3 3 I/O cage C(2) C(3) A(4) A(5) SubDIB 3 C(6) C(7) A(12) A(13) (bottom) C(9) C(10) A(18) A(19) 3 3 3 3 26 EK-S64ML-CD. A01 Configuration Overview Compaq ProLiant ML770 Servers Configuration Overview 5.2.3.2 Gigabit Upgrade Modules, 32 Processors: (16x1) and (8x2) Partitions A maximum of four Gigabit adapters can be present in a partition. A Gigabit adapter must reside only in slot 0 of a subDIB. A Gigabit adapter cannot reside in any subDIB of the boot DIB. Table 5-19: I/O Cage View Front--Gigabit Upgrade Modules, 32 Processors: (16x1) and (8x2) Partitions Domain 0 Domain 1 DIB 0-1 DIB 0-0 DIB 1-1 DIB 1-0 I/O cage slot 0 slot 0 SubDIB 1 1 1 (top) 2 2 3 3 I/O cage A(1) slot 0 B(1) slot 0 SubDIB 2 1 BOOT 1 BOOT (middle) 2 2 2 2 3 3 3 3 I/O cage A(2) A(6) B(2) B(3) SubDIB 3 1 1 (bottom) 2 2 2 2 3 3 3 3 Table 5-20: I/O Cage View Rear--Gigabit Upgrade Modules, 32 Processors: (16x1) and (8x2) Partitions
| 215381-001 215383-001 EK-S64ML-CD |