Enterprise Virtual Array
HSV Controller
User Guide
Par t Number: EK-E1HSV-UA. A01
First Edition August 2001
Product Version: VCS 1.0
This publication is for use by individuals responsible for operating
and maintaining the Compaq StorageWorks Enterprise Virtual Array
HSV Controller.
b
2001 Compaq Computer Corporation.
Compaq, the Compaq logo, StorageWorks, and SANworks are trademarks of Compaq Information
Technologies Group, L.P.
UNIX is a trademark of The Open Group.
All other product names mentioned herein may be trademarks of their respective companies.
Confidential computer software. Valid license from Compaq required for possession, use or copying.
Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software
Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under
vendor's standard commercial license.
Compaq shall not be liable for technical or editorial errors or omissions contained herein. The
information in this document is provided "as is" without warranty of any kind and is subject to change
without notice. The warranties for Compaq products are set forth in the express limited warranty
statements accompanying such products. Nothing herein should be construed as constituting an additional
warranty.
Compaq service tool software, including associated documentation, is the property of and contains
confidential technology of Compaq Computer Corporation. Service customer is hereby licensed to use
the software only for activities directly relating to the delivery of, and only during the term of, the
applicable services delivered by Compaq or its authorized service provider. Customer may not modify or
reverse engineer, remove, or transfer the software or make the software or any resultant diagnosis or
system management data available to other parties without Compaq's or its authorized service provider's
consent. Upon termination of the services, customer will, at Compaq's or its service provider's option,
destroy or return the software and associated documentation in its possession.
Printed in the U.S.A.
Enterprise Virtual Array HSV Controller User Guide
First Edition August 2001
Par t Number: EK-E1HSV-UA. A01
Contents
About this Guide
Text Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Symbols in Text . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Symbols on Equipment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xi
Rack Stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Getting Help . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
Compaq Technical Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Compaq Website . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Compaq Authorized Reseller . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
1 Introducing the HSV Series Controllers
Controller Enclosure Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
High Availability Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Controller Pairs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Blowers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Cache Battery Assemblies . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
OCP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Element Replacement. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
2 Setting Up an HSV-Series Controller Pair
Setup Procedure Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
Using the OCP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Displays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Startup Display . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Initial Setup Display . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
OCP Pushbuttons. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Node WWN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Procedure for Entering the WWN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Procedure for Entering the WWN Checksum . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
Procedure for Setting the Storage System Password . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
Enterprise Virtual Array HSV Controller User Guide iii
Contents
3 Controller Operations
An Overview of the HSV-Series Controller. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Cabling . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
OCP Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
LEDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Navigation Pushbuttons . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
LCD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Displaying the Storage System Menu Tree . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
Displaying System Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Versions System Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Shutting Down the System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 311
Restarting the System. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 314
Powering Off the System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 315
Initializing the System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 316
Password Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318
Changing a Password . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318
Clearing a Password. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320
4 Power and Cooling
DC Power Supplies. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Blowers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
5 Controller Fault Management
Using the Element Manager GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
GUI Termination Event Display . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
GUI Event Display. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
Fault Management Displays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Displaying Last Fault Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54
Displaying Detailed Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
6 Replacement Procedures
ESD Protection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Common Replacement Procedures. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Identifying the Spare Part Number . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Replacing a Cache Battery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Determining the Status of a Cache Battery . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Battery Assembly Replacement Guidelines. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
Battery Assembly Replacement Procedure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
iv Enterprise Virtual Array HSV Controller User Guide
Contents
Replacing a Blower . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Replacing a Fiber Optic Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Replacing a Transceiver. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
A Regulatory Notices
FCC Class A Certification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A1
Country-Specific Certifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A2
B Specifications
Physical Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B1
Power Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B2
Environmental Specifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . B3
C Protecting Fiber Optic Connections
Glossary
Index
Enterprise Virtual Array HSV Controller User Guide v
Contents
Figures
11 HSV-series controller--front view . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
12 Six drive enclosure storage system--front view . . . . . . . . . . . . . . . . . . . . . . . . 12
13 Twelve drive enclosure storage system--front view . . . . . . . . . . . . . . . . . . . . 13
14 Major HSV controller components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
15 HSV110 controller--rear view . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
16 Controller blowers location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
17 HSV controller cache battery assembly. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
18 OCP components . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
21 OCP displays and controls. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
22 Typical HSV110 controller startup display . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
23 Initial setup display . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
24 Pushbutton icons . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
25 Sample Node WWN label . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
26 Node WWN label location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
31 Model 3220 controller location--front view. . . . . . . . . . . . . . . . . . . . . . . . . . . 32
32 Model 3220 controller location--rear view . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
33 HSV controller connectors--rear view . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
34 Controller OCP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
35 Navigation pushbutton icons . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
36 Default LCD displays . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
41 Controller blower. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
42 Blower location . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
51 GUI Termination Event display . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
52 Typical Element Manager Event display. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
61 Typical Compaq CRU product label . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
62 Accessing and opening the cache battery compartment . . . . . . . . . . . . . . . . . . 64
63 Replacing a battery assembly . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
64 Opening the blower compartment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
65 Replacing a blower . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
66 Removing or installing a fiber optic cable. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
67 Removing or installing a transceiver . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 610
A1 Typical enclosure certification label . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . A2
vi Enterprise Virtual Array HSV Controller User Guide
Contents
Tables
1 Text Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii
21 WWN Pushbutton Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
22 System Password Pushbutton Functions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
31 Controller Status Icons and LEDs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
32 System Password Pushbutton Functions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
33 Shutdown Methods . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 311
B1 HSV-Series Controller Physical Specifications . . . . . . . . . . . . . . . . . . . . . . . . B1
B2 Controller Power Supply AC Power Requirements . . . . . . . . . . . . . . . . . . . . . B2
B3 Controller Power Supply Output Specifications. . . . . . . . . . . . . . . . . . . . . . . . B2
Enterprise Virtual Array HSV Controller User Guide vii
About this Guide
The following sections are covered:
Text Conventions
Symbols in Text
Symbols on Equipment
Rack Stability
Getting Help
Compaq Authorized Reseller
Text Conventions
This document uses the conventions in Table 1 to distinguish elements of text.
Table 1: Text Conventions
Element Convention Examples
Named Keys Bold Home, Print Screen, Num Lock, Esc, PgUp
Key A plus sign (+) between two keys means that
Sequences you should press them simultaneously:
Ctrl+A, Ctrl+Home, Alt+Ctrl+Del
On the File menu, choose Save.
Initial Caps
Menu Items
(for UNIX, AIX, and Save the file in the C:\StorageSets\Default
Directory
Solaris directory names, directory.
Names
the exact case of every
(UNIX, AIX, Solaris): Save the file in the
Button
character is displayed).
/home/newuser/practice directory.
Names
To back up files, click the Backup Now button.
Dialog Box
Names In the Save As dialog box, choose the drive
then the folder.
Enterprise Virtual Array HSV Controller User Guide ix
About this Guide
Table 1: Text Conventions (Continued)
Element Convention Examples
Initial Caps and User Input and System Responses:
User Input
and System monospace font. To exit from the program, type Exit.
Responses
At the prompt, type this command:
(Output and
COMMAND NAMES appear SHOW THIS_CONTROLLER
Error
in upper case, unless (no variable)
Messages)
they are case sensitive To see your settings, give the command:
COMMAND (UNIX, AIX, and Solaris SHOW FULL
NAMES command names are (with variable)
case sensitive and will
Drive Names
You will see the Continue? message.
not appear in uppercase).
Command Names
Use SET THIS_CONTROLLER to change
Entered
parameters.
are displayed in angle
To manage storage, enter RUN
brackets (< >) and all
sysmgr.exe
lower case.
(UNIX, AIX, Solaris): To list files, give the ls
command.
Drive Names:
Navigate to your CD-ROM drive
(usually D: or E:).
To configure storage, edit storageset.ini.
filenames Unless case sensitive,
use lowercase italics. Changes are stored in
If filenames are NewSystemConfigurationFile.ini.
case-sensitive (UNIX,
(UNIX, AIX, Solaris): Errors are logged to
AIX, Solaris) or are
MixedCaseFile.txt.
easier to understand with
some upper case letters,
the exact case of each
character is displayed.
To compare documents, choose:
Menu Command Initial Caps, with a right
Tools > Documents > Compare.
Sequences angle bracket (>)
between items. Menu
items are displayed as
shown on screen.
URLs Sans serif font. http://www.compaq.com/storage
x Enterprise Virtual Array HSV Controller User Guide
About this Guide
Symbols in Text
These symbols may be found in the text of this guide. They have the following
meanings.
WARNING: Text set off in this manner indicates that failure to follow directions
in the warning could result in bodily harm or loss of life or damage to
equipment.
CAUTION: Text set off in this manner indicates that failure to follow directions could
result in damage to equipment or loss of information.
IMPORTANT: Text set off in this manner presents clarifying information or specific instructions.
NOTE: Text set off in this manner presents commentary, sidelights, or interesting points of
information.
Symbols on Equipment
Any enclosed surface or area of the equipment marked with these
symbols indicates the presence of electrical shock hazards. Enclosed
area contains no operator serviceable parts.
WARNING: To reduce the risk of injury from electrical shock hazards, do
not open this enclosure.
Any RJ-45 receptacle marked with these symbols indicates a network
interface connection.
WARNING: To reduce the risk of electrical shock, fire, or damage to the
equipment, do not plug telephone or telecommunications connectors into
this receptacle.
Enterprise Virtual Array HSV Controller User Guide xi
About this Guide
Any surface or area of the equipment marked with these symbols
indicates the presence of a hot surface or hot component. Contact with
this surface could result in injury.
WARNING: To reduce the risk of injury from a hot component, allow the
surface to cool before touching.
Power supplies or systems marked with these symbols indicate the
presence of multiple sources of power.
WARNING: To reduce the risk of injury from electrical shock,
remove all power cords to completely disconnect power from the
supplies and systems.
Any product or assembly marked with these symbols indicates that the
component exceeds the recommended weight for one individual to
handle safely.
WARNING: To reduce the risk of personal injury or damage to the
equipment, observe local occupational health and safety requirements
and guidelines for manually handling material.
Rack Stability
WARNING: To reduce the risk of personal injury or damage to the equipment, be
sure that:
The leveling jacks are extended to the floor.
The full weight of the rack rests on the leveling jacks.
Getting Help
If you still have a question after reading this guide, contact a Compaq Authorized
Service Provider or visit out website.
xii Enterprise Virtual Array HSV Controller User Guide
About this Guide
Compaq Technical Support
In North America, call the Compaq technical support at 1-800-OK-COMPAQ. This
service is available 24 hours a day, 7 days a week.
NOTE: For continuous quality improvement, calls may be recorded or monitored.
Outside North America, call Compaq technical support at the nearest location.
Telephone numbers for worldwide technical support are listed on the Compaq
website: http://www.compaq.com.
Be sure to have the following information available before you call Compaq:
Technical support registration number (if applicable)
Product serial numbers
Product model names and numbers
Applicable error messages
Operating system type and revision level
Detailed, specific questions
Compaq Website
The Compaq website has the latest information on this product as well as the latest
drivers. Access the Compaq website at: http://www.compaq.com/storage.
Compaq Authorized Reseller
For the name of your nearest Compaq Authorized Reseller:
In the United States, call 1-800-345-1518.
In Canada, call 1-800-263-5868.
Elsewhere, see the Compaq website for locations and telephone numbers.
Enterprise Virtual Array HSV Controller User Guide xiii
1
Introducing the HSV Series Controllers
This chapter describes the major features, purpose, and function of the HSV-series
controllers (see Figure 11). Each Enterprise Storage System has a pair of these
controllers (see 1, Figure 12 and Figure 13).
CXO7541A
Figure 11: HSV-series controller--front view
Enterprise Virtual Array HSV Controller User Guide 11
Introducing the HSV Series Controllers
1 Model 3220 Controller
Pair
(2 HSV110
3 Controllers)
Location 7
Enclosure Address 07
2 Disk Drive Enclosure
1 Locations 13
Enclosure Addresses
0103
3 Disk Drive Enclosure,
Locations 57
Enclosure Addresses
0810
2
CXO7619A
Figure 12: Six drive enclosure storage system--front view
12 Enterprise Virtual Array HSV Controller User Guide
Introducing the HSV Series Controllers
3 1 Model 3220 Controller
Pair
(2 HSV110
Controllers)
Location 7
Enclosure Address 07
2 Disk Drive Locations
16
1
Enclosure Addresses
0106
3 Disk Drive Locations
712
Enclosure Addresses
0813
2
CXO7620A
Figure 13: 12-Drive enclosure storage system--front view
Enterprise Virtual Array HSV Controller User Guide 13
Introducing the HSV Series Controllers
Controller Enclosure Features
The major controller features on the front of the controller (see Figure 14) are:
A removable bezel 1 that provides access to the blower compartment and the
cache battery assembly compartment.
The blower compartment 2 that contains two blowers that cool the controller.
The Operator Control Panel (the OCP) 3 that includes four status LEDs, a liquid
crystal display (LCD), and a four position pushbutton switch. By using the OCP
pushbuttons and the LCD, you can display information about the controller, and,
in some cases, enter controller operational data.
Located behind the OCP is a cache battery compartment, which contains two
lead-acid battery assemblies.
1 Bezel
2
2 Blower Compartment
3 OCP
NOTE: The cache battery
compartment is behind the
OCP.
3
1
CXO7566A
Figure 14: Major HSV controller components
On the rear of the controller (see Figure 15) are the data and power connections. The
data connections are the interface to the disk drive enclosures, the other controller, and
the fabric (host) or the Compaq SANworks HSV Element Manager.
CXO7543A
Figure 15: HSV110 controller--rear view
14 Enterprise Virtual Array HSV Controller User Guide
Introducing the HSV Series Controllers
High Availability Features
The HSV-series controllers ensure high availability of the Enterprise Storage System
in the following ways.
Controller Pairs
Mounting two interconnected HSV-series controllers ensures that the failure of a
controller element (such as a power supply, transceiver, fiber optic cable, Fibre
Channel port, and so forth) does not disable the system. The complete data
redundancy includes two Loop A and two Loop B data paths.
Even the failure of a controller power supply would not disable the system. A single
controller can fully support an entire system until the defective controller, or controller
element, is repaired.
The internal power supply provides the DC voltages required for controller operation.
The controller power supply is not field replaceable. If a power supply fails, you must
replace the affected controller enclosure.
Blowers
The two controller blowers are physically located in the left front of the controller
enclosure (see Figure 16).
CXO7542A
Figure 16: Controller blowers location
If a blower fails, you can replace it without shutting down the system.
Enterprise Virtual Array HSV Controller User Guide 15
Introducing the HSV Series Controllers
Cache Battery Assemblies
Each HSV-series controller has two lead-acid cache battery assemblies that provide
power to the cache memory dual in-line memory modules (DIMMs). Each battery
assembly has three lead-acid, nonspillable cells. When both battery assemblies are
fully charged, they can provide power to the DIMMs for up to 96 hours.
These cells are mounted in a plastic case, which is the battery assembly (see
Figure 17).
The orientation label is located in the upper left corner at the rear of the case.
The battery assembly amber status LED 1 is located in the lower right corner at
the rear of the case.
The battery assemblies are located in a compartment behind the OCP.
1 Battery Assembly
Amber Status LED
1
CXO7640A
Figure 17: HSV controller cache battery assembly
16 Enterprise Virtual Array HSV Controller User Guide
Introducing the HSV Series Controllers
OCP
The OCP (see Figure 18) is an interface between you and the controller. Much of the
information provided here duplicates information displayed on the Element Manager
graphical user interface (GUI). Even if you cannot observe the GUI, or if the GUI is
not functioning, the controller status is available on the OCP. You can use the OCP
LEDs, the LCD, and the pushbuttons to determine the controller status.
1 2 3
1 LED Status Displays
2 LCD
3 Control Pushbuttons
CXO7638A
Figure 18: OCP components
The function and operation of these displays and controls are described in Chapter 3,
"Controller Operations."
Element Replacement
The only customer replaceable units (CRUs) or elements, are the blowers, the
batteries, the transceivers, and the cables. The failure of any other controller element,
including the power supply, requires replacing the controller enclosure.
Enterprise Virtual Array HSV Controller User Guide 17
2
Setting Up an HSV-Series Controller Pair
During the initial installation of an Enterprise Storage System, you must set up the
controller pair. This chapter describes the processes and procedures for setting up the
controller pair.
NOTE: The OCP procedures that define other controller functions are described in Chapter 3,
"Controller Operations."
Setup Procedure Overview
The Enterprise Virtual Array Initial Setup User Guide provides detailed instructions
for applying power and connecting the system to the fabrics. Once these procedures
are complete, you can use the OCP to set up the controller pair. The controller pair
setup involves:
Entering the 16-character Node WWN
Entering the two-character checksum
Entering the optional system password
IMPORTANT: Completing these procedures on either HSV-series controller automatically
completes the procedure on the other controller.
Enterprise Virtual Array HSV Controller User Guide 21
Setting Up an HSV-Series Controller Pair
Using the OCP
To set up an HSV-series controller pair, you use the OCP to display information and
enter data.
1 2 3
1 Status LEDs
2 LCD
3 Pushbuttons
CXO7638A
Figure 21: OCP displays and controls
Displays
The OCP has LEDs and a liquid crystal display (LCD).
The status LEDs 1 indicate the internal status of the controller, as described in
Chapter 3, "Controller Operations." During initial setup, the status LEDs may not be
fully operational.
Each LCD 2 row displays 20 alphanumeric characters.
Startup Display
Resetting or applying power to the storage system controller pair creates the display
shown in Figure 22.
The first line defines the controller model number.
The second line is a series of asterisks.
An asterisk is displayed when one of the 20 startup procedures is successfully
completed. After completing all the startup procedures, the display changes, as
shown in Figure 23.
22 Enterprise Virtual Array HSV Controller User Guide
Setting Up an HSV-Series Controller Pair
HSV110 Startup
********************
Figure 22: Typical HSV110 controller startup display
Initial Setup Display
The Initial Setup display (see Figure 23) is active after the startup procedure is
complete.
Storage System Name:
Figure 23: Initial setup display
CAUTION: An Enterprise Storage System cannot operate properly with the Element
Manager until you enter a valid WWN (see "Node WWN".)
The Element Manager can enter a storage system name thereby establishing an
option for a system password.
You can use the Element Manager to create the Storage System Name; the OCP
simply displays it. This name is required for operation. Compaq recommends that
each storage system have a unique name to easily identify the different storage
systems.
Enterprise Virtual Array HSV Controller User Guide 23
Setting Up an HSV-Series Controller Pair
OCP Pushbuttons
The four OCP pushbuttons enable you to select and display different controller
information. In some cases you can enter data. The information you display or the data
you enter depends on the active LCD function.
To simplify presentation and to avoid confusion, the pushbutton reference names,
regardless of labels, are left, right, top, and bottom (see Figure 24).
Top Pushbutton
L
Right Pushbutton
eft Pushbutton
B
ottom Pushbutton
Figure 24: Pushbutton icons
Node WWN
Enterprise Storage System operations require that each controller pair have a unique
Node WWN. This 16-character alphanumeric name identifies the system on the World
Wide Web (WWW). Compaq assigns the WWN to each storage system prior to
shipment. The Enterprise Virtual Array World Wide Name Label document defines the
WWN for each storage system. The Node WWN labels, similar to the one shown in
Figure 25, specify the system-specific WWN and checksum.
CXO7545A
Figure 25: Sample Node WWN label
24 Enterprise Virtual Array HSV Controller User Guide
Setting Up an HSV-Series Controller Pair
CAUTION: The controller pair WWN is unique to a controller pair, and cannot be used
for any other controller pair or device anywhere in the world. Figure 26 shows the
location of the WWN label on a controller pair.
This is the only WWN applicable to any controller installed in a specific physical
location, even a replacement controller.
Once a WWN is assigned to a controller, it cannot be changed as long as that
controller is part of the same storage system.
CXO7601A
Figure 26: Node WWN label location
The requirements for entering the WWN are:
Applying power to the system
No Storage System name assigned
You must complete the procedures described in the section titled "Procedure for
Entering the WWN."
IMPORTANT: If you enter an incorrect WWN or checksum, the system will reject the data and
you must repeat the procedure.
Enterprise Virtual Array HSV Controller User Guide 25
Setting Up an HSV-Series Controller Pair
Procedure for Entering the WWN
Table 21 defines the pushbutton functions when entering the WWN or the WWN
checksum.
Table 21: WWN Pushbutton Functions
se this pushbutton to:
Select a WWN or checksum character by scrolling up through the
U character list one character at a time.
to
If you select an incorrect character, you can use either or
select the correct character.
se this pushbutton to:
Accept the current character and select the next character.
U you accept an incorrect character, you can move through all 16
If
characters, one character at a time, until you display the incorrect
character. You can then change the character.
se this pushbutton to:
Select a WWN or checksum character by scrolling down through
U the character list one character at a time.
to the
If you select an incorrect character, you can use either or
select correct character.
se this pushbutton to:
U
Accept all the WWN or checksum characters.
Complete the following procedure to assign the WWN to each pair of controllers.
CAUTION: Applying power to the rack when the controller power switches are on can
prevent proper controller initialization.
The following procedure will enter the WWN 5000-1FE1-0000-0000.
1. Place the power switches on both controllers to the Off position.
2. Apply power to the rack.
26 Enterprise Virtual Array HSV Controller User Guide
Setting Up an HSV-Series Controller Pair
3. On both controllers, place the power switch to On. HSV110 Startup
NOTE: This display may not occur for up to two minutes. ********************
4. The WWN entry display has a 0 in each of the Enter WorldWide Name
16 positions. 0000-0000-0000-0000
5. Press or u ntil the first character display is 5. Enter WorldWide Name
Press o accept this character and select the next.
t 5000-0000-0000-0000
6. Repeat Step 5 to enter the remaining characters Enter WorldWide Name
000-1FE1-0000-0000. 5000-1FE1-0000-0000
7. Press to enter the WWN and select the checksum Enter WWN Checksum
entry mode. 00
See the section titled "Procedure for Entering the WWN Checksum" for details.
Enterprise Virtual Array HSV Controller User Guide 27
Setting Up an HSV-Series Controller Pair
Procedure for Entering the WWN Checksum
The second part of the WWN entry procedure is to enter the 2-character checksum,
HS, as follows.
1. Verify the initial WWN checksum displays 0 in both Enter WWN Checksum
positions. 00
2. Press or u ntil the character H displays. Enter WWN Checksum
Press to accept H and select the second character. H0
3. Press or u ntil the second character displays S. Enter WWN Checksum
Press to accept the checksum and exit. H0
4. Verify that the default display is automatically Storage System Name:
selected. This indicates the checksum is valid.
Node WorldWide Name:
5000-1FE1-0000-0000
If you enter an incorrect WWN or checksum, the system will reject the data and you
must repeat the procedure.
IMPORTANT: An active (flashing) display, an error condition, or a user entry (pressing a
pushbutton) overrides the default display.
When none of these conditions exist, the default display appears after approximately
15 seconds.
This completes the mandatory procedures for setting up a controller. The Element
Manager entry of a storage system name usually requires you to complete the
procedures in the section titled "Procedure for Setting the Storage System Password."
28 Enterprise Virtual Array HSV Controller User Guide
Setting Up an HSV-Series Controller Pair
Procedure for Setting the Storage System Password
The eight-character, alphanumeric storage system password feature enables you to
restrict certain functions to selected Element Managers. Table 22 describes the
pushbutton functions when using the password feature.
Table 22: System Password Pushbutton Functions
se this pushbutton to:
Select a password character by scrolling up through the character
U list one character at a time.
If you select an incorrect character, you can use to select the
correct character.
se this pushbutton to:
Move from the default display to the system menu tree.
Move from the system password display to the password entry
U display.
Accept the current character and select the next character.
If you accept an incorrect character, you can loop through the display,
one position at time, to select the character to be changed.
se this pushbutton to:
Select a password character by scrolling down through the
U character list one character at a time.
If you select an incorrect character, you can use to the select
correct character.
se this pushbutton to:
U
Accept all the password characters.
Complete the following procedure to set the password using the pushbuttons as
described in Table 22.
Enterprise Virtual Array HSV Controller User Guide 29
Setting Up an HSV-Series Controller Pair
The following procedure will enter JWMfzJjP as the password.
1. Determine a unique, eight-character password using the letters upper- or lowercase
letters A through Z.
2. With either of the default menus (Storage System Name, or Node WorldWide Name)
displayed, press any pushbutton to select the menu tree.
3. Press to cycle through the displays until System Shutdown System
Password is active (flashing). System Password
Press to select the system password function.
4. When the System Password function is flashing: Change
Press to select the change password function. Clear
The default Enter Password function displays the Enter Password
default password, AAAAAAAA. AAAAAAAA
5. Enter the first character of the new password by pressing the or until J displays.
6. Press to accept this character and select the next character.
7. Repeat the process to enter the remaining password Enter Password
characters, WMfzJjP. JWMfzJjP
8. Press twice to enter the password and return to the Storage System Name:
default menu display.
Node WorldWide Name:
5000-1FE1-0000-0000
The controller pair setup is complete.
210 Enterprise Virtual Array HSV Controller User Guide
3
Controller Operations
This chapter is an overview of the HSV110 controller operations, including:
LED displays
Connectors
This chapter also describes the procedures for using the OCP to:
Display system information
Display condition messages
Change passwords
Shut down the system
IMPORTANT: This chapter does not discuss the procedures for entering the WWN or system
password. Chapter 2, "Setting Up an HSV-Series Controller Pair" describes these procedures in
detail.
Enterprise Virtual Array HSV Controller User Guide 31
Controller Operations
An Overview of the HSV-Series Controller
The HSV-series controller is the interface between the Element Manager and a storage
system. A storage system is composed of one HSV controller pair and either 6 or 12
disk drive enclosures. Each Model 3220 Controller consists of two HSV110
controllers (see Figure 31 and Figure 32).
CXO7636A
Figure 31: Model 3220 controller location--front view
CXO7637A
Figure 32: Model 3220 controller location--rear view
32 Enterprise Virtual Array HSV Controller User Guide
Controller Operations
Cabling
All data cables and power cables attach to the rear of the HSV controller (see
Figure 33). Adjacent to each data connector (see 4, 5, 6, 7, 8, 9, and -) is a
two-colored LED that defines the link status.
When the green LED is On, the link can communicate.
When the amber LED is On, the link cannot communicate.
IMPORTANT: These LEDs do not indicate whether there is communication on the link, only
whether the link can transmit and receive data.
NOTE: In Figure 33, the connectors are identified by the label printed on the controller. The
information in the parentheses defines the connector function.
1 CAB (Address Bus)
2 ART (Not Used)
3
3 UART (Not Used
4 FP 1 (Fabric Port 1)
5 FP 2 (Fabric Port 2)
6 MP (Multiport)
7 1B (Loop 1B)
2 4 5 6 7 8 9 10 11 12
1
8 2B (Loop 2B)
CXO7562A 9 1A (Loop 1A)
- 102a (Loop 2A)
q AC Power Switch
w AC Power Connector
Figure 33: HSV controller connectors--rear view
IMPORTANT: The cables between the controller and the disk drives use LC connectors on
both ends of the cable. The cable between the controller and a host have an LC connector on
the controller end and an SC connector on the host end. See the Release Notes for details
about this cable and how to order it.
Enterprise Virtual Array HSV Controller User Guide 33
Controller Operations
OCP Overview
The OCP (see Figure 34) displays system information (status, error conditions, and
so forth) and lets you enter data or isolate problems.
1 Status LEDs (see the
section titled "LEDs.")
1 2 3
2 40-character
alphanumeric display
(see the section titled
"LCD.")
3 Pushbuttons (see the
section titled
"Displaying the
Storage System
CXO7638A
Menu Tree.")
Figure 34: Controller OCP
LEDs
The status LEDs indicate the internal status of the controller, as described in
Table 31. During initial setup, the status LEDs may not be fully operational.
The following sections define the alphanumeric displays modes, including the
possible displays, the valid LED displays, and the pushbutton functions.
Table 31: Controller Status Icons and LEDs
Fault LED
When the amber LED to the right of this icon is On or Flashing,
there is a controller problem. Check either the Element Manager
GUI or the LCD Fault Management displays for a definition of the
problem and recommended corrective action.
Host Link LED
When the green LED next to this icon is On, there is a link between
the storage system and a host.
When the red LED next to this icon is Off, there is no link between
the storage system and a host.
Controller "Heartbeat" LED
When the green LED next to this icon is Flashing slowly, a
heartbeat, the controller is operating normally.
When this LED is not Flashing, there is a problem.
34 Enterprise Virtual Array HSV Controller User Guide
Controller Operations
Table 31: Controller Status Icons and LEDs (Continued)
Cache Battery Assembly LED
When the red LED next to this icon is Off, the battery assembly is
charged.
When this LED is On, the battery assembly is discharged.
Navigation Pushbuttons
The information displayed by the OCP, the data you can enter, and the navigation
pushbutton functions depend on the alphanumeric display mode.
To simplify presentation and to avoid confusion, the pushbutton reference names,
regardless of labels, are left, right, top, and bottom (see Figure 35).
Top Pushbutton
L
Right Pushbutton
eft Pushbutton
B
ottom Pushbutton
Figure 35: Navigation pushbutton icons
Enterprise Virtual Array HSV Controller User Guide 35
Controller Operations
LCD
The two LCD rows display up to 20 alphanumeric characters per row. The LCD
alternates between displaying the Storage System Name and the Node WorldWide
Name (see Figure 36).
IMPORTANT: An active (flashing) display, an error condition message, or a user entry
(pressing a pushbutton) overrides the default display.
When none of these conditions exist, the default display is active after approximately
15 seconds.
..
Storage System Name:
SCELL22MAY200111543
Node WorldWide Name:
5000-1FE1-0000-0000
Figure 36: Default LCD displays
Displaying the Storage System Menu Tree
The Storage System Menu Tree lets you select information to be displayed (for
example, System Information, Fault Management) or select procedures to implement
, , , or
(Shutdown System, System Password). To display this tree, press
when either of the default displays is active.
When you select either System Information or Fault Management, you can
display, but not change, product information.
Selecting Shutdown System lets you implement the procedure for shutting down
the system in a logical, sequential manner. Using the Shutdown System procedure
maintains data integrity and avoids the possibility of losing or corrupting data.
Selecting System Password lets you create a system password to ensure that only
authorized personnel can modify system operation and functions from the OCP.
Use the following procedure to select and navigate the storage system menu tree.
36 Enterprise Virtual Array HSV Controller User Guide
Controller Operations
1. The default display alternates between the Storage Storage System Name:
System Name display and the Node WorldWide Name SCELL22MAY200111543
display. Node WorldWide Name:
) to select
Push any pushbutton ( 5000-1FE1-0000-0000
the Storage System Menu Tree display.
2. System Information is the active display. System Information
Press to sequence down through the tree. Fault Management
Press to sequence up through the tree.
Press to select an active display. System Information
Press to select the default display Fault Management
Shutdown System
System Password
Shutdown System
System Password
Enterprise Virtual Array HSV Controller User Guide 37
Controller Operations
Displaying System Information
IMPORTANT: The purpose of this information is to assist the Compaq Authorized Service
Provider when servicing your system.
The system information displays show the system configuration including the virtual
controller software (VCS) version, the OCP firmware and application programming
interface (API) versions, and the enclosure address bus programmable integrated
circuit (PIC) configuration. You can only view, not change, this information.
When there is no activity for approximately 15 seconds, the display automatically
returns to the default display.
NOTE: Activity is either an active error report or pressing a pushbutton.
Table 32 defines the pushbutton functions.
Table 32: System Password Pushbutton Functions
se this pushbutton to:
Move from the Versions VCS display to the Versions OCP display
U
Move from the Versions OCP display to the Versions Address Bus
PIC display
se this pushbutton to:
U Move from the Versions OCP display to the Versions VCS display
Move from the Versions PIC display to the Versions OCP display
se this pushbutton to:
Move from the System Information display to the Versions VCS
display
U
Move from the Versions VCS display to the VCS detail display
Move from the Versions OCP display to the OCP detail display
Move from the Versions PIC display to the detailed PIC display
se this pushbutton to:
Move from the System Information display to the default display
Move from the Versions display to the System Information display
U
Move from VCS detail display to the Versions VCS display
Move from the OCP detail display to the Versions OCP display
Move from the PIC detail display to the Versions PIC display
38 Enterprise Virtual Array HSV Controller User Guide
Controller Operations
Versions System Information
, the active display is Versions. From the Versions display you can
When you press
determine the:
VCS (virtual controller software) revision level
OCP firmware revision level
PIC (programmable integrated circuit) firmware revision level for:
-- Address Bus PIC
-- Battery PIC
-- PowerPC Processor
-- Quasar
-- glue FPGA (field programmable gate array) PIC
-- Surge
NOTE: The PIC terms PowerPC Processor, Quasar, glue FPGA, and Surge are for
development purposes and have no significance for normal operation.
If the requested version information is not available, the display is always
. Use the following procedure to select and display System
Information.
NOTE: When viewing the software or firmware version information, pressing displays the
Versions Menu tree.
1. The default display alternates between the Storage Storage System Name:
System Name display and the Node WorldWide Name SCELL22MAY200111543
display. Node WorldWide Name:
Press any pushbutton to select the Storage System 5000-1FE1-0000-0000
Menu Tree display.
to go to step 3, VCS.
2. Press System Information
Press to select Fault Management. Fault Management
Enterprise Virtual Array HSV Controller User Guide 39
Controller Operations
3. Press to display the VCS version. Versions Menu
Press to go to step 4, OCP. VCS
4. Press to display the OCP versions menu. Versions Menu
Press to go to step 5, Address Bus PIC. OCP
5. Press to display the Address Bus PIC. Versions Menu
Press to go to step 6, Address Bus PIC. Address BUS PIC
6. Press to display the Battery PIC. Versions Menu
Press to go to step 7, PowerPC Processor. Battery PIC
7. Press to PowerPC Processor. Versions Menu
to go to step 8, Quasar.
Press PowerPC Processor
8. Press to display the Quasar version Versions Menu
to go to step 9, glue FPGA version.
Press Quasar
9. Press to display the glue FPGA version. Versions Menu
Press to go to step 10, surge PIC. glue FPGA
310 Enterprise Virtual Array HSV Controller User Guide
Controller Operations
to display the surge version.
10. Press Versions Menu
surge
Shutting Down the System
CAUTION: When powering off the system for more than 96 hours:
1. Use the Compaq SANWorks HSV Element Manager to power off the system.
2. Remove all batteries from the controllers when shutting down the system for more
than 36 hours.
When reactivating the system:
1. Power on the system.
2. Install the batteries.
You can use the shutdown system function to implement the following methods:
Restarting the system (see "Restarting the System" on page 314)
Turning off the power "Powering Off the System" on page 315).
Initializing the system "Initializing the System" on page 316)
To ensure that you do not mistakenly activate a shutdown procedure, the default state
is always NO, indicating do not implement this procedure. Implementing any
shutdown method requires you to complete at least two actions.
Table 33: Shutdown Methods
LCD Prompt Description
RESTART Implementing this procedure establishes communications
between the storage system and the Element Manager.
This procedure is used to restore the controller to an
operational state where it can communicate with the Element
Manager.
Enterprise Virtual Array HSV Controller User Guide 311
Controller Operations
Table 33: Shutdown Methods (Continued)
LCD Prompt Description
POWER OFF Implementing this procedure initiates the sequential removal
of controller power. This ensures no data is lost.
The reasons for implementing this procedure include
replacing a disk drive enclosure.
INITIALIZE Implementing this procedure will cause the loss of all data. For
a detailed discussion of this procedure, see the section titled
"Initializing the System."
Use the following procedure to select the Shutdown System display and execute a
shutdown procedure.
1. The default display alternates between the Storage Storage System Name:
System Name display and Node WorldWide Name SCELL22MAY200111543
display. Node WorldWide Name:
Push any pushbutton to go to step 2, System 5000-1FE1-0000-0000
Information.
2. Press to go to step 3, Fault Management. System Information
Fault Management
3. Press to go to step 4, Shutdown System. System Information
Press to select System Information. Fault Management
4. Press to go to step 4, Restart. Shutdown System
Press to go to step 3, Fault Management System Password
312 Enterprise Virtual Array HSV Controller User Guide
Controller Operations
5. Press to display the Restart menu. Restart
to go to step 6, Power Off.
Press Power Off
6. Press to display the Restart. Restart
Press to go to step 7, Initialize System. Power Off
7. Press to display the Initialize System menu. Power Off
Press to go to step 6, Power Off. Initialize System
Once you have selected the Shutdown System function, you can select and execute a
shutdown method as described in the following sections.
Enterprise Virtual Array HSV Controller User Guide 313
Controller Operations
Restarting the System
To restore the controller to an operational state, use the following procedure to restart
the system.
to go to step 2, Restart.
1. Press Shutdown System
System Password
to display step 3, RESTART SYSTEM NO.
2. Press Restart
Press to go to Power Off. Power Off
3. Press to accept NO and go to step 1. RESTART SYSTEM
Press to go to step 4; RESTART SYSTEM YES NO
4. Press to accept YES and to go to step 5, RESTART SYSTEM
HSV110 Startup. YES
5. No user input is required. The system will HSV110 Startup
automatically initiate the startup procedure and ********************
proceed to step 6.
6. The system automatically loads the Storage System Storage System Name:
name and Node WorldWide Name information from SCELL22MAY200111543
the operational controller. Node WorldWide Name:
5000-1FE1-0000-0000
314 Enterprise Virtual Array HSV Controller User Guide
Controller Operations
Powering Off the System
Use the following procedure to remove power from the controller pair, save the data,
and remove the storage system from the Element Manager
IMPORTANT: Implementing this procedure removes power from the controller pair and all
associated drive shelves. To restore power to the controller system, you must cycle both PDU
breakers in the enclosure.
1. Press to go to step 2, Restart. Shutdown System
System Password
to go to step 3, Power Off.
2. Press Restart
Power Off
3. Press to go to step 4, POWER OFF SYSTEM Restart
Press to select Initialize System. Power Off
4. Press to accept NO and go to Step 3. POWER OFF SYSTEM
Press to go to step 5, POWER OFF SYSTEM YES NO
5. Press to accept YES. POWER OFF SYSTEM
Press to select NO and return to step 4. YES
Enterprise Virtual Array HSV Controller User Guide 315
Controller Operations
Initializing the System
Initializing the system is another way to shut down the system. This action will cause
the loss of all storage system data. Since the Element Manager cannot communicate
with the disk drive enclosures, the stored data cannot be accessed. This destroys the
storage system and all the data.
CAUTION: Initializing the system destroys all user data. Any data stored on the
system will be permanently destroyed. The WWN will remain in the controller unless
| EK-E1HSV-UA
|
