Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Technical Manual
Version 1.3
Table
1. Technical Overview Titan 7240 Series General Description 2. Physical and Operational Specifications Product Specifications Dimensions Electrical Specifications Power Requirements SCSI Interface Fibre Channel Interface Ethernet Interface Serial Interface UPS Status Inputs Environmental Specifications Ambient Room Temperature Relative Humidity Ventilation Airflow Direction Agency Approvals Cache Specifications Queue Depth
of
Contents
1-1 1-1 2-1 2-1 2-1 2-1 2-1 2-1 2-1 2-1 2-1 2-2 2-2 2-2 2-2 2-2 2-2 2-3 2-4 2-4 3-1 3-1 3-1 3-2 3-2 3-2 3-3 3-3 3-3 3-3 3-5 3-5 3-5 3-5 3-6 3-7 3-7 3-7 3-7 3-8 3-9
3. Considerations Before Installation Storage Considerations Disk Drive Interface Requirements Fibre Channel Considerations Fibre Channel Type Cable Distance Fibre Channel Configurations Fibre Channel Topologies Point-to-Point Arbitrated Loop Arbitrated Loop with a Hub Hubs and Switches Hubs Fibre Channel Switch Power Considerations Power Management Strategy Power Protection for the CRD-7240 Power Protection with a site UPS or Series Connecting of UPS Systems Selecting a UPS Power Terminology UPS Sizing Guidelines
Connecting the UPS Status Cable to the CRD-7240 APC - Smart-UPS Intellipower Liebert - PowerSure Series Liebert - UPStation GXT Series MGE - EX Series MGE - ESV+ Series LVD SCSI Cabling Considerations LVD Bus Basics LVD Mechanical Structure EMI Control 4. CRD-7240 Installation and Integration Physical Installation CRD-7240 Components List CMD Interoperability Program & Qualified Components List (QCL) SNMP Support (MIB Information) Unpacking your CRD-7240 Installing DIMMs (Cache Memory) Installing the CRD-7240 into an enclosure Cabling the CRD-7240 Fibre Channel SCSI Serial or Ethernet Power (including UPS status connection) Cabling Order Backplane EMI Control 5. CRA-7240 Installation and Integration Physical Installation CRA-7240 Components List CMD Interoperability Program & Qualified Components List (QCL) SNMP Support (MIB Information) Unpacking your CRD-7240 Installing DIMMs (Cache Memory) Installing the CRD-7240 into an enclosure Cabling the CRD-7240 Fibre Channel SCSI Serial or Ethernet Power (including UPS status connection) Cabling Order Backplane EMI Control
3-10 3-12 3-12 3-12 3-13 3-13 3-14 3-14 3-15 3-15 3-17 4-1 4-1 4-1 4-2 4-2 4-2 4-3 4-5 4-5 4-6 4-7 4-7 4-8 4-8 4-9 4-9 5-1 5-1 5-1 5-2 5-2 5-2 5-3 5-5 5-5 5-6 5-7 5-7 5-8 5-9 5-9 5-9
6. VisionTM Storage Management Utility Software and Titan Firmware Vision Storage Management Utility Installation Users Manual and Storage Management Utility (SMU) Manual RMS Password and Initial Settings A. Appendix Updating Firmware Using Hyperterminal CRD-7240 Configuration Examples
1.
Technical
Overview
1-1
ment and eliminates the need for highly-trained personnel to be on call to reconfigure the subsystem should a failure occur. Fibre Channel and SCSI interface signals, power and control signals are interfaced through the backplane (CRA-7240 includes Fibre CHannel hubs which connect directly to the backplane). Redundant controller (failover) signals are interfaced through the frontplane. No additional cable connections to the controller are required.
1-2
Electrical Specifications
Power Requirements
CRA-7240 AC voltage input - 90 to 264 VAC - auto ranging Frequency - 47 to 63 Hz Power consumption 1 Amp @ 115 VAC Max 0.5 Amp @ 240 VAC Max CRD-7240 +5 VDC @ 10 Amps (redundant configuration), +12VDC @ 0.4 Amps ORD-7240 +5 VDC @ 10 Amps (redundant configuration)
SCSI Interface
Provides 4 LVD Ultra160 (160 MB/sec) SCSI ports Utilizes high density VHDCI (.8mm) SCSI connectors LVD terminators integral on the backplane
Ethernet Interface
10Base-T/ with RJ45 connection per controller board Half/Full Duplex operation User-defined IP address User-defined Gateway address
Serial Interface
RS-232 2-1
Presence
CMOS Input
Environmental Specifications
Ambient Room Temperature
Operating Non-operating Temperature Gradient 0 to 40 degrees Celsius -40 to 60 degrees Celsius 10 degrees Celsius/hour 10% to 85% (non-condensing) 5% to 90% (non-condensing)
Relative Humidity
Operating Non-operating
Ventilation
Enclosure must be adequately ventilated by ensuring front and back surfaces are not restricted.
Airflow Direction
Front to Back
2-2
Proper airflow is critical to maintaining performance. The following rules should always be obeyed: Never leave the front door panel (connected to the controllers) open longer than necessary to perform replacement of Field Replaceable Units (FRUs). Always ensure the controller front door panel is closed and secure when FRU replacement is complete. When the controller front door panel is open, airflow across the controller(s) is completely eliminated. This will result in elevated controller temperatures which may, over time, cause a system shutdown. When placing the CRD-7240 canister in the enclosure, there must be no obstructions in the airflow path. Regenerative heating should be avoided when possible. Preheated air exhausted from other equipment must not be drawn into the airflow.
Agency Approvals
When the CRD-7240 is installed in a properly-shielded enclosure, it, along with the CRA-7240 conforms to all Class A electromagnetic interference (EMI) emission standards as regulated by Note: The CRD-7240 front door panel must be the following agencies: installed to complete the RF shield across the front of the CRD-7240 canister. Federal Communications Commission (FCC) (USA) Voluntary Control Council for Interference (VCCI) (Japan) European Community (CE) (Europe) Bureau of Standards, Metrology and Inspection (BSMI) (Taiwan) This Class A digital apparatus mets all requirements of the Canadian Interference-Causing Equipment Regulations. Cet appareil numerique de la classe A respecte toutes les exigences du Reglement sur le materiel brouilluer du Canada. Refer to chapters 3 and 4 for EMI control information. Warning: This equipment has been tested and found to comply with the limits for Class A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance withthe instructions manual, may cause interference to radio communications. Operation of this equipment in a residential area is likely to cause interference in which case the user will be required to correct the interference at his own expense. The user is cautioned that changes and modifcations made to the equipment without the approval of the manufacturer could void the users authority to operate the equipment. It is suggested that the user use only shielded and grounded cables to ensure compliance with FCC Rules.
2-3
Cache Specifications
72-bit ECC SDRAM DIMM Standard Intel PC100 compatible except maximum overall module height: Capacity: tac at CAS latency of 2: Standard nomenclature: 1.38" 32 - 512MB 6 ns PC100-222-620
Queue Depth
Commands LUNs supports up to 64 commands per LUN supports up to 32 LUNs
2-4
3-1
Cable Distance
Certain physical requirements dictate the type of Fibre Channel cable and technology should be used. The length of cable between two Fibre Channel nodes is one of the most important considerations. The shorter the distance, the greater the options. While required Fibre Channel cable lengths are defined by ANSI, the following table serves as a guideline as to the cable distance and technology specified: Cable Type Copper (for CRD-7240) Copper (for CRA-7240) Optical (for CRA-7240) Technology 3-pin header (PTP) Passive Copper Active Copper HSSDC Shortwave Optical Longwave Optical Maximum Cable Length 13 meters 13 meters 30 meters 30 meters 500 meters 10 kilometers*
3-2
Point-to-Point
Point-to-Point is the simplest topology with two Ports (such as a Host and RAID controller) connected. This topology has limited applications and has no expansion capability. It can serve as a high speed interface between two points over long distances. The communication is full duplex so a 1 gigabit/second link delivers 200MB/s of dedicated bandwidth. Because no additional devices are necessary, a Point-to-Point configuration is a lower-cost solution.
Arbitrated Loop
Tx Traditional I/O channels are buses: tunnels that allow L_Port one thing through at a time. But in Arbitrated Loop topolRx ogy there are two connections between any two devices: the outbound half of the loop going from the transmitting device to the receiving device, and the inbound half going Tx from the receiver back to the sender and completing the L_Port Rx loop. These are actually physically separate connections, and Fibre Channel allows for separate communications being in process on each half at the same time. This capability, called full duplex communication, can be used to make Fibre Channel more efficient than traditional buses. A typical parallel SCSI subsystem can do about 15,000 to 19,000 single sector operations per second. An FC-interfaced subsystem using the same model drives can do 30,000 single sector operations per second for the same kind of I/O's, simply by taking advantage of this full duplex feature. Vendors are now delivering products with some degree of full duplex support. Rx Tx
L_Port
Rx Tx
L_Port
3-3
Five fundamental aspects of FC-AL architecture give it distinct advantages over other interface technologies: 1. Absolute device addressing. A subsystem developer can use either a worldwide unique address built into every FC device; or an absolute address based on the physical location into which the drive is plugged. In neither case does the drive address ever change during operation. Therefore, if an I/O request is queued in a peripheral, it can be executed and the results returned regardless of the status of any other device in the loop. 2. Multiple device failure support. FC-AL can tolerate any number of device failures, and can support fully hot-pluggable RAID on a single loop. It would be not fault-tolerant if the loop broke, but it could provide complete protection against loss of data, including the extra protection of a hot spare or even RAID "6" dual-level parity protection. Any number of drives can be added during operation as easily as a single drive can be added. 3. Transmission distance. FC-AL can connect to peripherals up to 10 km away. This makes possible instant mirroring of on-line storage at a remote site. This is particularly attractive to companies and organizations that are critically dependent on their data. If the primary system should fail (such as in an earthquake) the remote site would be immediately ready to take over processing because the data on the remote storage is always an upto-date copy of the data on the now-unusable primary system. 4. Non-adjacent communications. FC-AL devices are not limited only to communication with immediately-neighboring devices. This makes it easier to manage large, enterprise-wide configurations. With IPI-2, SMD or dual port parallel SCSI in mainframe configurations, it is common practice to have one adapter be the primary controller for some drives and the other for the remaining drives. FC-AL maintains and builds on this capability. 5. Parallel SCSI mechanical compatibility. FC-AL has built-in accommodation for hot-plugging, eliminating the power surge and arcing problems that plague power supply design in arrays. Particularly attractive to developers of parallel SCSI is the fact the drive can plug directly onto the backplane with no extra electronics in the drive chassis, reducing the drive hot-plugging problem to little more than a simple mechanical housing or pair of guide rails. Moreover, since Fibre Channel disk drives use a 40-pin version of the parallel SCSI SCA blindmate connector, a subsystem designed for parallel SCA can be adapted to Fibre Channel with no significant mechanical changes.
3-4
L_Port
Hub
Rx Tx Tx Rx Rx Tx
L_Port
Hubs
A hub is a network device used to guarantee the loop resiliency of an arbitrated loop, as shown in the above diagram. If a device fails on an arbitrated loop, the loop is broken and accessibility to all devices on the loop is lost. A hub prevents this problem by creating a star configuration similar to that which can be used with a LAN. Hubs use Port Bypass Circuits (PBCs) to detect when different devices are installed onto the network and then automatically assembles these devices into the loop. More importantly, hubs detect failures and automatically restructure the loop to bypass the down connection.
N_Port
N_Port
NL_Port
3-5
The Fibre Channel ANSI specification identifies classes of service which can be used to tailor the connection;
Ports Supported N_Port NL_Port E_Port FL_Port L_Port
1 2 3 4 6
is is is is is
a a a a a
dedicated connection service guaranteed delivery service datagram service, no guaranteed delivery guaranteed bandwidth service dedicated unidirectional service
The Fibre Channel switch has two methods of operation; frame and circuit switching. The frame switching method is used for class 2, 3 and 4 while circuit switching is used for class 1 and 6. The circuit switch is a physical connection between ports while the frame switch creates a virtual connection utilizing buffering between ports. The F_Port switch will support all topologies and can configure each port for point-to-point (Fabric port or F_Port) or loop operation (Fabric Loop port or FL_Port). This allows low -cost loop-only devices to become part of the Fabric (Public Loop).
Ports Not Supported
The Fibre Channel Switch is used for applications that require increased bandwidth, connections and delivery service beyond loop or point-to-point configurations. The switch is highly flexible and easily configured making it the choice for enterprise-level applications. When a node has data to transfer, it tells the switch which node it wants to send to. The switch makes the connection to the requested destination node, and the data is transferred. This occurs totally independent of any other data transfer activity: since each node has both transmit and receive ports, all nodes in a switch-based network can conduct data transfers at any time.
Power Considerations
All Titan RAID Controllers have a unique architecture that, in the event of a power failure, dumps the contents of its internal memory to a non-volatile hard disk. This ensures the data will be protected and available once power is restored. An Uninterruptible Power Supply (UPS) is required for all 7240 Series controllers. The UPS keeps the system powered long enough for the controller to write its internal memory to a specified area of a hard disk (usually no more than 5 minutes). The UPS provides a signal to the 7240 indicating line power has failed and informing the controller about the condition of the UPS batteries. Another Titan architecture power management benefit is that most UPS systems are highly reliable and have many sophisticated features like power line monitoring, data logging, early warning alarms, etc.
3-6
Power Protection
The 7240 must be connected to a UPS system to prevent data loss during a power failure. The UPS status inputs provide the 7240 system with early warnings regarding UPS conditions.
Selecting a UPS
When selecting an Uninterruptible Power Supply (UPS) there are many factors that must be considered. Geographical and physical location is an important factor as some areas are prone to certain types of power problems: Blackouts - a complete loss of power Sags (also called brownouts) - line voltage dips below the nominal voltage Surges - line voltage rises above nominal voltage Transients / Noise - distortions of the line voltage waveform It is a good idea to understand what types of problems are most common, how often they occur, and how long they last. Some UPS systems can handle a blackout well, but do not offer good protection from brownouts. Some buildings have backup generators or a site UPS, but a local UPS system is deemed necessary due to reliability or switching issues. The combination of a site UPS feeding a local UPS system can be unstable. In
3-7
these cases extra care must be taken to insure the local UPS is compatible with the larger system. Most good UPS systems have digital outputs to indicate that power has failed and alarm signals to indicate the state of the batteries. Many also have software included for monitoring the incoming AC Line for the above conditions and logging the data, shutting down computer systems gracefully, etc.
Power Terminology
Most UPS manufacturers rate their systems in Volt Amps (VA). Some also include a rating in Watts (W). There is an important difference between the two ratings. Power Factor (FP) is defined as the ratio of active power to apparent power. Apparent power is defined as the Root Mean Squared (RMS) value of the voltage waveform multiplied by the RMS value of the current waveform (expressed in VA). This is a measure of the total average power. The active power is defined as the RMS value of the voltage waveform multiplied by the RMS value of the "in-phase" component of the current waveform (expressed in W). This component of the power is responsible for producing the heat generated by electronic components. Note: These are approximate guidelines. Please use the disk drive and enclosure manufacturers' values for more exact power estimates. The Power Factor gives an indication of what fraction of the apparent power is due to the active power. A purely resistive load (such as a heater or light bulb) has a power factor of 1 (Power Factors can not be greater than 1). Electronic devices (such as switching power supplies) do not draw sinusoidal currents and usually have power factors on the order of (0.6 to 0.8). Example 1 Power Factor = 1 A 220V @ 1 Amp resistive heater will have an apparent power of 220VA and an active power of 220W. Example 2 Power Factor = 0.7 A switching power supply with a power factor of 0.7 and rated at 120VAC @ 4 Amps will have an apparent power of 480 VA and an active power of 480 * 0.7 = 336 Watts. Most UPS systems are not designed to deliver their full rated power (VA) into purely resistive loads. They are typically designed for power factors as low as 0.6. This means that a UPS rated for 400VA could only supply 240 Watts of active power.
3-8
Care must be taken that the load does not exceed either of the power ratings, the apparent power rating (VA) or the active power rating (W). Some UPS manufacturers do not give a specification of rated power in Watts. If the rating cannot be obtained, the worse case power factor of 0.6 should be used to calculate wattage rating. Example 3 A UPS system is rated at 1000VA and no active power is specified. It would be safe to assume that the active power rating is 600 W.
Equation for Total Watts (# Drives * 16W) + (# 5" Fans * 12W) + (#3.5" Fans * 6W) + (Enclosure) + (60W 7240 Series) = Total Watts
3-9
Take the sum of all the UPS powered drives, fans, enclosure power and the 60W required by the 7240. The result is the continuous power required by the RAID subsystem. If the host or any other loads are connected to the same UPS, this additional power requirement must be included. Total the number of drives in each enclosure, then multiply the number of drives by 16 Watts. Add about 12W for each 5 axial cooling fan, and use 6W for each 3.5 axial or small squirrel cage fan. Add another 5W for any local drive enclosure displays or environmental controller. Add the sum of all the UPS-powered drives, fans, and enclosure power to the 60W required by the CRD-7240. Example x10 Drives, x2 5" Fans, 5W Enclosure Electronics (10 * 16W) + (2 * 12W) + (5W) + (60W) = (160W) + (24W) + (5W) + (60W) = 249 Watt Load At this point the size of the UPS may be determined. The active power that the UPS will need to supply has been calculated in Watts. If the UPS manufacturer only provides a Volt Amp (VA) rating, the power calculated is converted to VA by dividing the active power (Watts) by the worse case power factor of 0.6. Example The required power in VA = 249 Watts / 0.6 = 415 VA Load Example The minimum VA rating for the UPS = 415VA * 1.25 = 519VA Rated UPS minimum. Current estimates place the CRD-7240 shutdown time at about 5 minutes worst case. A typical hold up time for a Note: A UPS should not be operated at more than UPS is about 12 inutes at a 60 to 80% 80% of its rated capacity as this will cut its run time load. Actual UPS holdup time will vary by more than 50%. Be conservative when deterfrom one manufacturer to another so make mining UPS requirements. sure this time is a guaranteed minimum time, not a theoretical maximum.
(An adapter cable is supplied to interface the CRD-7240 backplane to the DB9 bulkhead connector on the disk enclosure.) The type of UPS interface used on the 7240 is commonly called an "AS400" interface by many UPS vendors. The required UPS port signals for the CRD-7240 are: Pin Number Signal Pin 2 (CRD) AC Fail Pin 2 (CRA DB-9) Description Active low connection indicating the loss of AC input power to the UPS. This signal is a 3.3V CMOS input with a 10K pull-up resistor to 3.3Volts. This signal will be shorted to ground by the UPS when the input AC power to the UPS is removed. Pin 4 (CRD) Presence Pin 3 (CRA DB-9) Active low connection indicating the presence of a UPS. This signal is a 3.3V CMOS input with a 10K pull up resistor to 3.3 Volts. This signal will be shorted to ground by the UPS when the cable is connected to the UPS. It is not recommended to use a shield or AC ground for this signal as the UPS may not connect these signals to DC ground internally. The presence signal may be connected to any normally closed side of one of the other signal relays to make a connection to ground. (This is because presence is assumed true because of the redundant connection created by any other UPS alarm condition). This is the signal ground between the UPS and the CRD-7040. Active low signal used to indicate the UPS batteries are almost exhausted. This signal is a 3.3V CMOS input with a 10K pull-up resistor to 3.3 Volts. This signal will be shorted to ground by the UPS when the backup battery has about two minutes of power left.
Pin 3 (CRD) Signal Ground Pin 4 (CRA-DB-9) Pin 1 (CRD) 2 Min. Warning Pin 5 (CRA DB-9)
UPS
CRD-7240
UPS Cable
UPS Conn.
CRD-7240 UPS Cable Diagram P2 UPS Backplane, 4-pin (Amp 102241-2 (4-pin polarized housing))
AC_Fail Input Presence Input Ground Low Batt Input (2 min. Alarm)
2 4 3 1
3-11
Cabling Instructions for Various UPS Systems for 7240 Series Controllers
Note: Systems capable of series connection are so indicated. Pins that are not shown are not connected (open). The following diagrams detail the connections for the cable from the enclosure backplane to each specific UPS.
APC - Smart-UPS
Model numbers: SU700RMNET, SU1000RMNET, SU1400RMNET, SU2200RM3U, SU3000RMSU. Caution: When using an APC UPS, the UPS SelfTest must be disabled. APC units must be equipped with the optional Smartslot relay I/O module, AP9610.
UPS Connector, DB25 (male) 1 24 23 2 15
Low Batt Input AC_Fail N.O. Ground Ground AC_Fail COM Low Batt COM
2 3 4
14
Intellipower
*** Suitable for series connection *** Model numbers: IQ-650, IQ-800, IQ-1100, IQ-1500
7000 Series UPS Interface, 9-pin DB9 (female)
AC_Fail Input Presence Input Ground
2 3 4
14
3-12
2 3 4
11
2 3 4
11
3-13
MGE - EX Series
Model numbers: EX10, EX15, EX20, EX30. MGE Systems must be equipped with the 8902AS Relay Interface Card option.
2 3 4 5
2 3 4 5
3-14
3-15
Connectors Since all connectors used for SCSI appear as impedance discontinuities the only hope of improving their performance is to reduce the size or number of them on the bus. To reduce the quantity of connectors avoid splitting the bus among multiple (split bus backplane) enclosures. Check the enclosure manufacturer for segmented backplanes or other connector intensive solutions. While cable loops between the drive bays improve the node spacing issue, they tend to have many more connectors on the bus. To reduce the physical size of the connector, the .8mm VHDCI connector standard can be used as a smaller, less distorting interface. Wire The most important factor in a quality SCSI cable is the wire itself. Consistent impedance is the best indicator of quality. After testing many different samples of LVD cable, one can easily see the difference between a low and high quality cable based on impedance variation. To meet the demands of LVD SCSI it is recommended that only cable suppliers listed below be used. Recommended Cable Types and Connectors Testing done by Silicon Image, CMD Storage Systems indicates that cables manufactured by Madison Cable Corporation and C&M, and connectors manufactured by Honda, are significantly better than the other vendors tested. Madisons UniversalTM SCSI Cable series of products meet the requirements for LVD as well as Single-ended and HVD configurations. While other vendors may list the same AWM style number or UL Style Number, they are not necessarily the same quality. Other cable suppliers will be qualified as they become available. The following are some sample part numbers: Sample Madison Part Numbers P/N 68KBK00045 P/N 68KBK00046 P/N 68KBK00048 P/N 68KBK00049 P/N 57317 Madison - 34 pair 30AWG Stranded Universal SCSI Cable Madison - 34 pair 30AWG Solid Universal SCSI Cable Madison - 34 pair 28AWG Solid Universal SCSI Cable Madison - 34 pair 28AWG Stranded Universal SCSI Cable C&M SCSI 160 Cable - AWM Style 20276 - AWM Style 20276 - UL Type CL2 / FT4 - UL Type CL2 / FT4
Cable with solid conductors are more fragile and should only be used in applications where the cables will not be subject to excessive mechanical stress.
3-16
3-17
3-18
Physical Installation
CRD-7240 Components List
The standard CRD-7240 includes the following already installed: 1 - CRD-7240 Chassis canister with either black or beige front door panel (including 2 fans) 1 - or 2 - (depending on configuration) Controller Boards (including Fibre Channel Daughter Boards) 1 - Frontplane (on dual controller configuration only) Included but not installed: 1 - Accessory Kit which includes: 8 - #6-32 x 3/16 (pan head, Phillips) Mounting Screws 1 - CD-ROM with SMU application and PDF files of the Users Manual and SMU Manual 3 - Serial cables for communication (2 intra-enclosure, 1 external) 1 - UPS Status Cable (intra-enclosure) Not included but necessary (must be customer supplied): Cache memory (DIMMs) SCSI Terminators (LVD) SCSI Cables Fibre Channel Cables Power Cables UPS Cables (external, customized for chosen UPS) Ethernet Cables (if applicable for communications) For information regarding necessary components that are not included, see CMD Interoperability Program & Qualified Components List (QCL) on following page.
4-1
CMD provides a fully compliant MIB for use with SNMP. The MIB can be downloaded from each Titan Controller product page inside the Partners Access portion of the CMD website, www.cmd.com.
4-2
CAUTION: DIMM modules can be destroyed by elecThe CRD-7240 is not shipped with memtrostatic discharge (ESD). Observe all anti-ESD ory factory installed. The cache on the shop practices before touching a DIMM module. CRD-7240 controller board uses one or two standard DIMMs, allowing for up to 1 gigabyte of read/write memory (0.5 gigabyte when mirrored). In a single controller configuration, you may install one DIMM or two as necessary, but the inside slot (J9) must be populated first. In a dual-controller configuration, Mirrored Caching is enabled. This requires equal amounts of memory to be installed in both Cache 0 (J9) and Cache 1 (J10) on each board. Additionally, for the controller boards to bind successfully, both boards must have the same amount of memory installed. DIMM Installation 1. Open and remove front door panel by gently pulling down the front panel latch lever located to the right of the System Status indicators. This unlocks the front door panel from the canister allowing the front door panel to be opened. Then disengage the hinge tabs on the left side of the front door panel from the slots in the CRD-7240 canister. Finally, remove the front door panel.
3. Gently pull handle forward and down. This will disengage the controller board from the backplane connectors. DO NOT FORCE. Let the handle do the work.
4-3
5. After removing the controller board from the CRD-7240, make sure that the ears on the DIMM slots are in the open position.
6. Insert DIMM module into slot for Cache 0 (J9). Pushing the DIMM module all the way into the slot automatically closes the ears. Ear Closed 7. Insert the same amount of DIMM into slot for Cache 1. (This is mandatory for dual controller configuration, but is optional for a single controller.) 8. Slide controller board completely into canister until handle engages. Ear Open 9. Gently push handle up and back. This will engage the backplane connectors and lock the controller board into place. The handle should smoothly lock into place with no excessive force required. If excessive force appears necessary, pull controller board back two inches and then slide it back in. 10.If this is a dual controller configuration, repeat steps 3 through 9 for the second controller board. 11.If this is a dual controller configuration, install the frontplane by sliding the guideposts into the guides and pushing frontplane until engaged. 12.Replace the front door panel by first placing the hinge tabs on the left side of the front door panel into their respective slots in the CRD7240 canister. Swing the front door panel into place until the latch tab on the front panel latch lever locks the door in position. Make sure that the latch is completely flush with the Caution: When CLOSING the front door front panel side. This will engage the panel, DO NOT hold the front panel front panel circuit board connectors to latch in the open position. their connections on the Controller Board(s) and the cooling fans should start running. DO NOT FORCE.
4-4
.82
9.78 6-32 MOUNTING HOLES 6-32 MOUNTING HOLES 8 PLACES 8 PLACES (4 EACH SIDE) 3.12 AVERAGE SERVICE LOOP
3.40
1.67
.86
2.06
3.13
Tools Required Installation of the CRD-7240 into an enclosure requires the 8 supplied mounting screws, a small Phillips head screwdriver, and a grounding wrist strap. 1. Remove enclosure covers in accordance with enclosure manufacturer instructions. 2. If necessary, install bulkhead connector for CRD-7240 IntraEnclosure UPS Cable (see page 3-11). 3. Slide CRD-7240 into selected enclosure drive bay. 4. Use a Phillips head screwdriver to install eight #6-32 x 3/16 mounting screws. Caution: Screws driven into the CRD-7240 sides shall be no longer than 3/16. Longer screws can make it impossible to remove FRUs, or may damage the circuitry inside the CRD-7240.
4-5
Fibre Channel
Every CRD-7240 controller includes a Fibre Channel daughter board. Each daughter board supplies two Fibre Channel ports, 0 and 1. The connectors for each Fibre Channel port are located on the backplane and comprised of both a transmission (Tx or Out) and a reception (Rx or In). Refer to the backplane diagram for Fibre Channel port layout. A Fibre Channel cable will need to have two 3-pin header connectors (PTP) on one end, and will combine the receive and transmit signals into one DB-9 connector on the other end to be mounted to the enclosure bulkhead. SCSI CH5 Ethernet LAN0 Fibre Channel C0 & C1 SCSI CH2 UPS Status Input Power Input
Serial Port 0
SCSI CH3
The Fibre Channel 3-pin header connectors Transmit (Tx) and Receive (Rx) designations on the controller backplane are with respect to the CRD7240. The cable, on the other hand, may be labeled with respect to either the controller OR the device end. It is critical for the proper operation of the CRD-7240 to understand how the cable was labeled, either with respect to controller or the device end. Caution: Fibre Channel cables need to be carefully sized. Do not use excessively long Fibre Channel cable as the extra cable in the enclosure will inject EMI causing noise in the other interfaces.
For example, if the cable were labeled with respect to the device end, then the cable labeled Transmit will connect to the controller backplane connector labeled Receive (Rx). But if the cable were labeled with respect to the controller, then the cable labeled Transmit will connect to the controller backplane labeled Transmit (Tx).
SCSI
The CRD-7240 has four SCSI channels at ports 2, 3, 4 and 5 (see backplane diagram). Each channel can accommodate up to 14 SCSI drives. Each SCSI bus must be terminated with an LVD terminator on the end of the bus away from the CRD-7240. The CRD-7240 has an internal terminator on the backplane (see page 3-1). Although technology continues to improve, length of cable (especially SCSI) should always be considered. It is always best to use as short a cable as possible. In any case, the maximum cable length is 12 meters.
Rx C0-CH0 Tx C0-CH1
Tx
CH2
Rx
Rx C1-CH0
Tx
CH3
Rx C1-CH1
Power Inputs
Tx
CH2
= Pin #1
4-7
Because each SCSI channel supports up to 14 SCSI drives, the cabling may or may not be completely intra-enclosure, depending on the needs of the end user and the capacity of the enclosure. A SCSI bus may include cabling to the enclosure bulkhead to allow additional drives to be used.
Serial or Ethernet
The RMS workstation communicates to the CRD-7240 through either two (for redundancy purposes) Serial Comm or Ethernet ports. The intraenclosure serial cables used from the Note: When dressing the cables inside the enclosure, backplane to the bulkhead are included, keep the Serial or Ethernet cables apart from the along with one serial cable for use from Fibre Channel cables as much as possible. the bulkhead to the workstation. For Ethernet, use typical Ethernet cables with RJ45 telephone-type jacks. If the workstation has only one available Ethernet connection, then it may be necessary to use an Ethernet hub to connect the two Ethernet cables from the controller to a single Ethernet cable to the workstation.
4-8
Cabling Order
Because the initial cabling should be completed before turning on any power to the CRD-7240 or any component, there is no set pattern as to order of cabling.
Backplane
With the exception of failover communications between the two controllers in a dual-controller configuration, all power and control signals are interfaced through the backplane.
EMI Control
The front panel display provides an EMI curtain for the front of the controller assembly. This front shield is provided by the front panel display PCB to the outer enclosure through connections between the copper fingers around the perimeter of the display. The fan door on the inside of the front panel display has a conductive gasket attached to the PCB to complete the shield behind the cooling fans. As with any high-speed multi-bus controller, the potential for driving noise into the chassis and out on the interface cables is very real. To avoid problems, use good shielding techniques on the entire enclosure. Many installations might shield the controller adequately, but fail to close the 6" slots between drive bays in the same enclosure. All cables leaving the enclosure must be attached to bulkhead connectors mounted to the enclosure wall. These bulkhead connectors must tie to the cable shields for
4-9
both the internal and external cables for all Fibre Channel and SCSI busses.
4-10
Physical Installation
CRA-7240 Components List
The standard CRA-7240 includes the following already installed: 1 - CRA-7240 enclosure with either black or beige controller front door panel (including 2 fans) 1 or 2 - (depending on configuration) Controller Boards (including Fibre Channel Daughter Boards) 1 - Frontplane (on dual controller configuration only) 2 - Power Supplies 2 - Fibre Channel Hubs or DB-9 Interface boards Included but not installed: Accessory Kit which includes: 4 - #10-32x6.33mm (pan head, Phillips) Bracket Screws 4 - #10-24x12.7mm (pan head, Phillips) Rail Mounting Screws 1 - CD-ROM with SMU application and PDF files of the Users Manual and SMU Manual 1 - Serial cable for communication 2 - Cable clamps Not included but necessary (must be customer supplied): Cache memory (DIMMs) Fibre Channel GBICs (if applicable) SCSI Terminators (LVD) SCSI Cables Fibre Channel Cables Power Cables UPS Cables (external, customized for chosen UPS) Ethernet Cables (if applicable for communications) For information regarding necessary components that are not included, see CMD Interoperability Program & Qualified Components List (QCL) on following page.
5-1
5-2
CAUTION: DIMM modules can be destroyed by elecThe CRA-7240 is not shipped with memtrostatic discharge (ESD). Observe all anti-ESD ory factory installed. The cache on the shop practices before touching a DIMM module. CRA-7240 controller board uses one or two standard DIMMs, allowing for up to 1 gigabyte of read/write memory (0.5 gigabyte when mirrored). In a single controller configuration, you may install one DIMM or two as necessary, but the inside slot (J9) must be populated first. In a dual-controller configuration, Mirrored Caching is enabled. This requires equal amounts of memory to be installed in both Cache 0 (J9) and Cache 1 (J10) on each board. Additionally, for the controller boards to bind successfully, both boards must have the same amount of memory installed. DIMM Installation 1. Open and remove controller front panel by gently pulling down the front panel latch lever located to the right of the System Status indicators. This unlocks the front door panel from the canister allowing the front door panel to be opened. Then disengage the hinge tabs on the left side of the front door panel from the slots in the CRA-7240 removing the controller front door panel.
Lever
2. Remove frontplane (if dual controller configuration) by pulling straight out. Frontplane
3. Gently pull handle forward and down. This will disengage the controller board from the backplane connectors. DO NOT FORCE. Let the handle do the work.
5-3
5. After removing the controller board from the CRA-7240, make sure that the ears on the DIMM slots are in the open position.
6. Insert DIMM module into slot for Cache 0 (J9). Pushing the DIMM module all the way into the slot automatically closes the ears. Ear Closed 7. Insert the same amount of DIMM into slot for Cache 1. (This is mandatory for dual controller configuration, but is optional for a single controller.) 8. Slide controller board completely into canister until handle engages. Ear Open 9. Gently push handle up and back. This will engage the backplane connectors and lock the controller board into place. The handle should smoothly lock into place with no excessive force required. If excessive force appears necessary, pull controller board back two inches and then slide it back in. 10.If this is a dual controller configuration, repeat steps 3 through 9 for the second controller board. 11.If this is a dual controller configuration, install the frontplane by sliding the guideposts into the guides and pushing frontplane until engaged. 12.Replace the controller front door panel by placing the hinge tabs on the left side of the front door panel into their respective slots. Swing the front door panel into place until the latch tab locks the door in position. Make sure that the latch is completely flush with the front panel side. This will engage the front panel circuit board connectors to their Caution: When CLOSING the front door connections on the Controller Board(s) panel, DO NOT hold the front panel and the cooling fans should start running. latch in the open position. DO NOT FORCE.
5-4
Lock button
Power Cables
The CRA-7240 comes with 2 power cables flexible enough to be easily routed below the handle of the bottom power supply, through Cable Clamp #1, and out the back of the unit. Note: Cable clamps do not ship installed and may be placed where ever the user desires. The following position is recommended.
Fibre Channel
The CRA-7240 comes with two hub boards (either GBIC Copper, GBIC Optical or HSSDC), or 2 DB-9 Host Interface cards, depending on which configuration was purchased. If a GBIC version of the hub board was purchased, the GBICs will have to be installed. This is done by simply sliding the GBIC into the opening until a connection is made. Fibre Channel cables should be routed through Cable Clamp #2, and out the back of the unit.
Cable Clamp #2
Cable Clamp #1
5-5
SCSI
The CRA-7240 has four SCSI channels at ports 2, 3, 4 and 5. Each channel can accommodate up to 14 SCSI drives. Each SCSI bus must be terminated with an LVD terminator on the end of the bus away from the CRA-7240. The CRA-7240 has an internal terminator on the backplane. SER 0 SER 1
LAN 0
CH. 5
CH. 3
LAN 1 CH. 4
CH. 2
UPS 0 UPS 1
Although technology continues to improve, length of cable (especially SCSI) should always be considered. It is always best to use as short a cable as possible. In any case, the maximum cable length is 12 meters.
Serial or Ethernet
The VisionTM Storage Management Utility (SMU) workstation communicates to the CRA-7240 through two (for redundancy purposes) Serial Comm or Ethernet ports. For Ethernet, use typical Ethernet cables with RJ45 telephone-type jacks. If the workstation has only one available Ethernet connection, then it may be necessary to use an Ethernet hub to connect the two Ethernet cables from the controller to a single Ethernet cable to the workstation.
5-6
The UPS cable from the backplane to the UPS must be specially made (see pages 3-6 through 3-14).
Cabling Order
Because the initial cabling should be completed before turning on any power to the CRA-7240 or any component, there is no set pattern as to order of cabling.
EMI Control
The controller front display panel provides an EMI curtain for the front of the controller assembly. This front shield is provided by the front panel display PCB to the enclosure through connections between the copper fingers around the perimeter of the display. The fan door on the inside of the front panel display has a conductive gasket attached to the PCB to complete the shield behind the cooling fans. The backplane is enclosed in an EMI shield as well. The metal front door in front of the power supplies and Fibre Channel hubs may be removed without impeding EMI performance.
5-7
5-8
Vis
Vision
CMD Storage Systems
Installation Disk including Manuals
)
TM
The platform must have the following Java Runtime Environment (JRE) installed: JRE v1.3.0 or higher
Please refer to the specific operating system manufacturer for more information on how to obtain the JRE for your platform. The CD-ROM contains the following folders and files: Install - Installation executables for all platforms Manuals - Product Manuals (including SMU) Readme.htm - HTML readme file
The readme file outlines the install procedure in detail for each platform.
6-1
6-2
A .
Updating Firmware Using Hyperterminal
It is strongly recommended that updating firmware be performed using RMS and the System ! Update Firmware feature. However, in cases where during the upgrade a power loss occurred causing a corruption of the CMD Titan RAID controller firmware, or where a corrupted file was uploaded to the controller, it may be necessary to perform this procedure. If so, here is a step-by-step procedure for upgrading CMD Titan RAID controller's firmware using the serial port connection and the HyperTerminal interface. 1. Ensure that your Desktop/Laptop PC is properly connected to the CMD Titan RAID Controller you wish to upgrade. There are two serial connections on the rear of the CMD Titan RAID controllers. One of the connections is for controller A and one of the connections is for controller B. The serial connections on the CMD Titan RAID Controllers require a NULL modem cable to function properly. 2. Properly power down the controller you are upgrading. With RMS select System ! Shutdown 3. Bring up HyperTerminal on your Desktop/Laptop PC and configure for the proper communications port "Connect using: Direct to COM1 or Direct to COM2 ". Set the configuration to 9600, 8, None, 1 and Xon/XOff. See the pictures below.
A P P E N D I X
A-1
4. Restart the controller you wish to upgrade, by powering the controller off then back on. 5. When the controller restarts the following lines will appear on the screen. As soon as text appears, hit <Ctrl-C> three or four times to prevent booting into the firmware code. This will stop the controller at the Boot> prompt. %Boot-I-Init, Initializing CRA-7280 %Boot-I-Post, Testing...A01234B012345CD012345EF012345GHIJKL If you performed the <Ctrl-C> functions properly, the following output should be displayed. %Boot-I-Init, Initializing CRA-7280 %Boot-I-Post, Testing... A01234B012345CD012345EF012345GHIJKL %Boot-I-Startup, Loader Rev 1.5.0, Copyright (c) 1999 CMD Technology Inc. %Boot-I-LoadSkipped, Stopping in Bootloader: ^C entered. Boot> If the <Ctrl-C> function was not performed properly, the controller will not enter the Boot Utility. If this happens repeat steps 3-5. 6. At the "Boot>" prompt, enter the following line followed by the <enter> key. The following command will run the FMU (FLASH Management Utility). Boot> SET:IMG{IMAGE=3}
A-2
7. At the "Enter option:" prompt, select option "1" (Download and program FLASH image) followed by the <Enter> key. The following screen will appear.
8. At this point select the baud rate to be used during the uploading of code to the CMD Titan RAID controller. In this example, select "1" (115200) followed by the <Enter> key. The following line "Change baud rate. Type any key to continue." will appear. See picture below.
A-3
9. Before typing any key to continue, it is necessary to change the HyperTerminal baud rate to match the selection made in step #9 above. At the top of the HyperTerminal window, select File ! Properties. In the "Properties" window, select "Configure". In the "COM2 Properties" window, change the baud rate to "115200". Select "OK" in the "COM2 Properties" window and then select "OK" in the "Properties" window. You must now disconnect and re-connect to the communications port. Select Call ! Disconnect and then Call ! Call and enter the name that was entered when HyperTerminal was first started. See pictures below.
10. Now that the baud rate at the CMD Titan Controller and the HyperTerminal match, hit any key to continue. The following line "Ready to download image - enter ^C to ABORT" will appear on the screen. See picture below.
A-4
11. In order to start the transfer, the file must be selected. At the top of the HyperTerminal window, select Transfer ! Send Text File. This will open a "Send Text File" window, which will allow you to locate the file to be uploaded. In the box next to the phrase "Look in:" , select the directory where the firmware code is located. In the box next to the phrase "Files of type:", select "All files (*.*)". The Titan Firmware will have an extension of ".rec". When the file has been selected, click on "Open" to start the transfer. See picture below.
The following three characters will alternate on your screen to indicate that the transfer is in progress. ( / - \). When the transfer is complete, the following lines will appear to indicate a successful transfer. See picture below.
A-5
12. Before typing any key to continue, repeat step # 10, and change the HyperTerminal baud rate back to 9600 (make sure the disconnect and re-connect is performed). When done changing the HyperTerminal baud rate back to 9600, hit any key to continue. The screen will display the "Current layout of FLASH" and prompt with the following question: Enter starting FLASH sector number to be programmed (^C to erase sectors): Since we are updating the Firmware version 2.0.4, in the sectors column of the display, it shows that firmware uses sectors 4-20. Answer the above question with "4" and hit the <enter> key. The following lines will appear: Overwrite image: Firmware version: 2.0.4 with image: Firmware version: 2.00.4 ? (y/n): Respond to the above question with "y". When you hit the <enter> key, the FLASH will erase and load the new code. When the FLASH is done updating, it will prompt you to "Type any key to return to menu". See picture below.
A-6
13. After hitting any key and returning to the menu, at the "Enter option:" prompt, select "4" (Restart controller). The following question will appear: Are you sure you want to restart the CRA-7280 (y/n): Answer "y" to this question and hit the <enter> key.
A-7
A-8
Host
Fibre Channel HBA Fibre Channel HBA
Host
Fibre Channel HBA
Host
Fibre Channel HBA Fibre Channel HBA
T
Backplane
0
FCAL
1
FCAL
T
Backplane
T
Backplane
0
FCAL
1
FCAL
Failover Bus
0
FCAL
1
FCAL
0
FCAL
1
FCAL
Failover Bus
0
FCAL
1
FCAL
Up to 56 Ultra160 SCSI disk drives Up to 56 Ultra160 SCSI disk drives Up to 56 Ultra160 SCSI disk drives
Enclosure w/bulkhead connectors
Host
Fibre Channel HBA
Host
Fibre Channel HBA
Host
Fibre Channel HBA Fibre Channel HBA
Host
Fibre Channel HBA Fibre Channel HBA
T
Backplane
T
Backplane
0
FCAL
1
FCAL
Failover Bus
0
FCAL
1
FCAL
0
FCAL
1
FCAL
Failover Bus
0
FCAL
1
FCAL
A-9
Configuration Example 1
The following is a non-redundant CRD-7240 configuration example of a single host with a single FCAL HBA connected to one of the CRD-7240's Fibre Channel loop ports. In this point-to-point configuration, should controller, HBA or Fibre Channel cable fail, data access to the host is lost. Optionally, denoted by dotted lines, a second FCAL HBA may be added to connect to the second FCAL loop port on the CRD-7240. In this optional configuration, if an HBA or Fibre Channel cable fail, data access can continue over the surviving loop. As with all dual HBA-per-host configurations, the host software must be capable of supporting multiple connections to the same controller for this topology to be viable.
Host
Fibre Channel HBA Fibre Channel HBA
T
Backplane
0
FCAL
1
FCAL
A-10
Configuration Example 2
The following is an example of a single host with a single FCAL HBA connected to a CRD-7240 dual redundant configuration. It is the simplest example of a single loop Fibre Channel topology. In this configuration, should an HBA or Fibre Channel cable fail, data access is lost. With this configuration, no special host software capabilities are needed for the controllers to perform a failover of resources should a failure occur.
Host
Fibre Channel HBA
T
Backplane
0
FCAL
1
FCAL
Failover Bus
0
FCAL
1
FCAL
A-11
Configuration Example 3
The following is an example of a single host with dual FCAL HBAs connected to a CRD-7240 dual redundant configuration. It is the simplest example of a dual loop Fibre Channel topology. In this configuration, should an HBA or Fibre Channel cable fail, data access can continue over the surviving loop. As with all dual HBA-per-host configurations, the host software must be capable of supporting multiple connections to the same controller for this topology to be viable.
Host
Fibre Channel HBA Fibre Channel HBA
T
Backplane
0
FCAL
1
FCAL
Failover Bus
0
FCAL
1
FCAL
A-12
Configuration Example 4
The following is a dual redundant CRD-7240 configuration example of a dual hosts with single FCAL HBAs in each host connected to separate CRD-7240 Fibre Channel loops. In this configuration, a host could be homogeneous or heterogeneous and each host would be mapped to separate redundancy groups unless the operating system(s) were fully clusterable and running lock managers. In this configuration, should an HBA or Fibre Channel cable fail, data access to the one host is lost but can continue on the other host.
Host
Fibre Channel HBA
Host
Fibre Channel HBA
T
Backplane
0
FCAL
1
FCAL
Failover Bus
0
FCAL
1
FCAL
A-13
Configuration Example 5
The following is a dual redundant CRD-7240 configuration example of dual hosts with dual FCAL HBAs in each host connected to separate CRD-7240 Fibre Channel loops. In this configuration, if an HBA or Fibre Channel cable fails, data access can continue over the surviving loop. As with all dual HBA-per-host configurations, the host software must be capable of supporting multiple connections to the same controller for this topology to be viable.
Host
Fibre Channel HBA Fibre Channel HBA
Host
Fibre Channel HBA Fibre Channel HBA
T
Backplane
0
FCAL
1
FCAL
Failover Bus
0
FCAL
1
FCAL
A-14
Port 0 GBIC A
TITAN CO YO TE C O N TR O LLE R 0
Port 1
LO O P 0 C AB LE
GBIC B
BYPASS
FIB R E C H AN N E L I/F 0
Port 0
GBIC
TITAN CO YO TE C O N TR O LLE R 1
Port 1 GBIC B
LO O P 1 C AB LE
B AC K P LAN E
A-15
Port 0 A
TITAN CO YO TE C O N TR O LLE R 0
Port 1 B
LO O P 0 C AB LE
BYPASS
FIB R E C H AN N E L I/F 0
Port 0
TITAN C O YO TE C O N TR O LLE R 1
Port 1 B
LO O P 1 C AB LE
BYPASS
B AC K P LAN E FIB R E C H AN N E L I/F 1
A-16
Fibre Channel Interface Boards Fibre Channel DB9-PASS THRU Interface Board (SBA-007002-001)
Interface The DB9-PASS THRU Fibre Channel Interface board provides the physical interface to the Fibre Channel allowing direct connection to a copper channel. Connectivity is provided as shown Figure 63.Two independent physical connections are provided. The interface supports inter-enclosure signaling levels. Physical connection is made via Fibre Channel style 1 (DB9) connector. Hot Plug Capability The Fibre Channel Interface board may be installed/removed without disrupting system operation on other ports.
Port 0 A
TITAN CO YO TE C O N TR O LLE R 0
Port 1
FIB R E C H AN N E L I/F 0
Port 0
TITAN CO YO TE C O N TR O LLE R 1
Port 1 B
B AC K P LAN E
FIB R E C H AN N E L I/F 1
A-17