raid_controller_utils
This is an old revision of the document!
Table of Contents
HP Raid Utils
# hpacucli ctrl all show config # hpacucli ctrl slot=0 ld all show status
Status & Physical drive S/N and model
# hpacucli ctrl all show config detail
Thorough information including hard drive S/N
# hpacucli ctrl all diag file=/tmp/test /tmp/test is output file for result
Smartctl hints for HP smart array (CCISS driver)
Drive0: # smartctl -a -d cciss,0 /dev/cciss/c0d0 Drive1: # smartctl -a -d cciss,1 /dev/cciss/c0d0
Smartctl hints for HP smart array (HPSA driver)
The HPSA driver was introduced with RHEL6 to the RHEL family.
Drive0: # smartctl -a -d cciss,0 /dev/sg0 Drive1: # smartctl -a -d cciss,1 /dev/sg0
Ref: man smartctl
Information about hpsa driver
List HP array information
# lsscsi --long [3:0:0:0] storage HP P410i 5.14 - state=running queue_depth=1020 scsi_level=6 type=12 device_blocked=0 timeout=0 [3:0:0:1] disk HP LOGICAL VOLUME 5.14 /dev/sda state=running queue_depth=1020 scsi_level=6 type=0 device_blocked=0 timeout=30 Alternatively # dmesg | grep "^scsi " scsi 3:0:0:0: RAID HP P410i 5.14 PQ: 0 ANSI: 5 scsi 3:0:0:1: Direct-Access HP LOGICAL VOLUME 5.14 PQ: 0 ANSI: 5
Display mapping between linux sg and other SCSI devices
Requires installation of sg3_utils RPM.
# sg_map /dev/sg0 /dev/sg1 /dev/sda /dev/sg2 /dev/sdb /dev/sg3 /dev/sdc /dev/sg4 /dev/sdd /dev/sg5 /dev/sde /dev/sg6 /dev/sdf /dev/sg7 /dev/sdg /dev/sg8 /dev/sdh /dev/sg9 /dev/sdi
Reference: man sg_map
Alternatively:
# lsscsi -g [3:0:0:0] storage HP P410i 5.14 - /dev/sg0 [3:0:0:1] disk HP LOGICAL VOLUME 5.14 /dev/sda /dev/sg1
LSI Raid Utils
LSI raid controller
Find disk device for logical driver under LSI raid controller
First list the Logical Drives (LD's)
# /opt/MegaRAID/MegaCli/MegaCli64 -ldinfo -Lall -aall Adapter 0 -- Virtual Drive Information: Virtual Drive: 0 (Target Id: 0) <<---- Target Id is 0 for VD 0 Name : RAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0 Size : 837.258 GB Mirror Data : 837.258 GB State : Optimal Strip Size : 128 KB Number Of Drives : 2 Span Depth : 1 Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disabled Encryption Type : None PI type: Proprietary type Virtual Drive: 1 (Target Id: 1) <<---- Target Id is 1 for VD 1 Name : RAID Level : Primary-1, Secondary-0, RAID Level Qualifier-0 Size : 1.634 TB Mirror Data : 1.634 TB State : Optimal Strip Size : 128 KB Number Of Drives per span:2 Span Depth : 2 Default Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Current Cache Policy: WriteBack, ReadAdaptive, Direct, No Write Cache if Bad BBU Default Access Policy: Read/Write Current Access Policy: Read/Write Disk Cache Policy : Disabled Encryption Type : None PI type: No PI
So the target ID is 0 for VD 0 and the Target ID is 1 for VD 1
Find target ID to Disk Device translation
#lsscsi [0:0:19:0] enclosu IBM-ESXS SAS EXP BP 6126 - [0:0:36:0] enclosu IBM-ESXS SAS EXP BP 6126 - [0:2:0:0] disk IBM ServeRAID M5110 3.19 /dev/sda [0:2:1:0] disk IBM ServeRAID M5110 3.19 /dev/sdb [0:2:2:0] disk IBM ServeRAID M5110 3.19 /dev/sdc [0:2:3:0] disk IBM ServeRAID M5110 3.19 /dev/sdd [0:2:4:0] disk IBM ServeRAID M5110 3.19 /dev/sde [0:2:5:0] disk IBM ServeRAID M5110 3.19 /dev/sdf [1:0:0:0] cd/dvd IBM SATA DEVICE 81Y3664 IBA1 /dev/sr0
So Target ID 0 = 0:2:0:0 (the target ID is the digit after 2:) equals sda So Target ID 1 = 0:2:1:0 (the target ID is the digit after 2:) equals sdb
lsscsi command can be found in lsscsi.x86_64 package
List logical disks (LD)
# /opt/MegaRAID/MegaCli/MegaCli64 -ldinfo -Lall -aall
List physical disks (PD)
# /opt/MegaRAID/MegaCli/MegaCli64 -PDlist -aALL
List thorough information indcluding LD & PD
# /opt/MegaRAID/MegaCli/MegaCli64 -CfgDsply -aALL
List smartctl information including disk S/N
First get the Disk Id from Physical disk list
# /opt/MegaRAID/MegaCli/MegaCli64 -PDlist -aALL Enclosure Device ID: 36 Slot Number: 15 Drive's postion: DiskGroup: 3, Span: 0, Arm: 7 Enclosure position: 1 Device Id: 27 <-------- This is the Device Id WWN: 5000C50042600CC8 Sequence Number: 2 Media Error Count: 0 Other Error Count: 0 Predictive Failure Count: 0 Last Predictive Failure Event Seq Number: 0 PD Type: SAS Raw Size: 931.512 GB [0x74706db0 Sectors] Non Coerced Size: 931.012 GB [0x74606db0 Sectors] Coerced Size: 930.390 GB [0x744c8000 Sectors] Firmware state: Online, Spun Up Commissioned Spare : No Emergency Spare : No Device Firmware Level: BD29 Shield Counter: 0 Successful diagnostics completion on : N/A SAS Address(0): 0x5000c50042600cc9 SAS Address(1): 0x0 Connected Port Number: 1(path0) Inquiry Data: IBM-ESXSST91000640SS BD299XG2NNN80221BD29 IBM FRU/CRU: 81Y9691 FDE Capable: Not Capable FDE Enable: Disable Secured: Unsecured Locked: Unlocked Needs EKM Attention: No Foreign State: None Device Speed: 6.0Gb/s Link Speed: 6.0Gb/s Media Type: Hard Disk Device Drive Temperature :24C (75.20 F) PI Eligibility: Yes Number of bytes of user data in LBA: 512 Drive is formatted for PI information: Yes PI: PI with type 2 Port-0 : Port status: Active Port's Linkspeed: 6.0Gb/s Port-1 : Port status: Active Port's Linkspeed: 6.0Gb/s Drive has flagged a S.M.A.R.T alert : No
Now run smartctl
# smartctl -a -d megaraid,<Device Id> /dev/sda
Eventhough disk with Disk Id 27 is not present in device /dev/sda it will show the correct disk information
# smartctl -a -d megaraid,27 /dev/sda smartctl 5.42 2011-10-20 r3458 [x86_64-linux-2.6.32-279.14.1.el6.x86_64] (local build) Copyright (C) 2002-11 by Bruce Allen, http://smartmontools.sourceforge.net Vendor: IBM-ESXS Product: ST91000640SS Revision: BD29 User Capacity: 1,000,204,886,016 bytes [1.00 TB] Logical block size: 512 bytes Logical Unit id: 0x5000c50042600ccb Serial number: 9XG2NNN800009301VW77 Device type: disk Transport protocol: SAS Local Time is: Fri Jan 25 15:26:14 2013 CET Device supports SMART and is Enabled Temperature Warning Enabled SMART Health Status: OK Current Drive Temperature: 24 C Drive Trip Temperature: 65 C Elements in grown defect list: 0 Vendor (Seagate) cache information Blocks sent to initiator = 0 Vendor (Seagate/Hitachi) factory information number of hours powered up = 1638.90 number of minutes until next internal SMART test = 17
Error counter log:
Errors Corrected by Total Correction Gigabytes Total
ECC rereads/ errors algorithm processed uncorrected
fast | delayed rewrites corrected invocations [10^9 bytes] errors
read: 373041640 0 0 373041640 0 3163.907 0
write: 0 0 0 0 0 737.264 0
verify: 2767709692 0 0 2767709692 0 4610.773 0
Non-medium error count: 1
No self-tests have been logged
Long (extended) Self Test duration: 13596 seconds [226.6 minutes]
List LSI adaptor information
# /opt/MegaRAID/MegaCli/MegaCli64 -AdpAllInfo -aAll
Adapter #0
==============================================================================
Versions
================
Product Name : ServeRAID M5110
Serial No : SV23610722
FW Package Build: 23.7.0-0037
Mfg. Data
================
Mfg. Date : 09/05/12
Rework Date : 00/00/00
Revision No : 27E
Battery FRU : N/A
Image Versions in Flash:
================
BIOS Version : 5.30.00_4.12.05.00_0x05160000
FW Version : 3.190.35-1786
NVDATA Version : 2.1206.03-0105
WebBIOS Version : 6.1-45-e_45-Rel
Preboot CLI Version: 05.04-05:#%00011
Boot Block Version : 2.05.00.00-0007
BOOT Version : 07.26.13.219
Pending Images in Flash
================
None
PCI Info
================
Controller Id : 0000
Vendor Id : 1000
Device Id : 005b
SubVendorId : 1014
SubDeviceId : 040b
Host Interface : PCIE
ChipRevision : D1
Link Speed : 0
Number of Frontend Port: 0
Device Interface : PCIE
Number of Backend Port: 8
Port : Address
0 500507603e839210
1 500507603e83bd90
2 0000000000000000
3 0000000000000000
4 0000000000000000
5 0000000000000000
6 0000000000000000
7 0000000000000000
HW Configuration
================
SAS Address : 500605b005302c40
BBU : Present
Alarm : Present
NVRAM : Present
Serial Debugger : Present
Memory : Present
Flash : Present
Memory Size : 512MB
TPM : Absent
On board Expander: Absent
Upgrade Key : Present
Temperature sensor for ROC : Present
Temperature sensor for controller : Absent
ROC temperature : 75 degree Celcius
Settings
================
Current Time : 14:30:0 1/25, 2013
Predictive Fail Poll Interval : 300sec
Interrupt Throttle Active Count : 16
Interrupt Throttle Completion : 50us
Rebuild Rate : 30%
PR Rate : 30%
BGI Rate : 30%
Check Consistency Rate : 30%
Reconstruction Rate : 30%
Cache Flush Interval : 4s
Max Drives to Spinup at One Time : 2
Delay Among Spinup Groups : 12s
Physical Drive Coercion Mode : 1GB
Cluster Mode : Disabled
Alarm : Disabled
Auto Rebuild : Enabled
Battery Warning : Enabled
Ecc Bucket Size : 15
Ecc Bucket Leak Rate : 1440 Minutes
Restore HotSpare on Insertion : Disabled
Expose Enclosure Devices : Enabled
Maintain PD Fail History : Enabled
Host Request Reordering : Enabled
Auto Detect BackPlane Enabled : SGPIO/i2c SEP
Load Balance Mode : Auto
Use FDE Only : Yes
Security Key Assigned : No
Security Key Failed : No
Security Key Not Backedup : No
Default LD PowerSave Policy : Controller Defined
Maximum number of direct attached drives to spin up in 1 min : 10
Auto Enhanced Import : No
Any Offline VD Cache Preserved : No
Allow Boot with Preserved Cache : No
Disable Online Controller Reset : No
PFK in NVRAM : No
Use disk activity for locate : No
POST delay : 90 seconds
BIOS Error Handling : Stop On Errors
Current Boot Mode :Normal
Capabilities
================
RAID Level Supported : RAID0, RAID1, RAID5, RAID00, RAID10, RAID50, PRL 11, PRL 11 with spanning, SRL 3 supported, PRL11-RLQ0 DDF layout with no span, PRL11-RLQ0 DDF layout with span
Supported Drives : SAS, SATA
Allowed Mixing:
Mix in Enclosure Allowed
Status
================
ECC Bucket Count : 0
Limitations
================
Max Arms Per VD : 32
Max Spans Per VD : 8
Max Arrays : 128
Max Number of VDs : 64
Max Parallel Commands : 1008
Max SGE Count : 60
Max Data Transfer Size : 8192 sectors
Max Strips PerIO : 42
Max LD per array : 16
Min Strip Size : 8 KB
Max Strip Size : 1.0 MB
Max Configurable CacheCade Size: 0 GB
Current Size of CacheCade : 0 GB
Current Size of FW Cache : 366 MB
Device Present
================
Virtual Drives : 6
Degraded : 0
Offline : 0
Physical Devices : 33
Disks : 30
Critical Disks : 0
Failed Disks : 0
Supported Adapter Operations
================
Rebuild Rate : Yes
CC Rate : Yes
BGI Rate : Yes
Reconstruct Rate : Yes
Patrol Read Rate : Yes
Alarm Control : Yes
Cluster Support : Yes
BBU : Yes
Spanning : Yes
Dedicated Hot Spare : Yes
Revertible Hot Spares : Yes
Foreign Config Import : Yes
Self Diagnostic : Yes
Allow Mixed Redundancy on Array : No
Global Hot Spares : Yes
Deny SCSI Passthrough : No
Deny SMP Passthrough : No
Deny STP Passthrough : No
Support Security : Yes
Snapshot Enabled : No
Support the OCE without adding drives : Yes
Support PFK : Yes
Support PI : Yes
Support Boot Time PFK Change : Yes
Disable Online PFK Change : Yes
Support LDPI Type1 : No
Support LDPI Type2 : No
Support LDPI Type3 : No
PFK TrailTime Remaining : 0 days 0 hours
Support Shield State : Yes
Block SSD Write Disk Cache Change: Yes
Supported VD Operations
================
Read Policy : Yes
Write Policy : Yes
IO Policy : Yes
Access Policy : Yes
Disk Cache Policy : Yes
Reconstruction : Yes
Deny Locate : No
Deny CC : No
Allow Ctrl Encryption: No
Enable LDBBM : No
Support Breakmirror : No
Power Savings : No
Supported PD Operations
================
Force Online : Yes
Force Offline : Yes
Force Rebuild : Yes
Deny Force Failed : No
Deny Force Good/Bad : No
Deny Missing Replace : No
Deny Clear : No
Deny Locate : No
Support Temperature : Yes
Disable Copyback : No
Enable JBOD : No
Enable Copyback on SMART : No
Enable Copyback to SSD on SMART Error : Yes
Enable SSD Patrol Read : No
PR Correct Unconfigured Areas : Yes
Error Counters
================
Memory Correctable Errors : 0
Memory Uncorrectable Errors : 0
Cluster Information
================
Cluster Permitted : Yes
Cluster Active : No
Default Settings
================
Phy Polarity : 0
Phy PolaritySplit : 0
Background Rate : 30
Strip Size : 128kB
Flush Time : 4 seconds
Write Policy : WB
Read Policy : Adaptive
Cache When BBU Bad : Disabled
Cached IO : No
SMART Mode : Mode 6
Alarm Disable : No
Coercion Mode : 1GB
ZCR Config : Unknown
Dirty LED Shows Drive Activity : No
BIOS Continue on Error : 0
Spin Down Mode : None
Allowed Device Type : SAS/SATA Mix
Allow Mix in Enclosure : Yes
Allow HDD SAS/SATA Mix in VD : No
Allow SSD SAS/SATA Mix in VD : No
Allow HDD/SSD Mix in VD : No
Allow SATA in Cluster : No
Max Chained Enclosures : 16
Disable Ctrl-R : Yes
Enable Web BIOS : Yes
Direct PD Mapping : No
BIOS Enumerate VDs : Yes
Restore Hot Spare on Insertion : No
Expose Enclosure Devices : Yes
Maintain PD Fail History : Yes
Disable Puncturing : Yes
Zero Based Enclosure Enumeration : No
PreBoot CLI Enabled : Yes
LED Show Drive Activity : Yes
Cluster Disable : No
SAS Disable : No
Auto Detect BackPlane Enable : SGPIO/i2c SEP
Use FDE Only : Yes
Enable Led Header : No
Delay during POST : 0
EnableCrashDump : No
Disable Online Controller Reset : No
EnableLDBBM : No
Un-Certified Hard Disk Drives : Allow
Treat Single span R1E as R10 : No
Max LD per array : 16
Power Saving option : All power saving options are disabled
Default spin down time in minutes: 30
Enable JBOD : No
TTY Log In Flash : No
Auto Enhanced Import : No
BreakMirror RAID Support : No
Disable Join Mirror : No
Enable Shield State : Yes
Time taken to detect CME : 60s
Exit Code: 0x00
raid_controller_utils.1359124561.txt.gz · Last modified: 2013/01/25 14:36 by root
Except where otherwise noted, content on this wiki is licensed under the following license: GNU Free Documentation License 1.3
