Linux使用storcli工具查看服务器硬盘和raid组信息


1、简介 MegaCli 是LSI公司官方提供的SCSI卡管理工具,由于LSI被收购变成了现在的Broadcom,所以现在想下载MegaCli, 需要去Broadcom官网查找Legacy产品支持,搜索MegaRAID即可。   现在官方有storcli,storcli已经基本代替了megacli,整合了LSI和3ware所有产品。   安装方面比较简单,megacli还要Lib_Utils的支持,而storcli只用一个rpm包就可以下载, 去Broadcom官网去找就行了:https://www.broadcom.com/site-search?q=storcli   storcli支持json格式输出,信息解析更加方便。   我个人推荐使用这个软件,因为megacli 工具需要安装额外的软件包,有些服务器客户不允许安装其他的软件包,所以比较麻烦。 这个工具直接安装了之后就可以用。     1.1服务器信息:     1.2系统信息: [root@localhost storcli]# cat /etc/redhat-release Red Hat Enterprise Linux Server release 6.4 (Santiago)     1.3 安装storcli rpm -ivh  storcli-1.03.11-1.noarch.rpm 目录: /opt/Mega/storcli 注意版本问题 我这台服务器是DELL  R720xd,2012年上线的,所以我用的是storcli.1.03.11版本。 我用的新版本安装之后,执行命令没有输出,所以这一点需要注意。     1.4一些参数定义: /cx = Controller ID /vx = Virtual Drive Number. /ex = Enclosure ID /sx = Slot ID     1.5为了管理方便,建立软连接 ln -s /opt/MegaRAID/storcli/storcli64 /bin/storcli ln -s /opt/MegaRAID/storcli/storcli64    /sbin/storcli   如果不想建立软连接,就在/opt/MegaRAID/storcli 目录下 执行./storcli64 指令     2、查看当前设备raid控制器相关信息 [root@localhost storcli]# ./storcli64 show all    可以看到只有一个控制器 Status Code = 0 Status = Success Description = None   Number of Controllers = 1 Host Name = localhost.localdomain Operating System  = Linux2.6.32-358.el6.x86_64   System Overview : ===============   ------------------------------------------------------------ Ctl Model Ports PDs DGs DNOpt VDs VNOpt BBU sPR DS EHS ASOs ------------------------------------------------------------   0 Mini      8  14   3     0   3     0 Opt On  3  N      0      【只看到一个控制器】 ------------------------------------------------------------   Ctl=Controller Index|DGs=Drive groups|VDs=Virtual drives|Fld=Failed PDs=Physical drives|DNOpt=DG NotOptimal|VNOpt=VD NotOptimal|Opt=Optimal Msng=Missing|Dgd=Degraded|NdAtn=Need Attention|Unkwn=Unknown sPR=Scheduled Patrol Read|DS=DimmerSwitch|EHS=Emergency Hot Spare Y=Yes|N=No|ASOs=Advanced Software Options|BBU=Battery backup unit     ASO : ===   ---- Ctl ----   0 ----   Cl=Cluster|MD=Max Disks|WC=Wide Cache|SS=Safe Store|FP=Fast Path|Re=Recovery CR=CacheCade(Read)|RF=Reduced Feature Set|CO=Cache Offload CW=CacheCade(Read/Write)|X=Not Available/Not Installed|U=Unlimited|T=Trial     3、查看控制器c0的相关信息 [root@localhost storcli]# ./storcli64  /c0 show Controller = 0 Status = Success Description = None   Product Name = PERC H710P Mini【控制器型号】 Serial Number = 26300UP SAS Address =  5d4ae520a6bcbc00 Mfg. Date = 06/04/12 System Time = 05/22/2019 16:22:28 Controller Time = 05/22/2019 08:22:28 FW Package Build = 21.0.2-0001 BIOS Version = 5.30.00_4.12.05.00_0x05110000 FW Version = 3.130.05-1587 Driver Name = megaraid_sas Driver Version = 06.504.01.00-rh1 Controller Bus Type = N/A PCI Slot = N/A PCI Bus Number = 2 PCI Device Number = 0 PCI Function Number = 0 Drive Groups = 3   TOPOLOGY : ========   -------------------------------------------------------------------------- DG Arr Row EID:Slot DID Type  State BT       Size PDC  PI SED DS3  FSpace -------------------------------------------------------------------------- 0 -   -   -        -   RAID1 Optl  N  278.875 GB dflt N  N   dflt N       0 0   -   -        -   RAID1 Optl  N  278.875 GB dflt N  N   dflt N       0 0   0   32:24    24  DRIVE Onln  N  278.875 GB dflt N  N   dflt -       0 0   1   32:25    25  DRIVE Onln  N  278.875 GB dflt N  N   dflt -       1 -   -   -        -   RAID5 Optl  N    4.089 TB dflt N  N   dflt N       1 0   -   -        -   RAID5 Optl  N    4.089 TB dflt N  N   dflt N       1 0   0   32:0     0   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       1 0   1   32:1     1   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       1 0   2   32:2     2   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       1 0   3   32:3     3   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       1 0   4   32:4     4   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       1 0   5   32:5     5   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       2 -   -   -        -   RAID5 Optl  N    4.089 TB dflt N  N   dflt N       2 0   -   -        -   RAID5 Optl  N    4.089 TB dflt N  N   dflt N       2 0   0   32:6     6   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       2 0   1   32:7     7   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       2 0   2   32:8     8   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       2 0   3   32:9     9   DRIVE Onln  N   837.75 GB dflt N  N   dflt -       2 0   4   32:10    10  DRIVE Onln  N   837.75 GB dflt N  N   dflt -       2 0   5   32:11    11  DRIVE Onln  N   837.75 GB dflt N  N   dflt -      【可以看到服务器有几个RAID,每个RAID的级别和成员盘】 --------------------------------------------------------------------------   DG=Disk Group Index|Arr=Array Index|Row=Row Index|EID=Enclosure Device ID DID=Device ID|Type=Drive Type|Onln=Online|Rbld=Rebuild|Dgrd=Degraded Pdgd=Partially degraded|Offln=Offline|BT=Background Task Active PDC=PD Cache|PI=Protection Info|SED=Self Encrypting Drive|Frgn=Foreign DS3=Dimmer Switch 3|dflt=Default|Msng=Missing|FSpace=Free Space Present   Virtual Drives = 3【服务器有三个RAID,两个RAID5一个RAID1】   VD LIST : =======   --------------------------------------------------------------- DG/VD TYPE  State Access Consist Cache Cac sCC       Size Name --------------------------------------------------------------- 0/0   RAID1 Optl  RW     Yes     RaWBD R   OFF 278.875 GB       1/1   RAID5 Optl  RW     Yes     RaWBD R   OFF   4.089 TB       2/2   RAID5 Optl  RW     Yes     RaWBD R   OFF   4.089 TB       ---------------------------------------------------------------   Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded Optl=Optimal|RO=Read Only|RW=Read Write|B=Blocked|Consist=Consistent| Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack| AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled Check Consistency   Physical Drives = 14【十四个物理磁盘】   PD LIST : =======   ------------------------------------------------------------------------- EID:Slt DID State DG       Size Intf Med SED PI SeSz Model            Sp ------------------------------------------------------------------------- 32:0      0 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:1      1 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:2      2 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:3      3 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:4      4 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:5      5 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:6      6 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:7      7 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:8      8 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:9      9 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:10    10 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:11    11 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:24    24 Onln   0 278.875 GB SAS  HDD N   N  512B ST9300603SS      U   32:25    25 Onln   0 278.875 GB SAS  HDD N   N  512B ST9300605SS      U   -------------------------------------------------------------------------   EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition|F-Foreign     BBU_Info : ========   ------------------------------------------------------------ Model State   RetentionTime Temp Mode MfgDate    Next Learn ------------------------------------------------------------ BBU   Optimal 0 hour(s)     30C  0    2011/07/18 None        ------------------------------------------------------------   4、获取enclosure信息 硬盘大多是附在enclosure上不是直接附在controller上。   显示所有的enclosure信息,但是系统中只有一个enclosure ,EID:32. [root@localhost storcli]# ./storcli64 /c0/eall show    Controller = 0 Status = Success Description = None     Properties : ==========   ----------------------------------------------------------------------------- EID State Slots PD PS Fans TSs Alms SIM Port#       ProdID    VendorSpecific ----------------------------------------------------------------------------- 32 OK       26 14  0    0   0    0   0 Unavailable BP12G+EXP                 -----------------------------------------------------------------------------   EID-Enclosure Device ID |PD-Physical drive count |PS-Power Supply count| TSs-Temperature sensor count |Alms-Alarm count |SIM-SIM Count     获取单个enclosure  ,e32详细信息 [root@localhost storcli]# ./storcli64 /c0/e32 show all Controller = 0 Status = Success Description = None     Enclosure /c0/e32  : ==================   Information : =========== Device ID = 32 Position = 1 Connector Name = Unavailable Enclosure Type = SES Status = OK FRU Part Number = N/A Enclosure Serial Number = N/A ESM Serial Number = N/A Enclosure Zoning Mode = N/A Partner Device ID = 65535     Inquiry Data : ============ Vendor Identification = DP Product Identification = BP12G+EXP Product Revision Level = 1.07     Properties : ==========   ----------------------------------------------------------------------------- EID State Slots PD PS Fans TSs Alms SIM Port#       ProdID    VendorSpecific ----------------------------------------------------------------------------- 32 OK       26 14  0    0   0    0   0 Unavailable BP12G+EXP                 -----------------------------------------------------------------------------     EID-Enclosure Device ID |PD-Physical drive count |PS-Power Supply count| TSs-Temperature sensor count |Alms-Alarm count |SIM-SIM Count   5、显示物理磁盘信息 语法:storcli64  /cx/eall/sall show  显示所有物理磁盘信息   [root@localhost storcli]# ./storcli64 /c0/e32/sall   show 【显示e32上的所有物理硬盘】    [root@localhost storcli]# ./storcli64 /c0/eall/sall show【显示所有enclosure下的所有物理硬盘】 Controller = 0 Status = Success Description = Show Drive Information Succeeded.     Drive Information : =================   ------------------------------------------------------------------------- EID:Slt DID State DG       Size Intf Med SED PI SeSz Model            Sp ------------------------------------------------------------------------- 32:0      0 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:1      1 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:2      2 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:3      3 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:4      4 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:5      5 Onln   1  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:6      6 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:7      7 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:8      8 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:9      9 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:10    10 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:11    11 Onln   2  837.75 GB SAS  HDD N   N  512B WD9001BKHG       U   32:24    24 Onln   0 278.875 GB SAS  HDD N   N  512B ST9300603SS      U   32:25    25 Onln   0 278.875 GB SAS  HDD N   N  512B ST9300605SS      U   -------------------------------------------------------------------------   EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare【表示有热备盘,DHS专有热备,GHS全局热备】 UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition|F-Foreign   从上面信息,可以看出:
  • 只有一个控制器,id 为 0
  • EID,Enclosure Device ID :32
  • Slot Number,能看到 0,1,2,3,4,5,6,7,8,9,10,11,24,25
  • DG:disk group,0,1,2
  • size:容量,磁盘容量
  • intf:接口,SAS
  • Med:介质,ssd 或 hdd
      6、查看raid组详细信息   查看系统里面有几个raid组: [root@localhost storcli]# ./storcli64 /c0/vall  show 【查看c0控制下的所有RAID信息】 Controller = 0 Status = Success Description = None     Virtual Drives : ==============   --------------------------------------------------------------- DG/VD TYPE  State Access Consist Cache Cac sCC       Size Name --------------------------------------------------------------- 0/  RAID1 Optl  RW     Yes     RaWBD R   OFF 278.875 GB       1/  RAID5 Optl  RW     Yes     RaWBD R   OFF   4.089 TB       2/2   RAID5 Optl  RW     Yes     RaWBD R   OFF   4.089 TB      【显示系统有三个raid组】 ---------------------------------------------------------------   Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded Optl=Optimal|RO=Read Only|RW=Read Write|B=Blocked|Consist=Consistent| Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack| AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled Check Consistency       查看V0  (虚拟磁盘0) raid的详细信息 [root@localhost storcli]# ./storcli64 /c0/v0 show all Controller = 0 Status = Success Description = None     /c0/v0 : ======   --------------------------------------------------------------- DG/VD TYPE  State Access Consist Cache Cac sCC       Size Name --------------------------------------------------------------- 0/0   RAID1 Optl  RW     Yes     RaWBD R   OFF 278.875 GB      【V0为RAID1】 ---------------------------------------------------------------   Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded Optl=Optimal|RO=Read Only|RW=Read Write|B=Blocked|Consist=Consistent| Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack| AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled Check Consistency     PDs for VD 0 : ============   ------------------------------------------------------------------------- EID:Slt DID State DG       Size Intf Med SED PI SeSz Model            Sp ------------------------------------------------------------------------- 32:24    24 Onln   0 278.875 GB SAS  HDD N   N  512B ST9300603SS      U   32:25    25 Onln   0 278.875 GB SAS  HDD N   N  512B ST9300605SS      U  【可以看到24号和25号盘组成了raid1】 -------------------------------------------------------------------------   EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info SeSz-Sector Size|Sp-Spun|U-Up|D-Down|T-Transition|F-Foreign     VD0 Properties : ============== Strip Size = 64 KB Span Depth = 1 Number of Drives Per Span = 2 Disk Cache Policy = Disk's Default Encryption = None Data Protection = None Active Operations = None Exposed to OS = Yes Creation Date = 05-09-2012 Creation Time = 01:38:23 PM Emulation type = None         7、磁盘状态设置 storcli64    /cx/ex/sx    set    good/offline/online/missing  设置某块磁盘的状态 good        空闲 online/offline       成员盘上下线 missing            设置磁盘为missing状态     磁盘热备 storcli64 /cx/ex/sx add hotsparedrive dgs=x  设置模块磁盘为diskgroup x 的热备盘 storcli64 /cx/ex/sx add hotsparedrive           设置全局热备 storcli64 /cx/ex/sx delete hotsparedrive     磁盘rebuild storcli64 /cx/ex/sx show rebuild  查看rebild storcli64 /cx/ex/sx start rebuild storcli64 /cx/ex/sx stop rebuild   磁盘点灯 storcli64 /cx/ex/sx start locate storcli64 /cx/ex/sx stop locate   磁盘擦除 快速擦除: storcli64 /cx/ex/sx set good storcli64 /cx/fall del|delete [securityKey = xxx]     完全擦除: storcli /cx[/ex]/sx secureerase [force] storcli /cx[/ex]/sx start erase [simple| normal| thorough | standard| threepass | crypto] storcli /cx[/ex]/sx stop erase storcli /cx[/ex]/sx show erase   8、获取rebuild速率 [root@localhost storcli]# ./storcli64  /c0 show rebuildrate Controller = 0 Status = Success Description = None     Controller Properties : =====================   ------------------ Ctrl_Prop   Value ------------------ Rebuildrate 30%    ------------------       storcli64   /c0  set  rebuildrate=60  设置rebuild速率     9、清除缓存 清除raid卡,物理磁盘cache storcli64   /c0    flushcache