Hi
We have a power edge 2900 server with PERC 5/E RAID Controller connected to two disk arrays (MD1000 enclosure) each array has 15 disks and two virtual disks (I assume each vd is 7 disks and 1 hot spare).
total virtual disks 4.
one physical disk from 2nd enclosure is an element of virtual disks of 1st enclosure and vice versa.
it seems by mistake 2nd enclosure was powered off during server on. this caused all virtual disks to become failed and all 15 physical disks of the affected enclosure are in foreign state.
I am trying to figure out what happened by reviewing the logs in order to know how to fix the situation and could notice the following facts:
1- when one physical disk turns into "FAIL" state... BOTH Virtual disks of the including array gets "DEGRADED". does this mean we have a RAID 50 configuration?
2- when importing foreign configuration, the system reports the following in the log:
Attempted import of Virtual Disk with missing physical disk: Controller 1 (PERC 5/E Adapter)
Attempted import of Virtual disk with stale physical disk: Controller 1 (PERC 5/E Adapter)
Attempted import of Virtual Disk with missing physical disk: Controller 1 (PERC 5/E Adapter)
Attempted import of Virtual disk with stale physical disk: Controller 1 (PERC 5/E Adapter)
Attempted import of an orphan drive: Controller 1 (PERC 5/E Adapter)
Attempted import of Virtual disk with stale physical disk: Controller 1 (PERC 5/E Adapter)
Attempted import of Virtual disk with stale physical disk: Controller 1 (PERC 5/E Adapter)
Attempted import of an orphan drive: Controller 1 (PERC 5/E Adapter)(15 times)
the following was taken from lsi.log
10/27/14 16:02:59: EVT#136061-10/27/14 16:02:59: 218=Foreign Configuration Detected
10/27/14 16:02:59: ForeignReadAfterImport requested for guidIndex 0xff.
10/27/14 16:03:00: ddfValidateForCfg: ldAfterImport 5, invalidLd 8
10/27/14 16:03:00: isForeignCfgComplete: Foreign - totAr: 0x3, totLd: 0xd, totSpare: 0x0
10/27/14 16:03:00: isForeignCfgComplete: MR_CFG - totAr: 0x3, totLd: 0x5, totSpare: 0x0
10/27/14 16:03:00: ForeignImport requested for guidIndex 0xff.
10/27/14 16:03:01: ddfValidateForCfg: ldAfterImport 5, invalidLd 12
10/27/14 16:03:01: isForeignCfgComplete: Foreign - totAr: 0x3, totLd: 0xd, totSpare: 0x0
10/27/14 16:03:01: isForeignCfgComplete: MR_CFG - totAr: 0x1, totLd: 0x1, totSpare: 0x0
10/27/14 16:03:01: EVT#136062-10/27/14 16:03:01: 81=State change on VD 04/4 from OFFLINE(0) to OPTIMAL(3)
10/27/14 16:03:01: EVT#136063-10/27/14 16:03:01: 249=VD 04/4 is now OPTIMAL
10/27/14 16:03:01: Memory End affffff0
10/27/14 16:03:01: Total memory available for disk cache: ebe1bf0
10/27/14 16:03:01: Total Number of Cache Lines 3763
10/27/14 16:03:01: SS 128: mrs=14 lc=3763 ldc=5 ps=1 cm=ff ba=0 LDs: 0 1 2 3 4
10/27/14 16:03:01: Cache initialization complete...Config info
10/27/14 16:03:01: ARs configured: 3
10/27/14 16:03:01: Ar 0: size=22dc0000, activeLd=3, numPd=e, seq=0, PDs: 43(22/12) 31(22/1) 2f(22/3) 27(22/11) 2e(22/4) 2d(22/5) 2c(22/6) 2b(22/7) 2a(22/8) 46(22/0) 28(22/10) ff(22/14) ff(23/0) 25(22/13)
10/27/14 16:03:01: Ar 1: size=22dc0000, activeLd=c, numPd=e, seq=0, PDs: ff(23/14) ff(23/1) ff(23/2) ff(23/3) ff(23/4) ff(23/5) ff(23/6) ff(23/7) ff(23/8) ff(23/13) ff(23/10) ff(23/11) ff(23/12) 30(22/2)
10/27/14 16:03:01: Ar 2: size=22dc0000, activeLd=10, numPd=1, seq=0, PDs: 48(23/9)
10/27/14 16:03:01: LD 0: L=5 SS=128 Size=e2961380 NL=3763 Status=0 DT=1618 BT=2593, prop=[ID=00,dcp=01,ccp=01,ap=0,dc=0,dbgi=1]
10/27/14 16:03:01: span 0: sBlk=00000000, nBlk=116e0180, ar=0
10/27/14 16:03:01: LD 1: L=5 SS=128 Size=e295ec80 NL=3763 Status=0 DT=1618 BT=2593, prop=[ID=01,dcp=01,ccp=01,ap=0,dc=0,dbgi=1]
10/27/14 16:03:01: span 0: sBlk=116e0180, nBlk=116dfe80, ar=0
10/27/14 16:03:01: LD 2: L=5 SS=128 Size=e2961380 NL=3763 Status=0 DT=1618 BT=2593, prop=[ID=02,dcp=01,ccp=01,ap=0,dc=0,dbgi=1]
10/27/14 16:03:01: span 0: sBlk=00000000, nBlk=116e0180, ar=1
10/27/14 16:03:01: LD 3: L=5 SS=128 Size=e295ec80 NL=3763 Status=0 DT=1618 BT=2593, prop=[ID=03,dcp=01,ccp=01,ap=0,dc=0,dbgi=1]
10/27/14 16:03:01: span 0: sBlk=116e0180, nBlk=116dfe80, ar=1
10/27/14 16:03:01: LD 4: L=0 SS=128 Size=22dc0000 NL=3763 Status=3 DT=1618 BT=2593, prop=[ID=04,dcp=01,ccp=01,ap=0,dc=0,dbgi=0]
10/27/14 16:03:01: span 0: sBlk=00000000, nBlk=22dc0000, ar=2
10/27/14 16:03:01: EVT#136064-10/27/14 16:03:01: 138=Created VD 04/4
10/27/14 16:03:01: EVT#136065-10/27/14 16:03:01: 219=Foreign Configuration Imported
3- after importing, we still have the 4 virtual drives in failed status, the system has created a virtual disk for a replacement disk we inserted instead of a failed physical drive (it was hot spare).
4- when trying to make further import attempts, the system reports nothing to import.
5- Is there any other way to import the configuration successfully? is it related to a failed physical disk? how can we know which one. i checked Dell Open management. and all disks are foreign.
6- I read from other posts that there is a possibility to "retag" the virtual disk, I don't have the old configuration, however can I conclude it from the following lsi.log lines?:
Ar 1: size=22dc0000, activeLd=c, numPd=e, seq=0, PDs: ff(23/14) ff(23/1) ff(23/2) ff(23/3) ff(23/4) ff(23/5) ff(23/6) ff(23/7) ff(23/8) ff(23/13) ff(23/10) ff(23/11) ff(23/12) 30(22/2)
Ar 2: size=22dc0000, activeLd=10, numPd=1, seq=0, PDs: 48(23/9)
LD 0: L=5 SS=128 Size=e2961380 NL=3763 Status=0 DT=1618 BT=2593, prop=[ID=00,dcp=01,ccp=01,ap=0,dc=0,dbgi=1]
LD 1: L=5 SS=128 Size=e295ec80 NL=3763 Status=0 DT=1618 BT=2593, prop=[ID=01,dcp=01,ccp=01,ap=0,dc=0,dbgi=1]
LD 2: L=5 SS=128 Size=e2961380 NL=3763 Status=0 DT=1618 BT=2593, prop=[ID=02,dcp=01,ccp=01,ap=0,dc=0,dbgi=1]
LD 3: L=5 SS=128 Size=e295ec80 NL=3763 Status=0 DT=1618 BT=2593, prop=[ID=03,dcp=01,ccp=01,ap=0,dc=0,dbgi=1]
I guess the configuration will be as follows:
RAID 5
Strip size 128
other letters (NL,DT,BT,DCP,CCP,AP,DC,DBGI) are not clear to me
Regards