Recovery from lost majority of voting disk CRS-1705 - 

Recover the Voting disk

 

Error:

While starting the services in cluster in Oracle Grid, Below error ws being observed.

[cssd(2446)]CRS-1705:Found 1 configured voting files but 2 voting files are required, terminating to ensure data integrity; details at (:CSSNM00021:) in /u01/app/ocssd.log      


Solution:

1) Stop the services on crs.

[root@funoracledb ~]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'funoracledb'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'funoracledb'
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'funoracledb'
CRS-2673: Attempting to stop 'ora.crf' on 'funoracledb'
CRS-2677: Stop of 'ora.cssdmonitor' on 'funoracledb' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'funoracledb' succeeded
CRS-2677: Stop of 'ora.crf' on 'funoracledb' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'funoracledb'
CRS-2677: Stop of 'ora.gipcd' on 'funoracledb' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'funoracledb'
CRS-2677: Stop of 'ora.gpnpd' on 'funoracledb' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'funoracledb' has completed
CRS-4133: Oracle High Availability Services has been stopped.


2) Start services in exclusive mode

[root@funoracledb ~]# crsctl start crs -excl
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.mdnsd' on 'funoracledb'
CRS-2676: Start of 'ora.mdnsd' on 'funoracledb' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'funoracledb'
CRS-2676: Start of 'ora.gpnpd' on 'funoracledb' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'funoracledb'
CRS-2672: Attempting to start 'ora.gipcd' on 'funoracledb'
CRS-2676: Start of 'ora.cssdmonitor' on 'funoracledb' succeeded
CRS-2676: Start of 'ora.gipcd' on 'funoracledb' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'funoracledb'
CRS-2672: Attempting to start 'ora.diskmon' on 'funoracledb'
CRS-2676: Start of 'ora.diskmon' on 'funoracledb' succeeded
CRS-2676: Start of 'ora.cssd' on 'funoracledb' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'funoracledb'
CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'funoracledb'
CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'funoracledb' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'funoracledb'
CRS-2676: Start of 'ora.ctssd' on 'funoracledb' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'funoracledb' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'funoracledb'
CRS-2676: Start of 'ora.asm' on 'funoracledb' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'funoracledb'
CRS-2676: Start of 'ora.crsd' on 'funoracledb' succeeded

3) Check Voting disks

[root@funoracledb ~]# crsctl query css votedisk
Located 0 voting disk(s).

4) Connect to grid home and mount the DATA diskgroup.

sqlplus '/as sysasm'
ALTER DISKGROUP DATA MOUNT;

5) Create a votedisk


[root@funoracledb ~]# crsctl replace votedisk +DATA
Successful addition of voting disk 6d1dc365ec824f94bfa7fc18f8e3f6b0.
Successfully replaced voting disk group with +DATA.
CRS-4266: Voting file(s) successfully replaced
 
6) Stop the services on crs

[root@funoracledb ~]# crsctl stop crs -f
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'funoracledb'
CRS-2673: Attempting to stop 'ora.crsd' on 'funoracledb'
CRS-2677: Stop of 'ora.crsd' on 'funoracledb' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'funoracledb'
CRS-2673: Attempting to stop 'ora.ctssd' on 'funoracledb'
CRS-2673: Attempting to stop 'ora.asm' on 'funoracledb'
CRS-2677: Stop of 'ora.mdnsd' on 'funoracledb' succeeded
CRS-2677: Stop of 'ora.asm' on 'funoracledb' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'funoracledb'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'funoracledb' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'funoracledb' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'funoracledb'
CRS-2677: Stop of 'ora.cssd' on 'funoracledb' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'funoracledb'
CRS-2677: Stop of 'ora.gipcd' on 'funoracledb' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'funoracledb'
CRS-2677: Stop of 'ora.gpnpd' on 'funoracledb' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'funoracledb' has completed
CRS-4133: Oracle High Availability Services has been stopped.

7) Start the services normally and validate

[root@funoracledb ~]# crsctl start crs

CRS-4123: Oracle High Availability Services has been started.

[root@funoracledb ~]# crsctl stat res -t
-----------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS
-----------------------------------------------------------------------
Local Resources
-----------------------------------------------------------------------
ora.DATA.dg
               ONLINE  ONLINE       funoracledb
ora.LISTENER.lsnr
               ONLINE  ONLINE       funoracledb
ora.OCR_VOTE.dg
               ONLINE  OFFLINE      funoracledb
ora.asm
               ONLINE  ONLINE       funoracledb                     Started
ora.gsd
               OFFLINE OFFLINE      funoracledb
ora.net1.network
               ONLINE  ONLINE       funoracledb
ora.ons
               ONLINE  ONLINE       funoracledb
-----------------------------------------------------------------------
Cluster Resources
-----------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       funoracledb
ora.cvu
      1        ONLINE  ONLINE       funoracledb
ora.oc4j
      1        ONLINE  ONLINE       funoracledb
ora.orcl.db
      1        ONLINE  ONLINE       funoracledb                     Open
      2        ONLINE  OFFLINE
ora.funoracledb.vip
      1        ONLINE  ONLINE       funoracledb
ora.scan1.vip
      1        ONLINE  ONLINE       funoracledb 


 [root@funoracledb bin]# ./crsctl check cluster

CRS-4537: Cluster Ready Services is online

CRS-4529: Cluster Synchronization Services is online

CRS-4533: Event Manager is online




If you like please follow and comment