--== 環境介紹
11G RAC 由於機房停電,停機了。電力恢復後發現數據庫不能訪問了。
--== 問題描述
使用 srvctl 啓動數據庫報錯
[oracle@dm01db01 ~]$ srvctl start database -d genome
PRCR-1079 : Failed to start resource ora.genome.db
CRS-2674: Start of 'ora.dm01db02.vip' on 'dm01db02' failed
CRS-2674: Start of 'ora.dm01db01.vip' on 'dm01db01' failed
CRS-5017: The resource action "ora.genome.db start" encountered the following error:
ORA-00119: invalid specification for system parameter REMOTE_LISTENER
ORA-00132: syntax error or unresolved network name 'dm01-scan:1521'
CRS-2674: Start of 'ora.genome.db' on 'dm01db02' failed
CRS-2632: There are no more servers to try to place resource 'ora.genome.db' on that would satisfy its placement policy
CRS-5017: The resource action "ora.genome.db start" encountered the following error:
ORA-00119: invalid specification for system parameter REMOTE_LISTENER
ORA-00132: syntax error or unresolved network name 'dm01-scan:1521'
CRS-2674: Start of 'ora.genome.db' on 'dm01db01' failed
--== 問題分析
提示 scan,REMOTE_LISTENER 有問題,通過 crsctl 查看 所有的資源情況如下;
[oracle@dm01db02 ~]$ crsctl status res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA_DM01.dg
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.DBFS_DG.dg
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.LISTENER.lsnr
ONLINE OFFLINE dm01db01
ONLINE OFFLINE dm01db02
ora.RECO_DM01.dg
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.asm
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.gsd
OFFLINE OFFLINE dm01db01
OFFLINE OFFLINE dm01db02
ora.net1.network
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.ons
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.registry.acfs
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE dm01db01
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE dm01db02
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE dm01db02
ora.cvu
1 ONLINE ONLINE dm01db01
ora.dm01db01.vip
1 ONLINE OFFLINE <<< vip 沒有啓動
ora.dm01db02.vip
1 ONLINE OFFLINE
<<< vip 沒有啓動
ora.genome.db
1 ONLINE OFFLINE Instance Shutdown,S
TARTING
2 ONLINE OFFLINE Instance Shutdown,S
TARTING
ora.oc4j
1 ONLINE ONLINE dm01db02
ora.scan1.vip
1 ONLINE ONLINE dm01db01
ora.scan2.vip
1 ONLINE ONLINE dm01db02
ora.scan3.vip
1 ONLINE ONLINE dm01db02
[oracle@dm01db02 ~]$
<<< 嘗試手工 啓動 vip
[oracle@dm01db01 ~]$ srvctl start vip -n dm01db01
PRCR-1079 : Failed to start resource ora.dm01db01.vip
CRS-2674: Start of 'ora.dm01db01.vip' on 'dm01db01' failed
CRS-2674: Start of 'ora.dm01db01.vip' on 'dm01db02' failed
CRS-2632: There are no more servers to try to place resource 'ora.dm01db01.vip'on that would satisfy its placement policy
[oracle@dm01db01 ~]$ srvctl start vip -n dm01db02
PRCR-1079 : Failed to start resource ora.dm01db02.vip
CRS-2674: Start of 'ora.dm01db02.vip' on 'dm01db02' failed
CRS-2674: Start of 'ora.dm01db02.vip' on 'dm01db01' failed
CRS-2632: There are no more servers to try to place resource 'ora.dm01db02.vip' on that would satisfy its placement policy
<<< 確認當前的 vip 解析方式。
查看 /etc/hosts 發現沒有 vip相關的條目,並且cat /etc/resolv.conf 存在 namedserver
說明是這套rac的 vip使用的是 dns解析的方式
<<< 確認當前是否 vip的 dns解析是否正常。
1. 使用 crsctl config vip -n <NODE1_NAME> 確認 vip 名稱
2. 使用 nslookup 命令,無法正常解析
<<< 到此已經明確問題由 vip 無法通過 dns解析出 對於的ip,導致db 啓動失敗。
在 dns服務器恢復後, vip成功啓動,db也隨之成功啓動。