Oracle 3rd Node add

The purpose of this article is to provide the details on the approach used to add 3rd node in the live environment and workarounds used to deal with unknown bugs.

Node 1 cd /data01/home/oracle/stage/clusterware/clusterware/cluvfy

./runcluvfy.sh stage -pre crsinst -n el1,el2,el3

Node 1 set display , start exceed
Node 1 sudo su - oracle
cd $ORA_CRS_HOME/oui/bin
./addNode.sh ( OUI will start) as oracle user
enter new node information
monitor oui
run rootaddnode.sh
Node 3 run root.sh Be careful here…CRS may not come up. Happened in 64 bit

root.sh failed with the following error:
Startup will be queued to init within 90 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.

Failure at final check of Oracle CRS stack.
10

crsd.log:

2007-09-06 04:20:42.701: [ CSSCLNT][3086964416]clsssInitNative: connect failed, rc 9

2007-09-06 04:20:42.702: [ CRSRTI][3086964416]0CSS is not ready. Received status 3 from
CSS. Waiting for good status ..

2007-09-06 04:20:43.737: [ COMMCRS][120400816]clsc_connect: (0x8622de0) no listener at (ADDRESS=(PROTO
=ipc)(KEY=OCSSD_LL_el2_crs))

2007-09-06 04:20:43.737: [ CSSCLNT][3086964416]clsssInitNative: connect failed, rc 9

2007-09-06 04:20:43.738: [ CRSRTI][3086964416]0CSS is not ready. Received status 3 from
CSS. Waiting for good status ..

2007-09-06 04:20:44.774: [ COMMCRS][120400816]clsc_connect: (0x8622de0) no listener at
(ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_el2_crs))

2007-09-06 04:20:44.774: [ CSSCLNT][3086964416]clsssInitNative: connect failed, rc 9

2007-09-06 04:20:44.775: [ CRSRTI][3086964416]0CSS is not ready. Received status 3 from
CSS. Waiting for good status..

Workarounds:

a. ps -ef | grep -i d.bin and kill the process
b. /etc/init.d/init.crs stop
c. rm -rf /tmp/.oracle
d. rm -rf /var/tmp/.oracle
e. rm -rf /etc/oracle
f. 3rd node
chown root:oinstall log cdata
g. run root.sh

It worked without any issues.

Node 3 run ./vipca

Node 1 oracle user: cat $ORA_CRS_HOME/opmn/conf/ons.config and check for remote port
cd $ORA_CRS_HOME/bin
./racgons add_config node3:remote port

Oracle Home installation

oracle user
Node 1 cd $ORACLE_HOME/oui/bin
./addNode.sh

In case you receive the following message then run oui in silent mode.

oui:10009 --> There are no new nodes to add
OUI will show the new node
./addNode.sh -silent "CLUSTER_NEW_NODES={el3}" -logLevel trace -debug

Questions or Comments

Download the toolbar and Stay connected with Live DBA