如何在oracle 集群中更换私有网络的网卡。
今天是2014-03-17，目前学习进度也正在紧锣密鼓的进行着，今天把一小部分实验在做一下记录一下笔记。
我们知道RAC网络有私有网络和公用网络，公用网络提供客户访问请求，私用网络提供oracle 的cache fusion和节点心跳等作用，因为在11G R2可以执行4个private network 进行cache fusion。
但在刚刚开始安装的时候进行了忽略，那么安装之后如何修改呢?且该环节可以模拟oracle RAC怎么添加私用网卡，如果替换损坏网卡等真实环节。
另外对于网络调整无非有、更改私用主机名阿不改变网段和掩码改变私用地址阿改变私有网络的mtu阿改变私有网卡子网或是掩码，这么几种情况。
今天就谈如何改变私网网卡。那么这时候需要使用一个工具叫oracle interface configuration assistant(oifcfg).
在11G r2之前，oracle在ocr中存储网络接口名称和子网信息，那么使用oifcfg即可完成修改：
1、增加和删除私网接口
增加一个私网接口
$ORA_CRS_HOME/bin/oifcfg setif -global /:cluster_interconnect
删除一个私网接口
$ORA_CRS_HOME/bin/oifcfg delif -global /
2、查看网卡改变情况
$ORA_CRS_HOME/bin/oifcfg getif
3、重启集群
crsctl stop crs
crsctl start crs
那么对于oracle 11G R2或是更高版本，如何修改私网呢?
在11.2gi中，私有网络配置不在保存在ocr中，而是保存在gpnp profile文件中，该文件是一个xml文件，不推荐使用手动编辑，在进行配置私网之前
首先需要备份该文件，进而进行后续操作。由于我的实验环境正好是11.2.0.4，因此随即记录真实修改过程。
1、备份gpnp profile 文件(每个节点都要备份)。
节点一：
?
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
[root@rac-one cdgi]# su - grid
[grid@rac-one ~]$ cd /u01/app/11.2.0/grid/gpnp/rac-one/profiles/peer/
[grid@rac-one peer]$ ls -l
total 12
-rw-r--r-- 1 grid oinstall 1857 Feb 25 21:54 profile.old
-rw-r--r-- 1 grid oinstall 1830 Feb 13 02:51 profile_orig.xml
-rw-r--r-- 1 grid oinstall 1896 Feb 25 21:58 profile.xml
[grid@rac-one peer]$ cp profile.xml profile.xml_bak
[grid@rac-one peer]$ ls -ltr
total 16
-rw-r--r-- 1 grid oinstall 1830 Feb 13 02:51 profile_orig.xml
-rw-r--r-- 1 grid oinstall 1857 Feb 25 21:54 profile.old
-rw-r--r-- 1 grid oinstall 1896 Feb 25 21:58 profile.xml
-rw-r--r-- 1 grid oinstall 1896 Mar 17 17:47 profile.xml_bak
[grid@rac-one peer]$
节点二：
?
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
[root@rac-two ~]# su - grid
[grid@rac-two ~]$ cd /u01/app/11.2.0/grid/gpnp/rac-two/profiles/peer/
[grid@rac-two peer]$ ls -l
total 12
-rw-r--r-- 1 grid oinstall 1857 Feb 25 21:54 profile.old
-rw-r--r-- 1 grid oinstall 1830 Feb 13 02:27 profile_orig.xml
-rw-r--r-- 1 grid oinstall 1896 Feb 25 21:58 profile.xml
[grid@rac-two peer]$ cp profile.xml profile.xml_bak
[grid@rac-two peer]$ ls -ltr
total 16
-rw-r--r-- 1 grid oinstall 1830 Feb 13 02:27 profile_orig.xml
-rw-r--r-- 1 grid oinstall 1857 Feb 25 21:54 profile.old
-rw-r--r-- 1 grid oinstall 1896 Feb 25 21:58 profile.xml
-rw-r--r-- 1 grid oinstall 1896 Mar 17 17:48 profile.xml_bak
[grid@rac-two peer]$
2、查看目前节点私网信息
节点二：
?
1
2
3
4
5
6
7
8
9
10
[grid@rac-two peer]$ oifcfg getif
eth0 192.168.4.0 global public
eth3 192.168.2.0 global cluster_interconnect
[grid@rac-two peer]$ oifcfg iflist -p -n
eth0 192.168.4.0 PRIVATE 255.255.255.0
eth3 192.168.2.0 PRIVATE 255.255.255.0
eth3 169.254.0.0 UNKNOWN 255.255.0.0
eth1 192.168.1.0 PRIVATE 255.255.255.0
eth2 192.168.1.0 PRIVATE 255.255.255.0
[grid@rac-two peer]$
节点一：
?
1
2
3
4
5
6
7
8
9
10
[grid@rac-one peer]$ oifcfg getif
eth0 192.168.4.0 global public
eth3 192.168.2.0 global cluster_interconnect
[grid@rac-one peer]$ oifcfg iflist -p -n
eth0 192.168.4.0 PRIVATE 255.255.255.0
eth1 192.168.1.0 PRIVATE 255.255.255.0
eth2 192.168.1.0 PRIVATE 255.255.255.0
eth3 192.168.2.0 PRIVATE 255.255.255.0
eth3 169.254.0.0 UNKNOWN 255.255.0.0
[grid@rac-one peer]$
目前可以知道集群内部连接私有网络设备名为eth3，所需要做的是将集群内部私有网络设备名由eth3改变为eth1和eth2.
3、增加新的集群内部连接
?
1
2
3
[grid@rac-one peer]$ oifcfg setif -global eth1/192.168.1.0:cluster_interconnect
[grid@rac-one peer]$ oifcfg setif -global eth2/192.168.1.0:cluster_interconnect
[grid@rac-one peer]$
4、验证
节点一：
?
1
2
3
4
5
6
[grid@rac-one peer]$ oifcfg getif
eth0 192.168.4.0 global public
eth3 192.168.2.0 global cluster_interconnect
eth1 192.168.1.0 global cluster_interconnect
eth2 192.168.1.0 global cluster_interconnect
[grid@rac-one peer]$
节点二：
?
1
2
3
4
5
6
[grid@rac-two peer]$ oifcfg getif
eth0 192.168.4.0 global public
eth3 192.168.2.0 global cluster_interconnect
eth1 192.168.1.0 global cluster_interconnect
eth2 192.168.1.0 global cluster_interconnect
[grid@rac-two peer]$
5、删除192.168.2.0这个集群内部连接：
[grid@rac-two peer]$ oifcfg delif -global eth3/192.168.2.0
[grid@rac-two peer]$
6、在所有节点关闭集群和禁用crs服务且重启
节点一：
?
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
root@rac-one cdgi]# ./crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac-one'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac-one'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac-one'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac-one'
CRS-2673: Attempting to stop 'ora.GIDG.dg' on 'rac-one'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'rac-one'
CRS-2673: Attempting to stop 'ora.DATADG.dg' on 'rac-one'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac-one'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac-one'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.rac-one.vip' on 'rac-one'
CRS-2677: Stop of 'ora.DATADG.dg' on 'rac-one' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'rac-one' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'rac-two'
CRS-2677: Stop of 'ora.registry.acfs' on 'rac-one' succeeded
CRS-2677: Stop of 'ora.rac-one.vip' on 'rac-one' succeeded
CRS-2672: Attempting to start 'ora.rac-one.vip' on 'rac-two'
CRS-2676: Start of 'ora.scan1.vip' on 'rac-two' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'rac-two'
CRS-2676: Start of 'ora.rac-one.vip' on 'rac-two' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.GIDG.dg' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac-one'
CRS-2677: Stop of 'ora.asm' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac-one'
CRS-2677: Stop of 'ora.ons' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac-one'
CRS-2677: Stop of 'ora.net1.network' on 'rac-one' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac-one' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac-one'
CRS-2673: Attempting to stop 'ora.crf' on 'rac-one'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac-one'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac-one'
CRS-2673: Attempting to stop 'ora.asm' on 'rac-one'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac-one'
CRS-2677: Stop of 'ora.mdnsd' on 'rac-one' succeeded
CRS-2677: Stop of 'ora.crf' on 'rac-one' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac-one' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac-one'
CRS-2677: Stop of 'ora.ctssd' on 'rac-one' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac-one'
CRS-2677: Stop of 'ora.cssd' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac-one'
CRS-2677: Stop of 'ora.drivers.acfs' on 'rac-one' succeeded
CRS-2677: Stop of 'ora.gipcd' on 'rac-one' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac-one'
CRS-2677: Stop of 'ora.gpnpd' on 'rac-one' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac-one' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac-one cdgi]# crsctl disable crs
-bash: crsctl: command not found
[root@rac-one cdgi]# ./crsctl disable crs
CRS-4621: Oracle High Availability Services autostart is disabled.
[root@rac-one cdgi]# ./crsctl enable crs
CRS-4622: Oracle High Availability Services autostart is enabled.
[root@rac-one cdgi]# ./crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
节点二：
?
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
[root@rac-two ~]# cd /u01/app/11.2.0/grid/bin/
[root@rac-two bin]# ./crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac-two'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac-two'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac-two'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac-two'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac-two'
CRS-2673: Attempting to stop 'ora.GIDG.dg' on 'rac-two'
CRS-2673: Attempting to stop 'ora.registry.acfs' on 'rac-two'
CRS-2673: Attempting to stop 'ora.DATADG.dg' on 'rac-two'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac-two'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac-two'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac-two'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac-two'
CRS-2673: Attempting to stop 'ora.rac-two.vip' on 'rac-two'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac-two'
CRS-2677: Stop of 'ora.cvu' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac-two'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac-two'
CRS-2677: Stop of 'ora.DATADG.dg' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.rac-two.vip' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.rac-one.vip' on 'rac-two'
CRS-2677: Stop of 'ora.registry.acfs' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.scan3.vip' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.rac-one.vip' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.GIDG.dg' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac-two'
CRS-2677: Stop of 'ora.oc4j' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac-two'
CRS-2677: Stop of 'ora.ons' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac-two'
CRS-2677: Stop of 'ora.net1.network' on 'rac-two' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac-two' has completed
CRS-2677: Stop of 'ora.crsd' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'rac-two'
CRS-2673: Attempting to stop 'ora.crf' on 'rac-two'
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac-two'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac-two'
CRS-2673: Attempting to stop 'ora.asm' on 'rac-two'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac-two'
CRS-2677: Stop of 'ora.crf' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.evmd' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac-two'
CRS-2677: Stop of 'ora.ctssd' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac-two'
CRS-2677: Stop of 'ora.drivers.acfs' on 'rac-two' succeeded
CRS-2677: Stop of 'ora.cssd' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac-two'
CRS-2677: Stop of 'ora.gipcd' on 'rac-two' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac-two'
CRS-2677: Stop of 'ora.gpnpd' on 'rac-two' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac-two' has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac-two bin]# ./crsctl enable crs
CRS-4622: Oracle High Availability Services autostart is enabled.
[root@rac-two bin]# ./crsctl start crs
CRS-4123: Oracle High Availability Services has been started.
[root@rac-two bin]#
7、验证
?
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
[grid@rac-two ~]$ crsctl status resource -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATADG.dg
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.GIDG.dg
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.LISTENER.lsnr
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.asm
ONLINE ONLINE rac-one Started
ONLINE ONLINE rac-two Started
ora.gsd
OFFLINE OFFLINE rac-one
OFFLINE OFFLINE rac-two
ora.net1.network
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.ons
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
ora.registry.acfs
ONLINE ONLINE rac-one
ONLINE ONLINE rac-two
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac-two
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE rac-one
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE rac-one
ora.cvu
1 ONLINE ONLINE rac-one
ora.oc4j
1 ONLINE ONLINE rac-one
ora.rac-one.vip
1 ONLINE ONLINE rac-one
ora.rac-two.vip
1 ONLINE ONLINE rac-two
ora.rac.db
1 OFFLINE OFFLINE Instance Shutdown
2 OFFLINE OFFLINE Instance Shutdown
ora.scan1.vip
1 ONLINE ONLINE rac-two
ora.scan2.vip
1 ONLINE ONLINE rac-one
ora.scan3.vip
1 ONLINE ONLINE rac-one
[grid@rac-two ~]$
[grid@rac-two ~]$ oifcfg getif
eth0 192.168.4.0 global public
eth1 192.168.1.0 global cluster_interconnect
eth2 192.168.1.0 global cluster_interconnect
[grid@rac-two ~]$ oifcfg iflist -p -n
eth0 192.168.4.0 PRIVATE 255.255.255.0
eth3 192.168.2.0 PRIVATE 255.255.255.0
eth1 192.168.1.0 PRIVATE 255.255.255.0
eth1 169.254.0.0 UNKNOWN 255.255.128.0
eth2 192.168.1.0 PRIVATE 255.255.255.0
eth2 169.254.128.0 UNKNOWN 255.255.128.0
[grid@rac-two ~]$
至此完成修改。
