一、准备工作

1，数据库环境

操作系统版本  : RedHat 7.2 x64   
数据库版本    : Oracle 11.2.0.4 x64 RAC    
Grid          : 11.2.0.4     
Oracle database: 11.2.0.4

2，准备内容

GI PSU : p215****75_112040_Linux-x86-64.zip    
OPatch : p688****80_112000_Linux-x86-64.zip    
DB PSU : p213****35_112040_Linux-x86-64.zip 仅单实例使用。

OPatch下载地址：   
https://updates.oracle.com/download/688****80.html

注意：GI PSU包括DB PSU,CPU。

二、更新OPatch版本，必须要更新

说明：分别在两个节点更新OPatch版本。

1. 更新OPatch版本，需要更新到11.2.0.3.11，OPatch直接压缩替换就可以了。

(1) 上传p688****80_112000_Linux-x86-64.zip到/u01/software目录下, /u01/software给777权限，也可以采用/tmp目录。   
(2) root用户下将原OPatch目录改名。

mv /u01/app/11.2.0/grid/OPatch /u01/app/11.2.0/grid/OPatchbk   
mv /u01/app/oracle/product/11.2.0/db_1/OPatch /u01/app/oracle/product/11.2.0/db_1/OPatchBK

2. grid目录OPatch替换

(1) root用户   
cd /u01/software/;chown grid:oinstall p688****80_112000_Linux-x86-64.zip

(2) grid用户

su - grid   
cd /u01/software/    
unzip p688****80_112000_Linux-x86-64.zip

(3) root用户

cd /u01/software/   
mv OPatch /u01/app/11.2.0/grid/

(4) grid用户测试

su - grid   
/u01/app/11.2.0/grid/OPatch/opatch version

OPatch Version: 11.2.0.3.11   
OPatch succeeded.

3. oracle目录OPatch替换

(1) root用户

cd /u01/software/;chown oracle:oinstall p688****80_112000_Linux-x86-64.zip

(2) oracle用户

su - oracle   
cd /u01/software/    
unzip p688****80_112000_Linux-x86-64.zip

(3) root用户

cd /u01/software/   
mv OPatch /u01/app/oracle/product/11.2.0/db_1/

(4) oracle用户测试

su - oracle

/u01/app/oracle/product/11.2.0/db_1/OPatch/opatch version

OPatch Version: 11.2.0.3.11   
OPatch succeeded.

三、开始升级GI PSU软件包

1. 前提

(1) root用户下打grid需要关闭grid(两节点都执行)

cd /u01/app/11.2.0/grid/bin   
./crsctl stop has

2. grid用户下解决GI PSU补丁包

(1) root用户操作

cd /u01/software/;chown grid:oinstall p215****75_112040_Linux-x86-64.zip

(2) grid用户操作

su - grid   
cd /u01/software/;unzip p215****75_112040_Linux-x86-64.zip

3. grid用户下测试兼容性，针对多次打CPU的环境中。

$ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/software/215****75/213****49 -oh $ORACLE_HOME    
$ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/software/215****75/213****42 -oh $ORACLE_HOME     
$ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/software/215****75/213****35 -oh $ORACLE_HOME

----------------------------------------------------   
执行示例如下：    
Oracle Interim Patch Installer version 11.2.0.3.11    
Copyright (c) 2015, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home      : /u01/app/11.2.0/grid   
Central Inventory : /u01/app/oraInventory    
  from          : /u01/app/11.2.0/grid/oraInst.loc    
OPatch version    : 11.2.0.3.11    
OUI version      : 11.2.0.4.0    
Log file location : /u01/app/11.2.0/grid/cfgtoollogs/opatch/opatch2015-12-18_16-21-46PM_1.log

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.

四、开始升级GRID

1. 依次节点1，节点2上执行。

第1步: 执行脚本, 一定要执行，否则无法成功，确保CRS是关闭状态。

也可以先查看补丁包中的README文件。

[root@db1 bin]# /u01/app/11.2.0/grid/crs/install/rootcrs.pl -unlock

Using configuration parameter file: /grid/grid_home/crs/install/crsconfig_params    
CRS-4544: Unable to connect to OHAS     
CRS-4000: Command Stop failed, or completed with errors.     
Successfully unlock /grid/grid_home

[root@db1 bin]#

第2步：下载补丁包（目前11.2.0.4.8 PSU），准备升级

su - grid

/u01/app/11.2.0/grid/OPatch/opatch napply -oh $ORACLE_HOME -local /u01/software/215****75/213****49   
/u01/app/11.2.0/grid/OPatch/opatch napply -oh $ORACLE_HOME -local /u01/software/215****75/213****42    
/u01/app/11.2.0/grid/OPatch/opatch napply -oh $ORACLE_HOME -local /u01/software/215****75/213****35

过程中按三个Y

2. 检查升级情况

$ /u01/app/11.2.0/grid/OPatch/opatch lsinv    
                                                    
Patch  213****35    : applied on Fri Dec 18 17:38:24 CST 2015    
Unique Patch ID:  192****62    
Patch description:  "Database Patch Set Update : 11.2.0.4.8 (213****35)"    
  Created on 1 Sep 2015, 07:49:44 hrs     
Sub-patch  20760982; "Database Patch Set Update : 11.2.0.4.7 (20760982)"    
Sub-patch  20299013; "Database Patch Set Update : 11.2.0.4.6 (20299013)"    
Sub-patch  197****89; "Database Patch Set Update : 11.2.0.4.5 (197****89)"    
Sub-patch  191****51; "Database Patch Set Update : 11.2.0.4.4 (191****51)"    
Sub-patch  185****09; "Database Patch Set Update : 11.2.0.4.3 (185****09)"    
Sub-patch  18031668; "Database Patch Set Update : 11.2.0.4.2 (18031668)"    
Sub-patch  174****14; "Database Patch Set Update : 11.2.0.4.1 (174****14)"    
  Bugs fixed:    
…

$ /u01/app/11.2.0/grid/OPatch/opatch lspatches

213****35;Database Patch Set Update : 11.2.0.4.8 (213****35)   
213****42;ACFS Patch Set Update : 11.2.0.4.8 (213****42)    
213****49;OCW Patch Set Update : 11.2.0.4.8 (213****49)

OPatch succeeded.

3. 两节点启动crs

说明：因为是手动打PSU,需要手动进行关闭与启动操作。   
# cd /u01/app/11.2.0/grid/bin    
# ./crsctl start has    
CRS-4123: Oracle High Availability Services has been started.

五、打database PSU补丁

1. 准备工作

(1) Root用户下，重新给PSU补丁包赋予权限

cd /u01/software/   
rm -rf 215****75    
chown oracle:oinstall p215****75_112040_Linux-x86-64.zip

(2) oracle用户

su - oracle   
cd /u01/software/;unzip p215****75_112040_Linux-x86-64.zip

(3) Oracle用户下检查兼容性,针对多次打CPU的环境中。

$ORACLE_HOME/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /u01/software/215****75/213****35 -oh $ORACLE_HOME    
----------------------------------------------------    
Oracle Interim Patch Installer version 11.2.0.3.11    
Copyright (c) 2015, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home      : /u01/app/oracle/product/11.2.0/db_1   
Central Inventory : /u01/app/oraInventory    
  from          : /u01/app/oracle/product/11.2.0/db_1/oraInst.loc    
OPatch version    : 11.2.0.3.11    
OUI version      : 11.2.0.4.0    
Log file location : /u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatch/opatch2015-12-21_09-25-57AM_1.log

Invoking prereq "checkconflictagainstohwithdetail"

Prereq "checkConflictAgainstOHWithDetail" passed.

OPatch succeeded.   
----------------------------------------------------

2. oracle database打补丁，还是用同一个补丁包

su - oracle

opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /home/app/25476126 -oh $ORACLE_HOME    
./opatch napply -oh $ORACLE_HOME -local /home/app/25476126/
/u01/app/oracle/product/11.2.0/db_1/OPatch/opatch napply -oh $ORACLE_HOME -local /u01/software/215****75/213****35

查看打补丁情况：

/u01/app/oracle/product/11.2.0/db_1/OPatch/opatch lsinv   
/u01/app/oracle/product/11.2.0/db_1/OPatch/opatch lspatches

六、升级数据库数据字典（此步骤可选，如果还未创建数据库可以不用做此步骤）

1. 数据库启动

(1) root用户下打grid需要关闭grid(两节点都执行)

cd /u01/app/11.2.0/grid/bin   
./crsctl start has

或直接执行如下命令，同时关闭两个节点。   
./crs_start -all

$ sqlplus / as sysdba    
  
SQL*Plus: Release 11.2.0.4.0 Production on Fri Mar 15 13:40:39 2013    
  
Copyright (c) 1982, 2011, Oracle.  All rights reserved.    
  
Connected to an idle instance.    
  
SQL> startup

ORA-01565: error in identifying file '+DATA/orcl/spfileorcl.ora'   
ORA-17503: ksfdopn:2 Failed to open file +DATA/orcl/spfileorcl.ora    
ORA-15001: diskgroup "DATA" does not exist or is not mounted    
ORA-15040: diskgroup is incomplete    
ORA-15040: diskgroup is incomplete    
ORA-15040: diskgroup is incomplete

说明：无法启动数据库，经过查询是因为oracle权限被更改为oracle:oinstall。通过如下方式解决。     
在集群的所有节点上执行如下命令修改：       
# chown oracle:asmadmin /u01/app/oracle/product/11.2.0/db_1/bin/oracle       
# chmod 6751 /u01/app/oracle/product/11.2.0/db_1/bin/oracle

SQL> startup   
ORACLE instance started.

Total System Global Area 250533****80 bytes   
Fixed Size                  225****32 bytes    
Variable Size            687****20 bytes    
Database Buffers        179****12 bytes    
Redo Buffers              20054016 bytes    
Database mounted.    
Database opened.

SQL> @?/rdbms/admin/catbundle.sql psu apply   
中间等待过程。

执行完后我们可以查到PSU更新信息：   
SQL>

set line 150   
col ACTION_TIME for a30    
col ACTION for a8    
col NAMESPACE for a8    
col VERSION for a10    
col BUNDLE_SERIES for a5    
col COMMENTS for a20    
select * from dba_registry_history;

ACTION_TIME                    ACTION  NAMESPAC VERSION            ID BUNDL COMMENTS   
------------------------------ -------- -------- ---------- ---------- ----- --------------------    
24-AUG-13 12.03.45.119862 PM  APPLY    SERVER  11.2.0.4            0 PSU  Patchset 11.2.0.2.0    
22-DEC-15 03.53.27.330912 PM  APPLY    SERVER  11.2.0.4            0 PSU  Patchset 11.2.0.2.0    
24-DEC-15 04.58.29.381100 PM  APPLY    SERVER  11.2.0.4            8 PSU  PSU 11.2.0.4.8

3 rows selected.

六、升级中碰到问题

 在升级过程遇到一个问题

[grid@ygc26 OPatch]$ ./opatch napply -oh $ORACLE_HOME -local /home/app/25476126/

Oracle Interim Patch Installer version 11.2.0.3.15

Copyright (c) 2017, Oracle Corporation.  All rights reserved.

Oracle Home       : /home/app/11.2.0.4/grid

Central Inventory : /home/app/oraInventory

   from           : /home/app/11.2.0.4/grid/oraInst.loc

OPatch version    : 11.2.0.3.15

OUI version       : 11.2.0.4.0

Log file location : /home/app/11.2.0.4/grid/cfgtoollogs/opatch/opatch2017-04-27_21-04-32PM_1.log

Verifying environment and performing prerequisite checks…

Prerequisite check "CheckActiveFilesAndExecutables" failed.

The details are:

Following executables are active :

/home/app/11.2.0.4/grid/lib/libclntsh.so.11.1

Prerequisite check "CheckActiveFilesAndExecutables" failed.

The details are:

Following executables are active :

/home/app/11.2.0.4/grid/lib/libsqlplus.so

UtilSession failed: Prerequisite check "CheckActiveFilesAndExecutables" failed.Prerequisite check "CheckActiveFilesAndExecutables" failed.

Log file location: /home/app/11.2.0.4/grid/cfgtoollogs/opatch/opatch2017-04-27_21-04-32PM_1.log

OPatch failed with error code 73

检查下那些文件又问题

[grid@ygc26 OPatch]$ ./opatch prereq CheckActiveFilesAndExecutables -phBaseDir /home/app/25476126/ -oh $ORACLE_HOME
Oracle Interim Patch Installer version 11.2.0.3.15
Copyright (c) 2017, Oracle Corporation.  All rights reserved.

PREREQ session

Oracle Home       : /home/app/11.2.0.4/grid
Central Inventory : /home/app/oraInventory
   from           : /home/app/11.2.0.4/grid/oraInst.loc
OPatch version    : 11.2.0.3.15
OUI version       : 11.2.0.4.0
Log file location : /home/app/11.2.0.4/grid/cfgtoollogs/opatch/opatch2017-04-27_21-05-50PM_1.log

Invoking prereq "checkactivefilesandexecutables"

Prereq "checkActiveFilesAndExecutables" for patch 22502505 passed.

Prereq "checkActiveFilesAndExecutables" for patch 23054319 passed.

Prereq "checkActiveFilesAndExecutables" for patch 17478514 failed.

The details are:

Following executables are active :
/home/app/11.2.0.4/grid/lib/libclntsh.so.11.1

Prereq "checkActiveFilesAndExecutables" for patch 18031668 passed.

Prereq "checkActiveFilesAndExecutables" for patch 18522509 passed.

Prereq "checkActiveFilesAndExecutables" for patch 19121551 passed.

Prereq "checkActiveFilesAndExecutables" for patch 19769489 passed.

Prereq "checkActiveFilesAndExecutables" for patch 20299013 passed.

Prereq "checkActiveFilesAndExecutables" for patch 20760982 passed.

Prereq "checkActiveFilesAndExecutables" for patch 21352635 passed.

Prereq "checkActiveFilesAndExecutables" for patch 21948347 passed.

Prereq "checkActiveFilesAndExecutables" for patch 22502456 passed.

Prereq "checkActiveFilesAndExecutables" for patch 23054359 passed.

Prereq "checkActiveFilesAndExecutables" for patch 24006111 failed.

The details are:

Following executables are active :
/home/app/11.2.0.4/grid/lib/libsqlplus.so

Prereq "checkActiveFilesAndExecutables" for patch 24732075 passed.

OPatch succeeded.

也是报相同的错误，使用fuser和lsof检查

root@ygc26 app]# fuser /home/app/11.2.0.4/grid/lib/libclntsh.so.11.1
/home/app/11.2.0.4/grid/lib/libclntsh.so.11.1: 25740m
[root@ygc26 app]# 
[root@ygc26 app]# lsof /home/app/11.2.0.4/grid/lib/libclntsh.so.11.1
lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/42/gvfs
      Output information may be incomplete.
COMMAND   PID USER  FD   TYPE DEVICE SIZE/OFF      NODE NAME
sqlplus 25740 grid mem    REG  253,2 53796056 932514326 /home/app/11.2.0.4/grid/lib/libclntsh.so.11.1

原来是我刚才通过sqlplus进入asm实例，一直没退出来，杀掉。该进程，继续patch 一切顺利。

参考：https://blog.csdn.net/zhang123456456/article/details/63688446