Thursday, October 30, 2014

Exalogic Patching - Virtual

Links to this post
This is procedure to apply Exalogic Virtual 2.0.6.1.1 April 2014 Patchset.

1 Set up the PSU
2 Run precheck for Patch
3 Create Rack History File.
4 Apply Patch on Exalogic Control servers.
5 Upgrade QDR InfiniBand (NM2-GW) Gateway Switches.
6 Update the Compute Node Base Image ROLLING.
7 Patch the OVMM, PC1, and PC2 Templates
8 Upgrade the Guest vServer  (VN02)
9 Observation
10 Reference

Important Notes About the Upgrade Procedure


Always run ExaPatch from the PSU bundle directory (where the  exapatch_descriptor.py file is located) using the full path to   exapatch from any compute node within the rack.
Do not run ExaPatch directly on the compute node being patched.
ExaPatch patches the NM2-GW and NM2-36P switches one switch at a time
(rolling upgrade). The switch running the master subnet manager is
patched after patching all the non-master switches.
The upgrade procedure supports upgrading the compute nodes one node at   a time (rolling upgrade). Upgrading one node at a time ensures that the hosted services and applications are not disrupted.
Oracle recommends that these patches be applied to a test or a   nonproduction system before it is applied to the production system. The total time taken for patching the test system can be used as a   baseline for scheduling the maintenance windows to patch the production system.
Perform the patching by following the steps exactly as documented in this readme.


--------------------------------------------
1 Set up the PSU
--------------------------------------------

~~~~~~~~

1. Log in to the compute node as root.
2. cd /exalogic-lcdata/patches
3. Add execute permissions for psuSetup.sh using the chmod command. In the following example,
      execute permissions for all users is added:
      # chmod a+x psuSetup.sh
4.  Run the script:
./psuSetup.sh ZFS_IP_Address [--mountonly] [--unmountonly] [--remount] [--verbose] [--force ] [--help]

[root@DummyCN01 patches]# ./psuSetup.sh 1.1.1.10

INFO: Pre-requiste Check...
INFO: Checking for Python version...
INFO: Python version check... succeeded
INFO: Checking for Root permissions...
INFO: /exalogic-lcdata is already mounted from 1.1.1.10
INFO: /exalogic-lctools is already mounted from 1.1.1.10
INFO: Extracting PSU Bundle data to /exalogic-lcdata. This will take a few minutes
ExaBR 1.1 (build 5951)
ExaBR 1.1 (build 5951)
INFO: /exalogic-lctools Version: 14.1 and expatch Version: 1.2.1 is already installed
INFO: Installation complete.
INFO: ExaPatch is installed in /exalogic-lctools/bin/exapatch
INFO: PSU is installed in /exalogic-lcdata/patches/Virtual/18178980/
#####

--------------------------------------------
2 Run precheck for Patch
--------------------------------------------

~~~~~~~~

1) Copy config file. 
cp /exalogic-lcdata/patches/Virtual/18178980/Infrastructure/2.0.6.1.1/exapatch_descriptor.py ./exalogic-lctools/bin
2) Cd to exapatch directory 
cd /exalogic-lcdata/patches/Virtual/18178980/Infrastructure/2.0.6.1.1/exalogic-lctools/bin
3) Run Exapatch pre-Patch check.
[root@DummyCN01 bin]# exapatch -a prePatchCheck
Logging to file /var/log/exapatch_20150730200807.log
log file: /var/log/exapatch_20200730200807.log
#####

Check authentication from Exapatch

The following prerequisites must be fulfilled on all Exalogic Control  vServers before they can be upgraded to version 12.1.4 b2500
 
When updating the Exalogic Control services, ExaPatch must be run on a compute node with TCP/IP access to all Exalogic Control vServers.
All the Exalogic Control vServers must be running. Verify that access to vServer-EC-OVMM and to the two vServer-EC-EMOC-PC is OK by running
   the following ExaPatch command:
         [root@compute-node]# /exalogic-lctools/bin/exapatch -a checkAuthentication
Log in to the Exalogic Control BUI and make sure that assets(switches storage) are managed by a single ProxyController(PC) at a time. If any of the assets appear to be managed by both the ProxyControllers, refer
           to the Troubleshooting section.
Back up the Exalogic Control Stack using the ExaBR tool, as described in Section 4.1 of Oracle Exalogic Elastic Cloud Backup and Recovery Guide Using ExaBR


-------------------------------------------------
3) Create Rack History File.
-------------------------------------------------

~~~~~~~~
[root@DummyCN01 bin]# ./exapatch -a getHistory
"/exalogic-lcdata/inventory/rack_history.xml"
INFO: Creating rack history file: /exalogic-lcdata/inventory/rack_history.xml
INFO: Updated rack history file: /exalogic-lcdata/inventory/rack_history.xml
#####

Make sure each component is in rack_history file.
WARNING: unable to update patch history: Unable to find unique identifier "xxyyzz123" for Compute-Node 1.1.557.66 in the rack history file.

-------------------------------------------------
4 ) Apply Patch on Exalogic Control servers.
-------------------------------------------------

1. Cd to Patch directory                                                                                       .
Cd /exalogic-lcdata/patches/1.78980/Infrastructure/2.0.6.1.1
2. Run the ExaPatch tool as follows:

~~~~~~~~
[root@DummyCN01 2.0.6.1.1]# /exalogic-lctools/bin/exapatch -a runExtension -p Exalogic_Control/emoc_patch_extension.py exapatch_descriptor.py
Logging to file /var/log/exapatch_20200804100747.log
Enter Compute-Node root password:
Enter ILOM-ComputeNode root password:
Enter ILOM-ZFS root password:
Enter vServer-EC-EMOC-PC 1.1.557.74 root password:
Enter vServer-EC-EMOC-PC 1.1.557.75 root password:
Enter EMOC-PC-service 1.1.557.74 root password:
Enter EMOC-PC-service 1.1.557.75 root password:
INFO: EMOC-PC-service 1.1.557.74 successfully completed all pre-patch checks
INFO: EMOC-PC-service 1.1.557.75 successfully completed all pre-patch checks
INFO: EMOC-EC-service 1.1.558.21 successfully completed all pre-patch checks
Upgrading PC software on EMOC-PC-service host 1.1.557.74 from version:
        12.1.4.2330
WARNING: unable to update patch history: RackHistory source file "/exalogic-lcdata/inventory/rack_history.xml" does not exist.
Upgrading PC software on EMOC-PC-service host 1.1.557.75 from version:
        12.1.4.2330
WARNING: unable to update patch history: RackHistory source file "/exalogic-lcdata/inventory/rack_history.xml" does not exist.
INFO: EMOC-PC-service 1.1.557.74 successfully completed all post-patch checks
Completed upgrade of PC software on EMOC-PC-service host 1.1.557.74 new version:
        12.1.4.2500
INFO: EMOC-PC-service 1.1.557.75 successfully completed all post-patch checks
Completed upgrade of PC software on EMOC-PC-service host 1.1.557.75 new version:
        12.1.4.2500
Upgrading EC software on EMOC-EC-service host 1.1.558.21 from version:
        12.1.4.2330
INFO: uploading patch bundle to vServer
INFO: running upgrade scripts
WARNING: unable to update patch history: RackHistory source file "/exalogic-lcdata/inventory/rack_history.xml" does not exist.
Completed upgrade of EC software on EMOC-EC-service host 1.1.558.21 new version:
        12.1.4.2500
INFO: EMOC-EC-service 1.1.558.21 successfully completed all post-patch checks
#####

-------------------------------------------------
5) Upgrade QDR InfiniBand (NM2-GW) Gateway Switches.
-------------------------------------------------

~~~~~~~~
----KILL user process.
Log in as root and run the following command:
[root@nm2gw-ib01 ~]# ps -ef | grep ssh


----Reduce the timeout for idle root sessions by editing sshd_config:
 
[root@nm2gw-ib01 ~]# vi /etc/ssh/sshd_config
-- 8< -- 
ClientAliveInterval 60
ClientAliveCountMax 3
-- 8< -- 

Restart the sshd service:
    
---[root@nm2gw-ib01 ~]# service sshd restart 
Stopping sshd:                                             [  OK  ]
Starting sshd:                                             [  OK  ]

---Verify that only one target is displayed by the sessions command, as shown in the following example:

[root@nm2gw-ib01 ~]# spsh
-> show /SP/sessions
/SP/sessions
Targets:
120350 (current)
      Properties:
      Commands:
      cd
      show
----Edit the timeout for the ILOM session:

 -> set /SP/cli timeout=1
 Set 'timeout' to '1'

---Get gwinstance value .
showgwconfig

----Updating the Firmware of the NM2-GW Switches

This step Approximately  41 Min.

Login into compute Node and Cd to Patch directory
Cd /exalogic-lcdata/patches/1.78980/Infrastructure/2.0.6.1.1
Apply Patch

    [root@compute-node]# /exalogic-lctools/bin/exapatch -a patch nm2-gw

[root@DummyCN01 2.0.6.1.1]# /exalogic-lctools/bin/exapatch -a patch nm2-gw
Logging to file /var/log/exapatch_20200804105003.log
INFO: NM2-GW-IB-Switch 1.1.557.72 pre-patch checks may run for approximately 10 minutes.
INFO: NM2-GW-IB-Switch 1.1.557.72 successfully completed all pre-patch checks
Upgrading InfiniBand software on NM2-GW-IB-Switch host 1.1.557.72 from version:
        SUN DCS gw version: 2.1.3-4
        Build time: Aug 28 2013 18.6:06
        FPGA version: 0x34
        SP board info:
        Hardware Revision: 0x0007
        Firmware Revision: 0x0000
        BIOS version: SUN0R100
        BIOS date: 06/22/2010
INFO: IB switch upgrade can take 10-15 minutes.
Completed upgrade of InfiniBand software on NM2-GW-IB-Switch host 1.1.557.72 new version:
        SUN DCS gw version: 2.1.4-1
        Build time: Jan.7 2020 11:18:57
        FPGA version: 0x34
        SP board info:
        Hardware Revision: 0x0007
        Firmware Revision: 0x0000
        BIOS version: SUN0R100
        BIOS date: 06/22/2010
INFO: NM2-GW-IB-Switch 1.1.557.72 post-patch checks may run for approximately 10 minutes.
INFO: NM2-GW-IB-Switch 1.1.557.72 successfully completed all post-patch checks
INFO: Changing master NM2-GW-IB-Switch 1.1.557.71 to standby.
INFO: NM2-GW-IB-Switch 1.1.557.71 pre-patch checks may run for approximately 10 minutes.
INFO: NM2-GW-IB-Switch 1.1.557.71 successfully completed all pre-patch checks
Upgrading InfiniBand software on NM2-GW-IB-Switch host 1.1.557.71 from version:
        SUN DCS gw version: 2.1.3-4
        Build time: Aug 28 2013 18.6:06
        FPGA version: 0x34
        SP board info:
        Hardware Revision: 0x0007
        Firmware Revision: 0x0000
        BIOS version: SUN0R100
        BIOS date: 06/22/2010
INFO: IB switch upgrade can take 10-15 minutes.
Completed upgrade of InfiniBand software on NM2-GW-IB-Switch host 1.1.557.71 new version:
        SUN DCS gw version: 2.1.4-1
        Build time: Jan.7 2020 11:18:57
        FPGA version: 0x34
        SP board info:
        Hardware Revision: 0x0007
        Firmware Revision: 0x0000
        BIOS version: SUN0R100
        BIOS date: 06/22/2010
INFO: NM2-GW-IB-Switch 1.1.557.71 post-patch checks may run for approximately 10 minutes.
INFO: NM2-GW-IB-Switch 1.1.557.71 successfully completed all post-patch checks
2020-08-04T10:50 2020-08-04T11:30:55
#####

-----If exalogic and exadata is connected via spine switch verify-topology will not work , Use ibnetdiscover instead

If the output does not contain all the NM2-GW switches in the rack, verify-topology will fail. To fix this do below.

~~~~~~~~
[root@DummyCN01 bin]# verify-topology
[ Exalogic Machine Infiniband Cabling Topology Verification Tool ]
[ERROR] switch xxyyxxzzz909090 does not configured to set ib node description.
[root@DummyCN01 bin]# ll /opt/exalogic.tools/tools/idgen.sh
-rwxr--r-- 1 root root 869 Oct 18  2013 /opt/exalogic.tools/tools/idgen.sh
[root@DummyCN01 bin]# /opt/exalogic.tools/tools/idgen.sh
spawn ssh-keygen -t dsa
Generating public/private dsa key pair.
Enter file in which to save the key (/root/.ssh/id_dsa):
/root/.ssh/id_dsa already exists.
Overwrite (y/n)? y
Enter passphrase (empty for no passphrase):
Enter same passphrase again:
Your identification has been saved in /root/.ssh/id_dsa.
Your public key has been saved in /root/.ssh/id_dsa.pub.
The key fingerprint is:
root@DummyCN01.domain.com
[root@DummyCN01 bin]# /opt/exalogic.tools/tools/dcli -c 1.1.555.71,1.1.555.72 -k
root@1.1.555.72's password:
root@1.1.555.71's password:
1.1.555.71: ssh key added
1.1.555.72: ssh key added
[root@DummyCN01 bin]# /opt/exalogic.tools/tools/dcli -c 1.1.555.71,1.1.555.72 -f /opt/exalogic.tools/tools/network_tools/switch_node_desc_config.tgz -d /tmp
[root@DummyCN01 bin]# /opt/exalogic.tools/tools/dcli -c 1.1.555.71 -f /opt/exalogic.tools/tools/network_tools/remote_config_switch_node_desc.sh -d /tmp "/tmp/remote_config_switch_node_desc.sh 1"
1.1.555.71: exalogic/
1.1.555.71: exalogic/rc.local
1.1.555.71: exalogic/config_ib_desc.sh
1.1.555.71: exalogic/ib_set_node_desc.sh
1.1.555.71: Successfully configured switch node description
[root@DummyCN01 bin]# /opt/exalogic.tools/tools/dcli -c 1.1.555.72 -f /opt/exalogic.tools/tools/network_tools/remote_config_switch_node_desc.sh -d /tmp "/tmp/remote_config_switch_node_desc.sh 2"
1.1.555.72: exalogic/
1.1.555.72: exalogic/rc.local
1.1.555.72: exalogic/config_ib_desc.sh
1.1.555.72: exalogic/ib_set_node_desc.sh
1.1.555.72: Successfully configured switch node description
#####

-------------------------------------------------
6) Update the Compute Node Base Image ROLLING.
-------------------------------------------------

Note: Updating Base Image on Compute Node does not required reboot of Compute Node.

-----Compute nodes can be patched in the following ways:
Rolling: Patch one node at a time
o This method applies on one node at a time, patching it. With this method, only one node is being patched at any point in time and the other nodes can continue to provide services, but the patching process takes more time.
Parallel: Patch multiple nodes simultaneouly
o This method applies compute node patches/updates across multiple nodes in parallel. Using ExaPatch, you can patch a subset of nodes at a time or patch all the nodes in the Exalogic rack.
It is recommended that you patch one compute node, verify that everything works as expected, and then attempt to patch multiple compute nodes in parallel.

-----Pre-requiste

Before upgrading:
Ensure that the compute node base image is at v2.0.6.1.0.
There is no need to backup the compute nodes. If there is a need to restore a compute node, install the base image and use the Exalogic Configuration Utility (ECU) to configure it.
Ensure that at least 80 MB of free space exists in the root (/) partition. You can free up some disk space by running yum clean all or by deleting files that are not longer needed in the /tmp directory. Do not delete files in the directories: /var/log/xen, /var/tmp/exalogic or /var/tmp/ebi_conf.pre20611.bak. In the /var/log directory, do not delete ExaPatch log files or the file called ebi_20611.log.


------Setup Patch on all Nodes

Transfer psuSetup.sh from the downloaded location to this machine:
    [root@compute-node2]# scp root@compute-node1:~/psuSetup.sh .

Run the psuSetup.sh while specifying ZFS active head IPoIB address and with --mountonly option:
    [root@compute-node2]# ./psuSetup.sh 1.1.555.120 --mountonly

First upgrade compute Node one of the Node.

~~~~~~~~
[root@DummyCN01 2.0.6.1.1]# /exalogic-lctools/bin/exapatch -a patch cn -h 1.1.557.68
Logging to file /var/log/exapatch_202008041.750.log
Enter Compute-Node root password:
INFO: Compute-Node 1.1.557.68 successfully completed all pre-patch checks
Upgrading Base Image software on Compute-Node host 1.1.557.68 from version:
        Image version       : 2.0.6.1.0
        Image build version : 228455
        BIOS                : 25010600-07/08/2013
        OFED                : OFED-IOV-1.5.5-1.0.054
        InfiniBand card     : 2.11.1282
        Disk controller     : 12.12.0-.78
Completed upgrade of Base Image software on Compute-Node host 1.1.557.68 new version:
        Image version       : 2.0.6.1.1
        Image build version : 228455
        BIOS                : 25010600-07/08/2013
        OFED                : OFED-IOV-1.5.5-1.0.054
        InfiniBand card     : 2.11.1282
        Disk controller     : 12.12.0-.78
INFO: Compute-Node 1.1.557.68 successfully completed all post-patch checks
#####


Now Upgrade compute Node rest of The Node.

~~~~~~~~
[root@DummyCN02 2.0.6.1.1]#/exalogic-lctools/bin/exapatch -a patch cn -h 1.1.557.63 -h 1.1.557.64 -h 1.1.557.65 -h 1.1.557.66 -h 1.1.557.67
Logging to file /var/log/exapatch_20200804124409.log
Enter Compute-Node root password:
        Image build version : 228455
        BIOS                : 25010600-07/08/2013
        OFED                : OFED-IOV-1.5.5-1.0.054
        InfiniBand card     : 2.11.1282
        Disk controller     : 12.12.0-.78
Upgrading Base Image software on Compute-Node host 1.1.557.63 from version:
        Image version       : 2.0.6.1.0
        Image build version : 228455
        BIOS                : 25010600-07/08/2013
        OFED                : OFED-IOV-1.5.5-1.0.054
        InfiniBand card     : 2.11.1282
        Disk controller     : 12.12.0-.78
WARNING: unable to update patch history: Unable to find unique identifier "xyxyxyxy" for Compute-Node 1.1.557.66 in the rack history file.
Completed upgrade of Base Image software on Compute-Node host 1.1.557.64 new version:
        Image version       : 2.0.6.1.1
        Image build version : 228455
        BIOS                : 25010600-07/08/2013
        OFED                : OFED-IOV-1.5.5-1.0.054
        InfiniBand card     : 2.11.1282
        Disk controller     : 12.12.0-.78
INFO: Compute-Node 1.1.557.64 successfully completed all post-patch checks


#####

----Verify upgrade.
This process takes less than 5 minutes. The main update to compute node is ksplice and version update. This does not cause a reboot on the compute node being upgraded. You may connect to the serial console through ILOM and monitor the upgrade process.
After all the compute nodes, other than the one on which ExaPatch is running, have been upgraded, log in to the second compute node (cn02) and run ExaPatch to upgrade the first (cn01) compute node.
Verify the new compute node base image version in the ExaPatch output:

~~~~~~~~

[root@DummyCN01 ~]# dcli -g cn_group.txt 'imageinfo | grep "Image version"'
DummyCN01: Image version       : 2.0.6.1.1

Get Version of Image History. 

[root@DummyCN01 ~]# dcli -g cn_group.txt 'imagehistory | grep "Image version"'
DummyCN01: Image version       : 2.0.6.1.1
DummyCN01: Image version       : 2.0.6.1.0

#####



-------------------------------------------------
7 Patch the OVMM, PC1, and PC2 Templates
-------------------------------------------------
--- Pre-requisite
Reboot Control Vserver Stack
While patching Vserver or Guest Vserver , measure progress from another session via xm console <id>
All Exalogic Control vServers must be running when the patching procedure starts.


----Apply Patch .


[root@compute-node1]# /exalogic-lctools/bin/exapatch -a patch ectemplates
Patching each vServer template can take at least 25 minutes. The total duration for this step is at least 75 minutes. During the patching process, the progress can be tracked by using xm console to log in to the console of the vServer being patched. If you are tracking the progress, after each vServer reboot you should run xm console again to reconnect to the vServer console.

~~~~~~~~
[root@DummyCN01 2.0.6.1.1]# /exalogic-lctools/bin/exapatch -a patch ectemplates
Logging to file /var/log/exapatch_2020080.73044.log
Enter vServer-EC-EMOC-PC 1.1.557.74 root password:
Enter vServer-EC-EMOC-PC 1.1.557.75 root password:
Enter EMOC-PC-service 1.1.557.74 root password:
Enter EMOC-PC-service 1.1.557.75 root password:
INFO: vServer-EC-OVMM 1.1.558.21 successfully completed all pre-patch checks
Upgrading Base Template on vServer-EC-OVMM host 1.1.558.21 from version:
        2.0.6.1.1
Completed upgrade of Base Template on vServer-EC-OVMM host 1.1.558.21 new version:
        2.0.6.1.1
INFO: vServer-EC-OVMM 1.1.558.21 successfully completed all post-patch checks
Completed patching VM template vServer-EC-OVMM 1.1.558.21
INFO: vServer-EC-EMOC-PC 1.1.557.74 successfully completed all pre-patch checks
Starting to patch VM template vServer-EC-EMOC-PC 1.1.557.74
Upgrading Base Template on vServer-EC-EMOC-PC host 1.1.557.74 from version:
        2.0.6.1.0
Completed upgrade of Base Template on vServer-EC-EMOC-PC host 1.1.557.74 new version:
        2.0.6.1.1
INFO: vServer-EC-EMOC-PC 1.1.557.74 successfully completed all post-patch checks
Completed patching VM template vServer-EC-EMOC-PC 1.1.557.74
INFO: vServer-EC-EMOC-PC 1.1.557.75 successfully completed all pre-patch checks
Starting to patch VM template vServer-EC-EMOC-PC 1.1.557.75
Upgrading Base Template on vServer-EC-EMOC-PC host 1.1.557.75 from version:
        2.0.6.1.0
Completed upgrade of Base Template on vServer-EC-EMOC-PC host 1.1.557.75 new version:
        2.0.6.1.1
INFO: vServer-EC-EMOC-PC 1.1.557.75 successfully completed all post-patch checks
Completed patching VM template vServer-EC-EMOC-PC 1.1.557.75
#####

----Work around for Failed exapatch, while updating EC template.

Refer to April 2020 PSU Upgrade - Known Issues (Doc ID.673860.1)

~~~~~~~~
1. On the EC vServer, back up /etc/nsswitch.conf 
2. comment out nis, nisplus, ldap in /etc/nsswitch.conf 
3, go to /opt/egbt_upgrade/BaseTemplate/2.0.6.0.1/scripts/ 
Run./egbt_upgrade.sh --unattended 
4. reboot 
5. run force upgrade from the compute node 
/exalogic-lctools/bin/exapatch -force -a patch ectemplates 
6. check the imageinfo, imagehistory on the vServer to make sure its April PSU. 
7. restore /etc/nsswitch.conf 
#####

-------------------------------------------------
8 Upgrade the Guest vServer  (VN02)
-------------------------------------------------


Log in to the first compute node and run the following command:

~~~~~~~~
[root@compute-node1]# /exalogic-lctools/bin/exapatch -a patch vserver -h <vserverIP1> [-h <vServerIPn>]
To patch multiple guest vServers, you can specify multiple -h vserverIP options.
The following is a sample of the output displayed on the console while patching from 2.0.6.0.0.:
Logging to file /var/log/exapatch_20200302134.7.log
Enter root password for guest vServers: 
INFO: vServer-Generic xx.xx.xx.xx successfully completed all pre-patch checks
Upgrading Base Template on vServer-Generic host xx.xx.xx.xx from version:
      2.0.6.0.0
Completed patching VM templates.     
#####

-------------------------------------------------
9 Observation
-------------------------------------------------

After upgrading each component , exapatch update rack_hisotry.xml file.
If –l option is not provided , then exapatch will generate logfile  itself.
Non master IB switch gets upgraded first, then non master switch changes  to master and then patch applies to Master.
Would like to see if  it disconnection existing connection while “ INFO: Changing master NM2-GW-IB-Switch 1.1.557.71 to standby.”
May be Gwinstance value get increase
Base Image update does not reboot compute Node or Migrate VM on it.
WARNING: unable to update patch history: Unable to find unique identifier "1337FML021" for Compute-Node 1.1.557.66 in the rack history file.
While patching Vserver or Guest Vserver , measure progress from another session via xm console <id>
All exapatch command must run from /exalogic-lcdata/patches/Virtual/1.78980/Infrastructure/2.0.6.1.1  dir and must be fully qualified path till exapatch.


-------------------------------------------------
10 Reference
-------------------------------------------------

Exalogic April 2014 PSU - 2.0.6.1.1 (Linux - Physical - Exalogic X4-2) Infrastructure Upgrade Guide (Doc ID 1638838.1)
Refer to April 2014 PSU Upgrade - Known Issues (Doc ID 1673860.1)
Exalogic Infrastructure PSU Patching - Troubleshooting Guide (Doc ID 1590392.1)
Exalogic Infrastructure PSU Upgrade - ExaPatch Guide (Doc ID 1612143.1)