Saumya Padhi

ODA Bundle Patch: Upgrade to OAK 18.3.0.0.0

ODA Bundle Patch: Upgrade to OAK 18.3.0.0.0

Here i am upgrading ODA from 12.1.2.12.0 to 18.3.0.0.0.
Backup ODA_BASE before proceeding with ODA Bundle patch.
For ODA_BASE backup refer to post “Backup ODA_BASE: Database Appliance ODA X5“.
Above post applies to ODA X5 or higher versions.

Login to ODA_BASE as root user.
Download & Unpack the ODA bundle patch on both Nodes.

Ensure you have sufficient space under /opt.
Usually the patches are unpacked to /opt/oak/oracle/pkgrepos folder.

# oakcli unpack -package /tmp/p28864520_183000_Linux-x86-64_1of3.zip
# oakcli unpack -package /tmp/p28864520_183000_Linux-x86-64_2of3.zip
# oakcli unpack -package /tmp/p28864520_183000_Linux-x86-64_3of3.zip

Verify the patch before apply. On Both ODA nodes.

On Node 1:

[root@oda1 ~]# oakcli update -patch 18.3.0.0 --verify
INFO: 2019-05-16 20:10:54: Reading the metadata file now...
                Component Name            Installed Version         Proposed Patch Version
                ---------------           ------------------        -----------------
                Controller_INT            4.650.00-7176             Up-to-date
                Controller_EXT            13.00.00.00               Up-to-date
                Expander                  0018                      Up-to-date
                SSD_SHARED {
                [ c1d20,c1d21,c1d22,      A29A                      Up-to-date
                c1d23 ]
                [ c1d16,c1d17,c1d18,      A29A                      Up-to-date
                c1d19 ]
                             }
                HDD_LOCAL                 A7E0                      Up-to-date
                HDD_SHARED                PAG1                      Up-to-date
                ILOM                      3.2.9.23 r116695          4.0.2.26.b r125868
                BIOS                      30110000                  30130500
                IPMI                      1.8.12.4                  Up-to-date
                HMP                       2.3.5.2.8                 2.4.1.0.14
                OAK                       12.1.2.12.0               18.3.0.0.0
                OL                        6.8                       6.10
                OVM                       3.4.3                     3.4.4
                GI_HOME                   12.1.0.2.170814           18.3.0.0.180717
                DB_HOME                   12.1.0.2.5                12.1.0.2.180717
                ASR                       5.5.1                     18.3.1

On Node 2:

[root@oda2 ~]# oakcli update -patch 18.3.0.0 --verify
INFO: 2019-05-16 20:27:49: Reading the metadata file now...
                Component Name            Installed Version         Proposed Patch Version
                ---------------           ------------------        -----------------
                Controller_INT            4.650.00-7176             Up-to-date
                Controller_EXT            13.00.00.00               Up-to-date
                Expander                  0018                      Up-to-date
                SSD_SHARED {
                [ c1d20,c1d21,c1d22,      A29A                      Up-to-date
                c1d23 ]
                [ c1d16,c1d17,c1d18,      A29A                      Up-to-date
                c1d19 ]
                             }
                HDD_LOCAL                 A7E0                      Up-to-date
                HDD_SHARED                PAG1                      Up-to-date
                ILOM                      3.2.9.23 r116695          4.0.2.26.b r125868
                BIOS                      30110000                  30130500
                IPMI                      1.8.12.4                  Up-to-date
                HMP                       2.3.5.2.8                 2.4.1.0.14
                OAK                       12.1.2.12.0               18.3.0.0.0
                OL                        6.8                       6.10
                OVM                       3.4.3                     3.4.4
                GI_HOME                   12.1.0.2.170814           18.3.0.0.180717
                DB_HOME                   12.1.0.2.5                12.1.0.2.180717

The components marked “Up-to-date” does not needs an upgrade.
Components that require upgrade is taken care automatically by the “oakcli update” command.

ODA Bundle patch can be applied in three phases in following order.

# /opt/oracle/oak/bin/oakcli update -patch 18.3.0.0.0 --server
# /opt/oracle/oak/bin/oakcli update -patch 18.3.0.0.0 --storage
# /opt/oracle/oak/bin/oakcli update -patch 18.3.0.0.0 --database
ODA_BASE Bundle patch: Server.

Patching Server component may fail if root mount has less than 12gb of space.
Make sure you free up root mount point to have more than 12gb.

[root@oda1 ~]# /opt/oracle/oak/bin/oakcli update -patch 18.3.0.0.0 --server

****************************************************************************
*****                                                                  *****
*****   For all X5-2 customers with 8TB disks, please make sure to     *****
*****   run storage patch ASAP to update the disk firmware to "PAG1".  *****
*****                                                                  *****
****************************************************************************

INFO: DB, ASM, Clusterware may be stopped during the patch if required
INFO: Both Nodes may get rebooted automatically during the patch if required
Do you want to continue: [Y/N]?: Y
INFO: User has confirmed for the reboot
INFO: Patch bundle must be unpacked on the second Node also before applying the patch
Did you unpack the patch bundle on the second Node? : [Y/N]? : Y
INFO: All the VMs except the ODABASE will be shutdown forcefully if needed
Do you want to continue : [Y/N]? : Y
INFO: Running pre-install scripts
INFO: Running  prepatching on node 0
INFO: Running  prepatching on node 1

For Further output refer below screenshot.

oakcli update -patch 18.3.0.0.0 –server (Image 1)
oakcli update -patch 18.3.0.0.0 –server (Image 2)
oakcli update -patch 18.3.0.0.0 –server (Image 3)
ODA_BASE Bundle patch: Storage

Now patching Storage….


[root@oda1 ~]# /opt/oracle/oak/bin/oakcli update -patch 18.3.0.0.0 --storage
INFO: DB, ASM, Clusterware may be stopped during the patch if required
INFO: Both Nodes may get rebooted automatically during the patch if required
Do you want to continue: [Y/N]?: Y
INFO: User has confirmed for the reboot
INFO: Running pre-install scripts
INFO: Running  prepatching on node 0
INFO: Running  prepatching on node 1
INFO: Completed pre-install scripts
INFO: All Shared Storage components are running with latest firmware
INFO: No patching required. Exiting...
You have new mail in /var/spool/mail/root 
oakcli update -patch 18.3.0.0.0 –storage
ODA_BASE Bundle patch: Database

Now Patching database…


[root@oda1 ~]# /opt/oracle/oak/bin/oakcli update -patch 18.3.0.0.0 --database  
INFO: Running pre-install scripts
INFO: Running  prepatching on node 0
INFO: Running  prepatching on node 1
INFO: Completed pre-install scripts
...
...
INFO: 2019-05-17 03:29:42: ------------------Patching DB-------------------------
INFO: 2019-05-17 03:29:43: Getting all the possible Database Homes for patching
...
INFO: 2019-05-17 03:29:51: Patching 12.1.0.2 Database Homes on the Node oda1

Found the following 12.1.0.2 homes possible for patching:

HOME_NAME                      HOME_LOCATION                                          
---------                      -------------                                          
OraDb12102_home1               /u01/app/oracle/product/12.1.0.2/dbhome_1              

[Please note that few of the above Database Homes may be already up-to-date. They will be automatically ignored]

Would you like to patch all the above homes: Y | N ? : Y
INFO: 2019-05-17 03:30:01: Updating OPATCH
Verifying Opatch version for home:.
Expecting version:<12.2.0.1.14>
Opatch version on node  is <12.2.0.1.14>
Opatch version on node  is <12.2.0.1.14>
INFO: 2019-05-17 03:33:15: Performing the conflict checks...
SUCCESS: 2019-05-17 03:33:27: Conflict checks passed for all the Homes
INFO: 2019-05-17 03:33:27: Checking if the patch is already applied on any of the Homes
INFO: 2019-05-17 03:33:31: Home is not Up-to-date
SUCCESS: 2019-05-17 03:33:33: Successfully stopped the Database consoles
SUCCESS: 2019-05-17 03:33:38: Successfully stopped the EM agents
INFO: 2019-05-17 03:33:43: Applying patch on /u01/app/oracle/product/12.1.0.2/dbhome_1 Homes
INFO: 2019-05-17 03:33:43: It may take upto 15 mins. Please wait...
SUCCESS: 2019-05-17 03:44:45: Successfully applied the patch on the Home : /u01/app/oracle/product/12.1.0.2/dbhome_1
SUCCESS: 2019-05-17 03:44:45: Successfully started the Database consoles
SUCCESS: 2019-05-17 03:44:45: Successfully started the EM Agents
INFO: 2019-05-17 03:44:50: Patching 12.1.0.2 Database Homes on the Node oda2

INFO: DB patching summary on node: oda1
SUCCESS: 2019-05-17 03:57:09:  Successfully applied the patch on the Home /u01/app/oracle/product/12.1.0.2/dbhome_1

INFO: DB patching summary on node: oda2
SUCCESS: 2019-05-17 03:57:09:  Successfully applied the patch on the Home /u01/app/oracle/product/12.1.0.2/dbhome_1

INFO: Executing /tmp/pending_actions on both nodes
oakcli update -patch 18.3.0.0.0 –database (Image 1)
oakcli update -patch 18.3.0.0.0 –database (Image 2)

Once patch is completed you can run –verify again to see components patched.
Now you should see all components are “Up-to-date”.

On Node 1:

[root@oda1 ~]# oakcli update -patch 18.3.0.0 --verify
INFO: 2019-05-17 04:06:43: Reading the metadata file now...
                Component Name            Installed Version         Proposed Patch Version
                ---------------           ------------------        -----------------
                Controller_INT            4.650.00-7176             Up-to-date
                Controller_EXT            13.00.00.00               Up-to-date
                Expander                  0018                      Up-to-date
                SSD_SHARED {
                [ c1d20,c1d21,c1d22,      A29A                      Up-to-date
                c1d23 ]
                [ c1d16,c1d17,c1d18,      A29A                      Up-to-date
                c1d19 ]
                             }
                HDD_LOCAL                 A7E0                      Up-to-date
                HDD_SHARED                PAG1                      Up-to-date
                ILOM                      4.0.2.26.b r125868        Up-to-date
                BIOS                      30130500                  Up-to-date
                IPMI                      1.8.12.4                  Up-to-date
                HMP                       2.4.1.0.14                Up-to-date
                OAK                       18.3.0.0.0                Up-to-date
                OL                        6.10                      Up-to-date
                OVM                       3.4.4                     Up-to-date
                GI_HOME                   18.3.0.0.180717           Up-to-date
                DB_HOME                   12.1.0.2.180717           Up-to-date
                ASR                       18.3.1                    Up-to-date
Node 1, Post ODA Bundle patch

On Node 2:

[root@oda2 ~]# oakcli update -patch 18.3.0.0 --verify
INFO: 2019-05-17 04:06:37: Reading the metadata file now...
                Component Name            Installed Version         Proposed Patch Version
                ---------------           ------------------        -----------------
                Controller_INT            4.650.00-7176             Up-to-date
                Controller_EXT            13.00.00.00               Up-to-date
                Expander                  0018                      Up-to-date
                SSD_SHARED {
                [ c1d20,c1d21,c1d22,      A29A                      Up-to-date
                c1d23 ]
                [ c1d16,c1d17,c1d18,      A29A                      Up-to-date
                c1d19 ]
                             }
                HDD_LOCAL                 A7E0                      Up-to-date
                HDD_SHARED                PAG1                      Up-to-date
                ILOM                      4.0.2.26.b r125868        Up-to-date
                BIOS                      30130500                  Up-to-date
                IPMI                      1.8.12.4                  Up-to-date
                HMP                       2.4.1.0.14                Up-to-date
                OAK                       18.3.0.0.0                Up-to-date
                OL                        6.10                      Up-to-date
                OVM                       3.4.4                     Up-to-date
                GI_HOME                   18.3.0.0.180717           Up-to-date
                DB_HOME                   12.1.0.2.180717           Up-to-date
Node 2, Post ODA Bundle patch

Oracle documentation is the best place to find upgrade path.

e.g. You can upgrade from 12.1.2.6- 12.1.2.12 -> 12.2.1.4 -> 18.3.0.0.0 -> 18.5.0.0.

You cannot upgrade from 12.1.2.6 to 18.3.0.0.0.

Check Oracle ODA Documentation here for more details.

Happy Patching. Thanks for visiting my post. Please feel free to comment.

Excuse typos.

Backup ODA_BASE: Database Appliance ODA X5

There are situations we may need to backup ODA_BASE, especially before patching ODA_BASE.
This article applies only to virtual deployment of ODA.
In this Article I’ve used ODA-X5-2 appliance to backup.
The procedure is applicable for ODA X5 or higher versions.
ODA_BASE is backed up from the DOM machines, i.e. the parent machine from where ODA_BASE was created.
Login to the DOM machine of the ODA Appliance.

NODE 1:
— ODA_BASE – DOM Server, STOP ODA_BASE —

[root@oda1-dom0 ~]# oakcli show oda_base
ODA base domain
ODA base CPU cores      :16
ODA base domain memory  :244
ODA base template       :/OVS/oda_base_12.1.2.5.gz
ODA base vlans          :['net1', 'net2', 'vbr1']
ODA base current status :Running

[root@oda1-dom0 ~]#  oakcli stop oda_base
INFO: Stopping ODA base domain... It may take several minutes.
INFO: Stopping all the shared repos

[root@oda1-dom0 ~]# oakcli show oda_base
ODA base domain
ODA base CPU cores      :16
ODA base domain memory  :244
ODA base template       :/OVS/oda_base_12.1.2.5.gz
ODA base vlans          :['net1', 'net2', 'vbr1']
ODA base current status :Stopped

Continue reading…

ODA X5 CPU configuration

Oracle Database Appliance X5-2 nodes
each contain 2 CPUs and
each CPU has 18 cores.
When you deploy Oracle Database Appliance X5-2, all 72 cores (36 cores in each server) are active with hyper-threading enabled by default.

Below show processor showing each node having two processors and each with 18 cores i.e.

Node 0: 18 Cores x 2 Proc = 36 Cores x 2 (for HT) = 72 vCPU/Threads
Node 1: 18 Cores x 2 Proc = 36 Cores x 2 (for HT) = 72 vCPU/Threads

[root@samodanodep01 ~]# oakcli show processor
  NAME  HEALTH HEALTH_DETAILS PART_NO. LOCATION   MODEL   MAX_CLK_SPEED TOTAL_CORES ENABLED_CORES
  CPU_0 OK     -              060F     P0 (CPU 0) Intel(R) Xeon(R) CPU E5-2699  2.300 GHz       18          18
  CPU_1 OK     -              060F     P1 (CPU 1) Intel(R) Xeon(R) CPU E5-2699  2.300 GHz       18          18
[root@samodanodp01 ~]# oakcli show cpupool -node 0
                     Pool                           Cpu List
    default-unpinned-pool     [0, 1, 2, 3, 4, 5, 6, 7, 8, 9,
                               10, 11, 12, 13, 14, 15, 16, 1
                              7, 18, 19, 20, 21, 22, 23, 24,
                               25, 26, 27, 28, 29, 30, 31, 3
                              2, 33, 34, 35, 36, 37, 38, 39,
                               40, 41, 42, 43, 44, 45, 46, 4
                              7, 48, 49, 50, 51, 52, 53, 54,
                               55, 56, 57, 58, 59, 60, 61, 6
                                      2, 63, 64, 65, 66, 67]
           odaBaseCpuPool                   [68, 69, 70, 71]

[root@samodanode02 ~]# oakcli show processor
  NAME  HEALTH HEALTH_DETAILS PART_NO. LOCATION   MODEL    MAX_CLK_SPEED TOTAL_CORES ENABLED_CORES
  CPU_0 OK     -              060F     P0 (CPU 0) Intel(R) Xeon(R) CPU E5-2699  2.300 GHz       18          18
  CPU_1 OK     -              060F     P1 (CPU 1) Intel(R) Xeon(R) CPU E5-2699  2.300 GHz       18          18

[root@samodanode02 ~]# oakcli show cpupool -node 1
                     Pool                           Cpu List
    default-unpinned-pool     [0, 1, 2, 3, 4, 5, 6, 7, 8, 9,
                               10, 11, 12, 13, 14, 15, 16, 1
                              7, 18, 19, 20, 21, 22, 23, 24,
                               25, 26, 27, 28, 29, 30, 31, 3
                              2, 33, 34, 35, 36, 37, 38, 39,
                               40, 41, 42, 43, 44, 45, 46, 4
                              7, 48, 49, 50, 51, 52, 53, 54,
                               55, 56, 57, 58, 59, 60, 61, 6
                                      2, 63, 64, 65, 66, 67]
           odaBaseCpuPool                   [68, 69, 70, 71]

RMAN backup details, Display last 5 days

Following query can be used to get rman backup job details for last 5 days.

set lines 220
col output_bytes_display for a30
col time_taken_display for a30
select session_key,input_type,status,
	   to_char(start_time,'yyyy-mm-dd hh24:mi') start_time,
       to_char(end_time,'yyyy-mm-dd hh24:mi') end_time,
       output_bytes_display,       time_taken_display
from v$rman_backup_job_details
where END_TIME > sysdate-5
order by session_key asc;