Sunday, April 25, 2021

Post actions after R12.2 upgrade worked

After EBS instance is upgraded to R12.2.10, patches and other custom steps are necessary for it to meet business needs. Before adding more nodes to the instance, I did followings in my site.

1. Apply required R12.2 apps patches for database 19c upgrade (Section 2.1, Doc ID 2552181.1 - Interoperability Notes: Oracle E-Business Suite Release 12.2 with Oracle Database 19c).

The following 9 patches must exist in the environment before database is upgraded to 19c.

SELECT adb.bug_number, aat.name appl_top_name, adb.language, adb.creation_date,
decode(ad_patch.is_patch_applied('R12',aat.appl_top_id,adb.bug_number,adb.language),'EXPLICIT','APPLIED','NOT_APPLIED','NOT APPLIED') status
 FROM ad_bugs adb,
(select aat.name, aat.appl_top_id
from applsys.ad_appl_tops aat,
(select distinct fat.name from applsys.fnd_appl_tops fat) fat
where aat.name=fat.name ) aat
where adb.bug_number in (
'25452805', -- Applied
'26052406', -- Applied
'26521736', -- Need (19c interoperability patch for Release 12.2)
'30433124', -- Applied
'31088182', -- Need to apply
'31349591', -- Need to apply
'31800803', -- Need to apply
'30611319', -- Applied (only if using Integrated SOA Gateway (ISG))
'28732161'  -- Need (Release 12.2.6 or later versions)
) order by adb.bug_number,aat.name,adb.language;

In my instance, 4 patches were applied. Use downtime mode to apply 5 patches:
26521736
31088182
31349591
31800803
28732161

DOWNTIME mode will apply the patch to RUN file system.  It is not necessary to use downtime mode to apply them, but it saves time to run adop cut-over.

$ sh $ADMIN_SCRIPTS_HOME/adstpall.sh apps/apps_PWD
$ ps -ef | grep $LOGNAME
$ echo $FILE_EDITION
run
$ echo $PATCH_TOP 
$NE_BASE/EBSapps/patch
$ cd $PATCH_TOP

$ unzip p26521736_12.2.0_R12_LINUX.zip
$ unzip p31088182_R12.FND.C_R12_GENERIC.zip
$ unzip p31349591_R12.OTA.C_R12_GENERIC.zip
$ unzip p31800803_R12.TXK.C_R12_GENERIC.zip
$ unzip p28732161_R12.FRM.C_R12_GENERIC.zip

$ adop phase=apply apply_mode=downtime patches=26521736,31088182,31349591,31800803,28732161

Run the SQL statement again to confirm all 9 patches were applied by now. 

Before completing the patching cycle, which is required by R12.2 Clone script, I applied 5 more patches to the instance:

2. Two more patches:
Patch 31405457 (See Doc ID 2554156.1 for 19c database Export/Import):
$ unzip p31405457_R12_GENERIC.zip

Patch 32357755 to fix issue on changing sysadmin password (Doc ID 2743640.1 - FRM-40735: WHEN-VALIDATE-ITEM Trigger Raised Unhandled Exception ORA-29261 )
$ unzip p32357755_R12.FND.C_R12_LINUX.zip

$ adop phase=apply apply_mode=downtime patches=31405457,32357755

2. Four patches for 1099 tax asked by Business:
$ unzip p32072819_R12.AP.C_R12_GENERIC.zip
$ unzip p32157516_R12.AP.C_R12_GENERIC.zip
$ unzip p32181474_R12.AP.C_R12_GENERIC.zip
$ unzip p32266274_R12.AP.C_R12_GENERIC.zip

$ adop phase=apply apply_mode=downtime patches=32072819,32157516,32181474,32266274 

Confirm 6 patches were applied:
SQL> SELECT adb.bug_number, aat.name appl_top_name, adb.language, adb.creation_date,
decode(ad_patch.is_patch_applied('R12',aat.appl_top_id,adb.bug_number,adb.language),'EXPLICIT','APPLIED','NOT_APPLIED','NOT APPLIED') status
 FROM ad_bugs adb,
(select aat.name, aat.appl_top_id
from applsys.ad_appl_tops aat,
(select distinct fat.name from applsys.fnd_appl_tops fat) fat
where aat.name=fat.name ) aat
where adb.bug_number in (
'31405457',
'32357755',
'32072819',
'32157516',
'32181474',
'32266274'
) order by adb.bug_number,aat.name,adb.language;

3. Apply EBS CPU patches
Oracle E-Business Suite Release 12 Critical Patch Update Knowledge Document (January 2021) (Doc ID 2737201.1)

4. Install 3rd party application (such as Excel4app)

5. If a custom top is not necessary but an env variable is needed as a pointer to a folder under $APPL_TOP, modify file $FND_TOP/fndenv.env by adding lines:
#Begin Customizations
XXEDI_TOP=${APPL_TOP}/xxedi/12.0.0; export XXEDI_TOP
#End Customizations

Start a new OS session to see $XXEDI_TOP
$ echo $XXEDI_TOP

Since ADSplice adds lines to Forms config file $INST_TOP/ora/10.1.2/forms/server/default.env when creating custom top, manual modification on file default.env is not necessary in R12.2:
#Begin Customizations
XXEDI_TOP=/path/to/appl/xxedi/12.0.0
#End Customizations

6. Copy Custom Top folders to R12.2. Then re-link folders & executables, and compile custom forms. 

7. Custom OAF page development

Modify $FND_TOP/admin/template/custom/ebsProductManifest_xml.tmp to add the entry below for customprod.jar (after cu
After EBS instance is upgraded to R12.2.10, Patches and other custom steps are necessary for it to meet the business needs. I did followings in my site.

1. . Apply required R12.2 apps patches for database 19c upgrade (Section 2.1, Doc ID 2552181.1 - Interoperability Notes: Oracle E-Business Suite Release 12.2 with Oracle Database 19c).

The following 9 patches must exist in the environment before database is upgraded to 19c.

SELECT adb.bug_number, aat.name appl_top_name, adb.language, adb.creation_date,
decode(ad_patch.is_patch_applied('R12',aat.appl_top_id,adb.bug_number,adb.language),'EXPLICIT','APPLIED','NOT_APPLIED','NOT APPLIED') status
 FROM ad_bugs adb,
(select aat.name, aat.appl_top_id
from applsys.ad_appl_tops aat,
(select distinct fat.name from applsys.fnd_appl_tops fat) fat
where aat.name=fat.name ) aat
where adb.bug_number in (
'25452805', -- Applied
'26052406', -- Applied
'26521736', -- Need (19c interoperability patch for Release 12.2)
'30433124', -- Applied
'31088182', -- Need to apply
'31349591', -- Need to apply
'31800803', -- Need to apply
'30611319', -- Applied (only if using Integrated SOA Gateway (ISG))
'28732161'  -- Need (Release 12.2.6 or later versions)
) order by adb.bug_number,aat.name,adb.language;

In my instance, 4 patches were applied. Use downtime mode to apply 5 patches:
26521736
31088182
31349591
31800803
28732161

DOWNTIME mode will apply the patch to RUN file system.
 
* It is not necessary to use downtime mode to apply them, if FS_CLONE was executed after R12.2.10 patch.

$ sh $ADMIN_SCRIPTS_HOME/adstpall.sh apps/apps_PWD
$ ps -ef | grep $LOGNAME
$ echo $FILE_EDITION
run
$ echo $PATCH_TOP 
$NE_BASE/EBSapps/patch
$ cd $PATCH_TOP

$ unzip p26521736_12.2.0_R12_LINUX.zip
$ unzip p31088182_R12.FND.C_R12_GENERIC.zip
$ unzip p31349591_R12.OTA.C_R12_GENERIC.zip
$ unzip p31800803_R12.TXK.C_R12_GENERIC.zip
$ unzip p28732161_R12.FRM.C_R12_GENERIC.zip

$ adop phase=apply apply_mode=downtime patches=26521736,31088182,31349591,31800803,28732161

Run the SQL statement again to confirm all 9 patches were applied by now. 

Before completing the patching cycle, which is required by R12.2 Clone script, I applied 5 more patches to the instance:

2. Two more patches:
Patch 31405457 (See Doc ID 2554156.1 for 19c database Export/Import):
$ unzip p31405457_R12_GENERIC.zip

Patch 32357755 to fix issue on changing sysadmin password (Doc ID 2743640.1 - FRM-40735: WHEN-VALIDATE-ITEM Trigger Raised Unhandled Exception ORA-29261 )
$ unzip p32357755_R12.FND.C_R12_LINUX.zip

$ adop phase=apply apply_mode=downtime patches=31405457,32357755

2. Four patches for 1099 tax asked by Business:
$ unzip p32072819_R12.AP.C_R12_GENERIC.zip
$ unzip p32157516_R12.AP.C_R12_GENERIC.zip
$ unzip p32181474_R12.AP.C_R12_GENERIC.zip
$ unzip p32266274_R12.AP.C_R12_GENERIC.zip

$ adop phase=apply apply_mode=downtime patches=32072819,32157516,32181474,32266274 

Confirm 6 patches were applied:
SQL> SELECT adb.bug_number, aat.name appl_top_name, adb.language, adb.creation_date,
decode(ad_patch.is_patch_applied('R12',aat.appl_top_id,adb.bug_number,adb.language),'EXPLICIT','APPLIED','NOT_APPLIED','NOT APPLIED') status
 FROM ad_bugs adb,
(select aat.name, aat.appl_top_id
from applsys.ad_appl_tops aat,
(select distinct fat.name from applsys.fnd_appl_tops fat) fat
where aat.name=fat.name ) aat
where adb.bug_number in (
'31405457',
'32357755',
'32072819',
'32157516',
'32181474',
'32266274'
) order by adb.bug_number,aat.name,adb.language;

3. Apply 2021 January CPU patches
Oracle E-Business Suite Release 12 Critical Patch Update Knowledge Document (January 2021) (Doc ID 2737201.1)

(a) Apply EBS patch 32071646
SQL> select ad_patch.is_patch_applied('R12',-1,32071646) from dual;

AD_PATCH.IS_PATCH_APPLIED('R12',-1,32071646)
-------------------------------------------------------------------
NOT_APPLIED

SQL> SELECT adb.bug_number, aat.name appl_top_name, adb.language, adb.creation_date,
decode(ad_patch.is_patch_applied('R12',aat.appl_top_id,adb.bug_number,adb.language),'EXPLICIT','APPLIED','NOT_APPLIED','NOT APPLIED') status
 FROM ad_bugs adb,
(select aat.name, aat.appl_top_id
from applsys.ad_appl_tops aat,
(select distinct fat.name from applsys.fnd_appl_tops fat) fat
where aat.name=fat.name ) aat
where adb.bug_number in (
'32071646',
'32163187',
'32004048'
) order by adb.bug_number,aat.name,adb.language;
no rows selected

$ echo APPL_TOP
$ cd $PATCH_TOP

$ unzip p32071646_12.2.0_R12_LINUX.zip
$ adop phase=apply apply_mode=downtime patches=32071646

$ unzip p32163187_R12.FWK.C_R12_GENERIC.zip
$ unzip p32004048_R12.OKC.C_R12_GENERIC.zip

$ adop phase=apply apply_mode=downtime patches=32163187,32004048
... ...
Applying patch 32163187.
    Log:  $NE_BASE/EBSapps/log/adop/4/.../32163187/log/u32163187.log
Applying patch 32004048.
    Log: $NE_BASE/EBSapps/log/adop/4/.../32004048/log/u32004048.log
Running finalize actions for the patches being applied.
    Log: @ADZDSHOWLOG.sql "2021/07/13 12:05:43"
Running cutover actions for the patches being applied.
    Creating workers to process cutover DDL in parallel
... ... 
The apply phase completed successfully.
adop exiting with status = 0 (Success)

Run SQL statement again to confirm 3 patches are applied.

(b) WebLogic PSU patch 32052267 was applied as a ETCC requirement.
See Doc ID 1306505.1 for more on Oracle WebLogic Server PSUs (Patch Set Updates).

(c) Oracle Fusion Middleware 11.1.1.9 OSS - Web Tier Home
Patch 31304503 (OSS Security Patch Update CPUJul2020): applied
$ export ORACLE_HOME=$IAS_ORACLE_HOME
$ export PATH=$IAS_ORACLE_HOME/OPatch:$PATH
$  opatch lsinventory | grep 31304503
Patch  31304503     : applied on Sat Jun 26 12:07:37 EDT 2021

(d) Oracle Fusion Middleware 11.1.1.9 OHS - Web Tier Home
Patch 31047338 (OHS Security Patch Update CPUApr2020)
$ opatch lsinventory | grep -i 31047338
Patch  31047338     : applied on Sat Jun 26 12:20:11 EDT 2021

(e) Oracle Fusion Middleware 11.1.1.9 - Oracle Common Home
Patch 30368663 (Security Patch Update CPUOct2019)
Note: Patch 31985571 is a superset of patch 30368663 in Oct 2020
$ export ORACLE_HOME=$FMW_HOME/oracle_common
$ export PATH=$ORACLE_HOME/OPatch:$PATH
$ opatch lsinventory | grep 30368663
Patch  30368663     : applied on Sat Jun 26 12:31:37 EDT 2021

$ adop -status
Enter the APPS password:
Connected.
==================================================
ADOP (C.Delta.12)
Session Id: 4
Command: status
Output: $NE_BASE/EBSapps/log/adop/4/20210713_130234/adzdshowstatus.out
==================================================
Node Name       Node Type  Phase           Status          Started              Finished             Elapsed
--------------- ---------- --------------- --------------- -------------------- -------------------- ------------
node_name     master     APPLY           ACTIVE      2021/0X/12 10:50:40  2021/0X/13 12:55:03  26:04:23
                                       CLEANUP     NOT STARTED

4. Install 3rd party application (such as Excel4app)

5. If a custom top is not necessary but an env variable is needed as a pointer to a folder under $APPL_TOP, modify file $FND_TOP/fndenv.env by adding lines:
#Begin Customizations
XXEDI_TOP=${APPL_TOP}/xxedi/12.0.0; export XXEDI_TOP
#End Customizations

Start a new OS session to see $XXEDI_TOP
$ echo $XXEDI_TOP

Since ADSplice adds lines to Forms config file $INST_TOP/ora/10.1.2/forms/server/default.env when creating custom top, manual modification on file default.env is not necessary in R12.2:
#Begin Customizations
XXEDI_TOP=/path/to/appl/xxedi/12.0.0
#End Customizations

6. Copy Custom Top folders to R12.2. Then re-link folders & executables, and compile custom forms. 

7. Custom OAF page development
Notes:  key entry is saved in file $FND_TOP/admin/template/custom/ebsProductManifest_xml.tmp (after customall.jar):

8. Apply 3 AP patch to fix AP issues

$ export FORMS_PATH=$FORMS_PATH:$AU_TOP/forms/US:AU_TOP/resource
$ frmcmp_batch userid=apps/apps_PWD module=$AU_TOP/resource/IBYFDOBJ.pll output_file=$AU_TOP/resource/IBYFDOBJ.plx module_type=library batch=no compile_all=special

Forms 10.1 (Form Compiler) Version 10.1.2.3.0 (Production)
Forms 10.1 (Form Compiler): Release  - Production
Copyright (c) 1982, 2005, Oracle.  All rights reserved.
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
     With the Partitioning, OLAP, Advanced Analytics and Real Application Testing options
PL/SQL Version 10.1.0.5.0 (Production)
Oracle Procedure Builder V10.1.2.3.0 - Production
Oracle Virtual Graphics System Version 10.1.2.0.0 (Production)
Oracle Multimedia Version 10.1.2.0.2 (Production)
Oracle Tools Integration Version 10.1.2.0.2 (Production)
Oracle Tools Common Area Version 10.1.2.0.2
Oracle CORE     10.1.0.5.0      Production
Compiling library IBYFDOBJ...
  Invalidating Package Spec IBY_PMTATTRIB......
  Invalidating Package Body IBY_PMTATTRIB......
  Compiling Package Spec IBY_PMTATTRIB......
  Compiling Package Body IBY_PMTATTRIB......
 Done.

NOTES: after compiled by frmcmp_batch, IBYFDOBJ.plx got newer file:

$ ls -al $AU_TOP/resource/IBYFDOBJ.plx
-rw-r--r-- 1 user group 40960 Mmm 20 14:01 IBYFDOBJ.plx

$ adident Header $AU_TOP/resource/IBYFDOBJ.plx
$Header IBYFDOBJ.pld 120.7.12020000.2 2012/07/12 15:13:21 sgogula ship $

$ adident Header $AU_TOP/resource/IBYFDOBJ.pll
$Header IBYFDOBJ.pld 120.7.12020000.2 2012/07/12 15:13:21 sgogula ship $

$ sqlplus  apps/apps_PWD
SQL> alter package IBY_DISBURSEMENT_COMP_PUB compile body;
Package body altered.

SQL> alter package IBY_DISBURSEMENT_COMP_PUB compile;
Package altered.

SQL> show parameter optimizer_capture_sql_plan_baselines

NAME                                                   TYPE        VALUE
----------------------------------------------- ----------- ------------------
optimizer_capture_sql_plan_baselines boolean     FALSE

$ unzip p32385168_R12.AP.C_R12_GENERIC.zip
$ adop phase=apply apply_mode=downtime patches=32385168

$ strings -a $AP_TOP/patch/115/sql/apaprvlb.pls |grep '$Header'
/* $Header: apaprvlb.pls 120.231.12020000.57 2021/02/24 09:40:39 anankitg ship $ */

$ unzip p32768426_R12.AP.C_R12_GENERIC.zip
$ unzip p31211521_R12.AP.C_R12_GENERIC.zip
$ adop phase=apply apply_mode=downtime patches=32768426,31211521

Confirm they are applied:
SQL> SELECT adb.bug_number, aat.name appl_top_name, adb.language, adb.creation_date,
decode(ad_patch.is_patch_applied('R12',aat.appl_top_id,adb.bug_number,adb.language),'EXPLICIT','APPLIED','NOT_APPLIED','NOT APPLIED') status
 FROM ad_bugs adb,
(select aat.name, aat.appl_top_id
from applsys.ad_appl_tops aat,
(select distinct fat.name from applsys.fnd_appl_tops fat) fat
where aat.name=fat.name ) aat
where adb.bug_number in (
'32385168',
'32768426',
'31211521'
) order by adb.bug_number,aat.name,adb.language;

32768426:R12.AP.C
---------------------------------
$AU_TOP/forms/US/APXINWKB.fmb 120.983.12020000.181
$AP_TOP/forms/US/APXINWKB.fmx 120.983.12020000.181

31211521:R12.AP.C
---------------------------------
$AP_TOP/patch/115/sql/apetxsrb.pls 120.223.12020000.38

Follow-up steps asked by Oracle:
1) Validate APPS schema using adadmin.
a. start adadmin
b. Pick Option 4 Maintain Applications Database Entities menu
c. Pick Validate APPS schema using adadmin (1).

2) Re-create grants and synonyms for APPS schema using adadmin.
a. Pick Option 4 Maintain Applications Database Entities menu
b. Pick Re-create grants and synonyms for APPS schema (2)

3) Generate product JAR files using adadmin.
a. Pick Option 1 Generate Applications Files menu
b. Pick Generate product JAR files (4, and answer Yes)

4) Reload JAR files to database using adadmin.
a. Pick Option 3 Compile/Reload Applications Database Entities menu
b. Pick Reload JAR files to database (4)

5) Compile all the INVALIDS using adadmin.
a. Pick Option 3 Compile/Reload Applications Database Entities menu
b. Pick Option 1 Compile APPS schema

6) Compile all the menus.
a. Pick Option 3 Compile/Reload Applications Database Entities menu
b. Pick Option 2 Compile menu information 

7) Compile all the ZX, IBY, XLA, PO, AP forms including libraries using adadmin.
a. Pick Option 1 Generate Applications Files menu
b. Pick Option 2 Generate form files

8)* Bounce the Database (Shutdown & Startup, optional)
9)* Start all the application services (adstrtal.sh apps/<apps password>).
10)* Submit the concurrent request "Gather Schema Statistics" with Schema Name: ALL and Estimate Percent: 20% Atleast and wait for the request to complete.
11)* Retest the issue.
* They can be deferred till configuration on all nodes is completed.

9. Verify database parameters for ADOP:

SQL> show parameter local_listener

NAME                       TYPE      VALUE
--------------------- ---- ----------- ------------------------------
local_listener             string       EBSDEV_LOCAL
SQL> show parameter service_names
NAME                       TYPE      VALUE
-------------------------- ----------- ------------------------------
service_names            string       EBSDEV, ebs_patch,EBSDEV_ebs_patch
SQL> select SERVICE_ID,NAME from dba_services where name='ebs_patch';
SERVICE_ID  NAME
-----------------  ----------------------------------------------------------------
                    6   ebs_patch
Notes: This line may got lost somehow. If so, add it (by "alter system ...").

SQL> select * from dba_editions;
EDITION_NAME PARENT_EDITION_NAME USABLE
---------------------- ------------------------------------ ------------
ORA$BASE                                                             YES

$ adop -status

Enter the APPS password:
Connected.
=======================================================
ADOP (C.Delta.12)
Session Id: 4
Command: status
Output: $NE_BASE/EBSapps/log/adop/4/20210X14_130108/adzdshowstatus.out
========================================================
Node Name       Node Type  Phase           Status          Started              Finished             Elapsed
--------------- ---------- --------------- --------------- -------------------- -------------------- ------------
$EBS_HOSTNAME        master     APPLY           ACTIVE          2021/0X/12 10:50:40  2021/0X/13 12:55:03  26:04:23
                                                          CLEANUP    NOT STARTED

10. Run FS_CLONE (when EBS Services are running) before adding/cloning 2 node

$ adop phase=cleanup   (or, adop phase=cleanup cleanup_mode=full )

Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:

Validating credentials.
... ...
    Patch file system free space: 49.76 GB

Validating system setup.
    Node registry is valid.

Checking for existing adop sessions.

===============================================
ADOP (C.Delta.12)
Session ID: 4
Node: $EBS_HOSTNAME
Phase: cleanup
Log: $NE_BASE/EBSapps/log/adop/4/20210X14_130309/adop.log
===============================================

Processing cleanup actions in parallel.
    Log: $NE_BASE/EBSapps/log/adop/4/20210X14_130309/cleanup/$EBS_HOSTNAME/log/cleanup.log

Generating report of queued DDL actions.
    Output: $NE_BASE/EBSapps/log/adop/4/20210X14_130309/cleanup/$EBS_HOSTNAME/adzdallddls.out

Running cleanup in STANDARD mode.
    Log: @ADZDSHOWLOG.sql "2021/0X/14 13:05:32"

Generating log report.
    Output: $NE_BASE/EBSapps/log/adop/4/20210X14_130309/cleanup/$EBS_HOSTNAME/adzdshowlog.out

The cleanup phase completed successfully.
adop exiting with status = 0 (Success)

$ adop -status

Enter the APPS password:
Connected.
========================================================
ADOP (C.Delta.12)
Session Id: 4
Command: status
Output: $NE_BASE/EBSapps/log/adop/4/20210X14_131226/adzdshowstatus.out
========================================================
Node Name               Node Type  Phase           Status          Started              Finished             Elapsed
-------------------------- --------------- --------------- -------------------- -------------------- ------------
$EBS_HOSTNAME    master     APPLY           COMPLETED     2021/0X/12 10:50:40  2021/0X/13 12:55:03  26:04:23
                                                   CLEANUP     COMPLETED     2021/0X/14 13:04:04  2021/0X/14 13:05:54  0:01:50

$ echo $FILE_EDITION
run

NOTES: fs_clone will delete folders from fs2 (PATCH file system) and then copy folders from fs1 (RUN file system) to replace them. If it failed in the middle, some folders or files may be missed on fs2.

$ adop phase=fs_clone    (or, adop phase=fs_clone force=yes)
                                   <== it may take up to 2 hours
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:

Validating credentials.

Initializing.
... ...
    Patch file system free space: 49.75 GB

Validating system setup.
    Node registry is valid.

Checking for existing adop sessions.
    No pending session exists.
    Starting new adop session.
==========================================================
ADOP (C.Delta.12)
Session ID: 5
Node: $EBS_HOSTNAME
Phase: fs_clone
Log: $NE_BASE/EBSapps/log/adop/5/20210X14_131409/adop.log
==========================================================

Validating configuration on node: [$EBS_HOSTNAME].
    Log: $NE_BASE/EBSapps/log/adop/5/20210X14_131409/fs_clone/validate/$EBS_HOSTNAME
        [WARNING]: There could be issues while validating the ports used for E-Business Suite instance against ports used in /etc/services. Refer the log file for more details.

Checking for pending cleanup actions.
    No pending cleanup actions found.

Blocking managed server ports.
    Log: $NE_BASE/EBSapps/log/adop/5/20210X14_131409/fs_clone/$EBS_HOSTNAME/txkCloneAcquirePort.log

Performing CLONE steps.
    Log: $NE_BASE/EBSapps/log/adop/5/20210X14_131409/fs_clone/$EBS_HOSTNAME

Beginning application tier FSCloneStage - Wed Mmm 14 13:17:31 2021

$COMMON_TOP/util/jdk32/bin/java -Xmx600M -Doracle.jdbc.autoCommitSpecCompliant=false -DCONTEXT_VALIDATED=false -Doracle.installer.oui_loc=/oui -classpath ... ...
Log file located at $INST_TOP/admin/log/clone/FSCloneStageAppsTier_0X141317.log

Completed FSCloneStage...
Wed Jul 14 13:24:27 2021

Beginning application tier FSCloneApply - Wed Mmm 14 13:26:59 2021
... ...
Completed FSCloneApply...
Wed Mmm 14 13:52:59 2021

Resetting FARM name...
runDomainName: EBS_domain_$TWO_TASK
patchDomainName: EBS_domain
targets_xml_loc: $FMW_HOME/user_projects/domains/EBS_domain/sysman/state/targets.xml

FARM name reset is successful.

Releasing managed server ports.
    Log: $NE_BASE/EBSapps/log/adop/5/20210X14_131409/fs_clone/$EBS_HOSTNAME/txkCloneAcquirePort.log

Synchronizing snapshots.

Stopping services on patch file system.

    Stopping admin server.
You are running adadminsrvctl.sh version 120.10.12020000.11

Stopping WLS Admin Server...
Refer $PATCH_BASE/inst/apps/$CONTEXT_NAME/logs/appl/admin/log/adadminsrvctl.txt for details
AdminServer logs are located at $PATCH_BASE/FMW_Home/user_projects/domains/EBS_domain/servers/AdminServer/logs
adadminsrvctl.sh: exiting with status 0
adadminsrvctl.sh: check the logfile $PARCH_BASE/inst/apps/$CONTEXT_NAME/logs/appl/admin/log/adadminsrvctl.txt for more information ...  

    Stopping node manager.
You are running adnodemgrctl.sh version 120.11.12020000.12

The Node Manager is already shutdown
NodeManager log is located at $PATCH_BASE/FMW_Home/wlserver_10.3/common/nodemanager/nmHome1
adnodemgrctl.sh: exiting with status 2
adnodemgrctl.sh: check the logfile $LOG_HOME/appl/admin/log/adnodemgrctl.txt for more information ...  

Generating log report.
    Output: $NE_BASE/EBSapps/log/adop/5/20210X14_131409/fs_clone/$EBS_HOSTNAME/adzdshowlog.out

The fs_clone phase completed successfully.
adop exiting with status = 0 (Success)

$ adop -status

Enter the APPS password:
Connected.
=========================================================
ADOP (C.Delta.12)
Session Id: 5
Command: status
Output: $NE_BASE/EBSapps/log/adop/5/20210X14_140211/adzdshowstatus.out
=========================================================
Node Name              Node Type  Phase           Status                    Started                          Finished             Elapsed
------------------------ -------------- ----------------- ------------------ --------------------- ------------
$EBS_HOSTNAME    master     FS_CLONE   COMPLETED   2021/0X/14 13:15:26  2021/0X/14 14:53:11  1:37:45

File System Synchronization Type: Full
adop exiting with status = 0 (Success)

Now, it can be cloned to 2nd node.

No comments: