opmn: unexpected exit: status 4200

server[applmgr]_> ./adopmnctl.sh start

You are running adopmnctl.sh version 120.0.12020000.2

Starting Oracle Process Manager (OPMN) ...
[2020-11-25T09:07:08-05:00] [opmn] [ERROR:1] [] [internal] $FMW_HOME/webtier/opmn/bin/opmn: unexpected exit: status 4200
opmnctl start: opmn failed to start.

adopmnctl.sh: exiting with status 0

adopmnctl.sh: check the logfile $INST_TOP/logs/appl/admin/log/adopmnctl.txt for more information ...

server[applmgr]_>

  

TROUBLESHOOTING STEPS

+++++++++++++++++++++++

STEP 1) PLease Stop services via adstpall.sh. If there are any defunct process kill it manually.

 

STEP 2) Please back up the following logs:

 

$IAS_ORACLE_HOME/instances/*/diagnostics/logs/OPMN/opmn

$EBS_DOMAIN_HOME/sysman/log

$EBS_DOMAIN_HOME/servers/*/logs

$IAS_ORACLE_HOME/../wlserver_10.3/common/nodemanager

$IAS_ORACLE_HOME/instances/*/diagnostics/logs/OHS/EBS_web_component

 

STEP 3) Run the command below to clear your logs:

 

for files in $IAS_ORACLE_HOME/instances/*/diagnostics/logs/OPMN/opmn $EBS_DOMAIN_HOME/sysman/log

do

for file in `ls $files/*`

do

echo "Clearing file - " $file

cat /dev/null > $file

done

done

for files in $IAS_ORACLE_HOME/instances/*/diagnostics/logs/OHS/EBS_web_component $EBS_DOMAIN_HOME/servers/*/logs $IAS_ORACLE_HOME/../wlserver_10.3/common/nodemanager

do

for file in `ls $files/*log* $files/*out*| grep -v lck`

do

echo "Clearing file - " $file

cat /dev/null > $file

done

done

 

STEP 4) Now Run Autconfig on EBS Middle tier and ensure the Autconfig Utility finishes with Status 0.

 

If it Errors please stop here and let me know. If it finishes fine, then proceed ahead

 

STEP 5).Enable Debug on OPMN

 

To enable debug for opmn, edit $IAS_ORACLE_HOME/instances/<instance>/config/OPMN/opmn/opmn.xml

 

Change the following line

<debug comp="" rotation-size="1500000"/>

to

<debug comp="ons[all];pm[all]" rotation-size="1500000"/>

 

STEP 6). Now just start Apache Server using the script adapcctl.sh script and if it fails, please check the logs with below script :

 

Use the following script to gather the Apache, WLS and Apps log files which have been modified in the last 1 day

 

==============================================================

Start of script

==============================================================

 (

# pick up files which have been modified in the last 1 day only

HowManyDaysOld=1

echo "Picking up files which have been modified in the last ${HowManyDaysOld} days"

set -x

find $LOG_HOME -type f -mtime -${HowManyDaysOld} > m.tmp

find $FMW_HOME/webtier/instances/*/diagnostics/logs -type f -mtime -${HowManyDaysOld} >> m.tmp

find $FMW_HOME/wlserver_10.3/common/nodemanager/nmHome*/*.log -type f -mtime -${HowManyDaysOld} >> m.tmp

## Get log files for only the WLS servers needed. Valid server names are one or more of:

## AdminServer forms-c4ws_server forms_server oacore_server oaea_server oafm_server

for SERVERNAME in AdminServer oacore_server forms_server oafm_server

do

find $EBS_DOMAIN_HOME/servers/${SERVERNAME}*/logs -type f -mtime -${HowManyDaysOld} >> m.tmp

find $EBS_DOMAIN_HOME/servers/${SERVERNAME}*/adr/diag/ofm/EBS_domain*/${SERVERNAME}*/incident -type f -mtime -${HowManyDaysOld} >> m.tmp

done

zip -r mzAppsLogFiles_`hostname`_`date '+%m%d%y'`.zip -@ < m.tmp

rm m.tmp

) 2>&1 | tee mzLogZip.out

==============================================================

End of script

 

Solution :

As part of JUL PSU and ETCC patches we have applied Patch# 31304503

 

If we gothrough the patch readme , we have below information

2. Prerequisites

----------------

 

Ensure that you meet the following requirements before you install or

deinstall the patch:

=============================================================================================================

1. After applying this patch, SSL processing will no longer accept SSL certificates signed by an older MD5 algorithm.

   If older MD5 certificates are in place when applying this patch, components using OSS libraries may fail to start or connect.

  

   Review the following document to evaluate your Oracle Wallets:

 

   Doc ID 2572809.1 Oracle Security Service (OSS) Patch Removes MD5 - Steps to Evaluate and Update SSL Wallet for FMW 11.1.1.9

   https://support.oracle.com/epmos/faces/DocumentDisplay?id=2572809.1

=============================================================================================================

 

 

I rolled back the patch and applied it . Restarted services and issue is fixed