Oracle APPS DBA Real Time Issues and Solutions

Hiya Buddies,

I would like to share some real time issue and solution which we have faced during the EBS integration recently.

These are very common issues also which may helpful here to all...

1. Issue –

Suppose, our Concurrent Manager processing are running slow then what we have done and what we need to check.

As per our investigation we found as 2000 request was submitted one at time. So, CM cannot cache as request are coming one at time

What we did and got Fix:

1) Reduced Conflict Resolution Manager Sleep Time to 10

2) Increase Cache Size to 20 for standard manager

2) Issue -

This issue we get almost time and it is very common : java.lang.OutOfMemoryError: Java heap space & Intermittent HTTP-500 Errors

Solution:

We got the fix issue by Increase Java Heap & number of oacore JVM’s

a)      <oacore_jvm_start_options oa_var="s_oacore_jvm_start_options">-server -

verbose:gc -Xmx1024M -Xms512M -XX:MaxPermSize=256M -XX:NewRatio=2  -XX:+PrintGCT

imeStamps -XX:+UseTLAB -XX:+UseParallelGC  -XX:ParallelGCThreads=2  -Dcom.sun.ma

nagement.jmxremote -Djava.security.policy=$ORACLE_HOME/j2ee/oacore/config/java2.

policy -Djava.awt.headless=true -Dhttp.webdir.enable=false -Doracle.security.jaz

n.config=/u01/apps/inst/apps/ORA-DATA/ora/10.1.3/j2ee/oacore/config/j

azn.xml</oacore_jvm_start_options>

b)  <oacore_nprocs oa_var="s_oacore_nprocs">2</oacore_nprocs>

3) Issue -

Log file details:

java.io.IOException: Broken pipe

13/01/19 11:12:04.849 html: Servlet error

java.io.IOException: Broken pipe

        at sun.nio.ch.FileDispatcher.write0(Native Method)

        at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29)

        at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:104)

        at sun.nio.ch.IOUtil.write(IOUtil.java:75)

        at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:334)

        at java.nio.channels.Channels.write(Channels.java:60)

        at java.nio.channels.Channels.access$000(Channels.java:47)

        at java.nio.channels.Channels$1.write(Channels.java:134)

        at com.evermind.server.http.AJPOutputStream.endRequest(AJPOutputStream.java:117)

        at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:317)

        at com.evermind.server.http.AJPRequestHandler.run(AJPRequestHandler.java:199)

        at oracle.oc4j.network.ServerSocketReadHandler$SafeRunnable.run(ServerSocketReadHandler.java:260)

For this above issue we found work-around and Fix as:

– Apache pid should be on Local File System than

s_lock_pid_dir - /u01/apps/inst/apps/ORA-DATA/pids/10.1.3/Apache/logs

s_pids_dir - /u01/apps/inst/apps/ORA-DATA/pids

s_web_pid_file - /u01/apps/inst/apps/ORA-DATA/pids/10.1.3/Apache/httpd.pid

4)Issue –

Suppose, our Workflow Notification Mailer is running either slow or not working then what we need to do.

Work-around:

a)  Workflow Manager Have System Hold Fix Manager Before Resetting Counters

Solution:

Wfmgsms And Wfmgsmd Managers Have System Hold Fix Manager Before Resetting Counters [ID 1378284.1] -- ref.

SQL> update FND_CONCURRENT_QUEUES

set ENABLED_FLAG='N'

where CONCURRENT_QUEUE_NAME like 'WF%GSM%'

SQL> commit;

b)  Notification Mailer slow/not running

oracle.apps.fnd.wf.mailer.NotificationFormatter$FormatterSAXException:

  Problem obtaining the HTML content -> oracle.apps.fnd.wf.common.HTTPClientException:

  Unable to invoke method HTTPClient.HTTPResponse.listHeaders caused by:

  java.net.SocketTimeoutException: Read timed out

Solution:

Profile “WF: Workflow Mailer Framework Web Agent” set.

select t.PROFILE_OPTION_ID ID, z.USER_PROFILE_OPTION_NAME Profile, nvl(v.PROFILE_OPTION_VALUE,'Replace with non-load balanced URL') Value, decode(v.level_id, 10001,'Site',

                            10002,'Application',

                            10003,'Responsibility',

                            10004,'User',

                            10005,'Server',

                            10006,'Organization') "LEVEL"

from fnd_profile_options t, fnd_profile_option_values v, fnd_profile_options_tl z

where (v.PROFILE_OPTION_ID (+) = t.PROFILE_OPTION_ID)

and (z.PROFILE_OPTION_NAME = t.PROFILE_OPTION_NAME)

and (t.PROFILE_OPTION_NAME in

('APPS_FRAMEWORK_AGENT','WF_MAIL_WEB_AGENT'));

To set the WF_MAIL_WEB_AGENT profile :

- Stop Workflow Mailer and Agent Listener service

- Change the "WF: Workflow Mailer Framework Web Agent" [WF_MAIL_WEB_AGENT] profile option to point to a physical Web Server host address that is non-load balanced.

- Rebuild mailer queue with:

SQL>@$FND_TOP/patch/115/sql/wfntfqup.sql APPS <APPS schema passwd> APPLSYS•Start Workflow Mailer and Agent Listener service.

-Test scenario with a new notification.

select * from wf_notifications

check mail_status=’SENT’ for notification

5)Issue -

FRM-41839 Disk I/O error on temporary record buffer file /tmp/AAxxe893.tmp

Solution:

We need to Increase the /tmp size to 8 GB

Some more useful link:

RMAN Issues and Solutions - (ORA-00020) and(ORA-00245)

Difference between fnd_conc_clone.setup_clean and cmclean

How To Start and Stop Informatica Services in Linux/Unix

Iprocurement Home Page Error : You have encounteredan unexpected error. Please contact System Administrator of assistance

Thanks,