E-Business Suite Applications Technology Stack, HTTP / IAS Server related issues
Users report cache initialization errors in OA Framework related pages.
The oacorestd.err file shows:
Exception in static block of jtf.cache.CacheManager. Stack trace is: oracle.apps.jtf.base.resources.FrameworkException: IAS Cache initialization failed.
The Distributed Caching System failed to initialize on port: 12360. The list of hosts in the distributed caching system is: 10.24.248.41 .
The port 12360 should be free on each host running the JVMs.
Solution:
To resolve the issue test the following steps in a development instance and then migrate accordingly:
I. For Autoconfig enabled environment:
1. Bring down opmn services on all boxes.
2. Verify no process is listening for s_java_object_cache_port value:
netstat -an | grep [port number] | grep LISTEN
Identify the OS process associated with a port:
lsof -i tcp:[port number]
3. Change s_java_object_cache_port on all the nodes in $CONTEXT_FILE.
4. Run autoconfig.
II. For Non-Autoconfig enabled environments:
s_java_object_cache_port value is referrenced in two places
1. $INST_TOP/ora/10.1.3/javacache/admin/javacache.xml
2. JTF_DIST_CACHE_PORT profile option.
Change the port value to a new number in the $CONTEXT_FILE and bounce opmnctl services.
3. Verify no process is listening for s_java_object_cache_port value :
netstat -an | grep [port number] | grep LISTEN
Identify the OS process associated with a port
lsof -i tcp:[port number]
If the newly assigned port still does not listen on the server you can use workaround given bellow. This workaround will resolve the “IAS Cache initialization failed” even if the port is not listening.
Workaround: (Note: The below workaround is intended for testing purposes only to help identify RCA)
a. Set LONG_RUNNING_JVM=false in $INST_TOP/ora/10.1.3/j2ee/oacore/config/oc4j.properties.
b. Bounce opmn services.
Note: This happens when Distributed Java Caching is enabled in a multi middle tier environment
Note: In 11i, if the database listener is down or if the archive location is full, may get the internal server page while trying to access the login page. In R12 may get a blank page and apache error log will show the “oc4j_socket_recvfull timed out” and “mod_oc4j: request to OC4J [mid-tier servername:ajp port] failed: Connect failed” error messages.