Hi Experts,
We have 40 to 50 connectors including SQL server, Oracle,Pco,OLAP etc on MII system.
SAP MII version 12.2 SP6.
We got the Java Heap space on the SAP MII server and due to lack of disk space the server process is shutdown.
#2.0#2015 04 14 09:30:16:473#0-400#Fatal#com.sap.engine.frame.ProcessEnvironment#
- com.sap.ASJ.krn_frm.000041#BC-JAS-COR#kernel.sda#C0000A0E68F54AF20000000100000D58#307331950000768373##com.sap.engine.frame.ProcessEnvironment#Guest#0##7F961CADD61211E4A26400001251836F#7f961cadd61211e4a26400001251836f#7f961cadd61211e4a26400001251836f#0#Thread[Managed_Application_Thread_37,5,Managed_Application_Thread]#Plain##
Server process shutting down with exit code [666]; memory allocation error [OutOfMemoryError]#
#2.0#2015 04 14 09:30:16:473#0-400#Fatal#com.sap.engine.frame.ProcessEnvironment#
- com.sap.ASJ.krn_frm.000041#BC-JAS-COR#kernel.sda#C0000A0E68F54AF20000000200000D58#307331950000768373##com.sap.engine.frame.ProcessEnvironment#Guest#0##7F961CADD61211E4A26400001251836F#7f961cadd61211e4a26400001251836f#7f961cadd61211e4a26400001251836f#0#Thread[Managed_Application_Thread_37,5,Managed_Application_Thread]#Plain##
Server process shutting down with exit code [666] memory allocation error [OutOfMemoryError]
[EXCEPTION]
- java.lang.OutOfMemoryError: Java heap space (failed to allocate 56 bytes)
After clearing the dump and make available disk space all the connectors like SQL server, OLAP,PCo etc working fine. But Oracle connectors are unstable.I can say oracle connectors keep loosing connections. The following errors were seen in logs. After I restart the server , the oracle connector starts working fine.
Unable to create connection to database for GDW
[EXCEPTION]
java.lang.ClassNotFoundException: oracle.jdbc.driver.OracleDriver
at com.sap.lhcommon.system.CustomClassLoader.findClass(CustomClassLoader.java:232)
at java.lang.ClassLoader.loadClass(ClassLoader.java:367)
at java.lang.ClassLoader.loadClass(ClassLoader.java:308)
at com.sap.xmii.Illuminator.tools.database.JDBCDriverManager.getClassInstance(JDBCDriverManager.java:104)
at com.sap.xmii.Illuminator.tools.database.ConnectionPool.<init>(ConnectionPool.java:62)
at com.sap.xmii.Illuminator.tools.database.ConnectionHolder.addDBConnectionPool(ConnectionHolder.java:121)
at com.sap.xmii.Illuminator.server.Server.createHolder(Server.java:277)
at com.sap.xmii.Illuminator.server.Server.start(Server.java:134)
at com.sap.xmii.Illuminator.server.ServerManager$ServerInitializer.run(ServerManager.java:451)
at com.sap.xmii.Illuminator.server.ServerManager.startServer(ServerManager.java:414)
at com.sap.xmii.Illuminator.server.ServerManager.reload(ServerManager.java:370)
at com.sap.xmii.ejb.ServiceHandlerBean.doServerFunction(ServiceHandlerBean.java:222)
at com.sap.xmii.ejb.ServiceHandlerBean.onMessage(ServiceHandlerBean.java:75)
at sun.reflect.GeneratedMethodAccessor276.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at com.sap.engine.services.ejb3.runtime.impl.RequestInvocationContext.proceedFinal(RequestInvocationContext.java:47)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:166)
at com.sap.engine.services.ejb3.runtime.impl.Interceptors_StatesTransition.invoke(Interceptors_StatesTransition.java:19)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:179)
at com.sap.engine.services.ejb3.runtime.impl.Interceptors_Resource.invoke(Interceptors_Resource.java:50)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:179)
at com.sap.engine.services.ejb3.runtime.impl.Interceptors_MessageListenerType.invoke(Interceptors_MessageListenerType.java:111)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:179)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:191)
at com.sap.engine.services.ejb3.runtime.impl.Interceptors_StatelessInstanceGetter.invoke(Interceptors_StatelessInstanceGetter.java:23)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:179)
at com.sap.engine.services.ejb3.runtime.impl.Interceptors_SecurityCheck.invoke(Interceptors_SecurityCheck.java:25)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:179)
at com.sap.engine.services.ejb3.runtime.impl.Interceptors_ExceptionTracer.invoke(Interceptors_ExceptionTracer.java:17)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:179)
at com.sap.engine.services.ejb3.runtime.impl.Interceptors_Lock.invoke(Interceptors_Lock.java:21)
at com.sap.engine.services.ejb3.runtime.impl.AbstractInvocationContext.proceed(AbstractInvocationContext.java:179)
at com.sap.engine.services.ejb3.runtime.impl.DefaultInvocationChainsManager.startChain(DefaultInvocationChainsManager.java:138)
at com.sap.engine.services.ejb3.runtime.impl.DefaultEJBProxyInvocationHandler.invoke(DefaultEJBProxyInvocationHandler.java:164)
at com.sap.engine.services.ejb3.runtime.impl.MDBProxyInvocationHandler.invoke(MDBProxyInvocationHandler.java:78)
at $Proxy435.onMessage(Unknown Source)
at com.sap.jms.client.session.JMSSession.deliverMessage(JMSSession.java:1046)
at com.sap.jms.client.session.JMSSession.run(JMSSession.java:894)
at com.sap.jms.resourceadapter.RaServerSession.run(RaServerSession.java:139)
at com.sap.engine.services.connector.jca15.work.TaskImpl.run(TaskImpl.java:410)
at com.sap.engine.core.thread.execution.Executable.run(Executable.java:122)
at com.sap.engine.core.thread.execution.Executable.run(Executable.java:101)
at com.sap.engine.core.thread.execution.CentralExecutor$SingleThread.run(CentralExecutor.java:328)
Error occurred while creating a database connection
[EXCEPTION]
com.sap.xmii.Illuminator.system.CommunicationException: Error occurred while creating a database connection
at com.sap.xmii.Illuminator.connectors.IDBC.IDBC.doProcessRequest(IDBC.java:81)
at com.sap.xmii.Illuminator.connectors.AbstractConnector.processRequest(AbstractConnector.java:83)
at com.sap.xmii.Illuminator.server.QueryEngine.run(QueryEngine.java:49)
at com.sap.xmii.Illuminator.services.handlers.IlluminatorService.processRequest(IlluminatorService.java:82)
at com.sap.xmii.Illuminator.services.ServiceManager.run(ServiceManager.java:69)
at com.sap.xmii.servlet.Illuminator.service(Illuminator.java:68)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:847)
at com.sap.engine.services.servlets_jsp.server.runtime.FilterChainImpl.runServlet(FilterChainImpl.java:202)
at com.sap.engine.services.servlets_jsp.server.runtime.FilterChainImpl.doFilter(FilterChainImpl.java:103)
at com.sap.xmii.system.SecurityFilter.doFilter(SecurityFilter.java:186)
at com.sap.engine.services.servlets_jsp.server.runtime.FilterChainImpl.doFilter(FilterChainImpl.java:79)
at com.sap.xsrf.filter.XSRFProtectorFilter.doFilter(XSRFProtectorFilter.java:62)
at com.sap.engine.services.servlets_jsp.server.runtime.FilterChainImpl.doFilter(FilterChainImpl.java:79)
at com.sap.engine.services.servlets_jsp.server.HttpHandlerImpl.runServlet(HttpHandlerImpl.java:441)
at com.sap.engine.services.servlets_jsp.server.HttpHandlerImpl.handleRequest(HttpHandlerImpl.java:210)
at com.sap.engine.services.httpserver.server.RequestAnalizer.startServlet(RequestAnalizer.java:441)
at com.sap.engine.services.httpserver.server.RequestAnalizer.startServlet(RequestAnalizer.java:430)
at com.sap.engine.services.servlets_jsp.filters.DSRWebContainerFilter.process(DSRWebContainerFilter.java:38)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.servlets_jsp.filters.ServletSelector.process(ServletSelector.java:81)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.servlets_jsp.filters.ApplicationSelector.process(ApplicationSelector.java:278)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.httpserver.filters.WebContainerInvoker.process(WebContainerInvoker.java:81)
at com.sap.engine.services.httpserver.chain.HostFilter.process(HostFilter.java:9)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.httpserver.filters.ResponseLogWriter.process(ResponseLogWriter.java:60)
at com.sap.engine.services.httpserver.chain.HostFilter.process(HostFilter.java:9)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.httpserver.filters.DefineHostFilter.process(DefineHostFilter.java:27)
at com.sap.engine.services.httpserver.chain.ServerFilter.process(ServerFilter.java:12)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.httpserver.filters.MonitoringFilter.process(MonitoringFilter.java:29)
at com.sap.engine.services.httpserver.chain.ServerFilter.process(ServerFilter.java:12)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.httpserver.filters.SessionSizeFilter.process(SessionSizeFilter.java:26)
at com.sap.engine.services.httpserver.chain.ServerFilter.process(ServerFilter.java:12)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.httpserver.filters.MemoryStatisticFilter.process(MemoryStatisticFilter.java:57)
at com.sap.engine.services.httpserver.chain.ServerFilter.process(ServerFilter.java:12)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.httpserver.filters.DSRHttpFilter.process(DSRHttpFilter.java:43)
at com.sap.engine.services.httpserver.chain.ServerFilter.process(ServerFilter.java:12)
at com.sap.engine.services.httpserver.chain.AbstractChain.process(AbstractChain.java:78)
at com.sap.engine.services.httpserver.server.Processor.chainedRequest(Processor.java:475)
at com.sap.engine.services.httpserver.server.Processor$FCAProcessorThread.process(Processor.java:269)
at com.sap.engine.services.httpserver.server.rcm.RequestProcessorThread.run(RequestProcessorThread.java:56)
at com.sap.engine.core.thread.execution.Executable.run(Executable.java:122)
at com.sap.engine.core.thread.execution.Executable.run(Executable.java:101)
at com.sap.engine.core.thread.execution.CentralExecutor$SingleThread.run(CentralExecutor.java:328)
I am not sure of OJDBC jar file version .we have either OJDBC5 or OJDBC6 jar deployed in SAP MII.
The oracle database version that we are connecting in the data server is Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit
My questions are
After the server process shutdown and recovered , While all other connectors working fine why oracle connectors have problems?
Is it due to oracle driver issue? or any other issue related to Netweaver.
Please help.