Hi All,
We have OMi 9.24 integration with xMatters (AlarmPoint Agent version 5.1.4) we see the following Errors and Info messages littering the BSM gateway opr-gateway.log file.
It seems wde is attempting to establish connection with the alarmpoint agent and for unknown reason we see it reporting no server available and then on the second attempt it is resolved. We're not sure how to go about troubleshooting this and whether this is some tuning issue on xMatter AlarmPoint - has anyone seen this problem before, we'd like to reduce the amount of noise in opr-gateway.log file.
[code]
2015-07-29 14:01:16,011 [EventSyncThread:xmatters.nnnnnnnnnn.corp:2] INFO EventSyncThread.logServerAvailable(1507) - Server xmatters.nnnnnnnnnn.corp is now reachable. Event update forward request has been successfully delivered: 580cbd22-356f-71e5-130d-0a8b81490000
2015-07-29 14:15:51,915 [EventSyncThread:xmatters.nnnnnnnnnn.corp:2] ERROR EventSyncThread.logServerUnavailable(1704) - Server xmatters.nnnnnnnnnn.corp appears to be unavailable. Event forward request will be re-queued for later delivery: 7f4b0930-35a8-71e5-130d-0a8b81490000
2015-07-29 14:15:51,925 [EventSyncThread:xmatters.nnnnnnnnnn.corp:2] ERROR EventSyncThread.sendEventList(496) - Server xmatters.nnnnnnnnnn.corp appears to be unavailable. 1 event forward requests will be re-queued for later delivery.
2015-07-29 14:15:53,010 [EventSyncThread:xmatters.nnnnnnnnnn.corp:2] INFO EventSyncThread.logServerAvailable(1511) - Server xmatters.nnnnnnnnnn.corp is now reachable. Event forward request has been successfully delivered: 7f4b0930-35a8-71e5-130d-0a8b81490000
2015-07-29 14:22:49,560 [EventSyncThread:xmatters.nnnnnnnnnn.corp:2] ERROR EventSyncThread.logServerUnavailable(1704) - Server xmatters.nnnnnnnnnn.corp appears to be unavailable. Event forward request will be re-queued for later delivery: 55f394c1-35a9-71e5-130d-0a8b81490000
2015-07-29 14:22:49,568 [EventSyncThread:xmatters.nnnnnnnnnn.corp:2] ERROR EventSyncThread.sendEventList(496) - Server xmatters.nnnnnnnnnn.corp appears to be unavailable. 1 event forward requests will be re-queued for later delivery.
2015-07-29 14:23:21,990 [EventSyncThread:xmatters.nnnnnnnnnn.corp:2] INFO EventSyncThread.logServerAvailable(1511) - Server xmatters.nnnnnnnnnn.corp is now reachable. Event forward request has been successfully delivered: 55f394c1-35a9-71e5-130d-0a8b81490000
[/code]
Comments
Please sign in to leave a comment.
Hi,
I'd like to provide an update, and wondering if anyone is reading these forums??? - I've enabled debugging on our OMi gateway server, I can see we are getting lots of HTTP 500 errors in the opr-event-sync-adapter.log.
Is there some problem with omi.js? or is the error in the apxml.js?
2015-08-04 11:18:15,391 [EventSyncThread:xxxxx.xxxxxx.xxxxxx:5] ERROR ExternalProcessAdapterAccessDirect.handleClientWebException(706) - HTTP request to Connected Server 'xxx_xxx_xxxxxxxx' on node xxxxx.xxxxx.xxxxx' failed with HTTP status: (500) Internal Server Error
'org.mule.umo.MessagingException: The Integration Service (applications,omi) terminated the request because of an unhandled exception.. Message payload is of type: byte[]
at com.alarmpoint.integrationagent.services.ServiceInterceptor.intercept(ServiceInterceptor.java:60)
at org.mule.impl.InterceptorsInvoker.execute(InterceptorsInvoker.java:47)
at com.alarmpoint.integrationagent.interceptors.AuthenticationInterceptor.intercept(AuthenticationInterceptor.java:106)
at org.mule.impl.InterceptorsInvoker.execute(InterceptorsInvoker.java:47)
at org.mule.interceptors.EnvelopeInterceptor.intercept(EnvelopeInterceptor.java:44)
at org.mule.impl.InterceptorsInvoker.execute(InterceptorsInvoker.java:47)
at org.mule.impl.model.DefaultMuleProxy.onCall(DefaultMuleProxy.java:258)
at org.mule.impl.model.seda.SedaComponent.doSend(SedaComponent.java:393)
at org.mule.impl.model.AbstractComponent.sendEvent(AbstractComponent.java:418)
at org.mule.impl.MuleSession.sendEvent(MuleSession.java:349)
at org.mule.routing.inbound.InboundRouterCollection.send(InboundRouterCollection.java:197)
at org.mule.routing.inbound.InboundRouterCollection.route(InboundRouterCollection.java:163)
at org.mule.providers.AbstractMessageReceiver$DefaultInternalMessageListener.onMessage(AbstractMessageReceiver.java:581)
at org.mule.providers.AbstractMessageReceiver.routeMessage(AbstractMessageReceiver.java:322)
at org.mule.providers.AbstractMessageReceiver.routeMessage(AbstractMessageReceiver.java:269)
at org.mule.providers.http.HttpMessageReceiver$HttpWorker.doGetOrPost(HttpMessageReceiver.java:248)
at org.mule.providers.http.HttpMessageReceiver$HttpWorker.processRequest(HttpMessageReceiver.java:186)
at org.mule.providers.http.HttpMessageReceiver$HttpWorker.run(HttpMessageReceiver.java:159)
at org.mule.impl.work.WorkerContext.run(WorkerContext.java:310)
at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:987)
at edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:528)
at java.lang.Thread.run(Thread.java:744)
Caused by: com.alarmpoint.integrationagent.exceptions.ServiceInvocationException: The Integration Service (applications,omi) terminated the request because of an unhandled exception.
at com.alarmpoint.integrationagent.services.ServiceProxyImpl.execute(ServiceProxyImpl.java:798)
at com.alarmpoint.integrationagent.services.ServiceProxyImpl.handleNormalRequest(ServiceProxyImpl.java:738)
at com.alarmpoint.integrationagent.services.ServiceProxyImpl.processRequest(ServiceProxyImpl.java:399)
at com.alarmpoint.integrationagent.services.ServiceInterceptor.intercept(ServiceInterceptor.java:56)
... 21 more
Caused by: org.mule.umo.ComponentException: Failed to invoke com.alarmpoint.integrationagent.GenericService. Component that caused exception is: applications_omi. Message payload is of type: byte[]
at org.mule.impl.DefaultLifecycleAdapter.intercept(DefaultLifecycleAdapter.java:200)
at org.mule.impl.InterceptorsInvoker.execute(InterceptorsInvoker.java:47)
at com.alarmpoint.integrationagent.services.ServiceProxyImpl$1.call(ServiceProxyImpl.java:774)
at com.alarmpoint.integrationagent.services.ServiceProxyImpl$1.call(ServiceProxyImpl.java:764)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
at com.alarmpoint.integrationagent.util.TimedThreadPoolExecutor$1$1.run(TimedThreadPoolExecutor.java:43)
Caused by: com.alarmpoint.integrationagent.exceptions.ScriptFunctionException: The script function apia_http in D:\Program Files\AlarmPointSystems\IntegrationAgent-5.1.4\integrationservices\applications\omi\omi.js threw an exception: org.mozilla.javascript.EcmaError: SyntaxError: Unexcpected character in string: '\A' (lib/integrationservices/javascript/apxml.js#104).
at com.alarmpoint.integrationagent.script.JavaScript.callFunction(JavaScript.java:184)
at com.alarmpoint.integrationagent.GenericService.processHttpRequest(GenericService.java:252)
at com.alarmpoint.integrationagent.GenericService.onCall(GenericService.java:686)
at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.mule.impl.model.resolvers.DynamicEntryPoint.invokeMethod(DynamicEntryPoint.java:312)
at org.mule.impl.model.resolvers.DynamicEntryPoint.invoke(DynamicEntryPoint.java:259)
at org.mule.impl.DefaultLifecycleAdapter.intercept(DefaultLifecycleAdapter.java:194)
... 8 more
Caused by: org.mozilla.javascript.EcmaError: SyntaxError: Unexcpected character in string: '\A' (lib/integrationservices/javascript/apxml.js#104)
at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3687)
at org.mozilla.javascript.ScriptRuntime.constructError(ScriptRuntime.java:3665)
at org.mozilla.javascript.NativeJSON.parse(NativeJSON.java:112)
at org.mozilla.javascript.NativeJSON.execIdCall(NativeJSON.java:88)
at org.mozilla.javascript.IdFunctionObject.call(IdFunctionObject.java:97)
at org.mozilla.javascript.optimizer.OptRuntime.call1(OptRuntime.java:32)
at org.mozilla.javascript.gen.lib_integrationservices_javascript_apxml_js_6.c_apxmlTokenToJs_4(lib/integrationservices/javascript/apxml.js:104)
at org.mozilla.javascript.gen.lib_integrationservices_javascript_apxml_js_6.call(lib/integrationservices/javascript/apxml.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:63)
at org.mozilla.javascript.gen.lib_integrationservices_javascript_apxml_js_6._c_anonymous_7(lib/integrationservices/javascript/apxml.js:155)
at org.mozilla.javascript.gen.lib_integrationservices_javascript_apxml_js_6.call(lib/integrationservices/javascript/apxml.js)
at org.mozilla.javascript.optimizer.OptRuntime.callN(OptRuntime.java:52)
at org.mozilla.javascript.gen.lib_integrationservices_javascript_event_js_2._c_apia_input_2(lib/integrationservices/javascript/event.js:47)
at org.mozilla.javascript.gen.lib_integrationservices_javascript_event_js_2.call(lib/integrationservices/javascript/event.js)
at org.mozilla.javascript.optimizer.OptRuntime.callName(OptRuntime.java:63)
at org.mozilla.javascript.gen.DProgram_Files_AlarmPointSystems_IntegrationAgent_5_1_4_integrationservices_applications_omi_omi_js_16._c_apia_http_1(D:\Program Files\AlarmPointSystems\IntegrationAgent-5.1.4\integrationservices\applications\omi\omi.js:100)
at org.mozilla.javascript.gen.DProgram_Files_AlarmPointSystems_IntegrationAgent_5_1_4_integrationservices_applications_omi_omi_js_16.call(D:\Program Files\AlarmPointSystems\IntegrationAgent-5.1.4\integrationservices\applications\omi\omi.js)
at org.mozilla.javascript.ContextFactory.doTopCall(ContextFactory.java:394)
at org.mozilla.javascript.ScriptRuntime.doTopCall(ScriptRuntime.java:3091)
at org.mozilla.javascript.gen.D_Program_Files_AlarmPointSystems_IntegrationAgent_5_1_4_integrationservices_applications_omi_omi_js_16.call(D:\Program Files\AlarmPointSystems\IntegrationAgent-5.1.4\integrationservices\applications\omi\omi.js)
at com.alarmpoint.integrationagent.script.JavaScript.callFunction(JavaScript.java:173)
... 16 more
'.
Hi Jim,
I could take a look at this if you like. However, it looks like you have a customized version of the integration so the line numbers don't match with my copy, making it hard to diagnose the problem without seeing the actual code.
Could you share the source code (preferably, entire ...\IntegrationAgent-5.1.4\integrationservices\applications\omi) and the log file (all files in ...\IntegrationAgent-5.1.4\logs) either via DropBox or email atrebounskikh@xmatters.com?