POM:Voice Portal system status has Major alarms: Location=auraexptl1mtc.hra.nycnet Description=Q_POMAMQ05: Unable to establish connection with ActiveMQ service.

Doc ID    SOLN297773
Version:    3.0
Status:    Published
Published date:    25 Oct 2019
Created Date:    06 Oct 2016
Author:   
Ashok Bharat
 

Details

Ver 2.5 / 3.0 VP

 

POM alarm - Q_POMAMQ05 -Unable to establish connection with ActiveMQ server.

Version: RH6.6.64-AV03EP7SP2

Offer type -: Bundled

Problem Clarification

[sroot@auraexptl1mtc bin]# service POM status

Checking POM <version POM.03.00.01.00.150> Status at Fri Sep 30 06:38:01 EDT 2016

Checking individual components:

STATE=RUNNING

Agent Manager ( pid 10652  ) is running...

 

 

STATE=RUNNING

Campaign Manager ( pid 11405  ) is running...

 

 

STATE=RUNNING

Campaign Director ( pid 12175  ) is running...

 

 

STATE=STOPPED

POM ActiveMQ is partially running.Please restart the ACTMQ

 

 

Overall Status: POM is partially running

Cause

Caused by: java.net.ConnectException: Connection refused.

POM log snippet:
 
 
28 Sep 2016 09:01:52,384 [POMActiveMQManager] INFO  com.avaya.pim.core.ActiveMQManager.connectToJMS(ActiveMQManager.java:553)  - Unable to establish connection with ActiveMQ service
28 Sep 2016 09:02:07,556 [POMActiveMQManager] ERROR com.avaya.pim.core.ActiveMQManager.ConnectAndSendMsg(ActiveMQManager.java:516)  -
-----------------------------------------------------
        at org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:35)
        at org.apache.activemq.ActiveMQConnectionFactory.createActiveMQConnection(ActiveMQConnectionFactory.java:286)
        at org.apache.activemq.ActiveMQConnectionFactory.createActiveMQConnection(ActiveMQConnectionFactory.java:230)
        at org.apache.activemq.ActiveMQConnectionFactory.createConnection(ActiveMQConnectionFactory.java:178)
        at com.avaya.pim.core.ActiveMQManager.createConnection(ActiveMQManager.java:442)
        at com.avaya.pim.core.ActiveMQManager.ConnectAndSendMsg(ActiveMQManager.java:511)
        at com.avaya.pim.core.ActiveMQManager.main(ActiveMQManager.java:343)
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
        at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
        at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
        at java.net.Socket.connect(Socket.java:579)
        at org.apache.activemq.transport.tcp.TcpTransport.connect(TcpTransport.java:483)
        at org.apache.activemq.transport.tcp.TcpTransport.doStart(TcpTransport.java:446)
        at org.apache.activemq.util.ServiceSupport.start(ServiceSupport.java:53)
        at org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:58)
        at org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:58)
        at org.apache.activemq.transport.WireFormatNegotiator.start(WireFormatNegotiator.java:72)
        at org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:58)
        at org.apache.activemq.transport.TransportFilter.start(TransportFilter.java:58)
 
28 Sep 2016 10:37:45,327 [POMActiveMQManager] ERROR com.avaya.pim.core.ActiveMQManager.connectToJMS(ActiveMQManager.java:552)  -
-----------------------------------------------------
        at org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:35)
        at org.apache.activemq.ActiveMQConnectionFactory.createActiveMQConnection(ActiveMQConnectionFactory.java:286)
        at org.apache.activemq.ActiveMQConnectionFactory.createActiveMQConnection(ActiveMQConnectionFactory.java:230)
        at org.apache.activemq.ActiveMQConnectionFactory.createConnection(ActiveMQConnectionFactory.java:178)
        at com.avaya.pim.core.ActiveMQManager.connectToJMS(ActiveMQManager.java:536)
        at com.avaya.pim.core.ActiveMQManager.checkStatus(ActiveMQManager.java:394)
        at com.avaya.pim.core.ActiveMQManager.main(ActiveMQManager.java:355)
Caused by: java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)

Solution

1) Ensured that  avayavp and sroot has unlimited nproc in /etc/security/limits.conf file.

# global nproc limit is specified in the system file 90-nproc.conf, default is 1024
avayavp             -    nproc           unlimited
sroot               -    nproc           unlimited
 
********************************************************************
2) Step-:
Reindex OMDB
Browse to $POM_HOME/bin folder.
[sroot@auraexptl1mtc bin]# ./reindexPOMPGDB.sh
Reindex POM tables, it may take few minutes....
 
3) Step -: 
1. Login to the POM Server from command line as root/sroot user. Stop POM service
2. Browse to $POM_HOME/bin folder.
3. Run the script ./resetActMQ.sh.
 
4) Reboot POM server.
 
Then check POM services status that out put should be below:
 

[sroot@auraexptl1mtc ~]# service POM status
Checking POM <version POM.03.00.01.00.150> Status at Fri Sep 30 21:21:17 EDT 2016
Checking individual components:
STATE=RUNNING
Agent Manager ( pid 3373  ) is running...


STATE=RUNNING
Campaign Manager ( pid 4259  ) is running...


STATE=RUNNING
Campaign Director ( pid 5064  ) is running...


STATE=RUNNING
POM ActiveMQ ( pid 2875 ) is running...


Overall Status: POM is running


Avaya -- Proprietary. Use pursuant to the terms of your signed agreement or Avaya policy