AVP first prompt latency

[simmos]

We are having a weird intermittent problem with 1st prompt latency. out of 16000 calls yesterday, 24 had 1st prompt latency over 1000ms. the latency is anywhere from 2.5 to 6 seconds. We are able to see in many log files that there is latency and we see it at the same time stamp but we are not able to define where the latency is coming from..


here is a snip of a sessionmgr log file.

@2012-07-17 08:36:08,636||FINEST|SessMgr|19088||Run - got message of type CCXMLMsg : DialogPrepare|fpavpmpp01####
@2012-07-17 08:36:08,738||FINEST|SessMgr|19088||Run - Waiting for message...|fpavpmpp01####
@2012-07-17 08:36:08,738||FINEST|SessMgr|19088||Run - got message of type CCXMLMsg|fpavpmpp01####
@2012-07-17 08:36:08,738||FINEST|SessMgr|19088||Run - got message of type CCXMLMsg : AppLog|fpavpmpp01####
@2012-07-17 08:36:08,738||FINEST|SessMgr|19088||Run - Waiting for message...|fpavpmpp01####

@2012-07-17 08:36:11,882||FINEST|SessMgr|19088||Run - got message of type VXMLMsg|fpavpmpp01####
@2012-07-17 08:36:11,883||FINEST|SessMgr|19088||Run - got message of type VXMLMsg : VXML_DIALOG_PREPARED|fpavpmpp01####
@2012-07-17 08:36:11,883||FINEST|SessMgr|19088||Run - Waiting for message...|fpavpmpp01####
@2012-07-17 08:36:11,884||FINEST|SessMgr|19088||Run - got message of type CCXMLMsg|fpavpmpp01####
@2012-07-17 08:36:11,884||FINEST|SessMgr|19088||Run - got message of type CCXMLMsg : DialogStart|fpavpmpp01####
@2012-07-17 08:36:11,887||FINEST|SessMgr|19088||Run - Waiting for message...|fpavpmpp01####
@2012-07-17 08:36:11,887||FINEST|SessMgr|19088||Run - got message of type VXMLMsg|fpavpmpp01####
@2012-07-17 08:36:11,887||FINEST|SessMgr|19088||Run - got message of type VXMLMsg : VXML_DIALOG_STARTED|fpavpmpp01####


and also the same time frame from a session slot log...

SessionSlot-009.log:@2012-07-17 08:36:08,749||FINEST|CommonVXI.Cache|14207|Session =fpavpmpp01-2012199133607-9|SWIsocket.cpp:172:SWIsocket.cpp:172:SWIsocket::c onnect enter.|fpavpmpp01####
SessionSlot-009.log:@2012-07-17 08:36:08,749||FINEST|CommonVXI.Cache|14207|Session =fpavpmpp01-2012199133607-9|SWIsocket.cpp:198:SWIsocket.cpp:198:SWIsocket::c onnect ptv != NULL.|fpavpmpp01####
SessionSlot-009.log:@2012-07-17 08:36:08,749||FINE|CommonVXI.Cache|14207|Session=f pavpmpp01-2012199133607-9|SWIsocket.cpp:222:connecting to 3007124652|fpavpmpp01####
SessionSlot-009.log:@2012-07-17 08:36:08,749||FINEST|CommonVXI.Cache|14207|Session =fpavpmpp01-2012199133607-9|SWIsocket.cpp:261:SWIsocket.cpp:261:SWIsocket::c onnect connected.|fpavpmpp01####
SessionSlot-009.log:@2012-07-17 08:36:11,748||FINE|CommonVXI.Cache|14207|Session=f pavpmpp01-2012199133607-9|SWIsocket.cpp:328:Established Connection to 3007124652|fpavpmpp01####
SessionSlot-009.log:@2012-07-17 08:36:11,748||FINEST|CommonVXI.Cache|14207|Session =fpavpmpp01-2012199133607-9|SWIsocket.cpp:427:SWIsocket.cpp:427:SWIsocket::c onnect restore blocking mode.|fpavpmpp01####
SessionSlot-009.log:@2012-07-17 08:36:11,748||FINER|CommonVXI.Cache|14207|Session= fpavpmpp01-2012199133607-9|SBinetHttpConnection.cpp:80:SBinetHttpConnection ::After connect timeout=44999|fpavpmpp01####


Can anyone help identify where the latency is happening? could it be a nuance server that is causing latency with grammars or wave files?

Thanks