IDP 2.3.6 Stops Sending SAML Responses.

[Montoya,Jose T]

Thanks for the suggestions.
Using Yourkit I was able to obtain this a capture of a deadlocked thread.
The idp-process.log does not seem to help in identifying what happens after its encoded the messages.
Thoughts?

http-443-1 <--- Frozen for at least 4m 7s
ch.qos.logback.core.AppenderBase.doAppend(Object)
ch.qos.logback.core.spi.AppenderAttachableImpl.appendLoopOnAppenders(Object)
ch.qos.logback.classic.Logger.appendLoopOnAppenders(ILoggingEvent)
ch.qos.logback.classic.Logger.callAppenders(ILoggingEvent)
ch.qos.logback.classic.Logger.buildLoggingEventAndAppend(String, Marker, Level, String, Object[], Throwable)
ch.qos.logback.classic.Logger.filterAndLog_0_Or3Plus(String, Marker, Level, String, Object[], Throwable)
ch.qos.logback.classic.Logger.info(String)
edu.internet2.middleware.shibboleth.idp.profile.saml1.AbstractSAML1ProfileHandler.writeAuditLogEntry(BaseSAMLProfileRequestContext)
edu.internet2.middleware.shibboleth.idp.profile.saml1.ShibbolethSSOProfileHandler.completeAuthenticationRequest(ShibbolethSSOLoginContext, HTTPInTransport, HTTPOutTransport)
edu.internet2.middleware.shibboleth.idp.profile.saml1.ShibbolethSSOProfileHandler.processRequest(HTTPInTransport, HTTPOutTransport)
edu.internet2.middleware.shibboleth.idp.profile.saml1.ShibbolethSSOProfileHandler.processRequest(InTransport, OutTransport)
edu.internet2.middleware.shibboleth.common.profile.ProfileRequestDispatcherServlet.service(HttpServletRequest, HttpServletResponse)
javax.servlet.http.HttpServlet.service(ServletRequest, ServletResponse)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ServletRequest, ServletResponse)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ServletRequest, ServletResponse)
edu.internet2.middleware.shibboleth.idp.util.NoCacheFilter.doFilter(ServletRequest, ServletResponse, FilterChain)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ServletRequest, ServletResponse)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ServletRequest, ServletResponse)
edu.internet2.middleware.shibboleth.idp.session.IdPSessionFilter.doFilter(ServletRequest, ServletResponse, FilterChain)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ServletRequest, ServletResponse)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ServletRequest, ServletResponse)
edu.internet2.middleware.shibboleth.common.log.SLF4JMDCCleanupFilter.doFilter(ServletRequest, ServletResponse, FilterChain)
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ServletRequest, ServletResponse)
org.apache.catalina.core.ApplicationFilterChain.doFilter(ServletRequest, ServletResponse)
org.apache.catalina.core.StandardWrapperValve.invoke(Request, Response)
org.apache.catalina.core.StandardContextValve.invoke(Request, Response)
org.apache.catalina.core.StandardHostValve.invoke(Request, Response)
org.apache.catalina.valves.ErrorReportValve.invoke(Request, Response)
org.apache.catalina.core.StandardEngineValve.invoke(Request, Response)
org.apache.catalina.connector.CoyoteAdapter.service(Request, Response)
org.apache.coyote.http11.Http11Processor.process(Socket)
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Socket)
org.apache.tomcat.util.net.JIoEndpoint$Worker.run()
java.lang.Thread.run()




From: users-bounces at shibboleth.net [mailto:users-bounces at shibboleth.net] On Behalf Of Daniel Fisher
Sent: Tuesday, May 01, 2012 11:04 AM
To: Shib Users
Subject: Re: IDP 2.3.6 Stops Sending SAML Responses.

I think you're going to need to identify the lock it's stuck on with a
debugger, but the other thing I would do is go trace the code and identify
what happens between the time it logs that message and the audit log entry
is done.

We use Yourkit for profiling and it's very helpful for tracking down deadlocks. If all else fails, run jstack when it locks up and try to identify the culprit.

--Daniel Fisher

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://shibboleth.net/pipermail/users/attachments/20120501/86016362/attachment.html