Guidance on troubleshooting org.ldaptive.pool.BlockingConnectionPool issue

[Mike Osterman]

Hello,

We've had an issue where our IdP (v3.3.1 - I know, we need to update) will
intermittently become unresponsive, and that event always coincides with
these messages in idp-warn.log:

WARN [org.ldaptive.pool.BlockingConnectionPool:882] -
org.ldaptive.pool.AbstractConnectionPool$DefaultPooledConnectionProxy at 5b65c083
failed validation

I've searched for others with this behavior and found this posting:

   - this posting
   http://shibboleth.net/pipermail/users/2017-January/033873.html I looked
   at Daniel's reply, and we're definitely falling in the "other network
   events cause the connection to be dropped" as this is not happening on a
   regular basis (e.g., every 5 minutes as with the OP); weeks can pass before
   this reoccurs, and then the very next day it can crop up.
   - and this issue: https://issues.shibboleth.net/jira/browse/IDP-1441 It
   doesn't appear that the Reporter of the issue is actually having their IdP
   become unresponsive.

When these events occur for us, the IdP won't load, and the normal shutdown
process via systemd fails to stop the service. We have to kill -9 the
process.

I suspect we'll need to put some logging in place, but I'm wondering if
anyone has suggestions for classes to debug other than "org.ldaptive.pool."
Given that others have gotten these messages and not had their system hang,
I'm wondering if this is a correlation != causation situation for these log
events, but I honestly don't know where to start looking.

Thanks in advance for any pointers you can provide!

-Mike
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://shibboleth.net/pipermail/users/attachments/20190514/30d9eca0/attachment.html>