IdP V3.1.0 - ReloadableServices not refreshing

[Koch, Ken]

Hey all, I think I've noticed a problem with the reloadable services process. After the IDP has been running a while (at least a day?) it doesn't refresh files from my web servers as expected.

I've got 3 IDPs all pulling from the same https config store. Making changes all day today and the cached copies are inconsistent across the three IDPs.

All 3 IDPs are PT15M checkInterval on shibboleth.attributeFilterResources

IDP 1 - wouldn't refresh at all, no attempts in log until I restarted the service. Now it works as expected (PT15M)
IDP 2 - Last refresh was 4 AM, I've been modifying files since 8:30 off and on, at least 10 times today until 1:54 PM now. Nothing obvious in the logs.
IDP 3 - In sync, refreshing as expected.

Here's my bean setup for the filter reload:

<bean id="http-attribute-filter" class="net.shibboleth.ext.spring.resource.FileBackedHTTPResource"
              c:client-ref="shibboleth.FileCachingHttpClient"
              c:url="https://<hostname>/shibboleth/configuration/test/attribute-filter.xml"
              c:resource="%{idp.home}/conf/cache/attribute-filter.xml"/>

I see these errors in the logs on all 3 IDPs once in a while, but I think they're related to metadata refresh and not my service beans. I haven't started troubleshooting on this yet.
2015-03-23 04:21:38,603 - INFO [org.apache.http.impl.execchain.RetryExec:94] - I/O exception (java.net.SocketException) caught when processing request to {s}->https://<hostname>:443: Connection reset by peer: socket write error
2015-03-23 04:21:38,603 - INFO [org.apache.http.impl.execchain.RetryExec:110] - Retrying request to {s}->https:// <hostname>:443<https://connect.wustl.edu:443>


____________________________________________________________
Ken Koch | Sr. Engineer
Information Services and Technology | Washington University in St. Louis
7425 Forsyth Blvd., Campus Box 1110 | St. Louis, MO 63105
w 314-935-8315 | c 314-223-7256 | ken at wustl.edu<mailto:ken at wustl.edu>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://shibboleth.net/pipermail/users/attachments/20150323/60576128/attachment.html