IDP 3.4.4 stops processing authentications

[Miguel Salinas Vivancos]

Hi,
We are observing a disruptive behaviour on the authenticacion process in the IDP.
>From time to time, maybe once a day, we can see that Shibboleth is accepting requests (seen in idp-process.log) but they aren't processed (nothing in the idp-audit.log). This happens during aprox. 30 minutes and after that the system begins to process the requests normally.

In the past we were using Shibboleth IDP 3.1.2 over Java 1.7, deployed in a Tomcat 7, and we detected massive usage of the CPUs in that moments so we change the Garbage Collector in Tomcat options to use Concurrent Mark Sweep. That solved our problem.

Now we have upgraded the environment so we are using Shibboleth IDP 3.4.4 over Java 1.8, deployed in a Tomcat 8.5.
And this "Stop The World" behaviour is acting again; we changed to CMS collector but with no effect.

We are studing to use G1GC, but first we are trying to understand the Garbage Collector effect on the IDP. On the development environment, with jstatd and jvisualvm we can see how the objects in memory are moving through young and old generation but we are not able to reproduce the error (in Production we have about 80 logins/minute).

Do you know if IDP 3.4.4 needs some heapspace tunning?
Do you recommend of changing to G1GC? I know it will be the default in Java 9...
Is there a way to send large amount of requests? We are trying JMeter but is a work in progress :(

Thank you so much,

Miguel Salinas Vivancos
Identity Management Integrator
Tel.: +34 639 198 154 - mail:msalinas at bcn.sia.es

[cid:image001.png at 01D52CD1.D29CDC20]

Grupo SIA
Citypark, Edificio Atenas, Ctra. Hospitalet 147. 08940 Cornellá de Llobregat - Barcelona
www.sia.es<http://www.sia.es/>  - Twitter: @SIA_es  - LinkedIn: Grupo SIA



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://shibboleth.net/pipermail/users/attachments/20190910/8f69955f/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 5341 bytes
Desc: image001.png
URL: <http://shibboleth.net/pipermail/users/attachments/20190910/8f69955f/attachment.png>