<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Hi all,<br>
    <br>
    since we originally reported the issue, it might make sense to
    mention that the IdP producing this error is also running on SLES
    (version 11 SP4 if I am not mistaken).<br>
    <br>
    I checked some other IdP servers we are running and was not able to
    find the error in the log of any of them. None of them is running on
    SLES. <br>
    On the flipside, none of then has a similar load than the one with
    the ELException.<br>
    <br>
    Looking through the logs I would also say that the error is getting
    more frequent, but that is hard to say with our small sample size.<br>
    We recently started getting some reports from people trying to login
    getting the Exception, though, so there's that.<br>
    <br>
    Some other information about the environment, which is similar to
    Brian's:<br>
    - JDK 1.8.0_112<br>
    - IdP 3.3.0<br>
    - Tomcat 8.0.39<br>
    <br>
    <pre class="moz-signature" cols="72">-- 
David Hübner, Solutions Engineer

DAASI International GmbH        
Europaplatz 3                   
D-72072 Tübingen                
Germany                    

phone: +49 7071 407109-0
fax:   +49 7071 407109-9  
email: <a class="moz-txt-link-abbreviated" href="mailto:david.huebner@daasi.de">david.huebner@daasi.de</a>
web:   <a class="moz-txt-link-abbreviated" href="http://www.daasi.de">www.daasi.de</a>

Sitz der Gesellschaft: Tübingen
Registergericht: Amtsgericht Stuttgart, HRB 382175
Geschäftsleitung: Peter Gietz
</pre>
    <div class="moz-cite-prefix">On 19.05.2017 01:53, Brian Moon wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CAH-7XYKkkCZ-Vw5t7L2av5zFTEjqE4e=7h30BKH8Y-GYm9wsRQ@mail.gmail.com">
      <div dir="ltr">
        <div class="gmail_default" style="font-family:"times new
          roman",serif">Hello all,</div>
        <div class="gmail_default" style="font-family:"times new
          roman",serif"><br>
        </div>
        <div class="gmail_default" style="font-family:"times new
          roman",serif">While stress testing one of our IdP servers
          today we were able to reproduce this error.  Below is some
          information about our environment and the testing parameters:</div>
        <div class="gmail_default" style="font-family:"times new
          roman",serif"><br>
        </div>
        <div class="gmail_default" style="font-family:"times new
          roman",serif">IdP Server:</div>
        <div class="gmail_default">
          <ul>
            <li><font face="times new roman, serif">SLES 12 SP2</font></li>
            <li><font face="times new roman, serif">IdP Version 3.3.1</font></li>
            <li><font face="times new roman, serif">Oracle JDK
                1.8.0_112-b15</font></li>
            <li><font face="times new roman, serif">Tomcat 8.0.36-20.7</font></li>
            <li><font face="times new roman, serif">JAVA_OPTS: -Xms3g
                -Xmx3g -XX:MaxGCPauseMillis=400 -XX:+DisableExplicitGC
                -XX:+UseG1GC</font></li>
            <li><font face="times new roman, serif">2 Cores</font></li>
            <li><font face="times new roman, serif">6 GB RAM (VM memory
                reservation set to reserve all guest memory)</font></li>
            <li><font face="times new roman, serif">Apache 2.4.23-21.1</font></li>
            <ul>
              <li><font face="times new roman, serif">Apache Prefork MPM</font></li>
              <li><font face="times new roman, serif">ServerLimit 5120</font></li>
              <li><font face="times new roman, serif">MaxClients 5120</font></li>
            </ul>
          </ul>
          <font face="times new roman, serif">Testing VM:</font></div>
        <div class="gmail_default">
          <ul>
            <li><font face="times new roman, serif">Windows 7 Enterprise
                (64-bit)</font></li>
            <li><font face="times new roman, serif">4 Cores</font></li>
            <li><font face="times new roman, serif">8 GB RAM</font></li>
            <li><font face="times new roman, serif">Oracle
                JRE 1.8.0_131-b11</font></li>
            <li><font face="times new roman, serif">Apache JMeter 3.2
                r1790748</font></li>
            <ul>
              <li><font face="times new roman, serif">Test plan: <a
href="https://wiki.shibboleth.net/confluence/download/attachments/17072886/shibboleth-unsolicited-sso-test.jmx?version=2&modificationDate=1435784363124&api=v2"
                    moz-do-not-send="true">https://wiki.shibboleth.net/confluence/download/attachments/17072886/shibboleth-unsolicited-sso-test.jmx?version=2&modificationDate=1435784363124&api=v2</a></font></li>
              <li><font face="times new roman, serif">ThreadCount 1500</font></li>
              <li><font face="times new roman, serif">Duration 300</font></li>
              <li><font face="times new roman, serif">RampUpPeriod 10</font></li>
              <li><font face="times new roman, serif">ProviderId <a
                    href="https://sp.testshib.org/shibboleth-sp"
                    moz-do-not-send="true">https://sp.testshib.org/shibboleth-sp</a></font></li>
            </ul>
          </ul>
          <font face="times new roman, serif">For the Apache config on
            the IdP server, the ServerLimit and MaxClients were set to
            something ridiculous so we could see what kind of load it
            could take.  On the testing VM we were running out of
            ephemeral ports, so we added a registry key to increase the
            max port number that could be used by a user: <a
href="https://www.baselogic.com/blog/solved-java-net-bindexception-address-use-connect-issue-windows/"
              moz-do-not-send="true">https://www.baselogic.com/blog/solved-java-net-bindexception-address-use-connect-issue-windows/</a>
            (this is not needed to reproduce the error, but cuts down on
            some noise).  We did still have some socket errors on the
            testing VM, but overall it seemed to run a lot better.</font></div>
        <div class="gmail_default"><font face="times new roman, serif"><br>
          </font></div>
        <div class="gmail_default"><font face="times new roman, serif">Hope
            that helps in reproducing this and tracking down the cause.</font></div>
      </div>
      <div class="gmail_extra"><br clear="all">
        <div>
          <div class="gmail_signature" data-smartmail="gmail_signature">
            <div dir="ltr">
              <div>
                <div dir="ltr">
                  <div>
                    <div dir="ltr">
                      <div>
                        <div dir="ltr">
                          <div>
                            <div dir="ltr"><br>
                              <font face="times new roman, serif">Brian
                                Moon</font><br>
                              <font face="times new roman, serif">Senior
                                System Administrator</font><br>
                              <font face="times new roman, serif">Enterprise
                                Systems</font><br>
                              <font face="times new roman, serif">Santa
                                Clara University</font><br>
                              <font face="times new roman, serif">Office:
                                408.554.4830</font><br>
                              <a href="mailto:bmoon@scu.edu"
                                style="font-family:'times new
                                roman',serif" target="_blank"
                                moz-do-not-send="true">bmoon@scu.edu</a><br>
                            </div>
                          </div>
                        </div>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </div>
        <br>
        <div class="gmail_quote">On Mon, Apr 24, 2017 at 9:26 AM,
          Cantor, Scott <span dir="ltr"><<a
              href="mailto:cantor.2@osu.edu" target="_blank"
              moz-do-not-send="true">cantor.2@osu.edu</a>></span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex"><span
              class="">> Yes, I'm currently waiting for my session to
              timeout on the login form so I can<br>
              > see what it does. I would expect it to throw a flow
              execution error though, so<br>
              > I don't know if that's going to do it. I also see
              *very* few of these in my log,<br>
              > like once a day or so, and that's with a decent
              volume, so that's puzzling.<br>
              <br>
            </span>A basic "Wait too long" timeout doesn't have anything
            to do with this error, so that's as expected. So I have no
            idea how one would reproduce it.<br>
            <span class="HOEnZb"><font color="#888888"><br>
                -- Scott<br>
              </font></span>
            <div class="HOEnZb">
              <div class="h5"><br>
                <br>
                --<br>
                To unsubscribe from this list send an email to <a
                  href="mailto:users-unsubscribe@shibboleth.net"
                  moz-do-not-send="true">users-unsubscribe@shibboleth.<wbr>net</a><br>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
    </blockquote>
    <br>
  </body>
</html>