<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Good Morning,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We have a fully functional IDP box that suddenly stopped working at some point between 9:00 AM yesterday, and 9:00 AM today. I can pull up the tomcat service page, but not the IDP page. (Server 2008 R2 Enterprise, Shibboleth 2.3.6 )
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I am unsure how best to proceed because of what I found in the tomcat logs. All the logs after restarting the service show nothing but “INFO” or “FINE” entries. But log entries dated to around 9am yesterday morning show a slew of warnings
and severe messages.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">(I’ve trimmed out a fair amount of java addressing to condense it)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b>WARNING: Exception obtaining work path for <o:p></o:p></b></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:07 AM org.apache.catalina.startup.HostConfig checkResources<o:p></o:p></b></p>
<p class="MsoNormal"><b>WARNING: Error delete redeploy resources from context []<o:p></o:p></b></p>
<p class="MsoNormal"><b>java.io.IOException: <span style="background:yellow;mso-highlight:yellow">
Insufficient system resources exist to complete the requested service</span><o:p></o:p></b></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">(This is repeated three times)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:07 AM org.apache.catalina.startup.HostConfig checkResources<o:p></o:p></b></p>
<p class="MsoNormal"><b>INFO: Undeploying context [/manager]<o:p></o:p></b></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:07 AM org.apache.catalina.core.StandardContext getWorkPath<o:p></o:p></b></p>
<p class="MsoNormal"><b>WARNING: Exception obtaining work path for /manager<o:p></o:p></b></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:07 AM org.apache.catalina.startup.HostConfig checkResources<o:p></o:p></b></p>
<p class="MsoNormal"><b>WARNING: Error delete redeploy resources from context [/manager]<o:p></o:p></b></p>
<p class="MsoNormal"><b>java.io.IOException: <span style="background:yellow;mso-highlight:yellow">
Insufficient system resources exist to complete the requested service</span><o:p></o:p></b></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">(This is repeated five times)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b>INFO: Undeploying context [/docs]<o:p></o:p></b></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:08 AM org.apache.catalina.core.StandardContext getWorkPath<o:p></o:p></b></p>
<p class="MsoNormal"><b>WARNING: Exception obtaining work path for /docs<o:p></o:p></b></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:08 AM org.apache.catalina.startup.HostConfig checkResources<o:p></o:p></b></p>
<p class="MsoNormal"><b>WARNING: Error delete redeploy resources from context [/docs]<o:p></o:p></b></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">(This is repeated three times)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b>INFO: Undeploying context [/idp]<o:p></o:p></b></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:08 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads<o:p></o:p></b></p>
<p class="MsoNormal"><b>SEVERE: The web application [/idp] appears to have started a thread named [net.sf.ehcache.CacheManager@1f2af1c] but has failed to stop it.
<span style="background:yellow;mso-highlight:yellow">This is very likely to create a memory leak.</span><o:p></o:p></b></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:08 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads<o:p></o:p></b></p>
<p class="MsoNormal"><b>SEVERE: The web application [/idp] appears to have started a thread named [Timer-0] but has failed to stop it.
<span style="background:yellow;mso-highlight:yellow">This is very likely to create a memory leak.</span><o:p></o:p></b></p>
<p class="MsoNormal"><b>Nov 2, 2014 9:43:08 AM org.apache.catalina.loader.WebappClassLoader clearReferencesThreads<o:p></o:p></b></p>
<p class="MsoNormal"><b>SEVERE: The web application [/idp] appears to have started a thread named [MultiThreadedHttpConnectionManager cleanup] but has failed to stop it.
<span style="background:yellow;mso-highlight:yellow">This is very likely to create a memory leak.</span><o:p></o:p></b></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">So I would guess there already was a memory leak, and it ended up corrupting some of my tomcat files.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Is there a way I could redeploy tomcat from the windows installer, but leave Shib IDP files as they are? Or am I off the mark and to you think something else is the cause?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thank you for your time.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Andy<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">Communications Network Analyst</span><b><span style="font-family:"Helvetica",sans-serif;color:black"><br>
</span></b><span style="font-size:10.0pt;font-family:"Arial",sans-serif;color:black">University Networking and Research Computing<br>
South Dakota State University<br>
SOHO #200, Box 2231<br>
Brookings, SD 57007<br>
<br>
</span><span style="font-size:10.0pt;font-family:"Arial",sans-serif">"It matters not how strait the gate, how charged with punishments the scroll, I am the master of my fate: I am the captain of my soul."<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial",sans-serif">--William Earnest Henry<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>