<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0">
<base href="https://issues.shibboleth.net/jira">
<title>Message Title</title>
</head>
<body class="jira" style="color: #333333; font-family: Arial, sans-serif; font-size: 14px; line-height: 1.429">
<table id="background-table" cellpadding="0" cellspacing="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt; background-color: #f5f5f5; border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt" bgcolor="#f5f5f5">
<!-- header here -->
<tbody>
<tr>
<td id="header-pattern-container" style="padding: 0px; border-collapse: collapse; padding: 10px 20px">
<table id="header-pattern" cellspacing="0" cellpadding="0" border="0" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tbody>
<tr>
<td id="header-avatar-image-container" valign="top" style="padding: 0px; border-collapse: collapse; vertical-align: top; width: 32px; padding-right: 8px" width="32"> <img id="header-avatar-image" class="image_fix" src="cid:jira-generated-image-avatar-e073e050-ca1b-4b0b-803b-03e1b6c7ffeb" height="32" width="32" border="0" style="border-radius: 3px; vertical-align: top"> </td>
<td id="header-text-container" valign="middle" style="padding: 0px; border-collapse: collapse; vertical-align: middle; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 1px"> <a class="user-hover" rel="57be911d30be4c376c7fb4d4693c20b45d246f18b6540ad4f1f45c20f7a83c2d@https://login.idp.eduid.se/idp.xml" id="email_57be911d30be4c376c7fb4d4693c20b45d246f18b6540ad4f1f45c20f7a83c2d@https://login.idp.eduid.se/idp.xml" href="https://issues.shibboleth.net/jira/secure/ViewProfile.jspa?name=57be911d30be4c376c7fb4d4693c20b45d246f18b6540ad4f1f45c20f7a83c2d%40https%3A%2F%2Flogin.idp.eduid.se%2Fidp.xml" style="color:#0052cc;; color: #3b73af; text-decoration: none">57be911d30be4c376c7fb4d4693c20b45d246f18b6540ad4f1f45c20f7a83c2d@https://login.idp.eduid.se/idp.xml</a> <strong>created</strong> an issue </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td id="email-content-container" style="padding: 0px; border-collapse: collapse; padding: 0 20px">
<table id="email-content-table" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt; border-spacing: 0; border-collapse: separate">
<tbody>
<tr>
<!-- there needs to be content in the cell for it to render in some clients -->
<td class="email-content-rounded-top mobile-expand" style="padding: 0px; border-collapse: collapse; color: #ffffff; padding: 0 15px 0 16px; height: 15px; background-color: #ffffff; border-left: 1px solid #cccccc; border-top: 1px solid #cccccc; border-right: 1px solid #cccccc; border-bottom: 0; border-top-right-radius: 5px; border-top-left-radius: 5px; height: 10px; line-height: 10px; padding: 0 15px 0 16px; mso-line-height-rule: exactly" height="10" bgcolor="#ffffff"> </td>
</tr>
<tr>
<td class="email-content-main mobile-expand " style="padding: 0px; border-collapse: collapse; border-left: 1px solid #cccccc; border-right: 1px solid #cccccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #ffffff" bgcolor="#ffffff">
<table class="page-title-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tbody>
<tr>
<td class="page-title-pattern-first-line " style="padding: 0px; border-collapse: collapse; font-family: Arial, sans-serif; font-size: 14px; padding-top: 10px"> <a href="https://issues.shibboleth.net/jira/browse/SSPCPP" style="color: #3b73af; text-decoration: none">Shibboleth SP - C++</a> / <a href="https://issues.shibboleth.net/jira/browse/SSPCPP-904" style="color: #3b73af; text-decoration: none"><img src="cid:jira-generated-image-avatar-b71b38e1-ae2f-4b69-ab8d-0d1fbda57b63" height="16" width="16" border="0" align="absmiddle" alt="Bug" style="vertical-align: text-bottom"></a> <a href="https://issues.shibboleth.net/jira/browse/SSPCPP-904" style="color: #3b73af; text-decoration: none">SSPCPP-904</a> </td>
</tr>
<tr>
<td style="vertical-align: top;; padding: 0px; border-collapse: collapse; padding-right: 5px; font-size: 20px; line-height: 30px; mso-line-height-rule: exactly" class="page-title-pattern-header-container"> <span class="page-title-pattern-header" style="font-family: Arial, sans-serif; padding: 0; font-size: 20px; line-height: 30px; mso-text-raise: 2px; mso-line-height-rule: exactly; vertical-align: middle"> <a href="https://issues.shibboleth.net/jira/browse/SSPCPP-904" style="color: #3b73af; text-decoration: none">Unhandled Exception in iis7_shib.dll</a> </span> </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td class="email-content-main mobile-expand wrapper-special-margin" style="padding: 0px; border-collapse: collapse; border-left: 1px solid #cccccc; border-right: 1px solid #cccccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #ffffff; padding-top: 10px; padding-bottom: 5px" bgcolor="#ffffff">
<table class="keyvalue-table" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tbody>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Issue Type:</th>
<td class="has-icon" style="padding: 0px; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> <img src="cid:jira-generated-image-avatar-b71b38e1-ae2f-4b69-ab8d-0d1fbda57b63" height="16" width="16" border="0" align="absmiddle" alt="Bug" style="vertical-align: text-bottom"> Bug </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Affects Versions:</th>
<td style="padding: 0px; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> 3.1.0 </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Assignee:</th>
<td style="padding: 0px; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> <a class="user-hover" rel="cantor.2@osu.edu" id="email_cantor.2@osu.edu" href="https://issues.shibboleth.net/jira/secure/ViewProfile.jspa?name=cantor.2%40osu.edu" style="color:#0052cc;; color: #3b73af; text-decoration: none">Scott Cantor</a> </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Components:</th>
<td style="padding: 0px; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> Error Handling, Web Server Modules </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Created:</th>
<td style="padding: 0px; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> 25/Aug/20 7:38 PM </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Environment:</th>
<td style="padding: 0px; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0; margin-top: 0">Windows Server 2016 on VMWare</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0">Our website is running mostly Classic ASP, I have set useHeaders="true" useVariables="false" </p> </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Priority:</th>
<td class="has-icon" style="padding: 0px; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> <img src="cid:jira-generated-image-static-major-0c669ead-ab73-4676-b12a-84b0a1607288" height="16" width="16" border="0" align="absmiddle" alt="Major" style="vertical-align: text-bottom"> Major </td>
</tr>
<tr>
<th style="color: #707070; font: normal 14px/20px Arial, sans-serif; text-align: left; vertical-align: top; padding: 2px 0">Reporter:</th>
<td style="padding: 0px; border-collapse: collapse; font: normal 14px/20px Arial, sans-serif; padding: 2px 0 2px 5px; vertical-align: top"> <a class="user-hover" rel="57be911d30be4c376c7fb4d4693c20b45d246f18b6540ad4f1f45c20f7a83c2d@https://login.idp.eduid.se/idp.xml" id="email_57be911d30be4c376c7fb4d4693c20b45d246f18b6540ad4f1f45c20f7a83c2d@https://login.idp.eduid.se/idp.xml" href="https://issues.shibboleth.net/jira/secure/ViewProfile.jspa?name=57be911d30be4c376c7fb4d4693c20b45d246f18b6540ad4f1f45c20f7a83c2d%40https%3A%2F%2Flogin.idp.eduid.se%2Fidp.xml" style="color:#0052cc;; color: #3b73af; text-decoration: none">57be911d30be4c376c7fb4d4693c20b45d246f18b6540ad4f1f45c20f7a83c2d@https://login.idp.eduid.se/idp.xml</a> </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td class="email-content-main mobile-expand issue-description-container" style="padding: 0px; border-collapse: collapse; border-left: 1px solid #cccccc; border-right: 1px solid #cccccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #ffffff; padding-top: 5px; padding-bottom: 10px" bgcolor="#ffffff">
<table class="text-paragraph-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 2px">
<tbody>
<tr>
<td class="text-paragraph-pattern-container mobile-resize-text " style="padding: 0px; border-collapse: collapse; padding: 0 0 10px 0"> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0; margin-top: 0">A few months ago we started using the Shibboleth Service Provider v3.1.0.1 on IIS on Windows Server 2016 (with all recent Windows updates)</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0">It can be running fine for days but then sometimes w3wp.exe crashes (a few times on a day) with no apparent cause.</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0">Windows Error Reporting shows:</p>
<div class="code panel" style="border-width: 1px;; border: 1px solid #cccccc; background: #f5f5f5; font-size: 12px; line-height: 1.333; font-family: monospace; border: 1px solid #cccccc; -moz-border-radius: 3px 3px 3px 3px; border-radius: 3px 3px 3px 3px; margin: 9px 0">
<div class="codeContent panelContent" style="padding: 9px 12px">
<pre class="code-java" style="margin: 10px 0 0 0; margin-top: 0; max-height: 30em; overflow: auto; white-space: pre-wrap; word-wrap: normal">
Faulting application name: w3wp.exe, version: 10.0.14393.0, time stamp: 0x57899b8a
Faulting module name: KERNELBASE.dll, version: 10.0.14393.3659, time stamp: 0x5e9140ed
Exception code: 0xe06d7363
Fault offset: 0x0000000000034f38
Faulting process id: 0xc44c
Faulting application start time: 0x01d65efa426943f8
Faulting application path: c:\windows\system32\inetsrv\w3wp.exe
Faulting module path: C:\Windows\System32\KERNELBASE.dll</pre>
</div>
</div> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0"> </p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0"> </p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0">The 0xe06d7363 translates to EXCEPTION_UNCAUGHT_CXX_EXCEPTION</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0">Next step is to catch a minidump. The Call Stack is shown below<br> Iis7_shib.dll is very high in the call-stack with IIS7Request::throwError at the top.<br> It is called by IIS7Request::getRequestBody because a call to m_request->ReadEntityBody fails.</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0">First of all: I am not sure Shibboleth is *<b>causing</b>* the crash, maybe it is just collateral damage. But it may help in finding the root cause</p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0">My questions:</p>
<ul>
<li>A message goes into the IOException. Is there any way to retrieve that message (some logging perhaps? I could not find it in shibd.log or any other log)<br> --> In the minidump I can see the error is ERROR_NETNAME_DELETED</li>
<li>ReadEntityBody sound like it is receiving data. Is it fair to generate an (unhandled) exception for ‘just’ a network error?</li>
<li>If it is only collateral damage: is there a way to catch the exception?<br> I do see the <InProcess> element supports a (disadvised) catchAll but if I read the sourcecode correctly it may not apply to the IOException<br> -->Currently testing</li>
</ul> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0"> (callstack and shibd.log follows)</p>
<div class="code panel" style="border-width: 1px;; border: 1px solid #cccccc; background: #f5f5f5; font-size: 12px; line-height: 1.333; font-family: monospace; border: 1px solid #cccccc; -moz-border-radius: 3px 3px 3px 3px; border-radius: 3px 3px 3px 3px; margin: 9px 0">
<div class="codeContent panelContent" style="padding: 9px 12px">
<pre class="code-java" style="margin: 10px 0 0 0; margin-top: 0; max-height: 30em; overflow: auto; white-space: pre-wrap; word-wrap: normal">
KERNELBASE.dll!RaiseException-() Unknown
[External Code]
iis7_shib.dll!IIS7Request::throwError(<span class="code-keyword" style="color: #000091">const</span> std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > & operation, HRESULT hr) Line 452 C++
iis7_shib.dll!IIS7Request::getRequestBody() Line 332 C++
shibsp-lite3_1.dll!std::_Tree<std::_Tmap_traits<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> >,boost::shared_ptr<shibsp::DOMPropertySet>,std::less<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > >,std::allocator<std::pair<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > <span class="code-keyword" style="color: #000091">const</span> ,boost::shared_ptr<shibsp::DOMPropertySet> > >,0> >::_Insert_hint<std::pair<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > <span class="code-keyword" style="color: #000091">const</span> ,boost::shared_ptr<shibsp::DOMPropertySet> > &,std::_Tree_node<std::pair<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > <span class="code-keyword" style="color: #000091">const</span> ,boost::shared_ptr<shibsp::DOMPropertySet> >,void *> *>(std::_Tree_const_iterator<std::_Tree_val<std::_Tree_simple_types<std::pair<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > <span class="code-keyword" style="color: #000091">const</span> ,boost::shared_ptr<shibsp::DOMPropertySet> > > > > _Where, std::pair<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > <span class="code-keyword" style="color: #000091">const</span> ,boost::shared_ptr<shibsp::DOMPropertySet> > & _Val, std::_Tree_node<std::pair<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > <span class="code-keyword" style="color: #000091">const</span> ,boost::shared_ptr<shibsp::DOMPropertySet> >,void *> * _Newnode) Line 1703 C++
shibsp-lite3_1.dll!shibsp::AbstractSPRequest::getHandlerURL(<span class="code-keyword" style="color: #000091">const</span> <span class="code-object" style="color: #910091">char</span> * resource) Line 247 C++
xmltooling-lite3_1.dll!xmltooling::TemplateEngine::TemplateParameters::getParameter(<span class="code-keyword" style="color: #000091">const</span> <span class="code-object" style="color: #910091">char</span> * name) Line 61 C++
shibsp-lite3_1.dll!shibsp::ServerThread::job() Line 597 C++
xmltooling-lite3_1.dll!xmltooling::TemplateEngine::process(bool visible, <span class="code-keyword" style="color: #000091">const</span> std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > & buf, <span class="code-keyword" style="color: #000091">const</span> <span class="code-object" style="color: #910091">char</span> * & lastpos, std::basic_ostream<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>> > & os, <span class="code-keyword" style="color: #000091">const</span> xmltooling::TemplateEngine::TemplateParameters & parameters, <span class="code-keyword" style="color: #000091">const</span> std::pair<std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > <span class="code-keyword" style="color: #000091">const</span> ,std::basic_string<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>>,std::allocator<<span class="code-object" style="color: #910091">char</span>> > > & loopentry, <span class="code-keyword" style="color: #000091">const</span> xmltooling::XMLToolingException * e) Line 157 C++
xmltooling-lite3_1.dll!xmltooling::TemplateEngine::run(std::basic_istream<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>> > & is, std::basic_ostream<<span class="code-object" style="color: #910091">char</span>,std::char_traits<<span class="code-object" style="color: #910091">char</span>> > & os, <span class="code-keyword" style="color: #000091">const</span> xmltooling::TemplateEngine::TemplateParameters & parameters, <span class="code-keyword" style="color: #000091">const</span> xmltooling::XMLToolingException * e) Line 286 C++
shibsp-lite3_1.dll!shibsp::ServiceProvider::doHandler(shibsp::SPRequest & request) Line 684 C++
[External Code]
shibsp-lite3_1.dll!shibsp::DOMPropertySet::load(<span class="code-keyword" style="color: #000091">const</span> xercesc_3_2::DOMElement * e, log4shib::Category * log, xercesc_3_2::DOMNodeFilter * filter, <span class="code-keyword" style="color: #000091">const</span> shibsp::DOMPropertySet::Remapper * remapper, <span class="code-keyword" style="color: #000091">const</span> xmltooling::QName * unsetter) Line 151 C++
iis7_shib.dll!ShibHttpModule::DoHandler(IHttpContext * pHttpContext, IHttpEventProvider * pProvider) Line 62 C++
[External Code]</pre>
</div>
</div> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0"> </p> <p style="margin-top:0;margin-bottom:10px;; margin: 10px 0 0 0">Also: this is what shibd.log shows during the crash:</p>
<div class="code panel" style="border-width: 1px;; border: 1px solid #cccccc; background: #f5f5f5; font-size: 12px; line-height: 1.333; font-family: monospace; border: 1px solid #cccccc; -moz-border-radius: 3px 3px 3px 3px; border-radius: 3px 3px 3px 3px; margin: 9px 0">
<div class="codeContent panelContent" style="padding: 9px 12px">
<pre class="code-java" style="margin: 10px 0 0 0; margin-top: 0; max-height: 30em; overflow: auto; white-space: pre-wrap; word-wrap: normal">
2020-08-19 17:13:17 ERROR Shibboleth.Listener [45]: error reading size of input message
2020-08-19 17:13:17 ERROR Shibboleth.Listener [45]: failed socket call (unknown), result (0): No error
2020-08-19 17:13:17 ERROR Shibboleth.Listener [45]: I/O failure processing request on socket (636)
2020-08-19 17:13:17 ERROR Shibboleth.Listener [47]: error reading size of input message
2020-08-19 17:13:17 ERROR Shibboleth.Listener [47]: failed socket call (unknown), result (0): No error
2020-08-19 17:13:17 ERROR Shibboleth.Listener [47]: I/O failure processing request on socket (440)
2020-08-19 17:13:17 ERROR Shibboleth.Listener [46]: error reading size of input message
2020-08-19 17:13:17 ERROR Shibboleth.Listener [46]: failed socket call (unknown), result (0): No error
2020-08-19 17:13:17 ERROR Shibboleth.Listener [46]: I/O failure processing request on socket (648)</pre>
</div>
</div> </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td class="email-content-main mobile-expand " style="padding: 0px; border-collapse: collapse; border-left: 1px solid #cccccc; border-right: 1px solid #cccccc; border-top: 0; border-bottom: 0; padding: 0 15px 0 16px; background-color: #ffffff" bgcolor="#ffffff">
<table id="actions-pattern" cellspacing="0" cellpadding="0" border="0" width="100%" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 1px">
<tbody>
<tr>
<td id="actions-pattern-container" valign="middle" style="padding: 0px; border-collapse: collapse; padding: 10px 0 10px 24px; vertical-align: middle; padding-left: 0">
<table align="left" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tbody>
<tr>
<td class="actions-pattern-action-icon-container" style="padding: 0px; border-collapse: collapse; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 0; vertical-align: middle"> <a href="https://issues.shibboleth.net/jira/browse/SSPCPP-904#add-comment" target="_blank" title="Add Comment" style="color: #3b73af; text-decoration: none"> <img class="actions-pattern-action-icon-image" src="cid:jira-generated-image-static-comment-icon-d1a472d5-6dd3-4988-829d-500c0ea37f0b" alt="Add Comment" title="Add Comment" height="16" width="16" border="0" style="vertical-align: middle"> </a> </td>
<td class="actions-pattern-action-text-container" style="padding: 0px; border-collapse: collapse; font-family: Arial, sans-serif; font-size: 14px; line-height: 20px; mso-line-height-rule: exactly; mso-text-raise: 4px; padding-left: 5px"> <a href="https://issues.shibboleth.net/jira/browse/SSPCPP-904#add-comment" target="_blank" title="Add Comment" style="color: #3b73af; text-decoration: none">Add Comment</a> </td>
</tr>
</tbody>
</table> </td>
</tr>
</tbody>
</table> </td>
</tr>
<!-- there needs to be content in the cell for it to render in some clients -->
<tr>
<td class="email-content-rounded-bottom mobile-expand" style="padding: 0px; border-collapse: collapse; color: #ffffff; padding: 0 15px 0 16px; height: 5px; line-height: 5px; background-color: #ffffff; border-top: 0; border-left: 1px solid #cccccc; border-bottom: 1px solid #cccccc; border-right: 1px solid #cccccc; border-bottom-right-radius: 5px; border-bottom-left-radius: 5px; mso-line-height-rule: exactly" height="5" bgcolor="#ffffff"> </td>
</tr>
</tbody>
</table> </td>
</tr>
<tr>
<td id="footer-pattern" style="padding: 0px; border-collapse: collapse; padding: 12px 20px">
<table id="footer-pattern-container" cellspacing="0" cellpadding="0" border="0" style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tbody>
<tr>
<td id="footer-pattern-text" class="mobile-resize-text" width="100%" style="padding: 0px; border-collapse: collapse; color: #999999; font-size: 12px; line-height: 18px; font-family: Arial, sans-serif; mso-line-height-rule: exactly; mso-text-raise: 2px"> This message was sent by Atlassian Jira <span id="footer-build-information">(v8.5.4#805004-<span title="0444eab799707f9ad7b248d69f858774aadfd250" data-commit-id="0444eab799707f9ad7b248d69f858774aadfd250}">sha1:0444eab</span>)</span> </td>
<td id="footer-pattern-logo-desktop-container" valign="top" style="padding: 0px; border-collapse: collapse; padding-left: 20px; vertical-align: top">
<table style="border-collapse: collapse; mso-table-lspace: 0pt; mso-table-rspace: 0pt">
<tbody>
<tr>
<td id="footer-pattern-logo-desktop-padding" style="padding: 0px; border-collapse: collapse; padding-top: 3px"> <img id="footer-pattern-logo-desktop" src="https://issues.shibboleth.net/jira/images/mail/atlassian-email-logo.png" alt="Atlassian logo" title="Atlassian logo" width="191" height="24" class="image_fix"> </td>
</tr>
</tbody>
</table> </td>
</tr>
</tbody>
</table> </td>
</tr>
</tbody>
</table>
</body>
</html>