SP metadata cache keeps growing

[Jon Agland]

Some further info...
On Tue, 2020-03-03 at 15:05 +0000, Jon Agland wrote:
> 
> Within the UK federation, we've similar seen growth in the size of
> our metadata aggregate publication, to about ~53.5MB.  We've had a
> few adhoc reports, but nothing really concrete, so we've been using
> our metadata publication logs to help us a little, as the
> consumption/traffic levels have also gone up a little too.  We've
> pro-actively contacted a handful of organisations whose SPs we can
> identify (this is fairly standard procedure for us to contact those
> using our metadata publication excessively).  I guess we may get a
> few more calls when the metadata the SPs are running with
> expires/hits the validUntil, or when the service needs to restart?
> A colleague has also tested two versions of Shibboleth SP (3.0.4 and
> 2.5.3 ) with the metadata consumption and signature verification on.
>  The reason for this was that the adhoc reports did seem to indicate
> slightly older versions were affected.    We've observed that 3.0.4
> took ~17 minutes, whilst 2.5.3 took ~35-37 minutes, this was done on
> the same machine/hardware.
We (a colleague) has tested on SP 3.0.4 with some UK federation
metadata publications both before and after a time period where an
embedded mdui:logo of 800kB+ appeared in the federation metadata (the
entity concerned was imported from eduGAIN), and the SP verifies the
signature in less than 2m30s.  Therefore, we now suspect it will be
this large blob that was causing the issues.
We are (with an exception, which we are resolving) clear of embedded
mdui:logos within the UK federation registered entities, as we enforce
https URLs, and that seems to be a good standpoint in the
circumstances.
https://www.ukfederation.org.uk/content/Documents/MDUIRecommendations
Cheers,
Jon

-- 
Jisc is a registered charity (number 1149740) and a company limited by
guarantee which is registered in England under company number.
05747339, VAT number GB 197 0632 86.  Jisc’s registered office is: 4
Portwall Lane, Bristol, BS1 6NB. T 0203 697 5800.

Jisc Services Limited is a wholly owned Jisc subsidiary and a company
limited by guarantee which is registered in England under company
number 02881024, VAT number GB 197 0632 86. The registered office is: 4

Portwall Lane, Bristol, BS1 6NB. T 0203 697 5800. 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://shibboleth.net/pipermail/users/attachments/20200309/c69a1942/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 5812 bytes
Desc: not available
URL: <http://shibboleth.net/pipermail/users/attachments/20200309/c69a1942/attachment.bin>