Very slow processing of attribute-filter.xml with many AttributeFilterPolicy elements

[Ian Young]

> On 27 Nov 2014, at 09:46, Lukas Hämmerle <lukas.haemmerle at switch.ch> wrote:
> 
> We intend to do some optimization for the filter files but still, why
> does loading and processing a 650kB XML file need so much time and what
> optimizations would we best perform? Given the interfederation metadata
> file is almost four times as large and does not take more than a few
> seconds to load and process, it must have to do something with the
> internal representation of attribute filter rules.

Filtering rules boil down to customised Spring bean configurations, so there are several extra layers of processing in there, some of which are not under our control. I doubt, too, that much effort was put into optimising that part of the system against extremely large configurations.

To narrow it down, you could try timing startup with several smaller attribute-filter.xml files and see if it's roughly linear. If not, there's probably some looping across existing beans going on (either in Spring or our code) that might give you an NxN effect.

Best of all would be running some kind of profiler to see where it was spending its time.

Have you had a chance to try this against the V3 IdP yet?

    -- Ian




-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 5250 bytes
Desc: not available
Url : http://shibboleth.net/pipermail/users/attachments/20141127/3c126cd8/attachment.bin