Preconfigured metrics in IdP 3.3.1

[Etienne Dysli-Metref]

On 05/07/17 17:11, Cantor, Scott wrote:
>> Does it make sense to time whole profile requests? If they contain user
>> interaction, that kind of thrashes the measure's value, doesn't it?
> 
> It depends what you're measuring. For one thing, you can audit 
> whether SSO occurred also, so you can eliminate the other set of 
> cases from the data if you want to. What it tells you is how long
> people are taking to get through the process, which tells you things
> about your UI, how long people sit on the page, things like that.

Hmm good point. I've tried this timer
metricContext.addTimer("idp.profile." + profile, "DecodeMessage",
"WriteAuditLog");
but since there are several possible end states I'm not sure
WriteAuditLog is a good choice. RecordResponseComplete maybe?

>> - time LDAP requests (both authn and attributes)
> 
> I believe resolver plugin IDs are also usable as triggered counters
> and timers. If not, they should be, but I think I included that.

Nice! I have this LDAP connector
<resolver:DataConnector id="myLDAP" xsi:type="dc:LDAPDirectory" ...>
so I tried
metricContext.addTimer("idp.attribute.resolution.ldap", "myLDAP", "myLDAP");
and it worked! :)

> The problem with the metrics is you have to have a way to collect
> them, which can be more work in the end than just using the log with
> good tools.

I think applications should provide their own metrics, instead of having
to analyse theirs logs to get the information. For the moment, the only
thing I have running in production is Munin scripts that grep the audit
log and I don't consider grep a "good tool" for log analysis...
Prometheus and ELK are on my wish list.

For HTTP response times I guess I'll have to write a servlet filter (or
look at Apache logs).

  Etienne

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: OpenPGP digital signature
URL: <http://shibboleth.net/pipermail/users/attachments/20170706/ab73a413/attachment.sig>