Load Test Numbers with Different idp.properties settings

[Cantor, Scott]

On 7/8/14, 12:09 PM, "Nate Klingenstein" <ndk at internet2.edu> wrote:

>I couldn't get a whole lot of variance in the numbers.  I did validate
>that the IdP remains the bottleneck by dropping one node and observing
>TPS drop by more than half.  Please indicate other things you'd like me
>to test.

You had no variance because you didn't change things, see below.

>Uncommented delta; starting point mostly stock
>peak TPS, rough average maximum TPS(eyeballed after everything has run
>for a few minutes, ~15000 tests in), error rate %
>
>no change
>97, 85, .1337% (no, I didn't make that up)

What are the errors though?

>idp.storage.StorageService =
>org.opensaml.storage.impl.MemoryStorageService
>idp.storage.cleanupInterval = PT10M
>109, 93, .0866%

I think you misunderstood; you're setting properties there to the actual
defaults. When you uncomment one, you're actually not changing anything.
We used the approach of commenting out the default setting, but noting the
alternative. So you'd have to change the properties.

In that particular case, there's really no alternative except
JDBC/Hibernate right now.

>idp.storage.ClientStorageService =
>org.opensaml.storage.impl.ServletRequestScopedStorageService
>101, 90, .0764%

Also not changeable. What you would change is:

# Set to "shibboleth.StorageService" for server-side storage
#idp.session.StorageService = shibboleth.ClientStorageService


That might have an impact.

>idp.transientId.generator = shibboleth.CryptoTransientIdGenerator
>99, 93, .1129%

Also the default. Look at the comment:

# Set to shibboleth.StoredTransientIdGenerator for server-side storage
#idp.transientId.generator = shibboleth.CryptoTransientIdGenerator


>idp.session.trackSPSessions = true
>Startup appears to fail silently with logs at default levels.

That's because you have to change the storage option, but I'll check the
log level, it should say something louder.

>idp.session.enabled = shibboleth.Conditions.True
>idp.session.StorageService = shibboleth.ClientStorageService

Again, that's the default.

The values I'm interested in are:

idp.transientId.generator = shibboleth.StoredTransientIdGenerator


and

idp.sesson.StorageService = shibboleth.StorageService

They may have no impact, but I don't think your tests actually included
either.

-- Scott