Jetty refuses to start

[Herron, Joel D]

I’m switching from tomcat 8 and java 8 to jetty 9.4 and Java 11 to facilitate the 3.4.8 -> 4.1 upgrade and jetty just refuses to start. My two qa boxes no issues, get to my first production box this morning and run into this.

Corretto-11.0.9.11.1
IDP 3.4.8
jetty 9.4.40.20210413

It seems like it’s failing extracting the war as it dies in the same spot. I’ve rebuilt the war file half a dozen times compared web.xml and the jetty-base configs, ensured file permissions are all set the same I just can’t find anything different or what could be causing it.

2021-04-29 08:58:01.672:DBUG:oejur.JarResource:main: Extract jar:file:///opt/shibboleth-idp/war/idp.war!/WEB-INF/lib/ to /opt/jetty-base/tmp/jetty-127_0_0_1-8080-idp_war-_idp-any-11394561727586115859/webinf/WEB-INF/lib
2021-04-29 08:58:01.672:DBUG:oejur.JarResource:main: Extracting entry = WEB-INF/lib/ from jar file:/opt/shibboleth-idp/war/idp.war
2021-04-29 08:58:01.674:DBUG:oejur.JarResource:main: Skipping entry: WEB-INF/
2021-04-29 08:58:01.674:DBUG:oejur.JarResource:main: Skipping entry: WEB-INF/classes/
2021-04-29 08:58:01.674:DBUG:oejur.JarResource:main: Skipping entry: WEB-INF/jsp/
2021-04-29 08:58:01.675:DBUG:oejur.JarResource:main: Skipping entry:
2021-04-29 08:58:01.675:DBUG:oejur.JarResource:main: Skipping entry: css/
2021-04-29 08:58:01.675:DBUG:oejur.JarResource:main: Skipping entry: images/
2021-04-29 08:58:01.675:DBUG:oejur.JarResource:main: Skipping entry: js/
2021-04-29 08:58:01.675:DBUG:oejur.JarResource:main: Skipping entry: WEB-INF/idpui.tld
2021-04-29 08:58:01.675:DBUG:oejur.JarResource:main: Skipping entry: WEB-INF/jsp/info.jsp
2021-04-29 08:58:01.675:DBUG:oejur.JarResource:main: Skipping entry: WEB-INF/jsp/metadata.jsp
2021-04-29 08:58:01.675:DBUG:oejur.JarResource:main: Skipping entry: WEB-INF/jsp/services.jsp
2021-04-29 08:58:01.676:DBUG:oejur.JarResource:main: Skipping entry: WEB-INF/jsp/status.jsp
2021-04-29 08:58:03.118:DBUG:oejut.ShutdownThread:JettyShutdownThread:
java.lang.IllegalStateException: !STOPPED
                at org.eclipse.jetty.server.handler.HandlerWrapper.destroy(HandlerWrapper.java:140)
                at org.eclipse.jetty.util.thread.ShutdownThread.run(ShutdownThread.java:139)

jetty check returns

JAVA                  =  /usr/lib/jvm/java-11-amazon-corretto/bin/java
JAVA_OPTIONS          =  -Djetty.home=/opt/jetty/jetty-9.4.40 -Djetty.base=/opt/jetty-base -Djava.io.tmpdir=/tmp
JETTY_HOME            =  /opt/jetty/jetty-9.4.40
JETTY_BASE            =  /opt/jetty-base
START_D               =  /opt/jetty-base/start.d
START_INI             =  /opt/jetty-base/start.ini
JETTY_START           =  /opt/jetty/jetty-9.4.40/start.jar
JETTY_CONF            =  /opt/jetty/jetty-9.4.40/etc/jetty.conf
JETTY_ARGS            =  jetty.state=/opt/jetty-base/jetty.state jetty-started.xml
JETTY_RUN             =  /var/run/jetty
JETTY_PID             =  /var/run/jetty/jetty.pid
JETTY_START_LOG       =  /var/run/jetty/jetty-start.log
JETTY_STATE           =  /opt/jetty-base/jetty.state
JETTY_START_TIMEOUT   =  60
RUN_CMD               =  /usr/lib/jvm/java-11-amazon-corretto/bin/java -Djetty.home=/opt/jetty/jetty-9.4.40 -Djetty.base=/opt/jetty-base -Djava.io.tmpdir=/tmp -jar /opt/jetty/jetty-9.4.40/start.jar jetty.state=/opt/jetty-base/jetty.state jetty-started.xml

Which is identical to my running qa servers

Any thoughts would be welcome.

Thanks,
--Joel
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://shibboleth.net/pipermail/users/attachments/20210429/9ebab515/attachment.htm>