After a crash of the server (Ubuntu 18.04) our puppetserver (6.2.1) process refuses to start with the message it can not find the file/directory "concurrent". It looks like this is a JRuby/Java problem.
... Oct 9 09:18:12 foreman puppetserver[32556]: LoadError: no such file to load -- concurrent Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/thread_local.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <module:(root)> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: Puppet at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:41 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:38 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: (root) at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: (root) at uri:classloader:/puppetserver-lib/puppet/server.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: Exception in thread "main" java.lang.IllegalStateException: There was a problem adding a JRubyInstance to the pool. ... Anyone any experience with this? Thanks in advance! Sander -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/puppet-users/3677619a-8bac-4ca0-811a-0a0ce73d2828%40googlegroups.com.
Oct 9 09:17:44 foreman systemd[1]: Starting puppetserver Service... Oct 9 09:18:12 foreman puppetserver[32556]: LoadError: no such file to load -- concurrent Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/thread_local.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: <module:(root)> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: Puppet at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:41 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at /opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:38 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: (root) at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59 Oct 9 09:18:12 foreman puppetserver[32556]: require at org/jruby/RubyKernel.java:970 Oct 9 09:18:12 foreman puppetserver[32556]: (root) at uri:classloader:/puppetserver-lib/puppet/server.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: <main> at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1 Oct 9 09:18:12 foreman puppetserver[32556]: Exception in thread "main" java.lang.IllegalStateException: There was a problem adding a JRubyInstance to the pool. Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32598$prime_pool_BANG___32603$fn__32607.invoke(jruby_agents.clj:75) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32598$prime_pool_BANG___32603.invoke(jruby_agents.clj:48) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32848$send_prime_pool_BANG___32853$fn__32854$fn__32855.invoke(jruby_agents.clj:233) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$shutdown_on_error_STAR_.invokeStatic(internal.clj:389) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$shutdown_on_error_STAR_.invoke(internal.clj:364) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$shutdown_on_error_STAR_.invokeStatic(internal.clj:374) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$shutdown_on_error_STAR_.invoke(internal.clj:364) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$fn__14006$shutdown_service__14011$fn$reify__14013$service_fnk__4991__auto___positional$reify__14018.shutdown_on_error(internal.clj:429) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$fn__13953$G__13938__13961.invoke(internal.clj:397) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.trapperkeeper.internal$fn__13953$G__13937__13970.invoke(internal.clj:397) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.core$partial$fn__5824.invoke(core.clj:2625) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.core$partial$fn__5824.invoke(core.clj:2624) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32573$send_agent__32578$fn__32579$agent_fn__32580.invoke(jruby_agents.clj:42) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.core$binding_conveyor_fn$fn__5739.invoke(core.clj:2033) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.AFn.applyToHelper(AFn.java:154) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.RestFn.applyTo(RestFn.java:132) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.Agent$Action.doRun(Agent.java:114) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.Agent$Action.run(Agent.java:163) Oct 9 09:18:12 foreman puppetserver[32556]: #011at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) Oct 9 09:18:12 foreman puppetserver[32556]: #011at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) Oct 9 09:18:12 foreman puppetserver[32556]: #011at java.lang.Thread.run(Thread.java:748) Oct 9 09:18:12 foreman puppetserver[32556]: Caused by: org.jruby.embed.EvalFailedException: (LoadError) no such file to load -- concurrent Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.embed.internal.EmbedEvalUnitImpl.run(EmbedEvalUnitImpl.java:131) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.embed.ScriptingContainer.runUnit(ScriptingContainer.java:1295) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.embed.ScriptingContainer.runScriptlet(ScriptingContainer.java:1288) Oct 9 09:18:12 foreman puppetserver[32556]: #011at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) Oct 9 09:18:12 foreman puppetserver[32556]: #011at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) Oct 9 09:18:12 foreman puppetserver[32556]: #011at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) Oct 9 09:18:12 foreman puppetserver[32556]: #011at java.lang.reflect.Method.invoke(Method.java:498) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:167) Oct 9 09:18:12 foreman puppetserver[32556]: #011at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:102) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby.jruby_puppet_core$fn__34109$get_initialize_pool_instance_fn__34114$fn__34115$fn__34116.invoke(jruby_puppet_core.clj:132) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_internal$fn__32180$create_pool_instance_BANG___32189$fn__32192.invoke(jruby_internal.clj:211) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_internal$fn__32180$create_pool_instance_BANG___32189.invoke(jruby_internal.clj:177) Oct 9 09:18:12 foreman puppetserver[32556]: #011at puppetlabs.services.jruby_pool_manager.impl.jruby_agents$fn__32598$prime_pool_BANG___32603$fn__32607.invoke(jruby_agents.clj:65) Oct 9 09:18:12 foreman puppetserver[32556]: #011... 20 more Oct 9 09:18:12 foreman puppetserver[32556]: Caused by: org.jruby.exceptions.LoadError: (LoadError) no such file to load -- concurrent Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at uri_3a_classloader_3a_.META_minus_INF.jruby_dot_home.lib.ruby.stdlib.rubygems.core_ext.kernel_require.require(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/thread_local.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at uri_3a_classloader_3a_.META_minus_INF.jruby_dot_home.lib.ruby.stdlib.rubygems.core_ext.kernel_require.require(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at uri_3a_classloader_3a_.META_minus_INF.jruby_dot_home.lib.ruby.stdlib.rubygems.core_ext.kernel_require.require(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<module:(root)>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet/context.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.Puppet(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:41) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(/opt/puppetlabs/puppet/lib/ruby/vendor_ruby/puppet.rb:38) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.(root)(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:59) Oct 9 09:18:12 foreman puppetserver[32556]: #011at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:970) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.(root)(uri:classloader:/puppetserver-lib/puppet/server.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: #011at RUBY.<main>(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1) Oct 9 09:18:12 foreman puppetserver[32556]: Background process 32572 exited before start had completed Oct 9 09:18:12 foreman systemd[1]: puppetserver.service: Control process exited, code=exited status=1 Oct 9 09:18:12 foreman systemd[1]: puppetserver.service: Failed with result 'exit-code'. Oct 9 09:18:12 foreman systemd[1]: Failed to start puppetserver Service. Oct 9 09:18:13 foreman systemd[1]: puppetserver.service: Service hold-off time over, scheduling restart. Oct 9 09:18:13 foreman systemd[1]: puppetserver.service: Scheduled restart job, restart counter is at 5. Oct 9 09:18:13 foreman systemd[1]: Stopped puppetserver Service.
