[JENKINS-63463] Jenkins Google Compute Node Fails to start in 2.253

Type: Bug
Resolution: Duplicate
Priority: Critical
Component/s: google-compute-engine-plugin
Labels:
None
Environment:
Jenkins 2.254. Java 8. Ubuntu 18.

Similar Issues:
Powered by SuggestiMate

Show

Previously installed google compute plugin dynamic node Fails to launch with Jenkins 2.253 and above environment.

It's a ubuntu 18 image with psql, maven and google cloud tools (pubsub emulators and the like).

It works flawlessly in 2.253 and before.

Here's the log output.

2020-08-21 03:28:23.953+0000 [id=28]    INFO    c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:24.716+0000 [id=28]    INFO    c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 1 nodes in cloud java8-maven-tf-buf-u18-2
2020-08-21 03:28:26.246+0000 [id=28]    INFO    c.g.j.p.c.InstanceConfiguration#provision: Sent insert request for instance configuration [java8-maven-tf-buf-u18]
2020-08-21 03:28:26.263+0000 [id=639]   INFO    c.g.j.p.c.ComputeEngineComputerLauncher#launch: Launch will wait 300000 for operation operation-1597980505150-5ad5ad45e13a8-24037927-72933120 to complete...
2020-08-21 03:28:26.344+0000 [id=639]   INFO    c.g.j.p.c.ComputeEngineCloud#lambda$getPlannedNodeFuture$0: Waiting 300000ms for node java8-maven-tf-buf-u18-zng5sq to connect
2020-08-21 03:28:26.348+0000 [id=544]   INFO    c.g.j.p.c.ComputeEngineComputerLauncher#launch: Launch will wait 300000 for operation operation-1597980505150-5ad5ad45e13a8-24037927-72933120 to complete...
2020-08-21 03:28:26.350+0000 [id=28]    INFO    h.s.NodeProvisioner$StandardStrategyImpl#apply: Started provisioning java8-maven-tf-buf-u18-zng5sq from gce-java8-maven-tf-buf-u18-2 with 5 executors. Remaining excess workload: -4
2020-08-21 03:28:31.189+0000 [id=652]   INFO    hudson.model.AsyncPeriodicWork#lambda$doRun$0: Started PersistentMaster-Worker
2020-08-21 03:28:31.190+0000 [id=652]   INFO    hudson.model.AsyncPeriodicWork#lambda$doRun$0: Finished PersistentMaster-Worker. 1 ms
2020-08-21 03:28:33.944+0000 [id=34]    WARNING hudson.slaves.NodeProvisioner#lambda$update$6: Unexpected exception encountered while provisioning agent java8-maven-tf-buf-u18-zng5sq
java.lang.ClassNotFoundException: org.hamcrest.Matcher
        at jenkins.util.AntClassLoader.findClassInComponents(AntClassLoader.java:1387)
        at jenkins.util.AntClassLoader.findClass(AntClassLoader.java:1342)
        at jenkins.util.AntClassLoader.loadClass(AntClassLoader.java:1089)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
Caused: java.lang.NoClassDefFoundError: org/hamcrest/Matcher
        at org.awaitility.Awaitility.await(Awaitility.java:316)
        at org.awaitility.Awaitility.await(Awaitility.java:303)
        at com.google.cloud.graphite.platforms.plugin.client.ComputeClient.waitForOperationCompletion(ComputeClient.java:665)
        at com.google.jenkins.plugins.computeengine.ComputeEngineComputerLauncher.launch(ComputeEngineComputerLauncher.java:157)
        at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:301)
Caused: java.util.concurrent.ExecutionException
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:206)
        at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.lambda$getPlannedNodeFuture$0(ComputeEngineCloud.java:315)
        at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
        at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2020-08-21 03:28:33.948+0000 [id=34]    INFO    c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:34.182+0000 [id=34]    INFO    c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 0 nodes in cloud java8-maven-tf-buf-u18-2
2020-08-21 03:28:34.182+0000 [id=34]    WARNING c.g.j.p.c.ComputeEngineCloud#provision: Could not provision new nodes to meet excess workload demand (1). Cloud provider java8-maven-tf-buf-u18-2 has reached its configured capacity of 1
2020-08-21 03:28:43.944+0000 [id=30]    INFO    c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:44.193+0000 [id=30]    INFO    c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 0 nodes in cloud java8-maven-tf-buf-u18-2
020-08-21 03:28:44.206+0000 [id=30]    WARNING c.g.j.p.c.ComputeEngineCloud#provision: Could not provision new nodes to meet excess workload demand (1). Cloud provider java8-maven-tf-buf-u18-2 has reached its configured capacity of 1
2020-08-21 03:28:47.358+0000 [id=433]   WARNING h.i.i.InstallUncaughtExceptionHandler#handleException: Caught unhandled exception with ID ab8fc4ad-60e2-41ba-baa0-3751cadb6584
java.awt.AWTError: Assistive Technology not found: org.GNOME.Accessibility.AtkWrapper
        at java.awt.Toolkit.loadAssistiveTechnologies(Toolkit.java:807)
        at java.awt.Toolkit.getDefaultToolkit(Toolkit.java:886)
        at sun.swing.SwingUtilities2.getSystemMnemonicKeyMask(SwingUtilities2.java:2032)
        at javax.swing.plaf.basic.BasicLookAndFeel.initComponentDefaults(BasicLookAndFeel.java:1158)
        at javax.swing.plaf.metal.MetalLookAndFeel.initComponentDefaults(MetalLookAndFeel.java:431)
        at javax.swing.plaf.basic.BasicLookAndFeel.getDefaults(BasicLookAndFeel.java:148)
        at javax.swing.plaf.metal.MetalLookAndFeel.getDefaults(MetalLookAndFeel.java:1577)
        at javax.swing.UIManager.setLookAndFeel(UIManager.java:539)
        at javax.swing.UIManager.setLookAndFeel(UIManager.java:579)
        at javax.swing.UIManager.initializeDefaultLAF(UIManager.java:1349)
        at javax.swing.UIManager.initialize(UIManager.java:1459)
        at javax.swing.UIManager.maybeInitialize(UIManager.java:1426)
        at javax.swing.UIManager.getDefaults(UIManager.java:659)
        at javax.swing.UIManager.getColor(UIManager.java:701)
        at org.jfree.chart.JFreeChart.<clinit>(JFreeChart.java:264)
        at org.jfree.chart.ChartFactory.createLineChart(ChartFactory.java:1387)
        at hudson.model.MultiStageTimeSeries$TrendChart.createChart(MultiStageTimeSeries.java:234)
        at hudson.model.MultiStageTimeSeries$TrendChart.generateResponse(MultiStageTimeSeries.java:301)
        at org.kohsuke.stapler.HttpResponseRenderer$Default.handleHttpResponse(HttpResponseRenderer.java:124)
        at org.kohsuke.stapler.HttpResponseRenderer$Default.generateResponse(HttpResponseRenderer.java:69)
        at org.kohsuke.stapler.Function.renderResponse(Function.java:164)
        at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:147)
        at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:536)
        at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)
        at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:766)
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:898)

Let me know what else is needed.

Thanks

Eric

Eric Sherman created issue - 2020-08-21 00:44

Eric Sherman made changes - 2020-08-21 02:45

Resolution		New: Not A Defect [ 7 ]
Status	Original: Open [ 1 ]	New: Fixed but Unreleased [ 10203 ]

Eric Sherman made changes - 2020-08-21 02:45

Description

Original: Previously installed google compute plugin dynamic node Fails to launch with Jenkins 2.254 and above environment.

It's a ubuntu 18 image with psql, maven and google cloud tools (pubsub emulators and the like).

It works flawlessly in 2.253 and before.

Here's the log output.

Let me know what else is needed.

Thanks

Eric

{code:java}
2020-08-21 00:03:50.119+0000 [id=37] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@3195327a] for excess workload of 1 units of label 'java8-maven-tf-buf-u18' 2020-08-21 00:03:50.119+0000 [id=37] SEVERE c.g.j.p.c.ComputeEngineCloud#createClient: Exception when creating GCE client hudson.AbortException: Failed to initialize HTTP transport: hudson.AbortException: Could not retrieve credentials: tausight-ci at com.google.jenkins.plugins.computeengine.client.ClientUtil.getClientFactory(ClientUtil.java:56) at com.google.jenkins.plugins.computeengine.client.ClientUtil.getClientFactory(ClientUtil.java:71) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.createClient(ComputeEngineCloud.java:190) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.getClient(ComputeEngineCloud.java:208) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.availableNodeCapacity(ComputeEngineCloud.java:348) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.provision(ComputeEngineCloud.java:254) at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:729) at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:334) at hudson.slaves.NodeProvisioner.access$900(NodeProvisioner.java:64) at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:823) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:91) at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:58) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-08-21 00:03:50.120+0000 [id=37] SEVERE hudson.triggers.SafeTimerTask#run: Timer task hudson.slaves.NodeProvisioner$NodeProvisionerInvoker@193db6ca failed java.lang.NullPointerException at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.availableNodeCapacity(ComputeEngineCloud.java:348) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.provision(ComputeEngineCloud.java:254) at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:729) at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:334) at hudson.slaves.NodeProvisioner.access$900(NodeProvisioner.java:64) at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:823) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:91) at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:58) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-08-21 00:04:00.123+0000 [id=37] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@3195327a] for excess workload of 1 units of label 'java8-maven-tf-buf-u18' 2020-08-21 00:04:00.124+0000 [id=37] SEVERE c.g.j.p.c.ComputeEngineCloud#createClient: Exception when creating GCE client hudson.AbortException: Failed to initialize HTTP transport: hudson.AbortException: Could not retrieve credentials: tausight-ci at com.google.jenkins.plugins.computeengine.client.ClientUtil.getClientFactory(ClientUtil.java:56) at com.google.jenkins.plugins.computeengine.client.ClientUtil.getClientFactory(ClientUtil.java:71) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.createClient(ComputeEngineCloud.java:190) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.getClient(ComputeEngineCloud.java:208) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.availableNodeCapacity(ComputeEngineCloud.java:348) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.provision(ComputeEngineCloud.java:254) at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:729) at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:334) at hudson.slaves.NodeProvisioner.access$900(NodeProvisioner.java:64) at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:823) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:91) at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:58) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2020-08-21 00:04:00.124+0000 [id=37] SEVERE hudson.triggers.SafeTimerTask#run: Timer task hudson.slaves.NodeProvisioner$NodeProvisionerInvoker@193db6ca failed java.lang.NullPointerException at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.availableNodeCapacity(ComputeEngineCloud.java:348) at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.provision(ComputeEngineCloud.java:254) at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:729) at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:334) at hudson.slaves.NodeProvisioner.access$900(NodeProvisioner.java:64) at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:823) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:91) at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:58) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
{code}

Eric Sherman made changes - 2020-08-21 03:40

Comment

[ my error. ]

Eric Sherman made changes - 2020-08-21 03:40

Comment

[ not an issue . closing. ]

Eric Sherman made changes - 2020-08-21 03:41

Description

New: Previously installed google compute plugin dynamic node Fails to launch with Jenkins 2.254 and above environment.

It's a ubuntu 18 image with psql, maven and google cloud tools (pubsub emulators and the like).

It works flawlessly in 2.253 and before.

Here's the log output.

{code:java}
2020-08-21 03:28:23.953+0000 [id=28] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:24.716+0000 [id=28] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 1 nodes in cloud java8-maven-tf-buf-u18-2
2020-08-21 03:28:26.246+0000 [id=28] INFO c.g.j.p.c.InstanceConfiguration#provision: Sent insert request for instance configuration [java8-maven-tf-buf-u18]
2020-08-21 03:28:26.263+0000 [id=639] INFO c.g.j.p.c.ComputeEngineComputerLauncher#launch: Launch will wait 300000 for operation operation-1597980505150-5ad5ad45e13a8-24037927-72933120 to complete...
2020-08-21 03:28:26.344+0000 [id=639] INFO c.g.j.p.c.ComputeEngineCloud#lambda$getPlannedNodeFuture$0: Waiting 300000ms for node java8-maven-tf-buf-u18-zng5sq to connect
2020-08-21 03:28:26.348+0000 [id=544] INFO c.g.j.p.c.ComputeEngineComputerLauncher#launch: Launch will wait 300000 for operation operation-1597980505150-5ad5ad45e13a8-24037927-72933120 to complete...
2020-08-21 03:28:26.350+0000 [id=28] INFO h.s.NodeProvisioner$StandardStrategyImpl#apply: Started provisioning java8-maven-tf-buf-u18-zng5sq from gce-java8-maven-tf-buf-u18-2 with 5 executors. Remaining excess workload: -4
2020-08-21 03:28:31.189+0000 [id=652] INFO hudson.model.AsyncPeriodicWork#lambda$doRun$0: Started PersistentMaster-Worker
2020-08-21 03:28:31.190+0000 [id=652] INFO hudson.model.AsyncPeriodicWork#lambda$doRun$0: Finished PersistentMaster-Worker. 1 ms
2020-08-21 03:28:33.944+0000 [id=34] WARNING hudson.slaves.NodeProvisioner#lambda$update$6: Unexpected exception encountered while provisioning agent java8-maven-tf-buf-u18-zng5sq
java.lang.ClassNotFoundException: org.hamcrest.Matcher
        at jenkins.util.AntClassLoader.findClassInComponents(AntClassLoader.java:1387)
        at jenkins.util.AntClassLoader.findClass(AntClassLoader.java:1342)
        at jenkins.util.AntClassLoader.loadClass(AntClassLoader.java:1089)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
Caused: java.lang.NoClassDefFoundError: org/hamcrest/Matcher
        at org.awaitility.Awaitility.await(Awaitility.java:316)
        at org.awaitility.Awaitility.await(Awaitility.java:303)
        at com.google.cloud.graphite.platforms.plugin.client.ComputeClient.waitForOperationCompletion(ComputeClient.java:665)
        at com.google.jenkins.plugins.computeengine.ComputeEngineComputerLauncher.launch(ComputeEngineComputerLauncher.java:157)
        at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:301)
Caused: java.util.concurrent.ExecutionException
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:206)
        at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.lambda$getPlannedNodeFuture$0(ComputeEngineCloud.java:315)
        at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
        at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2020-08-21 03:28:33.948+0000 [id=34] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:34.182+0000 [id=34] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 0 nodes in cloud java8-maven-tf-buf-u18-2
2020-08-21 03:28:34.182+0000 [id=34] WARNING c.g.j.p.c.ComputeEngineCloud#provision: Could not provision new nodes to meet excess workload demand (1). Cloud provider java8-maven-tf-buf-u18-2 has reached its configured capacity of 1
2020-08-21 03:28:43.944+0000 [id=30] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:44.193+0000 [id=30] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 0 nodes in cloud java8-maven-tf-buf-u18-2
020-08-21 03:28:44.206+0000 [id=30] WARNING c.g.j.p.c.ComputeEngineCloud#provision: Could not provision new nodes to meet excess workload demand (1). Cloud provider java8-maven-tf-buf-u18-2 has reached its configured capacity of 1
2020-08-21 03:28:47.358+0000 [id=433] WARNING h.i.i.InstallUncaughtExceptionHandler#handleException: Caught unhandled exception with ID ab8fc4ad-60e2-41ba-baa0-3751cadb6584
java.awt.AWTError: Assistive Technology not found: org.GNOME.Accessibility.AtkWrapper
        at java.awt.Toolkit.loadAssistiveTechnologies(Toolkit.java:807)
        at java.awt.Toolkit.getDefaultToolkit(Toolkit.java:886)
        at sun.swing.SwingUtilities2.getSystemMnemonicKeyMask(SwingUtilities2.java:2032)
        at javax.swing.plaf.basic.BasicLookAndFeel.initComponentDefaults(BasicLookAndFeel.java:1158)
        at javax.swing.plaf.metal.MetalLookAndFeel.initComponentDefaults(MetalLookAndFeel.java:431)
        at javax.swing.plaf.basic.BasicLookAndFeel.getDefaults(BasicLookAndFeel.java:148)
        at javax.swing.plaf.metal.MetalLookAndFeel.getDefaults(MetalLookAndFeel.java:1577)
        at javax.swing.UIManager.setLookAndFeel(UIManager.java:539)
        at javax.swing.UIManager.setLookAndFeel(UIManager.java:579)
        at javax.swing.UIManager.initializeDefaultLAF(UIManager.java:1349)
        at javax.swing.UIManager.initialize(UIManager.java:1459)
        at javax.swing.UIManager.maybeInitialize(UIManager.java:1426)
        at javax.swing.UIManager.getDefaults(UIManager.java:659)
        at javax.swing.UIManager.getColor(UIManager.java:701)
        at org.jfree.chart.JFreeChart.<clinit>(JFreeChart.java:264)
        at org.jfree.chart.ChartFactory.createLineChart(ChartFactory.java:1387)
        at hudson.model.MultiStageTimeSeries$TrendChart.createChart(MultiStageTimeSeries.java:234)
        at hudson.model.MultiStageTimeSeries$TrendChart.generateResponse(MultiStageTimeSeries.java:301)
        at org.kohsuke.stapler.HttpResponseRenderer$Default.handleHttpResponse(HttpResponseRenderer.java:124)
        at org.kohsuke.stapler.HttpResponseRenderer$Default.generateResponse(HttpResponseRenderer.java:69)
        at org.kohsuke.stapler.Function.renderResponse(Function.java:164)
        at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:147)
        at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:536)
        at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)
        at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:766)
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:898)

{code}
Let me know what else is needed.

Thanks

Eric

Eric Sherman made changes - 2020-08-21 03:41

Resolution	Original: Not A Defect [ 7 ]
Status	Original: Fixed but Unreleased [ 10203 ]	New: Reopened [ 4 ]

Eric Sherman made changes - 2020-08-21 03:42

Description

Original: Previously installed google compute plugin dynamic node Fails to launch with Jenkins 2.254 and above environment.

It's a ubuntu 18 image with psql, maven and google cloud tools (pubsub emulators and the like).

It works flawlessly in 2.253 and before.

Here's the log output.

{code:java}
2020-08-21 03:28:23.953+0000 [id=28] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:24.716+0000 [id=28] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 1 nodes in cloud java8-maven-tf-buf-u18-2
2020-08-21 03:28:26.246+0000 [id=28] INFO c.g.j.p.c.InstanceConfiguration#provision: Sent insert request for instance configuration [java8-maven-tf-buf-u18]
2020-08-21 03:28:26.263+0000 [id=639] INFO c.g.j.p.c.ComputeEngineComputerLauncher#launch: Launch will wait 300000 for operation operation-1597980505150-5ad5ad45e13a8-24037927-72933120 to complete...
2020-08-21 03:28:26.344+0000 [id=639] INFO c.g.j.p.c.ComputeEngineCloud#lambda$getPlannedNodeFuture$0: Waiting 300000ms for node java8-maven-tf-buf-u18-zng5sq to connect
2020-08-21 03:28:26.348+0000 [id=544] INFO c.g.j.p.c.ComputeEngineComputerLauncher#launch: Launch will wait 300000 for operation operation-1597980505150-5ad5ad45e13a8-24037927-72933120 to complete...
2020-08-21 03:28:26.350+0000 [id=28] INFO h.s.NodeProvisioner$StandardStrategyImpl#apply: Started provisioning java8-maven-tf-buf-u18-zng5sq from gce-java8-maven-tf-buf-u18-2 with 5 executors. Remaining excess workload: -4
2020-08-21 03:28:31.189+0000 [id=652] INFO hudson.model.AsyncPeriodicWork#lambda$doRun$0: Started PersistentMaster-Worker
2020-08-21 03:28:31.190+0000 [id=652] INFO hudson.model.AsyncPeriodicWork#lambda$doRun$0: Finished PersistentMaster-Worker. 1 ms
2020-08-21 03:28:33.944+0000 [id=34] WARNING hudson.slaves.NodeProvisioner#lambda$update$6: Unexpected exception encountered while provisioning agent java8-maven-tf-buf-u18-zng5sq
java.lang.ClassNotFoundException: org.hamcrest.Matcher
        at jenkins.util.AntClassLoader.findClassInComponents(AntClassLoader.java:1387)
        at jenkins.util.AntClassLoader.findClass(AntClassLoader.java:1342)
        at jenkins.util.AntClassLoader.loadClass(AntClassLoader.java:1089)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
Caused: java.lang.NoClassDefFoundError: org/hamcrest/Matcher
        at org.awaitility.Awaitility.await(Awaitility.java:316)
        at org.awaitility.Awaitility.await(Awaitility.java:303)
        at com.google.cloud.graphite.platforms.plugin.client.ComputeClient.waitForOperationCompletion(ComputeClient.java:665)
        at com.google.jenkins.plugins.computeengine.ComputeEngineComputerLauncher.launch(ComputeEngineComputerLauncher.java:157)
        at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:301)
Caused: java.util.concurrent.ExecutionException
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:206)
        at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.lambda$getPlannedNodeFuture$0(ComputeEngineCloud.java:315)
        at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
        at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2020-08-21 03:28:33.948+0000 [id=34] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:34.182+0000 [id=34] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 0 nodes in cloud java8-maven-tf-buf-u18-2
2020-08-21 03:28:34.182+0000 [id=34] WARNING c.g.j.p.c.ComputeEngineCloud#provision: Could not provision new nodes to meet excess workload demand (1). Cloud provider java8-maven-tf-buf-u18-2 has reached its configured capacity of 1
2020-08-21 03:28:43.944+0000 [id=30] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:44.193+0000 [id=30] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 0 nodes in cloud java8-maven-tf-buf-u18-2
020-08-21 03:28:44.206+0000 [id=30] WARNING c.g.j.p.c.ComputeEngineCloud#provision: Could not provision new nodes to meet excess workload demand (1). Cloud provider java8-maven-tf-buf-u18-2 has reached its configured capacity of 1
2020-08-21 03:28:47.358+0000 [id=433] WARNING h.i.i.InstallUncaughtExceptionHandler#handleException: Caught unhandled exception with ID ab8fc4ad-60e2-41ba-baa0-3751cadb6584
java.awt.AWTError: Assistive Technology not found: org.GNOME.Accessibility.AtkWrapper
        at java.awt.Toolkit.loadAssistiveTechnologies(Toolkit.java:807)
        at java.awt.Toolkit.getDefaultToolkit(Toolkit.java:886)
        at sun.swing.SwingUtilities2.getSystemMnemonicKeyMask(SwingUtilities2.java:2032)
        at javax.swing.plaf.basic.BasicLookAndFeel.initComponentDefaults(BasicLookAndFeel.java:1158)
        at javax.swing.plaf.metal.MetalLookAndFeel.initComponentDefaults(MetalLookAndFeel.java:431)
        at javax.swing.plaf.basic.BasicLookAndFeel.getDefaults(BasicLookAndFeel.java:148)
        at javax.swing.plaf.metal.MetalLookAndFeel.getDefaults(MetalLookAndFeel.java:1577)
        at javax.swing.UIManager.setLookAndFeel(UIManager.java:539)
        at javax.swing.UIManager.setLookAndFeel(UIManager.java:579)
        at javax.swing.UIManager.initializeDefaultLAF(UIManager.java:1349)
        at javax.swing.UIManager.initialize(UIManager.java:1459)
        at javax.swing.UIManager.maybeInitialize(UIManager.java:1426)
        at javax.swing.UIManager.getDefaults(UIManager.java:659)
        at javax.swing.UIManager.getColor(UIManager.java:701)
        at org.jfree.chart.JFreeChart.<clinit>(JFreeChart.java:264)
        at org.jfree.chart.ChartFactory.createLineChart(ChartFactory.java:1387)
        at hudson.model.MultiStageTimeSeries$TrendChart.createChart(MultiStageTimeSeries.java:234)
        at hudson.model.MultiStageTimeSeries$TrendChart.generateResponse(MultiStageTimeSeries.java:301)
        at org.kohsuke.stapler.HttpResponseRenderer$Default.handleHttpResponse(HttpResponseRenderer.java:124)
        at org.kohsuke.stapler.HttpResponseRenderer$Default.generateResponse(HttpResponseRenderer.java:69)
        at org.kohsuke.stapler.Function.renderResponse(Function.java:164)
        at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:147)
        at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:536)
        at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)
        at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:766)
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:898)

{code}
Let me know what else is needed.

Thanks

Eric

New: Previously installed google compute plugin dynamic node Fails to launch with Jenkins 2.253 and above environment.

It's a ubuntu 18 image with psql, maven and google cloud tools (pubsub emulators and the like).

It works flawlessly in 2.253 and before.

Here's the log output.

{code:java}
2020-08-21 03:28:23.953+0000 [id=28] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:24.716+0000 [id=28] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 1 nodes in cloud java8-maven-tf-buf-u18-2
2020-08-21 03:28:26.246+0000 [id=28] INFO c.g.j.p.c.InstanceConfiguration#provision: Sent insert request for instance configuration [java8-maven-tf-buf-u18]
2020-08-21 03:28:26.263+0000 [id=639] INFO c.g.j.p.c.ComputeEngineComputerLauncher#launch: Launch will wait 300000 for operation operation-1597980505150-5ad5ad45e13a8-24037927-72933120 to complete...
2020-08-21 03:28:26.344+0000 [id=639] INFO c.g.j.p.c.ComputeEngineCloud#lambda$getPlannedNodeFuture$0: Waiting 300000ms for node java8-maven-tf-buf-u18-zng5sq to connect
2020-08-21 03:28:26.348+0000 [id=544] INFO c.g.j.p.c.ComputeEngineComputerLauncher#launch: Launch will wait 300000 for operation operation-1597980505150-5ad5ad45e13a8-24037927-72933120 to complete...
2020-08-21 03:28:26.350+0000 [id=28] INFO h.s.NodeProvisioner$StandardStrategyImpl#apply: Started provisioning java8-maven-tf-buf-u18-zng5sq from gce-java8-maven-tf-buf-u18-2 with 5 executors. Remaining excess workload: -4
2020-08-21 03:28:31.189+0000 [id=652] INFO hudson.model.AsyncPeriodicWork#lambda$doRun$0: Started PersistentMaster-Worker
2020-08-21 03:28:31.190+0000 [id=652] INFO hudson.model.AsyncPeriodicWork#lambda$doRun$0: Finished PersistentMaster-Worker. 1 ms
2020-08-21 03:28:33.944+0000 [id=34] WARNING hudson.slaves.NodeProvisioner#lambda$update$6: Unexpected exception encountered while provisioning agent java8-maven-tf-buf-u18-zng5sq
java.lang.ClassNotFoundException: org.hamcrest.Matcher
        at jenkins.util.AntClassLoader.findClassInComponents(AntClassLoader.java:1387)
        at jenkins.util.AntClassLoader.findClass(AntClassLoader.java:1342)
        at jenkins.util.AntClassLoader.loadClass(AntClassLoader.java:1089)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
Caused: java.lang.NoClassDefFoundError: org/hamcrest/Matcher
        at org.awaitility.Awaitility.await(Awaitility.java:316)
        at org.awaitility.Awaitility.await(Awaitility.java:303)
        at com.google.cloud.graphite.platforms.plugin.client.ComputeClient.waitForOperationCompletion(ComputeClient.java:665)
        at com.google.jenkins.plugins.computeengine.ComputeEngineComputerLauncher.launch(ComputeEngineComputerLauncher.java:157)
        at hudson.slaves.SlaveComputer.lambda$_connect$0(SlaveComputer.java:301)
Caused: java.util.concurrent.ExecutionException
        at java.util.concurrent.FutureTask.report(FutureTask.java:122)
        at java.util.concurrent.FutureTask.get(FutureTask.java:206)
        at com.google.jenkins.plugins.computeengine.ComputeEngineCloud.lambda$getPlannedNodeFuture$0(ComputeEngineCloud.java:315)
        at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
        at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
2020-08-21 03:28:33.948+0000 [id=34] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:34.182+0000 [id=34] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 0 nodes in cloud java8-maven-tf-buf-u18-2
2020-08-21 03:28:34.182+0000 [id=34] WARNING c.g.j.p.c.ComputeEngineCloud#provision: Could not provision new nodes to meet excess workload demand (1). Cloud provider java8-maven-tf-buf-u18-2 has reached its configured capacity of 1
2020-08-21 03:28:43.944+0000 [id=30] INFO c.g.j.p.c.ComputeEngineCloud#provision: Provisioning node from configs [com.google.jenkins.plugins.computeengine.InstanceConfiguration@320ee728] for excess workload of 1 units of label 'java8-maven-tf-buf-u18'
2020-08-21 03:28:44.193+0000 [id=30] INFO c.g.j.p.c.ComputeEngineCloud#availableNodeCapacity: Found capacity for 0 nodes in cloud java8-maven-tf-buf-u18-2
020-08-21 03:28:44.206+0000 [id=30] WARNING c.g.j.p.c.ComputeEngineCloud#provision: Could not provision new nodes to meet excess workload demand (1). Cloud provider java8-maven-tf-buf-u18-2 has reached its configured capacity of 1
2020-08-21 03:28:47.358+0000 [id=433] WARNING h.i.i.InstallUncaughtExceptionHandler#handleException: Caught unhandled exception with ID ab8fc4ad-60e2-41ba-baa0-3751cadb6584
java.awt.AWTError: Assistive Technology not found: org.GNOME.Accessibility.AtkWrapper
        at java.awt.Toolkit.loadAssistiveTechnologies(Toolkit.java:807)
        at java.awt.Toolkit.getDefaultToolkit(Toolkit.java:886)
        at sun.swing.SwingUtilities2.getSystemMnemonicKeyMask(SwingUtilities2.java:2032)
        at javax.swing.plaf.basic.BasicLookAndFeel.initComponentDefaults(BasicLookAndFeel.java:1158)
        at javax.swing.plaf.metal.MetalLookAndFeel.initComponentDefaults(MetalLookAndFeel.java:431)
        at javax.swing.plaf.basic.BasicLookAndFeel.getDefaults(BasicLookAndFeel.java:148)
        at javax.swing.plaf.metal.MetalLookAndFeel.getDefaults(MetalLookAndFeel.java:1577)
        at javax.swing.UIManager.setLookAndFeel(UIManager.java:539)
        at javax.swing.UIManager.setLookAndFeel(UIManager.java:579)
        at javax.swing.UIManager.initializeDefaultLAF(UIManager.java:1349)
        at javax.swing.UIManager.initialize(UIManager.java:1459)
        at javax.swing.UIManager.maybeInitialize(UIManager.java:1426)
        at javax.swing.UIManager.getDefaults(UIManager.java:659)
        at javax.swing.UIManager.getColor(UIManager.java:701)
        at org.jfree.chart.JFreeChart.<clinit>(JFreeChart.java:264)
        at org.jfree.chart.ChartFactory.createLineChart(ChartFactory.java:1387)
        at hudson.model.MultiStageTimeSeries$TrendChart.createChart(MultiStageTimeSeries.java:234)
        at hudson.model.MultiStageTimeSeries$TrendChart.generateResponse(MultiStageTimeSeries.java:301)
        at org.kohsuke.stapler.HttpResponseRenderer$Default.handleHttpResponse(HttpResponseRenderer.java:124)
        at org.kohsuke.stapler.HttpResponseRenderer$Default.generateResponse(HttpResponseRenderer.java:69)
        at org.kohsuke.stapler.Function.renderResponse(Function.java:164)
        at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:147)
        at org.kohsuke.stapler.MetaClass$11.doDispatch(MetaClass.java:536)
        at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)
        at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:766)
        at org.kohsuke.stapler.Stapler.invoke(Stapler.java:898)

{code}
Let me know what else is needed.

Thanks

Eric

Eric Sherman added a comment - 2020-08-21 03:42

sorry for the back and forth. I just did another try of 2.253 (I thought it was my error) and saw the GCE plugin failed to launch my node. Again, reverting back to 2.252 is fine once more. I updated the log. sorry once more. let me know what else you need.

Eric Sherman added a comment - 2020-08-21 03:42 sorry for the back and forth. I just did another try of 2.253 (I thought it was my error) and saw the GCE plugin failed to launch my node. Again, reverting back to 2.252 is fine once more. I updated the log. sorry once more. let me know what else you need.

Eric Sherman added a comment - 2020-08-21 04:21

this may related to https://github.com/jenkinsci/google-compute-engine-plugin/issues/200

I can follow and track it there if you want me to close this one.

Eric Sherman added a comment - 2020-08-21 04:21 this may related to https://github.com/jenkinsci/google-compute-engine-plugin/issues/200 I can follow and track it there if you want me to close this one.

Assignee:: Evan Brown

Reporter:: Eric Sherman

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Created:: 2020-08-21 00:44

Updated:: 2022-02-07 13:49

Resolved:: 2022-02-07 13:49

Jenkins

Details

Description

Attachments

Activity

Collapse comment: Eric Sherman added a comment - 2020-08-21 03:42

Expand comment: Eric Sherman added a comment - 2020-08-21 03:42

Collapse comment: Eric Sherman added a comment - 2020-08-21 04:21

Expand comment: Eric Sherman added a comment - 2020-08-21 04:21

People

Dates