-
Type:
Bug
-
Resolution: Cannot Reproduce
-
Priority:
Blocker
-
Component/s: ec2-plugin
-
Environment:Jenkins master and nodes are in AWS, Ubuntu 14.04.
We love ec2 plugin 1.40.1, it seems launching ec2 instance very fast. we upgrade ec2 plugin from 1.39 to 1.40.1 on Oct 4. Jenkins master sever is 2.1442.
It works very well in the morning and afternoon. However at 7:55PM, it stop launching ec2 instance.
when we try to manually launch a node, we got the error "Authentication failed. Trying again”.
when we check “EC2 Key Pair’s Private Key” connection, the connection test successes.
Here is the screenshot of error.

we also saw below error from jenkins.log file:
“Oct 04, 2018 11:00:32 PM hudson.plugins.ec2.EC2Cloud provision
WARNING: SlaveTemplate{ami=‘ami-029d750fbe0ba000a’, labels=‘ka-test-ec2’}. Exception during provisioning
com.amazonaws.services.ec2.model.AmazonEC2Exception: Invalid value ‘i-036772cf29021ea0f’ for instanceId. Instance does not have a volume attached at root (/dev/sda1) (Service: AmazonEC2; Status Code: 400; Error Code: InvalidParameterValue; Request ID: 25f5fcbb-0d77-42d6-9844-afc0a45a7112)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1658)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1322)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1072)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:745)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:719)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:701)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:669)
at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:651)
at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:515)
at com.amazonaws.services.ec2.AmazonEC2Client.doInvoke(AmazonEC2Client.java:17597)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:17566)
at com.amazonaws.services.ec2.AmazonEC2Client.invoke(AmazonEC2Client.java:17555)
at com.amazonaws.services.ec2.AmazonEC2Client.executeStartInstances(AmazonEC2Client.java:17037)
at com.amazonaws.services.ec2.AmazonEC2Client.startInstances(AmazonEC2Client.java:17008)
at hudson.plugins.ec2.SlaveTemplate.wakeOrphansUp(SlaveTemplate.java:614)
at hudson.plugins.ec2.SlaveTemplate.provisionOndemand(SlaveTemplate.java:569)
at hudson.plugins.ec2.SlaveTemplate.provision(SlaveTemplate.java:432)
at hudson.plugins.ec2.EC2Cloud.getNewOrExistingAvailableSlave(EC2Cloud.java:544)
at hudson.plugins.ec2.EC2Cloud.provision(EC2Cloud.java:559)
at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:715)
at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:320)
at hudson.slaves.NodeProvisioner.access$000(NodeProvisioner.java:61)
at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:809)
at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:72)
at jenkins.security.ImpersonatingScheduledExecutorService$1.run(ImpersonatingScheduledExecutorService.java:58)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Oct 04, 2018 11:00:32 PM hudson.plugins.ec2.EC2Cloud log
”