Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-38556

Jenkins spawns infinite windows spot instances on aws.

    XMLWordPrintable

Details

    Description

      A problem occurred while processing the request. Please check our bug tracker to see if a similar problem has already been reported. If it is already reported, please vote and put a comment on it to let us gauge the impact of the problem. If you think this is a new issue, please file a new issue. When you file an issue, make sure to add the entire stack trace, along with the version of Jenkins and relevant plugins. The users list might be also useful in understanding what has happened.

      Stack trace

      javax.servlet.ServletException: java.lang.NoSuchMethodError: com.amazonaws.services.ec2.AmazonEC2.createTags(Lcom/amazonaws/services/ec2/model/CreateTagsRequest;)V
      at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:796)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
      at org.kohsuke.stapler.MetaClass$5.doDispatch(MetaClass.java:233)
      at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)
      at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:876)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:649)
      at org.kohsuke.stapler.Stapler.service(Stapler.java:238)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
      at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:812)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1669)
      at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:135)
      at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:126)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:80)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84)
      at hudson.security.UnwrapSecurityExceptionFilter.doFilter(UnwrapSecurityExceptionFilter.java:51)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
      at jenkins.security.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:117)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
      at org.acegisecurity.providers.anonymous.AnonymousProcessingFilter.doFilter(AnonymousProcessingFilter.java:125)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
      at org.acegisecurity.ui.rememberme.RememberMeProcessingFilter.doFilter(RememberMeProcessingFilter.java:142)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
      at org.acegisecurity.ui.AbstractProcessingFilter.doFilter(AbstractProcessingFilter.java:271)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
      at jenkins.security.BasicHeaderProcessor.doFilter(BasicHeaderProcessor.java:93)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
      at org.acegisecurity.context.HttpSessionContextIntegrationFilter.doFilter(HttpSessionContextIntegrationFilter.java:249)
      at hudson.security.HttpSessionContextIntegrationFilter2.doFilter(HttpSessionContextIntegrationFilter2.java:67)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:87)
      at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:76)
      at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:171)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      at org.kohsuke.stapler.compression.CompressionFilter.doFilter(CompressionFilter.java:49)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      at hudson.util.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:82)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      at org.kohsuke.stapler.DiagnosticThreadNameFilter.doFilter(DiagnosticThreadNameFilter.java:30)
      at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
      at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
      at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
      at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:553)
      at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
      at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
      at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
      at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
      at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
      at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
      at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
      at org.eclipse.jetty.server.Server.handle(Server.java:499)
      at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
      at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
      at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
      at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      at java.lang.Thread.run(Thread.java:745)
      Caused by: java.lang.NoSuchMethodError: com.amazonaws.services.ec2.AmazonEC2.createTags(Lcom/amazonaws/services/ec2/model/CreateTagsRequest;)V
      at hudson.plugins.ec2.SlaveTemplate.updateRemoteTags(SlaveTemplate.java:882)
      at hudson.plugins.ec2.SlaveTemplate.provisionSpot(SlaveTemplate.java:822)
      at hudson.plugins.ec2.SlaveTemplate.provision(SlaveTemplate.java:374)
      at hudson.plugins.ec2.EC2Cloud.getNewOrExistingAvailableSlave(EC2Cloud.java:515)
      at hudson.plugins.ec2.EC2Cloud.doProvision(EC2Cloud.java:340)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
      at java.lang.reflect.Method.invoke(Method.java:498)
      at org.kohsuke.stapler.Function$InstanceFunction.invoke(Function.java:324)
      at org.kohsuke.stapler.Function.bindAndInvoke(Function.java:167)
      at org.kohsuke.stapler.Function.bindAndInvokeAndServeResponse(Function.java:100)
      at org.kohsuke.stapler.MetaClass$1.doDispatch(MetaClass.java:124)
      at org.kohsuke.stapler.NameBasedDispatcher.dispatch(NameBasedDispatcher.java:58)
      at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:746)
      ... 58 more

      Amazon EC2 plugin
      Allow Jenkins to start slaves on EC2 or Eucalyptus on demand, and kill them as they get unused.
      1.35
      Uninstall

      Amazon Web Services SDK
      This plugin provides AWS SDK for Java for other plugins.
      1.11.37
      DOWNGRADE TO 1.10.50
      Uninstall

      Ant Plugin
      This plugin adds Apache Ant support to Jenkins.
      1.4
      DOWNGRADE TO 1.3
      Uninstall

      bouncycastle API Plugin
      Provides an stable API to Bouncy Castle related tasks. Plugins using Bouncy Castle should depend on this plugin and not directly on Bouncy Castle
      1.648.3
      Uninstall

      Branch API Plugin
      This plugin provides an API for multiple branch based projects.
      1.11
      DOWNGRADE TO 1.10.2
      Uninstall

      build timeout plugin
      This plugin allows builds to be automatically terminated after the specified amount of time has elapsed.
      1.17.1
      Uninstall

      build-name-setter
      This plug-in sets the display name of a build to something other than #1, #2, #3, ...
      1.6.5
      Uninstall

      CloudBees Amazon Web Services Credentials Plugin
      Allows storing Amazon IAM credentials within the Jenkins Credentials API.
      1.16
      Uninstall

      Copy Artifact Plugin
      Adds a build step to copy artifacts from another project.
      1.38.1
      Uninstall

      Credentials Binding Plugin
      Allows credentials to be bound to environment variables for use from miscellaneous build steps.
      1.9
      DOWNGRADE TO 1.8
      Uninstall

      Credentials Plugin
      This plugin allows you to store credentials in Jenkins.
      2.1.5
      DOWNGRADE TO 2.1.4
      Uninstall

      Display URL API
      Provides the DisplayURLProvider extension point to provide alternate URLs for use in notifications
      0.5
      DOWNGRADE TO 0.3
      Uninstall

      Docker plugin
      This plugin integrates Jenkins with Docker
      0.16.2
      DOWNGRADE TO 0.16.1
      Uninstall

      Durable Task Plugin
      Library offering an extension point for processes which can run outside of Jenkins yet be monitored.
      1.12
      Uninstall

      External Monitor Job Type Plugin
      Adds the ability to monitor the result of externally executed jobs.
      1.6
      Uninstall

      Folders Plugin
      This plugin allows users to create "folders" to organize jobs. Users can define custom taxonomies (like by project type, organization type etc). Folders are nestable and you can define views within folders. Maintained by CloudBees, Inc.
      5.13
      DOWNGRADE TO 5.12
      Uninstall

      Git client plugin
      Shared library plugin for other Git related Jenkins plugins.
      2.0.0
      DOWNGRADE TO 1.21.0
      Uninstall

      Git Parameter Plug-In
      Adds ability to choose from git repository revisions or tags
      0.7.0
      DOWNGRADE TO 0.6.2
      Uninstall

      Git plugin
      This plugin integrates Git with Jenkins.
      3.0.0
      DOWNGRADE TO 2.5.3
      Uninstall

      GIT server Plugin
      Allows Jenkins to act as a Git server.
      1.7
      Uninstall

      Icon Shim Plugin
      This plugin allows other Jenkins plugins to take advantage of the <l:icon> tag.
      2.0.3
      Uninstall

      Jackson 2 API Plugin
      This plugin exposes the Jackson 2 JSON APIs to other Jenkins plugins.
      2.7.3
      Uninstall

      Javadoc Plugin
      This plugin adds Javadoc support to Jenkins.
      1.4
      Uninstall

      JavaScript GUI Lib: ACE Editor bundle plugin
      JavaScript GUI Lib: ACE Editor bundle plugin.
      1.1
      Uninstall

      JavaScript GUI Lib: Handlebars bundle plugin
      JavaScript GUI Lib: Handlebars bundle plugin.
      1.1.1
      Uninstall

      JavaScript GUI Lib: jQuery bundles (jQuery and jQuery UI) plugin
      JavaScript GUI Lib: jQuery bundles (jQuery and jQuery UI) plugin.
      1.2.1
      Uninstall

      JavaScript GUI Lib: Moment.js bundle plugin
      JavaScript GUI Lib: Moment.js bundle plugin.
      1.1.1
      Uninstall

      Job Configuration History Plugin
      Job history plugin for Jenkins.
      2.15
      Uninstall

      jQuery plugin
      This allows other plugins to use jQuery in UI.
      1.11.2-0
      Uninstall

      JUnit Plugin
      Allows JUnit-format test results to be published.
      1.18
      Uninstall

      LDAP Plugin
      Adds LDAP authentication to Jenkins
      1.13
      DOWNGRADE TO 1.12
      Uninstall

      Locale plugin
      This plugin lets you control the language of Jenkins.
      1.2
      Uninstall

      Mailer Plugin
      This plugin allows you to configure email notifications for build results. This is a break-out of the original core based email component.
      1.18
      DOWNGRADE TO 1.17
      Uninstall

      MapDB API Plugin
      This plugin provides a shared dependency on the MapDB library so that other plugins can co-operate when using this library.
      1.0.9.0
      Uninstall

      Matrix Authorization Strategy Plugin
      Offers matrix-based security authorization strategies (global and per-project).
      1.4
      Uninstall

      Matrix Project Plugin
      Multi-configuration (matrix) project type.
      1.7.1
      Uninstall

      Maven Integration plugin
      This plugin provides an advanced integration for Maven 2/3 projects.
      2.13
      Uninstall

      Multiple SCMs plugin
      This plugin enables the selection of multiple source code management systems for a build. For example, it enables checking out the source code from one SCM while checking out legacy or third-party code from another.
      0.6
      Uninstall

      Node and Label parameter plugin
      This plugin adds two new parameter types to job configuration - node and label, this allows to dynamically select the node where a job/project should be executed.
      1.7.2
      Uninstall

      Node Iterator API Plugin
      This plugin provides support for iterating through all the Node instances that are in use by Jenkins, even those Node instances that are not traditionally attached to Jenkins. The API exposed by this plugin can be used by cloud provider plugins to identify unused provisioned resource.
      1.5.0
      Uninstall

      OWASP Markup Formatter Plugin
      Uses the OWASP Java HTML Sanitizer to allow safe-seeming HTML markup to be entered in project descriptions and the like.
      1.5
      Uninstall

      PAM Authentication plugin
      Adds Unix Pluggable Authentication Module (PAM) support to Jenkins.
      1.3
      Uninstall

      Pipeline: SCM Step
      Adds a Pipeline step to check out or update working sources from various SCMs (version control).
      2.2
      Uninstall

      Pipeline: Step API
      API for asynchronous build step primitive.
      2.4
      DOWNGRADE TO 2.3
      Uninstall

      Plain Credentials Plugin
      Allows use of plain strings and files as credentials.
      1.3
      DOWNGRADE TO 1.2
      Uninstall

      S3 publisher plugin
      This is a plugin to upload files to Amazon S3 buckets.
      0.10.9
      DOWNGRADE TO 0.10.7
      Uninstall

      SCM API Plugin
      This plugin provides a new enhanced API for interacting with SCM systems.
      1.3
      DOWNGRADE TO 1.2
      Uninstall

      Script Security Plugin
      Allows Jenkins administrators to control what in-process scripts can be run by less-privileged users.
      1.23
      DOWNGRADE TO 1.22
      Uninstall

      Simple Theme Plugin
      A plugin for Jenkins that supports custom CSS & JavaScript. You can customize Jenkins's appearance (ex. his gentle face on the background).
      0.3
      Uninstall

      SSH Credentials Plugin
      This plugin allows you to store SSH credentials in Jenkins.
      1.12
      Uninstall

      SSH Slaves plugin
      This plugin allows you to manage slaves running on *nix machines over SSH.
      1.11
      Uninstall

      Structs Plugin
      Library plugin for DSL plugins that need names for Jenkins objects.
      1.5
      DOWNGRADE TO 1.3
      Uninstall

      Subversion Plug-in
      This plugin adds the Subversion support (via SVNKit) to Jenkins.
      2.6
      Uninstall

      ThinBackup
      This plugin simply backs up the global and job specific configurations (not the archive or the workspace).
      1.7.4
      Uninstall

      Timestamper
      Adds timestamps to the Console Output.
      1.8.6
      DOWNGRADE TO 1.8.5
      Uninstall

      Token Macro Plugin
      This plug-in adds reusable macro expansion capability for other plug-ins to use.
      2.0
      DOWNGRADE TO 1.12.1
      Uninstall

      Windows Slaves Plugin
      Allows you to connect to Windows machines and start slave agents on them.
      1.2
      Uninstall

      Workspace Cleanup Plugin
      This plugin deletes the project workspace after a build is finished.
      0.30

      Attachments

        Issue Links

          Activity

            sbrain Steve Brain added a comment -

            Same problem,

            I updated to the latest aws-java-sdk 1.11.37 from 1.10.50 library and restarted my Jenkins instance, and noticed no nodes were being created. I looked at my ec2 page and had the maximum number of allowed machines running or starting up. I terminated these and it filled up again.

            I immediately undid the upgrade and it started working correctly.

            The jenkins log was filled with these

            Sep 29, 2016 12:01:08 AM hudson.plugins.ec2.EC2Cloud provision
            INFO: Attempting to provision slave from template hudson.plugins.ec2.SlaveTemplate@1a01b2a0 needed by excess workload of 1 units of label 'cxx'
            Considering launching ami-63112100 for template Linux AMI
            Sep 29, 2016 12:01:10 AM hudson.plugins.ec2.SlaveTemplate logProvisionInfo
            INFO: Considering launching ami-63112100 for template Linux AMI
            Setting Instance Initiated Shutdown Behavior : ShutdownBehavior.Stop
            Sep 29, 2016 12:01:10 AM hudson.plugins.ec2.SlaveTemplate logProvisionInfo
            INFO: Setting Instance Initiated Shutdown Behavior : ShutdownBehavior.Stop
            Looking for existing instances with describe-instance: {InstanceIds: [],Filters: [

            {Name: image-id,Values: [ami-63112100]}

            ,

            {Name: instance.group-name,Values: [JenkinsSecurity]}

            ,

            {Name: key-name,Values: [Jenkins_keys]}

            ,

            {Name: instance-type,Values: [c3.large]}

            ,

            {Name: tag:Name,Values: [Centos Jenkins Slave CXX]}

            ,

            {Name: tag:Jenkins,Values: [Slave]}

            ],}
            Sep 29, 2016 12:01:11 AM hudson.triggers.SafeTimerTask run
            SEVERE: Timer task hudson.slaves.NodeProvisioner$NodeProvisionerInvoker@459472fa failed
            java.lang.NoSuchMethodError: com.amazonaws.services.ec2.AmazonEC2.createTags(Lcom/amazonaws/services/ec2/model/CreateTagsRequest;)V
            at hudson.plugins.ec2.SlaveTemplate.updateRemoteTags(SlaveTemplate.java:882)
            at hudson.plugins.ec2.SlaveTemplate.provisionOndemand(SlaveTemplate.java:585)
            at hudson.plugins.ec2.SlaveTemplate.provision(SlaveTemplate.java:377)
            at hudson.plugins.ec2.EC2Cloud.getNewOrExistingAvailableSlave(EC2Cloud.java:515)
            at hudson.plugins.ec2.EC2Cloud.provision(EC2Cloud.java:532)
            at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:701)
            at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:307)
            at hudson.slaves.NodeProvisioner.access$000(NodeProvisioner.java:60)
            at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:798)
            at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50)
            at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
            at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
            at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
            at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
            at java.lang.Thread.run(Thread.java:745)

            Sep 29, 2016 12:01:18 AM hudson.plugins.ec2.EC2Cloud provision
            INFO: Attempting to provision slave from template hudson.plugins.ec2.SlaveTemplate@1a01b2a0 needed by excess workload of 1 units of label 'cxx'
            Considering launching ami-63112100 for template Linux AMI
            Sep 29, 2016 12:01:19 AM hudson.plugins.ec2.SlaveTemplate logProvisionInfo
            INFO: Considering launching ami-63112100 for template Linux AMI
            Setting Instance Initiated Shutdown Behavior : ShutdownBehavior.Stop
            Sep 29, 2016 12:01:19 AM hudson.plugins.ec2.SlaveTemplate logProvisionInfo
            INFO: Setting Instance Initiated Shutdown Behavior : ShutdownBehavior.Stop
            Looking for existing instances with describe-instance: {InstanceIds: [],Filters: [

            {Name: image-id,Values: [ami-63112100]}

            ,

            {Name: instance.group-name,Values: [JenkinsSecurity]}

            ,

            {Name: key-name,Values: [Jenkins_keys]}

            ,

            {Name: instance-type,Values: [c3.large]}

            ,

            {Name: tag:Name,Values: [Centos Jenkins Slave CXX]}

            ,

            {Name: tag:Jenkins,Values: [Slave]}

            ],}
            Sep 29, 2016 12:01:20 AM hudson.triggers.SafeTimerTask run
            SEVERE: Timer task hudson.slaves.NodeProvisioner$NodeProvisionerInvoker@459472fa failed
            java.lang.NoSuchMethodError: com.amazonaws.services.ec2.AmazonEC2.createTags(Lcom/amazonaws/services/ec2/model/CreateTagsRequest;)V
            at hudson.plugins.ec2.SlaveTemplate.updateRemoteTags(SlaveTemplate.java:882)
            at hudson.plugins.ec2.SlaveTemplate.provisionOndemand(SlaveTemplate.java:585)
            at hudson.plugins.ec2.SlaveTemplate.provision(SlaveTemplate.java:377)
            at hudson.plugins.ec2.EC2Cloud.getNewOrExistingAvailableSlave(EC2Cloud.java:515)
            at hudson.plugins.ec2.EC2Cloud.provision(EC2Cloud.java:532)
            at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:701)
            at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:307)
            at hudson.slaves.NodeProvisioner.access$000(NodeProvisioner.java:60)
            at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:798)
            at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50)
            at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
            at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
            at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
            at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
            at java.lang.Thread.run(Thread.java:745)

            sbrain Steve Brain added a comment - Same problem, I updated to the latest aws-java-sdk 1.11.37 from 1.10.50 library and restarted my Jenkins instance, and noticed no nodes were being created. I looked at my ec2 page and had the maximum number of allowed machines running or starting up. I terminated these and it filled up again. I immediately undid the upgrade and it started working correctly. The jenkins log was filled with these Sep 29, 2016 12:01:08 AM hudson.plugins.ec2.EC2Cloud provision INFO: Attempting to provision slave from template hudson.plugins.ec2.SlaveTemplate@1a01b2a0 needed by excess workload of 1 units of label 'cxx' Considering launching ami-63112100 for template Linux AMI Sep 29, 2016 12:01:10 AM hudson.plugins.ec2.SlaveTemplate logProvisionInfo INFO: Considering launching ami-63112100 for template Linux AMI Setting Instance Initiated Shutdown Behavior : ShutdownBehavior.Stop Sep 29, 2016 12:01:10 AM hudson.plugins.ec2.SlaveTemplate logProvisionInfo INFO: Setting Instance Initiated Shutdown Behavior : ShutdownBehavior.Stop Looking for existing instances with describe-instance: {InstanceIds: [],Filters: [ {Name: image-id,Values: [ami-63112100]} , {Name: instance.group-name,Values: [JenkinsSecurity]} , {Name: key-name,Values: [Jenkins_keys]} , {Name: instance-type,Values: [c3.large]} , {Name: tag:Name,Values: [Centos Jenkins Slave CXX]} , {Name: tag:Jenkins,Values: [Slave]} ],} Sep 29, 2016 12:01:11 AM hudson.triggers.SafeTimerTask run SEVERE: Timer task hudson.slaves.NodeProvisioner$NodeProvisionerInvoker@459472fa failed java.lang.NoSuchMethodError: com.amazonaws.services.ec2.AmazonEC2.createTags(Lcom/amazonaws/services/ec2/model/CreateTagsRequest;)V at hudson.plugins.ec2.SlaveTemplate.updateRemoteTags(SlaveTemplate.java:882) at hudson.plugins.ec2.SlaveTemplate.provisionOndemand(SlaveTemplate.java:585) at hudson.plugins.ec2.SlaveTemplate.provision(SlaveTemplate.java:377) at hudson.plugins.ec2.EC2Cloud.getNewOrExistingAvailableSlave(EC2Cloud.java:515) at hudson.plugins.ec2.EC2Cloud.provision(EC2Cloud.java:532) at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:701) at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:307) at hudson.slaves.NodeProvisioner.access$000(NodeProvisioner.java:60) at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:798) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Sep 29, 2016 12:01:18 AM hudson.plugins.ec2.EC2Cloud provision INFO: Attempting to provision slave from template hudson.plugins.ec2.SlaveTemplate@1a01b2a0 needed by excess workload of 1 units of label 'cxx' Considering launching ami-63112100 for template Linux AMI Sep 29, 2016 12:01:19 AM hudson.plugins.ec2.SlaveTemplate logProvisionInfo INFO: Considering launching ami-63112100 for template Linux AMI Setting Instance Initiated Shutdown Behavior : ShutdownBehavior.Stop Sep 29, 2016 12:01:19 AM hudson.plugins.ec2.SlaveTemplate logProvisionInfo INFO: Setting Instance Initiated Shutdown Behavior : ShutdownBehavior.Stop Looking for existing instances with describe-instance: {InstanceIds: [],Filters: [ {Name: image-id,Values: [ami-63112100]} , {Name: instance.group-name,Values: [JenkinsSecurity]} , {Name: key-name,Values: [Jenkins_keys]} , {Name: instance-type,Values: [c3.large]} , {Name: tag:Name,Values: [Centos Jenkins Slave CXX]} , {Name: tag:Jenkins,Values: [Slave]} ],} Sep 29, 2016 12:01:20 AM hudson.triggers.SafeTimerTask run SEVERE: Timer task hudson.slaves.NodeProvisioner$NodeProvisionerInvoker@459472fa failed java.lang.NoSuchMethodError: com.amazonaws.services.ec2.AmazonEC2.createTags(Lcom/amazonaws/services/ec2/model/CreateTagsRequest;)V at hudson.plugins.ec2.SlaveTemplate.updateRemoteTags(SlaveTemplate.java:882) at hudson.plugins.ec2.SlaveTemplate.provisionOndemand(SlaveTemplate.java:585) at hudson.plugins.ec2.SlaveTemplate.provision(SlaveTemplate.java:377) at hudson.plugins.ec2.EC2Cloud.getNewOrExistingAvailableSlave(EC2Cloud.java:515) at hudson.plugins.ec2.EC2Cloud.provision(EC2Cloud.java:532) at hudson.slaves.NodeProvisioner$StandardStrategyImpl.apply(NodeProvisioner.java:701) at hudson.slaves.NodeProvisioner.update(NodeProvisioner.java:307) at hudson.slaves.NodeProvisioner.access$000(NodeProvisioner.java:60) at hudson.slaves.NodeProvisioner$NodeProvisionerInvoker.doRun(NodeProvisioner.java:798) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745)
            joshma Joshua Ma added a comment -

            We're seeing the same thing with Linux non-spot instances. 80+ nodes launched (all missing tags, weirdly) - I terminated them at night, only to have them come back the next day. (It might've come back immediately, I just didn't check.) Would be great to have this bug be investigated - it's going to accidentally cost a lot of people a lot of money.

            joshma Joshua Ma added a comment - We're seeing the same thing with Linux non-spot instances. 80+ nodes launched (all missing tags, weirdly) - I terminated them at night, only to have them come back the next day. (It might've come back immediately, I just didn't check.) Would be great to have this bug be investigated - it's going to accidentally cost a lot of people a lot of money.
            joshma Joshua Ma added a comment -

            (Looks like JENKINS-38481 is the issue I'm seeing and is likely the same issue as the original poster.)

            joshma Joshua Ma added a comment - (Looks like JENKINS-38481 is the issue I'm seeing and is likely the same issue as the original poster.)
            danielbeck Daniel Beck added a comment -

            Amazon EC2 plugin
            Allow Jenkins to start slaves on EC2 or Eucalyptus on demand, and kill them as they get unused.
            1.35
            Uninstall

            Amazon Web Services SDK
            This plugin provides AWS SDK for Java for other plugins.
            1.11.37
            DOWNGRADE TO 1.10.50
            Uninstall

            Fixed in EC2 Plugin 1.36

            danielbeck Daniel Beck added a comment - Amazon EC2 plugin Allow Jenkins to start slaves on EC2 or Eucalyptus on demand, and kill them as they get unused. 1.35 Uninstall Amazon Web Services SDK This plugin provides AWS SDK for Java for other plugins. 1.11.37 DOWNGRADE TO 1.10.50 Uninstall Fixed in EC2 Plugin 1.36

            People

              Unassigned Unassigned
              sahka alexander yushchenko
              Votes:
              3 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: