Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-23787

EC2-plugin not spooling up stopped nodes - "still in the queue ... all nodes of label ... are offline"

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Major Major
    • ec2-plugin
    • Jenkins 1.572, EC2 plugin 1.21, Node Iterator API Plugin 1.5

      The Jenkins EC2 plugin no longer launches stopped nodes. Unfortunately I'm not sure exactly when it stopped working - I wasn't sure that was the issue until later, due to unrelated issues caused by too many nodes spawning and having to be killed.

      If I use Manage Jenkins -> Manage Nodes to start a stopped EC2 node that a build is waiting on manually, the build proceeds.

      Builds succeed when the EC2 plugin spawns a new node for the first time. It's only a problem if the node is stopped for idleness - the plugin doesn't seem to restart it.

      Builds get stuck with output like:

      Triggering bdr_linux ? x64,debian7
Triggering bdr_linux ? x86,amazonlinux201209
Triggering bdr_linux ? x86,debian6
Triggering bdr_linux ? x64,amazonlinux201209
Configuration bdr_linux ? x86,amazonlinux201209 is still in the queue: Amazon Linux 2012.09 EBS 32-bit  (i-b848fbfa) is offline
Configuration bdr_linux ? x86,amazonlinux201209 is still in the queue: All nodes of label ?amazonlinux201209&&x86? are offline

      where there's at least one node with that label stopped, ready to start and use.

      There's no sign that any attempt is made to start the node.

          [JENKINS-23787] EC2-plugin not spooling up stopped nodes - "still in the queue ... all nodes of label ... are offline"

          Craig Ringer created issue -
          Craig Ringer made changes -
          Labels New: demand-launch ec2
          Craig Ringer made changes -
          Labels Original: demand-launch ec2 New: demand-launch ec2 regression
          Andrew Coulton made changes -
          Link New: This issue is related to JENKINS-23850 [ JENKINS-23850 ]
          Craig Ringer made changes -
          Link New: This issue is related to JENKINS-23792 [ JENKINS-23792 ]
          Craig Ringer made changes -
          Fix Version/s Original: current [ 10162 ]
          Francis Upton made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: Open [ 1 ] New: Resolved [ 5 ]
          Francis Upton made changes -
          Status Original: Resolved [ 5 ] New: Closed [ 6 ]
          R. Tyler Croy made changes -
          Workflow Original: JNJira [ 156577 ] New: JNJira + In-Review [ 207851 ]

            francisu Francis Upton
            ringerc Craig Ringer
            Votes:
            2 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: