Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-61779

Regression: Job stuck in queue waiting forever after upgrade

      I "apt dist-upgrade"-d my build Jenkins server, and was updated from 2.204.4 to 2.222.1, and now I am running into issues.

      The major issue is that my throttled builds do not work. I have a build (see attached creenshot)
      that is configured with throttling:

      <hudson.plugins.throttleconcurrents.ThrottleJobProperty plugin="throttle-concurrents@2.0.2">
      <maxConcurrentPerNode>1</maxConcurrentPerNode>
      <maxConcurrentTotal>1</maxConcurrentTotal>
      <categories class="java.util.concurrent.CopyOnWriteArrayList">
      <string>vm-installer</string>
      <string>kickstart-repo</string>
      </categories>
      <throttleEnabled>true</throttleEnabled>
      <throttleOption>category</throttleOption>
      <limitOneJobWithMatchingParams>true</limitOneJobWithMatchingParams>
      <matrixOptions>
      <throttleMatrixBuilds>false</throttleMatrixBuilds>
      <throttleMatrixConfigurations>true</throttleMatrixConfigurations>
      </matrixOptions>
      <paramsToUseForLimit></paramsToUseForLimit>
      <configVersion>1</configVersion>
      </hudson.plugins.throttleconcurrents.ThrottleJobProperty>

      It is set up to build on a single node:

      <hudson.matrix.LabelAxis>
      <name>label</name>
      <values>
      <string>kickstartbuild</string>
      </values>
      </hudson.matrix.LabelAxis>

      The pop-up says that is waiting for the next available executor, which is "master", which is the only one satisfying this label. It is idle, but Jenkins is still waiting.

      The configuration worked fine before upgrading. Restarting Jenkins does not help.

          [JENKINS-61779] Regression: Job stuck in queue waiting forever after upgrade

          Peter Krefting created issue -
          Peter Krefting made changes -
          Summary Original: Regression: Job stock in queue waiting forever after upgrade New: Regression: Job stuck in queue waiting forever after upgrade

          Daniel Beck added a comment -

          May be caused by https://github.com/jenkinsci/jenkins/pull/3983 in Jenkins 2.205.

          If a similar behavior works in 2.204 (not LTS), and doesn't work in 2.205, that would be a strong indication.

          A bit weird we're only hearing about this now though. I cannot find similar recent bugs in throttle-concurrents either.

          Daniel Beck added a comment - May be caused by https://github.com/jenkinsci/jenkins/pull/3983 in Jenkins 2.205. If a similar behavior works in 2.204 (not LTS), and doesn't work in 2.205, that would be a strong indication. A bit weird we're only hearing about this now though. I cannot find similar recent bugs in throttle-concurrents either.

          Is there a 2.205 DEB that I can install to see if it has the same behaviour (if the configuration is downward compatible)?

          Peter Krefting added a comment - Is there a 2.205 DEB that I can install to see if it has the same behaviour (if the configuration is downward compatible)?

          Daniel Beck added a comment -

          Daniel Beck added a comment - http://mirrors.jenkins-ci.org/debian/

          Downgrading to http://mirrors.jenkins-ci.org/debian/jenkins_2.205_all.deb the build queue is still stuck.

          Downgrading to http://pkg.jenkins-ci.org/debian-stable/binary/jenkins_2.204.6_all.deb the builds start running again.

          Peter Krefting added a comment - Downgrading to http://mirrors.jenkins-ci.org/debian/jenkins_2.205_all.deb  the build queue is still stuck. Downgrading to http://pkg.jenkins-ci.org/debian-stable/binary/jenkins_2.204.6_all.deb  the builds start running again.

          Daniel Beck added a comment -

          Create a log recorder for the loggers:

          • hudson.plugins.throttleconcurrents
          • hudson.model.Queue
          • hudson.model.queue.QueueSorter

          and see whether anything interesting is being logged

          Daniel Beck added a comment - Create a log recorder for the loggers: hudson.plugins.throttleconcurrents hudson.model.Queue hudson.model.queue.QueueSorter and see whether anything interesting is being logged
          John Rocha made changes -
          Priority Original: Minor [ 4 ] New: Blocker [ 1 ]

          John Rocha added a comment -

          Having the same problem. I update about once a month and after updating from 2.204 to 2.222 I see the same issue, but I'm on Windows systems.

          John Rocha added a comment - Having the same problem. I update about once a month and after updating from 2.204 to 2.222 I see the same issue, but I'm on Windows systems.
          Alex Gray made changes -
          Attachment New: master_node.gif [ 50910 ]

            Unassigned Unassigned
            nafmo Peter Krefting
            Votes:
            3 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated: