Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-44380

Removing big number GCE nodes hangs up jenkins

    XMLWordPrintable

Details

    • Bug
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • jclouds-plugin
    • None
    • Jenkins ver. 2.46.2
      JCloud 2.14

    Description

      We use about 100 nodes for provisioning on GCE. Job run tests in parallel and a lot of nodes (60) made simultaneously. Then jcloud trying remove them and did it one after the other. It take time. And during this time no one job can be run.

      Attachments

        Activity

          tommywo Tomasz Wojtun added a comment -

          This is a regression from fix for JENKINS-28403, commit f141bc7633987e691856e4c20af6dd262e27f9c1.

          RetentionStrategy.check(Computer c) is @GuardedBy("hudson.model.Queue.lock"), so queue is locked. 

          tommywo Tomasz Wojtun added a comment - This is a regression from fix for JENKINS-28403 , commit f141bc7633987e691856e4c20af6dd262e27f9c1. RetentionStrategy.check(Computer c) is @GuardedBy("hudson.model.Queue.lock"), so queue is locked. 

          There are 2 questions:
          1. Why it remove nodes one by one? And not all together?
          2. Why it can't start other jobs when removing nodes?

          dubrsl Viacheslav Dubrovskyi added a comment - There are 2 questions: 1. Why it remove nodes one by one? And not all together? 2. Why it can't start other jobs when removing nodes?

          People

            felfert Fritz Elfert
            dubrsl Viacheslav Dubrovskyi
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: