Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-44150

Pipeline job not waiting for all triggered parallel jobs

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      When running this job with parallel enabled the parallel jobs terminate early causing failures.

      Files that were available at the beginning of parallel jobs are removed and errors such as:

      ```

      [4.8.1] /usr/local/bin/ruby: No such file or directory – extconf.rb (LoadError)
      [4.8.1] Gem files will remain installed in /usr/local/bundle/gems/json-1.8.6 for
      [4.8.1] Errno::ENOENT: No such file or directory @ chmod_internal

      ```

      When the parallel function is disabled the job runs without an issue but obviously takes longer since it can't take advantage of the parallel processing.

       

      Attached is the 2 jobs referencing the same shared library but with different tag references for the paralleldisabled and "enabled" versions for the required methods used by this job.

       

      As long as kubernetes-plugin is installed and configured this job should be able to run anywhere with an internet connection to retrieve the shared library and download the required images.

       

      Might be related to #44152

        Attachments

          Issue Links

            Activity

            cdenneen Chris Denneen created issue -
            cdenneen Chris Denneen made changes -
            Field Original Value New Value
            Description When running this job with parallel enabled the parallel jobs terminate early causing failures.

            Files that were available at the beginning of parallel jobs are removed and errors such as:

            ```

            [4.8.1] /usr/local/bin/ruby: No such file or directory -- extconf.rb (LoadError)
            [4.8.1] Gem files will remain installed in /usr/local/bundle/gems/json-1.8.6 for
            [4.8.1] Errno::ENOENT: No such file or directory @ chmod_internal

            ```

            When the parallel function is disabled the job runs without an issue but obviously takes longer since it can't take advantage of the parallel processing.

             

            Attached is the 2 jobs referencing the same shared library but with different tag references for the paralleldisabled and "enabled" versions for the required methods used by this job.

             

            As long as kubernetes-plugin is installed and configured this job should be able to run anywhere with an internet connection to retrieve the shared library and download the required images.

             
            When running this job with parallel enabled the parallel jobs terminate early causing failures.

            Files that were available at the beginning of parallel jobs are removed and errors such as:

            ```

            [4.8.1] /usr/local/bin/ruby: No such file or directory – extconf.rb (LoadError)
             [4.8.1] Gem files will remain installed in /usr/local/bundle/gems/json-1.8.6 for
             [4.8.1] Errno::ENOENT: No such file or directory @ chmod_internal

            ```

            When the parallel function is disabled the job runs without an issue but obviously takes longer since it can't take advantage of the parallel processing.

             

            Attached is the 2 jobs referencing the same shared library but with different tag references for the paralleldisabled and "enabled" versions for the required methods used by this job.

             

            As long as kubernetes-plugin is installed and configured this job should be able to run anywhere with an internet connection to retrieve the shared library and download the required images.

             

            Might be related to #44152
            cdenneen Chris Denneen made changes -
            Link This issue is related to JENKINS-44152 [ JENKINS-44152 ]
            csanchez Carlos Sanchez made changes -
            Link This issue is blocked by JENKINS-42048 [ JENKINS-42048 ]
            Hide
            csanchez Carlos Sanchez added a comment -

            can you try the latest version?

            Show
            csanchez Carlos Sanchez added a comment - can you try the latest version?
            vivek Vivek Pandey made changes -
            Component/s pipeline [ 21692 ]
            jglick Jesse Glick made changes -
            Assignee Carlos Sanchez [ csanchez ]
            Hide
            vlatombe Vincent Latombe added a comment -

            Needs a full reproducer. In the logs, I see only one kubernetes node, so are you running parallel within that single node? I don't see anything specific to the kubernetes plugin, the problem would be the same within a static node.

            Show
            vlatombe Vincent Latombe added a comment - Needs a full reproducer. In the logs, I see only one kubernetes node, so are you running parallel within that single node? I don't see anything specific to the kubernetes plugin, the problem would be the same within a static node.
            vlatombe Vincent Latombe made changes -
            Resolution Incomplete [ 4 ]
            Status Open [ 1 ] Closed [ 6 ]

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              cdenneen Chris Denneen
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: