Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-19208

build flow takes a long time to detect that all started jobs have finished successfully

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Component/s: build-flow-plugin
    • Labels:
    • Environment:
    • Similar Issues:

      Description

      The following flow frequently takes a long time before detecting all spawned builds have completed.

      build.setDisplayName("#${params['pullrequest']}@${params['sha'].substring(0,6)}>${params['mergebranch']} [${build.number}]")
      
      // full, parallelized, Scala PR validation
      // scala-distpack should run fastdistpack-maven-opt, a new task that skips generating docs
      parallel (
        { retry (2, { build(params, "pr-scala-rangepos") }) },
      
        { distpack = build(params, "pr-scala-distpack")
          downParams = params + [ 'distpack_build' : "<SpecificBuildSelector><buildNumber>${distpack.build.number}</buildNumber></SpecificBuildSelector>" ]
          // has to run on same node as distpack for stability test
          // TODO: have separate job for stability (skip locker in distpack)
          testParams = downParams + [ 'node' : distpack.build.builtOnStr ]
      
          parallel (
            { retry(2, { build(testParams, "pr-scala-test") }) },
            { retry(2, { build(downParams, "pr-scala-integrate-ide") }) }, // cannot figure out how to add an ignore wrapper here..
            { retry(2, { build(downParams, "pr-scala-integrate-partest") }) }
          )
        }
      )
      
      

      Here's close to 30 examples:
      https://scala-webapps.epfl.ch/jenkins/view/pr-validators/job/pr-scala/1113/
      ...
      https://scala-webapps.epfl.ch/jenkins/view/pr-validators/job/pr-scala/1135/
      https://scala-webapps.epfl.ch/jenkins/view/pr-validators/job/pr-scala/1145/
      https://scala-webapps.epfl.ch/jenkins/view/pr-validators/job/pr-scala/1146/
      https://scala-webapps.epfl.ch/jenkins/view/pr-validators/job/pr-scala/1147/
      https://scala-webapps.epfl.ch/jenkins/view/pr-validators/job/pr-scala/1150/

      ps: the ignore combinator causes even worse breakage (I wanted to ignore a build in a parallel block, but had to abandon because it caused what looks like races)

        Attachments

          Activity

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            adriaanm Adriaan Moors
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated: