[JENKINS-53148] Downstream pipeline no longer triggered

Cyrille Le Clerc added a comment - 2018-08-23 09:08

Can you enable more logs on the logger "org.jenkinsci.plugins.pipeline.maven.listeners.DownstreamPipelineTriggerRunListener", it will add more messages in the build logs.

Can you please provide more details?

Style of your Maven projects
Relationship between the pipelines and maven projects
messages in the logs (particularly logs of the upstream build that is not triggering the desired downstream pipeline)

Cyrille Le Clerc added a comment - 2018-08-23 09:08 Can you enable more logs on the logger "org.jenkinsci.plugins.pipeline.maven.listeners.DownstreamPipelineTriggerRunListener", it will add more messages in the build logs. Can you please provide more details? Style of your Maven projects Relationship between the pipelines and maven projects messages in the logs (particularly logs of the upstream build that is not triggering the desired downstream pipeline)

dan tran added a comment - 2018-08-27 08:39 - edited

my build consists of 3 layers.

* Multiple Maven pipelines in layer 1 trigger layer 2. ( maven clean deploy). This works

* Layer 2 is one single Maven pipeline with a fairly large source tree to produce an OVA. It also builds and maven deploys integration test code, but not running the tests

* Layer 3 has a number of small Git repos which clone the large source tree of layer 2 on the fly and build a portion of the tree for integration test purpose ( via maven clean install ). ie we run slow integration test suites in parallel at layer 3

Layer 2 has this message:

[withMaven] Not triggering [x » y » z » master] because it has dependencies in the downstream project list

My guess here is withMaven thinks layer 3 has dependencies of itself already built at Layer 2

I think I will be able to simulate this scenario with smaller pipelines, just need time

dan tran added a comment - 2018-08-27 08:39 - edited my build consists of 3 layers. * Multiple Maven pipelines in layer 1 trigger layer 2. ( maven clean deploy). This works * Layer 2 is one single Maven pipeline with a fairly large source tree to produce an OVA. It also builds and maven deploys integration test code, but not running the tests * Layer 3 has a number of small Git repos which clone the large source tree of layer 2 on the fly and build a portion of the tree for integration test purpose ( via maven clean install ). ie we run slow integration test suites in parallel at layer 3 Layer 2 has this message: [withMaven] Not triggering [x » y » z » master] because it has dependencies in the downstream project list My guess here is withMaven thinks layer 3 has dependencies of itself already built at Layer 2 I think I will be able to simulate this scenario with smaller pipelines, just need time

Cyrille Le Clerc added a comment - 2018-08-27 08:45

Thanks Dan, the "finer" log level granularity should display in the log if the algorithm thinks there is an infinite loop.

Cyrille Le Clerc added a comment - 2018-08-27 08:45 Thanks Dan, the "finer" log level granularity should display in the log if the algorithm thinks there is an infinite loop.

dan tran added a comment - 2018-09-01 03:51 - edited

I am not able to scale down to reproduce the issue. Ended up to install latest pipeline-maven-plugin and enable org.jenkinsci.plugins.pipeline.maven.listeners.DownstreamPipelineTriggerRunListener to finer at production build to troubleshoot

dan tran added a comment - 2018-09-01 03:51 - edited I am not able to scale down to reproduce the issue. Ended up to install latest pipeline-maven-plugin and enable org.jenkinsci.plugins.pipeline.maven.listeners.DownstreamPipelineTriggerRunListener to finer at production build to troubleshoot

dan tran added a comment - 2018-09-01 16:24

no log. I push the second level job and want to to see a bunch of jobs to be triggered at third level jobs. The only message I see:

onCompleted(xxxx)

what kind of dependency that would produce "Not triggering [x » y » z » master] because it has dependencies in the downstream project list" ?

dan tran added a comment - 2018-09-01 16:24 no log. I push the second level job and want to to see a bunch of jobs to be triggered at third level jobs. The only message I see: onCompleted(xxxx) what kind of dependency that would produce "Not triggering [x » y » z » master] because it has dependencies in the downstream project list" ?

Cyrille Le Clerc added a comment - 2018-09-01 17:33

dantran I am preparing at the moment an improvement of this message:
https://issues.jenkins-ci.org/browse/JENKINS-53378
https://github.com/jenkinsci/pipeline-maven-plugin/pull/159

Cyrille Le Clerc added a comment - 2018-09-01 17:33 dantran I am preparing at the moment an improvement of this message: https://issues.jenkins-ci.org/browse/JENKINS-53378 https://github.com/jenkinsci/pipeline-maven-plugin/pull/159

dan tran added a comment - 2018-09-01 17:42

very promising, look forward with a test build of this plugin

dan tran added a comment - 2018-09-01 17:42 very promising, look forward with a test build of this plugin

dan tran added a comment - 2018-09-02 00:17 - edited

i locally built latest and deployed to my production. Triggering now works but each downstream job runs twice with the second one repeated in log. and take a long time for triggering log to finish

Here is my ending log with sensitive info removed

[Bitbucket] Notifying commit build result
[Bitbucket] Build result notified
[withMaven] pipelineGraphPublisher - triggerDownstreamPipelines
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#959...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1161...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#261...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960...
[withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162...
Finished: SUCCESS

dan tran added a comment - 2018-09-02 00:17 - edited i locally built latest and deployed to my production. Triggering now works but each downstream job runs twice with the second one repeated in log. and take a long time for triggering log to finish Here is my ending log with sensitive info removed [Bitbucket] Notifying commit build result [Bitbucket] Build result notified [withMaven] pipelineGraphPublisher - triggerDownstreamPipelines [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#959... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1161... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#261... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-3 » master#262... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-1 » master#960... [withMaven] Scheduling downstream folder-x » project-x » repo-2 » master#1162... Finished: SUCCESS

dan tran added a comment - 2018-09-02 06:49 - edited

it seems to me, the multiple trigger entries coming from all transitive dependencies found at the upstream's Maven report. The first one triggers a first downstream job, and then the rest follow up with another job

So my private build, with the change at https://issues.jenkins-ci.org/browse/JENKINS-51953, solves my original issue, but introduce a new one a little less severe must fix

dan tran added a comment - 2018-09-02 06:49 - edited it seems to me, the multiple trigger entries coming from all transitive dependencies found at the upstream's Maven report. The first one triggers a first downstream job, and then the rest follow up with another job So my private build, with the change at https://issues.jenkins-ci.org/browse/JENKINS-51953 , solves my original issue, but introduce a new one a little less severe must fix

Cyrille Le Clerc added a comment - 2018-09-02 08:18 - edited

dantran can you try to reproduce with the improved message https://github.com/jenkinsci/pipeline-maven-plugin/commit/c65ec72a02a15ab5a1171d435fdb7af887207e18 . You just have to build master branch.

I suspect that you see multi triggers of some downstream pipelines because these downstream pipelines depend on multiple artifacts generated by your upstream pipeline.

I will ASAP improve the trigger of downstream pipelines to replace multi-trigger of downstream pipelines when they depend on multiple dependencies by mono trigger with multi-causes.

Cyrille Le Clerc added a comment - 2018-09-02 08:18 - edited dantran can you try to reproduce with the improved message https://github.com/jenkinsci/pipeline-maven-plugin/commit/c65ec72a02a15ab5a1171d435fdb7af887207e18 . You just have to build master branch. I suspect that you see multi triggers of some downstream pipelines because these downstream pipelines depend on multiple artifacts generated by your upstream pipeline. I will ASAP improve the trigger of downstream pipelines to replace multi-trigger of downstream pipelines when they depend on multiple dependencies by mono trigger with multi-causes.

dan tran added a comment - 2018-09-02 08:39 - edited

I started another build with this plugin latest source. So what are you looking for from the log?

dan tran added a comment - 2018-09-02 08:39 - edited I started another build with this plugin latest source. So what are you looking for from the log?

dan tran added a comment - 2018-09-02 09:25

my upstream job now has this type of log

[withMaven] Scheduling downstream pipeline folder-x» project-x» repo-x » master#273 due to dependency on groupId:artifactid:type:version

the list matches with upstream's Maven report's downstream job

Perhaps you can detect this condition and trigger downstream job once?

dan tran added a comment - 2018-09-02 09:25 my upstream job now has this type of log [withMaven] Scheduling downstream pipeline folder-x» project-x» repo-x » master#273 due to dependency on groupId:artifactid:type:version the list matches with upstream's Maven report's downstream job Perhaps you can detect this condition and trigger downstream job once?

Cyrille Le Clerc added a comment - 2018-09-02 09:40 - edited

dantran can you please try with the branch https://github.com/jenkinsci/pipeline-maven-plugin/tree/JENKINS-53380

You will have this de-duplication. Message of downstream pipeline scheduling with multiple causes (i.e. dependencies) will look like

[withMaven] Scheduling downstream pipeline my-downstream-pipeline#62 due to dependency on \
com.example:my-jar:jar:0.7-SNAPSHOT(0.7-20180902.093122-80),  \
com.example:my-other-jar:jar:0.7-SNAPSHOT(0.7-20180902.093137-80)...

Cyrille Le Clerc added a comment - 2018-09-02 09:40 - edited dantran can you please try with the branch https://github.com/jenkinsci/pipeline-maven-plugin/tree/JENKINS-53380 You will have this de-duplication. Message of downstream pipeline scheduling with multiple causes (i.e. dependencies) will look like [withMaven] Scheduling downstream pipeline my-downstream-pipeline#62 due to dependency on \ com.example:my-jar:jar:0.7-SNAPSHOT(0.7-20180902.093122-80), \ com.example:my-other-jar:jar:0.7-SNAPSHOT(0.7-20180902.093137-80)...

dan tran added a comment - 2018-09-02 11:03

it works, but this is what i see

[Bitbucket] Build result notified
[withMaven] pipelineGraphPublisher - triggerDownstreamPipelines
[withMaven] Scheduling downstream pipeline folder-x » project-x » repo-1 » master#275 due to dependency on groupId:artifactId:type:3.0.0-1-SNAPSHOT(3.0.0-1-SNAPSHOT) ...
[withMaven] Scheduling downstream pipeline folder-x » project-x » repo-2 » master#976 due to dependency on groupId:artifactId:type:3.0.0-1-SNAPSHOT(3.0.0-1-20180902.102143-2087) ...
[withMaven] Scheduling downstream pipeline folder-x » project-x » repo-3 » master#1177 due to dependency on groupId:artifactId:type:3.0.0-1-SNAPSHOT(3.0.0-1-20180902.102219-2086) ...
Finished: SUCCESS

ie, only one maven GAV shows up ending with '...'

dan tran added a comment - 2018-09-02 11:03 it works, but this is what i see [Bitbucket] Build result notified [withMaven] pipelineGraphPublisher - triggerDownstreamPipelines [withMaven] Scheduling downstream pipeline folder-x » project-x » repo-1 » master#275 due to dependency on groupId:artifactId:type:3.0.0-1-SNAPSHOT(3.0.0-1-SNAPSHOT) ... [withMaven] Scheduling downstream pipeline folder-x » project-x » repo-2 » master#976 due to dependency on groupId:artifactId:type:3.0.0-1-SNAPSHOT(3.0.0-1-20180902.102143-2087) ... [withMaven] Scheduling downstream pipeline folder-x » project-x » repo-3 » master#1177 due to dependency on groupId:artifactId:type:3.0.0-1-SNAPSHOT(3.0.0-1-20180902.102219-2086) ... Finished: SUCCESS ie, only one maven GAV shows up ending with '...'

Cyrille Le Clerc added a comment - 2018-09-02 12:55 - edited

dantran can you please try https://github.com/jenkinsci/pipeline-maven-plugin/releases/tag/pipeline-maven-3.5.12-beta-2 ?

The reasons why downstream pipelines are triggered or are not triggered are clearly explained in the build logs and are visible as build causes

https://repo.jenkins-ci.org/releases/org/jenkins-ci/plugins/pipeline-maven/3.5.12-beta-2/pipeline-maven-3.5.12-beta-2.hpi

Cyrille Le Clerc added a comment - 2018-09-02 12:55 - edited dantran can you please try https://github.com/jenkinsci/pipeline-maven-plugin/releases/tag/pipeline-maven-3.5.12-beta-2 ? The reasons why downstream pipelines are triggered or are not triggered are clearly explained in the build logs and are visible as build causes https://repo.jenkins-ci.org/releases/org/jenkins-ci/plugins/pipeline-maven/3.5.12-beta-2/pipeline-maven-3.5.12-beta-2.hpi

dan tran added a comment - 2018-09-02 20:20 - edited

it works,

* the upstream log now shows entries of the next jobs, with a long list of maven dependencies

* the downstream job shows all entries each has

Started by upstream project xxxxx #yyyy generating Maven artifact com.xxxxx

Can we reduce the content of the second item, it is just too verbose?

in my case,

* upstream - large source tree build on Linux with clean deploy

* downstream - pom.xml has a dependency on top level upstream's parent project build on windows. It then dynamically checks out upstream source tree and run maven clean install. This has a large log entry of at upstream log since this downstream builds the same set of dependencies at upstream

* downstream -2, same as downstream 1 running on Linux, but only runs a subset of maven modules with integration test enabled via a Maven profil

both downstream jobs shows lots of upstream trigger entries for many maven gav

dan tran added a comment - 2018-09-02 20:20 - edited it works, * the upstream log now shows entries of the next jobs, with a long list of maven dependencies * the downstream job shows all entries each has Started by upstream project xxxxx #yyyy generating Maven artifact com.xxxxx Can we reduce the content of the second item, it is just too verbose? in my case, * upstream - large source tree build on Linux with clean deploy * downstream - pom.xml has a dependency on top level upstream's parent project build on windows. It then dynamically checks out upstream source tree and run maven clean install. This has a large log entry of at upstream log since this downstream builds the same set of dependencies at upstream * downstream -2, same as downstream 1 running on Linux, but only runs a subset of maven modules with integration test enabled via a Maven profil both downstream jobs shows lots of upstream trigger entries for many maven gav

Cyrille Le Clerc added a comment - 2018-09-02 21:09

dantran thanks for the good news. Regarding the rendering problem, can you confirm that your problem is similar to the attached screenshot? How many dependencies do you have listed as cause? 5? 10? 50?

Cyrille Le Clerc added a comment - 2018-09-02 21:09 dantran thanks for the good news. Regarding the rendering problem, can you confirm that your problem is similar to the attached screenshot? How many dependencies do you have listed as cause? 5? 10? 50?

Cyrille Le Clerc added a comment - 2018-09-02 21:27

Fixed in 3.5.12-beta-2

Cyrille Le Clerc added a comment - 2018-09-02 21:27 Fixed in 3.5.12-beta-2

dan tran added a comment - 2018-09-02 21:40 - edited

sorry, the trigger is intermittent. I forced another upstream build and here is the end of upstream log

[Bitbucket] Build result notified
[withMaven] pipelineGraphPublisher - triggerDownstreamPipelines

dont even see

Finished: SUCCESS

dan tran added a comment - 2018-09-02 21:40 - edited sorry, the trigger is intermittent. I forced another upstream build and here is the end of upstream log [Bitbucket] Build result notified [withMaven] pipelineGraphPublisher - triggerDownstreamPipelines dont even see Finished: SUCCESS

dan tran added a comment - 2018-09-02 21:44 - edited

yes, i see the same screen shot you posted. I have about 300

dan tran added a comment - 2018-09-02 21:44 - edited yes, i see the same screen shot you posted. I have about 300

Cyrille Le Clerc added a comment - 2018-09-02 21:59

> sorry, the trigger is intermittent. I forced another upstream build and here is the end of upstream log

Are there any messages in the logs of the build or in Jenkins logs? I would expect a stacktrace in the logs

> I have about 300

Ack, it's way beyond what I anticipated for this feature. I am not aware of technical limitation, the UI is definitively not thought for such number. I'll discuss with colleagues of the multi Cause design.

Cyrille Le Clerc added a comment - 2018-09-02 21:59 > sorry, the trigger is intermittent. I forced another upstream build and here is the end of upstream log Are there any messages in the logs of the build or in Jenkins logs? I would expect a stacktrace in the logs > I have about 300 Ack, it's way beyond what I anticipated for this feature. I am not aware of technical limitation, the UI is definitively not thought for such number. I'll discuss with colleagues of the multi Cause design.

dan tran added a comment - 2018-09-02 22:16 - edited

actually, the upstream log eventually shows the downstream triggers, but it took about 40min after the completion. Will do more test to find the pattern

dan tran added a comment - 2018-09-02 22:16 - edited actually, the upstream log eventually shows the downstream triggers, but it took about 40min after the completion. Will do more test to find the pattern

dan tran added a comment - 2018-09-03 02:53

the delay is real

dan tran added a comment - 2018-09-03 02:53 the delay is real

Cyrille Le Clerc added a comment - 2018-09-03 08:46

Can you try with the latest master branch to get https://github.com/jenkinsci/pipeline-maven-plugin/commit/a94794456c1a6bb6342729f41569418e1e4cbf31
You will have a log message "[withMaven] triggerDownstreamPipelines completed in xxx ms" if the duration is greater than 5 seconds or if you enable logs on org.jenkinsci.plugins.pipeline.maven.listeners.DownstreamPipelineTriggerRunListener .

Can you please also generate few thread dump during the processing? With jstack or with Jenkins URL /threadDump

Cyrille Le Clerc added a comment - 2018-09-03 08:46 Can you try with the latest master branch to get https://github.com/jenkinsci/pipeline-maven-plugin/commit/a94794456c1a6bb6342729f41569418e1e4cbf31 You will have a log message " [withMaven] triggerDownstreamPipelines completed in xxx ms " if the duration is greater than 5 seconds or if you enable logs on org.jenkinsci.plugins.pipeline.maven.listeners.DownstreamPipelineTriggerRunListener . Can you please also generate few thread dump during the processing? With jstack or with Jenkins URL /threadDump

Cyrille Le Clerc added a comment - 2018-09-03 17:19

dantran I have aggregated all the maven artifacts into one single upstream cause to support a relationship on many artifacts.

https://github.com/jenkinsci/pipeline-maven-plugin/tree/JENKINS-53392

Cyrille Le Clerc added a comment - 2018-09-03 17:19 dantran I have aggregated all the maven artifacts into one single upstream cause to support a relationship on many artifacts. https://github.com/jenkinsci/pipeline-maven-plugin/tree/JENKINS-53392

dan tran added a comment - 2018-09-03 17:31

i am currently running private build which has this commit https://github.com/jenkinsci/pipeline-maven-plugin/commit/a94794456c1a6bb6342729f41569418e1e4cbf31 to get teh timeout logger.

The delay varies 5 to 40 mins. I also have the thread dump while delay is going on. Need to digest the output

Will try latest build for ~~JENKINS-53392~~

dan tran added a comment - 2018-09-03 17:31 i am currently running private build which has this commit https://github.com/jenkinsci/pipeline-maven-plugin/commit/a94794456c1a6bb6342729f41569418e1e4cbf31 to get teh timeout logger. The delay varies 5 to 40 mins. I also have the thread dump while delay is going on. Need to digest the output Will try latest build for JENKINS-53392

Cyrille Le Clerc added a comment - 2018-09-03 19:41

dantran can you please try with https://github.com/jenkinsci/pipeline-maven-plugin/releases/tag/pipeline-maven-3.5.12-beta-3 ?
It's the beta release than contains ~~JENKINS-53392~~

Cyrille Le Clerc added a comment - 2018-09-03 19:41 dantran can you please try with https://github.com/jenkinsci/pipeline-maven-plugin/releases/tag/pipeline-maven-3.5.12-beta-3 ? It's the beta release than contains JENKINS-53392

dan tran added a comment - 2018-09-03 19:52

I deployed the latest from source. Upstream jobs did not come to complete after 40 minutes ( ie any ending logger about triggering). I ended up to revert back to 3.5.9

The interesting is the double downstream trigger issue was there all along.

Thought of reverting changes at 3.5.10 where problem started?

dan tran added a comment - 2018-09-03 19:52 I deployed the latest from source. Upstream jobs did not come to complete after 40 minutes ( ie any ending logger about triggering). I ended up to revert back to 3.5.9 The interesting is the double downstream trigger issue was there all along. Thought of reverting changes at 3.5.10 where problem started?

Cyrille Le Clerc added a comment - 2018-09-03 19:53 - edited

there was a performance regression that was very visible in your special case with so many generated maven artifacts being dependencies on the downstream pipeline.

Can you please test with the latest https://github.com/jenkinsci/pipeline-maven-plugin/tree/JENKINS-53396 (I have amended a commit to add a troubleshooting log message).
1. Enable logging "org.jenkinsci.plugins.pipeline.maven.listeners.DownstreamPipelineTriggerRunListener=FINEST"
2. Launch your upstream job
3. You will see "299 times" in the build logs a troubleshooting message that will look like

[withMaven - DownstreamPipelineTriggerRunListener] Skip eligibility check of pipeline dependency-graph/my-downstream-of-a-multi-jar-project/master for artifact com.example.multi-jar:jar-2:jar:0.0.1-SNAPSHOT(0.0.1-20180903.201513-17), eligibility already confirmed

Reference: https://issues.jenkins-ci.org/browse/JENKINS-53396

2018-09-03 22:55 CEST: code merged in master branch

Cyrille Le Clerc added a comment - 2018-09-03 19:53 - edited there was a performance regression that was very visible in your special case with so many generated maven artifacts being dependencies on the downstream pipeline. Can you please test with the latest https://github.com/jenkinsci/pipeline-maven-plugin/tree/JENKINS-53396 (I have amended a commit to add a troubleshooting log message). 1. Enable logging " org.jenkinsci.plugins.pipeline.maven.listeners.DownstreamPipelineTriggerRunListener=FINEST " 2. Launch your upstream job 3. You will see "299 times" in the build logs a troubleshooting message that will look like [withMaven - DownstreamPipelineTriggerRunListener] Skip eligibility check of pipeline dependency-graph/my-downstream-of-a-multi-jar-project/master for artifact com.example.multi-jar:jar-2:jar:0.0.1-SNAPSHOT(0.0.1-20180903.201513-17), eligibility already confirmed Reference: https://issues.jenkins-ci.org/browse/JENKINS-53396 2018-09-03 22:55 CEST: code merged in master branch

dan tran added a comment - 2018-09-03 22:53 - edited

confirm!!! installing latest from source works for me. I can see the mentioned loggers. Looks like we finally got the closure. The delay time is within 30sec consistently.

Thank you.

dan tran added a comment - 2018-09-03 22:53 - edited confirm!!! installing latest from source works for me. I can see the mentioned loggers. Looks like we finally got the closure. The delay time is within 30sec consistently. Thank you.

dan tran added a comment - 2018-09-04 22:17

Tested with 3.5.12-beta-4

dan tran added a comment - 2018-09-04 22:17 Tested with 3.5.12-beta-4

Cyrille Le Clerc added a comment - 2018-09-21 01:39

3.5.12

Cyrille Le Clerc added a comment - 2018-09-21 01:39 3.5.12

Jenkins

Details

Description

Attachments

Attachments

Issue Links

Activity

Collapse comment: Cyrille Le Clerc added a comment - 2018-08-23 09:08

Expand comment: Cyrille Le Clerc added a comment - 2018-08-23 09:08

Collapse comment: dan tran added a comment - 2018-08-27 08:39, Edited by dan tran - 2018-08-27 08:48

Expand comment: dan tran added a comment - 2018-08-27 08:39, Edited by dan tran - 2018-08-27 08:48

Collapse comment: Cyrille Le Clerc added a comment - 2018-08-27 08:45

Expand comment: Cyrille Le Clerc added a comment - 2018-08-27 08:45

Collapse comment: dan tran added a comment - 2018-09-01 03:51, Edited by dan tran - 2018-09-01 16:15

Expand comment: dan tran added a comment - 2018-09-01 03:51, Edited by dan tran - 2018-09-01 16:15

Collapse comment: dan tran added a comment - 2018-09-01 16:24

Expand comment: dan tran added a comment - 2018-09-01 16:24

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-01 17:33

Expand comment: Cyrille Le Clerc added a comment - 2018-09-01 17:33

Collapse comment: dan tran added a comment - 2018-09-01 17:42

Expand comment: dan tran added a comment - 2018-09-01 17:42

Collapse comment: dan tran added a comment - 2018-09-02 00:17, Edited by dan tran - 2018-09-02 03:53

Expand comment: dan tran added a comment - 2018-09-02 00:17, Edited by dan tran - 2018-09-02 03:53

Collapse comment: dan tran added a comment - 2018-09-02 06:49, Edited by dan tran - 2018-09-02 06:51

Expand comment: dan tran added a comment - 2018-09-02 06:49, Edited by dan tran - 2018-09-02 06:51

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-02 08:18, Edited by Cyrille Le Clerc - 2018-09-02 08:19

Expand comment: Cyrille Le Clerc added a comment - 2018-09-02 08:18, Edited by Cyrille Le Clerc - 2018-09-02 08:19

Collapse comment: dan tran added a comment - 2018-09-02 08:39, Edited by dan tran - 2018-09-02 08:40

Expand comment: dan tran added a comment - 2018-09-02 08:39, Edited by dan tran - 2018-09-02 08:40

Collapse comment: dan tran added a comment - 2018-09-02 09:25

Expand comment: dan tran added a comment - 2018-09-02 09:25

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-02 09:40, Edited by Cyrille Le Clerc - 2018-09-02 09:41

Expand comment: Cyrille Le Clerc added a comment - 2018-09-02 09:40, Edited by Cyrille Le Clerc - 2018-09-02 09:41

Collapse comment: dan tran added a comment - 2018-09-02 11:03

Expand comment: dan tran added a comment - 2018-09-02 11:03

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-02 12:55, Edited by Cyrille Le Clerc - 2018-09-02 14:05

Expand comment: Cyrille Le Clerc added a comment - 2018-09-02 12:55, Edited by Cyrille Le Clerc - 2018-09-02 14:05

Collapse comment: dan tran added a comment - 2018-09-02 20:20, Edited by dan tran - 2018-09-02 21:55

Expand comment: dan tran added a comment - 2018-09-02 20:20, Edited by dan tran - 2018-09-02 21:55

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-02 21:09

Expand comment: Cyrille Le Clerc added a comment - 2018-09-02 21:09

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-02 21:27

Expand comment: Cyrille Le Clerc added a comment - 2018-09-02 21:27

Collapse comment: dan tran added a comment - 2018-09-02 21:40, Edited by dan tran - 2018-09-02 21:56

Expand comment: dan tran added a comment - 2018-09-02 21:40, Edited by dan tran - 2018-09-02 21:56

Collapse comment: dan tran added a comment - 2018-09-02 21:44, Edited by dan tran - 2018-09-02 21:45

Expand comment: dan tran added a comment - 2018-09-02 21:44, Edited by dan tran - 2018-09-02 21:45

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-02 21:59

Expand comment: Cyrille Le Clerc added a comment - 2018-09-02 21:59

Collapse comment: dan tran added a comment - 2018-09-02 22:16, Edited by dan tran - 2018-09-03 02:54

Expand comment: dan tran added a comment - 2018-09-02 22:16, Edited by dan tran - 2018-09-03 02:54

Collapse comment: dan tran added a comment - 2018-09-03 02:53

Expand comment: dan tran added a comment - 2018-09-03 02:53

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-03 08:46

Expand comment: Cyrille Le Clerc added a comment - 2018-09-03 08:46

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-03 17:19

Expand comment: Cyrille Le Clerc added a comment - 2018-09-03 17:19

Collapse comment: dan tran added a comment - 2018-09-03 17:31

Expand comment: dan tran added a comment - 2018-09-03 17:31

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-03 19:41

Expand comment: Cyrille Le Clerc added a comment - 2018-09-03 19:41

Collapse comment: dan tran added a comment - 2018-09-03 19:52

Expand comment: dan tran added a comment - 2018-09-03 19:52

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-03 19:53, Edited by Cyrille Le Clerc - 2018-09-03 20:55

Expand comment: Cyrille Le Clerc added a comment - 2018-09-03 19:53, Edited by Cyrille Le Clerc - 2018-09-03 20:55

Collapse comment: dan tran added a comment - 2018-09-03 22:53, Edited by dan tran - 2018-09-03 22:59

Expand comment: dan tran added a comment - 2018-09-03 22:53, Edited by dan tran - 2018-09-03 22:59

Collapse comment: dan tran added a comment - 2018-09-04 22:17

Expand comment: dan tran added a comment - 2018-09-04 22:17

Collapse comment: Cyrille Le Clerc added a comment - 2018-09-21 01:39

Expand comment: Cyrille Le Clerc added a comment - 2018-09-21 01:39

People

Dates