Kevin Huber added a comment - 2021-02-09 07:27 I've already recreated the database earlier with 3.9.x an it got slower as the database startet to grow. Nontheless i've recreated the database again, this is what i have done: Install the hpi provided in this Jira issue Stopped Jenkins Recreated the database using the dropdb and createdb commands Started Jenkins Created the indexes manually as the hpi does not contain your fix yet I'm now triggering some builds and will let the plugin run for a week. Last time it took around 4 days to trigger the issue. I'll keep you updated as the database grows in size.

benoit guerin added a comment - 2021-02-09 07:57 > Created the indexes manually as the hpi does not contain your fix yet Right ... sorry, I just uploaded a new HPI to this issue   Many thanks again for your tests. I am interested by a new dump of your database (started from scratch, with only the 3.9 plugin) once the issue triggers Could you also provide the spy log (See https://github.com/jenkinsci/pipeline-maven-plugin/blob/master/FAQ.adoc#how-do-i-capture-the-log-file-generated-by-the-jenkins-maven-event-spy)  for one build triggering others, one with the 3.8 plugin and another one with the 3.9 ?

Kevin Huber added a comment - 2021-02-18 15:28 - edited 9 days have been passed since i dropped the database and created a new one with the 3.10-SNAPSHOT version of the plugin. The trigger is now running around 7.555.251 ms (~2 hours) again. I've send you the sql dump as an e-mail. I've tried to save the spy logs through adding writeFile file: '.archive-jenkins-maven-event-spy-logs', text: '' to my pipeline, unfortunately, this caused the pipeline to hang. Some background to my setup: 1 Master Instance (0 build executors) 6 Slave Instances (1 build executor for each slave) Pipeline: Three separate maven steps for compiling, testing and deploying I enabled the spy log for the deploy stage but as soon as the file should have been transfered to the master the jobs hung up (i also tried to enable them in the other stages but the result was the same). I've attached the thread dump of the master process to this issue. This is the output after the job has been canceled: [INFO] [jenkins-event-spy] Generated /data/jenkins/workspace/on_integration_develop_current_2@tmp/withMaven0cedcb4c/maven-spy-20210218-111559-605226699638201085421.log [Pipeline] writeFile [Pipeline] } ERROR: [withMaven] WARNING Exception archiving Maven build logs /var/data/jenkins/workspace/on_integration_develop_current_2@tmp/withMaven0cedcb4c/maven-spy-20210218-111559-605226699638201085421.log, skip file. java.lang.InterruptedException at java.lang.Object.wait(Native Method) at hudson.remoting.Request.call(Request.java:177) at hudson.remoting.Channel.call(Channel.java:1000) at hudson.FilePath.act(FilePath.java:1158) at hudson.FilePath.act(FilePath.java:1147) at hudson.FilePath.copyTo(FilePath.java:2478) at hudson.FilePath.copyTo(FilePath.java:2433) at org.jenkinsci.plugins.pipeline.maven.publishers.JenkinsMavenEventSpyLogsPublisher.process(JenkinsMavenEventSpyLogsPublisher.java:38) at org.jenkinsci.plugins.pipeline.maven.MavenSpyLogProcessor.processMavenSpyLogs(MavenSpyLogProcessor.java:128) at org.jenkinsci.plugins.pipeline.maven.WithMavenStepExecution2$WithMavenStepExecutionCallBack.finished(WithMavenStepExecution2.java:1097) at org.jenkinsci.plugins.workflow.steps.GeneralNonBlockingStepExecution$TailCall.lambda$onSuccess$0(GeneralNonBlockingStepExecution.java:140) at org.jenkinsci.plugins.workflow.steps.GeneralNonBlockingStepExecution.lambda$run$0(GeneralNonBlockingStepExecution.java:77) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) [Pipeline] // withMaven [Pipeline] } [Pipeline] // stage [Pipeline] } I've copied the log manually and attached it to the issue ( logs-and-dumps_18-02-2018.zip ). Please tell me if you really need the logs for 3.8 and if you need the logs for all three stages or just the last one. If you need them i'll try to figure out how i can save them manually before the workspace is wiped out after the build. Update Sorry, i used the wrong date in the name of the zip file. It should have been 2021 instead of 2018...

Niclas Behrendt added a comment - 2021-11-10 19:09 Hello, any chance that we can get a fix for this issue? We tried tuning the database on our side by creating indexes but unfortunately without success. It has severe impact on our builds. Some of them do take more than two hours to calculate all the jobs they need to trigger because they're checking the same downstream dependencies over and over again if multiple artifacts do have the same downstream dependents, and the queries are incredibly slow.

Benoit added a comment - 2021-12-28 11:28 Hello everyone here, Sorry for the - long - delay ... I found something, but it seems too stupid to be only that, so I need feedbacks please !!! You can find hpi here : https://ci.jenkins.io/job/Plugins/job/pipeline-maven-plugin/job/PR-323/ The pull request has been rebased on top of master, so you will get the edge version of the plugin, with all last fixes.