-
Bug
-
Resolution: Unresolved
-
Minor
-
None
-
Ubuntu 16.04.5 LTS (Xenial Xerus)
openjdk version "1.8.0_181"
p4 pluguin version: 1.9.5
Jenkins 2.138.3, run via:
/usr/bin/daemon --name=jenkins.qata --inherit --env=JENKINS_HOME=/var/lib/jenkins/qata --output=/var/log/jenkins/jenkins.qata.log --pidfile=/var/run/jenkins/qata.pid -- /usr/lib/jvm/java-1.8.0-openjdk-amd64/jre/bin/java -Djava.awt.headless=true -Xmx2048m -Djava.net.preferIPv4Stack=true -Djcifs.smb.client.disablePlainTextPasswords=false -Dhudson.security.csrf.requestfield=Jenkins-Crumb -DsessionTimeout=1440 -Dhudson.model.DirectoryBrowserSupport.CSP=default-src 'self'; img-src 'self' data: *; style-src 'self' 'unsafe-inline'; child-src 'self'; frame-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval'; frame-ancestors 'self' -jar /var/lib/jenkins/qata/jenkins.war --httpPort=8996 --prefix=/qata -Xdebug
jenkins+ 20411 1.7 4.6 8108212 1534816 ? Sl 2018 1404:00 \_ /usr/lib/jvm/java-1.8.0-openjdk-amd64/jre/bin/java -Djava.awt.headless=true -Xmx2048m -Djava.net.preferIPv4Stack=true -Djcifs.smb.client.disablePlainTextPasswords=false -Dhudson.security.csrf.requestfield=Jenkins-Crumb -DsessionTimeout=1440 -Dhudson.model.DirectoryBrowserSupport.CSP=default-src 'self'; img-src 'self' data: *; style-src 'self' 'unsafe-inline'; child-src 'self'; frame-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval'; frame-ancestors 'self' -jar /var/lib/jenkins/qata/jenkins.war --httpPort=8996 --prefix=/qata -XdebugUbuntu 16.04.5 LTS (Xenial Xerus) openjdk version "1.8.0_181" p4 pluguin version: 1.9.5 Jenkins 2.138.3, run via: /usr/bin/daemon --name=jenkins.qata --inherit --env=JENKINS_HOME=/var/lib/jenkins/qata --output=/var/log/jenkins/jenkins.qata.log --pidfile=/var/run/jenkins/qata.pid -- /usr/lib/jvm/java-1.8.0-openjdk-amd64/jre/bin/java -Djava.awt.headless=true -Xmx2048m -Djava.net.preferIPv4Stack=true -Djcifs.smb.client.disablePlainTextPasswords=false -Dhudson.security.csrf.requestfield=Jenkins-Crumb -DsessionTimeout=1440 -Dhudson.model.DirectoryBrowserSupport.CSP=default-src 'self'; img-src 'self' data: *; style-src 'self' 'unsafe-inline'; child-src 'self'; frame-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval'; frame-ancestors 'self' -jar /var/lib/jenkins/qata/jenkins.war --httpPort=8996 --prefix=/qata -Xdebug jenkins+ 20411 1.7 4.6 8108212 1534816 ? Sl 2018 1404:00 \_ /usr/lib/jvm/java-1.8.0-openjdk-amd64/jre/bin/java -Djava.awt.headless=true -Xmx2048m -Djava.net.preferIPv4Stack=true -Djcifs.smb.client.disablePlainTextPasswords=false -Dhudson.security.csrf.requestfield=Jenkins-Crumb -DsessionTimeout=1440 -Dhudson.model.DirectoryBrowserSupport.CSP=default-src 'self'; img-src 'self' data: *; style-src 'self' 'unsafe-inline'; child-src 'self'; frame-src 'self'; script-src 'self' 'unsafe-inline' 'unsafe-eval'; frame-ancestors 'self' -jar /var/lib/jenkins/qata/jenkins.war --httpPort=8996 --prefix=/qata -Xdebug
I have a job configured to poll perforce @hourly. One build was triggered by SCM change, but failed, because agent ran out of disk space. When I go to build screen, I see "Summary of changes" box with changeset details.
Shurtly after this failure, another build was triggered. Build screen also informs me, that build was triggered by SCM change, but there is no changeset box. This build failed immediately, because this failed on remote call to aforementioned agent. Few seconds after that the same situation occured. This happened 5 times during 2 minutes before I disabled the job and I suspect it would have kept going.
What and why did it happen? It looks like somehow jenkins did not get notified about build status of that particular perforce changeset. It constantly tried to re-build the same, failed changeset.
Below is call trace of second (and following) failed builds, but I doubt it's helpful, as it only informs about problems connecting agent.
Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on js-qata-u16 (hhqapve proxmox) in workspace /jenkins/qata/workspace/tfc-2016.07.28-submitted [WS-CLEANUP] Deleting project workspace... [WS-CLEANUP] Deferred wipeout is used... Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to js-qata-u16 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357) at hudson.remoting.Channel.call(Channel.java:955) at hudson.FilePath.act(FilePath.java:1071) at hudson.FilePath.act(FilePath.java:1060) at hudson.FilePath.mkdirs(FilePath.java:1245) at hudson.model.AbstractProject.checkout(AbstractProject.java:1202) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499) at hudson.model.Run.execute(Run.java:1819) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) java.nio.file.FileSystemException: /jenkins/qata/workspace/tfc-2016.07.28-submitted: No space left on device at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at sun.nio.fs.UnixFileSystemProvider.createDirectory(UnixFileSystemProvider.java:384) at java.nio.file.Files.createDirectory(Files.java:674) at java.nio.file.Files.createAndCheckIsDirectory(Files.java:781) at java.nio.file.Files.createDirectories(Files.java:767) at hudson.FilePath.mkdirs(FilePath.java:3272) at hudson.FilePath.access$1300(FilePath.java:212) at hudson.FilePath$Mkdirs.invoke(FilePath.java:1253) at hudson.FilePath$Mkdirs.invoke(FilePath.java:1249) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3085) at hudson.remoting.UserRequest.perform(UserRequest.java:212) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Archiving artifacts ERROR: Build step failed with exception Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to js-qata-u16 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357) at hudson.remoting.Channel.call(Channel.java:955) at hudson.FilePath.act(FilePath.java:1071) at hudson.FilePath.act(FilePath.java:1060) at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:233) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690) at hudson.model.Build$BuildExecution.post2(Build.java:186) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635) at hudson.model.Run.execute(Run.java:1844) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) /jenkins/qata/workspace/tfc-2016.07.28-submitted does not exist. at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:484) at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:461) at hudson.tasks.ArtifactArchiver$ListFiles.invoke(ArtifactArchiver.java:288) at hudson.tasks.ArtifactArchiver$ListFiles.invoke(ArtifactArchiver.java:268) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3085) at hudson.remoting.UserRequest.perform(UserRequest.java:212) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Build step 'Archive the artifacts' marked build as failure [Cobertura] Publishing Cobertura coverage report... FATAL: Unable to find coverage results java.io.IOException: /jenkins/qata/workspace/tfc-2016.07.28-submitted does not exist. at hudson.FilePath.glob(FilePath.java:1961) at hudson.FilePath.access$3400(FilePath.java:212) at hudson.FilePath$ListGlob.invoke(FilePath.java:1935) at hudson.FilePath$ListGlob.invoke(FilePath.java:1923) at hudson.FilePath.act(FilePath.java:1077) at hudson.FilePath.act(FilePath.java:1060) at hudson.FilePath.list(FilePath.java:1921) at hudson.FilePath.list(FilePath.java:1905) at hudson.FilePath.list(FilePath.java:1890) at hudson.plugins.cobertura.CoberturaPublisher$ParseReportCallable.invoke(CoberturaPublisher.java:846) at hudson.plugins.cobertura.CoberturaPublisher$ParseReportCallable.invoke(CoberturaPublisher.java:835) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3085) at hudson.remoting.UserRequest.perform(UserRequest.java:212) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to js-qata-u16 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357) at hudson.remoting.Channel.call(Channel.java:955) at hudson.FilePath.act(FilePath.java:1071) at hudson.FilePath.act(FilePath.java:1060) at hudson.plugins.cobertura.CoberturaPublisher.perform(CoberturaPublisher.java:547) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690) at hudson.model.Build$BuildExecution.post2(Build.java:186) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635) at hudson.model.Run.execute(Run.java:1844) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) ERROR: Step ‘Publish Cobertura Coverage Report’ failed: [Cobertura] Unable to find coverage results Recording test results ERROR: Build step failed with exception Also: hudson.remoting.Channel$CallSiteStackTrace: Remote call to js-qata-u16 at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1741) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:357) at hudson.remoting.Channel.call(Channel.java:955) at hudson.FilePath.act(FilePath.java:1071) at hudson.FilePath.act(FilePath.java:1060) at hudson.tasks.junit.JUnitParser.parseResult(JUnitParser.java:114) at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:137) at hudson.tasks.junit.JUnitResultArchiver.parseAndAttach(JUnitResultArchiver.java:167) at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:154) at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690) at hudson.model.Build$BuildExecution.post2(Build.java:186) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635) at hudson.model.Run.execute(Run.java:1844) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) /jenkins/qata/workspace/tfc-2016.07.28-submitted does not exist. at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:484) at org.apache.tools.ant.types.AbstractFileSet.getDirectoryScanner(AbstractFileSet.java:461) at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:141) at hudson.tasks.junit.JUnitParser$ParseResultCallable.invoke(JUnitParser.java:118) at hudson.FilePath$FileCallableWrapper.call(FilePath.java:3085) at hudson.remoting.UserRequest.perform(UserRequest.java:212) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Build step 'Publish JUnit test result report' marked build as failure [Current build status] check if current [FAILURE] is worse or equals then [SUCCESS] and better or equals then [SUCCESS] Run condition [And] preventing perform for step [[Send build artifacts over SSH]] Email was triggered for: Always Email was triggered for: Failure - Any Sending email for trigger: Failure - Any FAILURE Trigger is not null Finished: FAILURE