[JENKINS-7089] OutOfMemoryError while parsing 11 mb log file

Type: Bug
Resolution: Incomplete
Priority: Minor
Component/s: warnings-plugin
Labels:
- exception
- master
- slave
Environment:
Windows slave of Windows master, jenkins 1.509.2 master and slaves on Linux RHEL

Similar Issues:
Powered by SuggestiMate

Show

Hi, we got an exception while the Warning plugin is working. We tried increasing memory to 512mb with no luck.

Thanks

D:\eng\Projects\EAX\EASportsActive\EASportsActive2_0\bin>exit 0
[WARNINGS] Parsing warnings in console log...
ERROR: Publisher hudson.plugins.warnings.WarningsPublisher aborted due to exception
hudson.util.IOException2: remote file operation failed: D:\eng\Projects\EAX\Skate\SK83\hudson at hudson.remoting.Channel@1e87ba1:PCFARM19
at hudson.FilePath.act(FilePath.java:749)
at hudson.FilePath.act(FilePath.java:735)
at hudson.plugins.warnings.WarningsPublisher.perform(WarningsPublisher.java:213)
at hudson.plugins.analysis.core.HealthAwarePublisher.perform(HealthAwarePublisher.java:208)
at hudson.tasks.BuildStepMonitor$2.perform(BuildStepMonitor.java:27)
at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:601)
at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:580)
at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:558)
at hudson.model.Build$RunnerImpl.post2(Build.java:158)
at hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:528)
at hudson.model.Run.run(Run.java:1280)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
at hudson.model.ResourceController.execute(ResourceController.java:88)
at hudson.model.Executor.run(Executor.java:129)
Caused by: java.io.IOException: Remote call on PCFARM19 failed
at hudson.remoting.Channel.call(Channel.java:564)
at hudson.FilePath.act(FilePath.java:742)
... 13 more
Caused by: java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Unknown Source)
at java.io.ByteArrayOutputStream.write(Unknown Source)
at java.io.ObjectOutputStream$BlockDataOutputStream.drain(Unknown Source)
at java.io.ObjectOutputStream$BlockDataOutputStream.setBlockDataMode(Unknown Source)
at java.io.ObjectOutputStream.writeObject0(Unknown Source)
at java.io.ObjectOutputStream.writeObject(Unknown Source)
at hudson.remoting.UserRequest._serialize(UserRequest.java:151)
at hudson.remoting.UserRequest.serialize(UserRequest.java:160)
at hudson.remoting.UserRequest.perform(UserRequest.java:122)
at hudson.remoting.UserRequest.perform(UserRequest.java:48)
at hudson.remoting.Request$2.run(Request.java:270)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Notifying upstream projects of job completion
Finished: FAILURE

emanuelelhardt added a comment - 2010-08-13 00:37

we had the same out of memory exception.
I increased the memory on the master since it seemed to me that the parsing is done one the master. Is that correct?

In our case, the master is a windows xp machine, the slave runs on a Ubuntu 9.10 Linux.

emanuelelhardt added a comment - 2010-08-13 00:37 we had the same out of memory exception. I increased the memory on the master since it seemed to me that the parsing is done one the master. Is that correct? In our case, the master is a windows xp machine, the slave runs on a Ubuntu 9.10 Linux.

Ulli Hafner added a comment - 2010-08-13 01:14

Yes, parsing is done on the master.

Ulli Hafner added a comment - 2010-08-13 01:14 Yes, parsing is done on the master.

deccico added a comment - 2010-08-13 09:03

Hi, we also increase the memory in the master to 512 mb but the job continue failing while parsing.

deccico added a comment - 2010-08-13 09:03 Hi, we also increase the memory in the master to 512 mb but the job continue failing while parsing.

Ulli Hafner added a comment - 2010-08-15 14:21 - edited

How many warnings do you have? And what is the size of the log?

Ulli Hafner added a comment - 2010-08-15 14:21 - edited How many warnings do you have? And what is the size of the log?

emanuelelhardt added a comment - 2010-08-15 23:36

I don't know the number of warnings but the log file summed up to about 550 MB.

emanuelelhardt added a comment - 2010-08-15 23:36 I don't know the number of warnings but the log file summed up to about 550 MB.

Ulli Hafner added a comment - 2010-08-16 00:57

@emanuelelhardt: did increasing the memory help?

Ulli Hafner added a comment - 2010-08-16 00:57 @emanuelelhardt: did increasing the memory help?

Ulli Hafner added a comment - 2010-08-16 00:59

BTW: Which parsers are you using? Some parsers read the whole file so it is clear that using a max memory restriction of 512MB for a file that is 550MB will fail...

Ulli Hafner added a comment - 2010-08-16 00:59 BTW: Which parsers are you using? Some parsers read the whole file so it is clear that using a max memory restriction of 512MB for a file that is 550MB will fail...

Ulli Hafner added a comment - 2010-09-16 13:02

Please provide more information (see previous comments).

Can you also check if increasing the memory to e.g. 2GByte will help.

Ulli Hafner added a comment - 2010-09-16 13:02 Please provide more information (see previous comments). Can you also check if increasing the memory to e.g. 2GByte will help.

vdupain added a comment - 2013-07-24 09:19

We have the same issue: OutOfMemoryError.
Build was successfull whereas there are tests failures.
In one of the surefire-reports directory, there is more than 400 Mb of files.

Workaround was to add more memory to the job (-Xmx2048m to MAVEN_OPTS).

[ERROR] There are test failures.

Please refer to /data/jenkins-agents/local-slave-2/workspace/MEZZO-pdo-100pro-ps-ci/pdo-100pro-ps-mediation/target/surefire-reports for the individual test results.
[JENKINS] Recording test results
java.io.IOException: Remote call on channel failed
        at hudson.remoting.Channel.call(Channel.java:681)
        at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158)
        at $Proxy2.execute(Unknown Source)
        at hudson.maven.MavenBuildProxy$Filter.execute(MavenBuildProxy.java:191)
        at hudson.maven.reporters.SurefireArchiver.postExecute(SurefireArchiver.java:160)
        at hudson.maven.Maven3Builder$MavenExecutionListener.recordMojoEnded(Maven3Builder.java:453)
        at hudson.maven.Maven3Builder$MavenExecutionListener.mojoSucceeded(Maven3Builder.java:435)
        at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:87)
        at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:42)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:228)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
        at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
        at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
        at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329)
        at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239)
        at org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158)
        at hudson.maven.Maven3Builder.call(Maven3Builder.java:100)
        at hudson.maven.Maven3Builder.call(Maven3Builder.java:66)
        at hudson.remoting.UserRequest.perform(UserRequest.java:118)
        at hudson.remoting.UserRequest.perform(UserRequest.java:48)
        at hudson.remoting.Request$2.run(Request.java:326)
        at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:662)
Caused by: java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOf(Arrays.java:2786)
        at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
        at java.io.ObjectOutputStream$BlockDataOutputStream.drain(ObjectOutputStream.java:1847)
        at java.io.ObjectOutputStream$BlockDataOutputStream.setBlockDataMode(ObjectOutputStream.java:1756)
        at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1169)
        at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:330)
        at hudson.remoting.UserRequest._serialize(UserRequest.java:155)
        at hudson.remoting.UserRequest.serialize(UserRequest.java:164)
        at hudson.remoting.UserRequest.<init>(UserRequest.java:62)
        at hudson.remoting.Channel.call(Channel.java:671)
        at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158)
        at $Proxy2.execute(Unknown Source)
        at hudson.maven.MavenBuildProxy$Filter.execute(MavenBuildProxy.java:191)
        at hudson.maven.reporters.SurefireArchiver.postExecute(SurefireArchiver.java:160)
        at hudson.maven.Maven3Builder$MavenExecutionListener.recordMojoEnded(Maven3Builder.java:453)
        at hudson.maven.Maven3Builder$MavenExecutionListener.mojoSucceeded(Maven3Builder.java:435)
        at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:87)
        at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:42)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:228)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
        at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
        at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
        at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
        at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
        at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
        at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)

vdupain added a comment - 2013-07-24 09:19 We have the same issue: OutOfMemoryError. Build was successfull whereas there are tests failures. In one of the surefire-reports directory, there is more than 400 Mb of files. Workaround was to add more memory to the job (-Xmx2048m to MAVEN_OPTS). [ERROR] There are test failures. Please refer to /data/jenkins-agents/local-slave-2/workspace/MEZZO-pdo-100pro-ps-ci/pdo-100pro-ps-mediation/target/surefire-reports for the individual test results. [JENKINS] Recording test results java.io.IOException: Remote call on channel failed at hudson.remoting.Channel.call(Channel.java:681) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158) at $Proxy2.execute(Unknown Source) at hudson.maven.MavenBuildProxy$Filter.execute(MavenBuildProxy.java:191) at hudson.maven.reporters.SurefireArchiver.postExecute(SurefireArchiver.java:160) at hudson.maven.Maven3Builder$MavenExecutionListener.recordMojoEnded(Maven3Builder.java:453) at hudson.maven.Maven3Builder$MavenExecutionListener.mojoSucceeded(Maven3Builder.java:435) at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:87) at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:42) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:228) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239) at org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158) at hudson.maven.Maven3Builder.call(Maven3Builder.java:100) at hudson.maven.Maven3Builder.call(Maven3Builder.java:66) at hudson.remoting.UserRequest.perform(UserRequest.java:118) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:326) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang. Thread .run( Thread .java:662) Caused by: java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2786) at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94) at java.io.ObjectOutputStream$BlockDataOutputStream.drain(ObjectOutputStream.java:1847) at java.io.ObjectOutputStream$BlockDataOutputStream.setBlockDataMode(ObjectOutputStream.java:1756) at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1169) at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:330) at hudson.remoting.UserRequest._serialize(UserRequest.java:155) at hudson.remoting.UserRequest.serialize(UserRequest.java:164) at hudson.remoting.UserRequest.<init>(UserRequest.java:62) at hudson.remoting.Channel.call(Channel.java:671) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:158) at $Proxy2.execute(Unknown Source) at hudson.maven.MavenBuildProxy$Filter.execute(MavenBuildProxy.java:191) at hudson.maven.reporters.SurefireArchiver.postExecute(SurefireArchiver.java:160) at hudson.maven.Maven3Builder$MavenExecutionListener.recordMojoEnded(Maven3Builder.java:453) at hudson.maven.Maven3Builder$MavenExecutionListener.mojoSucceeded(Maven3Builder.java:435) at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:87) at org.apache.maven.lifecycle.internal.DefaultExecutionEventCatapult.fire(DefaultExecutionEventCatapult.java:42) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:228) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59) at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156) at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597)

Ulli Hafner added a comment - 2013-07-24 21:53

Please create a new issue, this issue is for the warnings plug-in. Your problem is in the test report.

Ulli Hafner added a comment - 2013-07-24 21:53 Please create a new issue, this issue is for the warnings plug-in. Your problem is in the test report.

Assignee:: Ulli Hafner

Reporter:: deccico

Votes:: 3 Vote for this issue

Watchers:: 7 Start watching this issue

Created:: 2010-07-29 06:34

Updated:: 2013-07-24 21:53

Resolved:: 2013-07-24 21:53

Jenkins

Details

Description

Attachments

Activity

Collapse comment: emanuelelhardt added a comment - 2010-08-13 00:37

Expand comment: emanuelelhardt added a comment - 2010-08-13 00:37

Collapse comment: Ulli Hafner added a comment - 2010-08-13 01:14

Expand comment: Ulli Hafner added a comment - 2010-08-13 01:14

Collapse comment: deccico added a comment - 2010-08-13 09:03

Expand comment: deccico added a comment - 2010-08-13 09:03

Collapse comment: Ulli Hafner added a comment - 2010-08-15 14:21, Edited by Ulli Hafner - 2010-08-15 14:22

Expand comment: Ulli Hafner added a comment - 2010-08-15 14:21, Edited by Ulli Hafner - 2010-08-15 14:22

Collapse comment: emanuelelhardt added a comment - 2010-08-15 23:36

Expand comment: emanuelelhardt added a comment - 2010-08-15 23:36

Collapse comment: Ulli Hafner added a comment - 2010-08-16 00:57

Expand comment: Ulli Hafner added a comment - 2010-08-16 00:57

Collapse comment: Ulli Hafner added a comment - 2010-08-16 00:59

Expand comment: Ulli Hafner added a comment - 2010-08-16 00:59

Collapse comment: Ulli Hafner added a comment - 2010-09-16 13:02

Expand comment: Ulli Hafner added a comment - 2010-09-16 13:02

Collapse comment: vdupain added a comment - 2013-07-24 09:19

Expand comment: vdupain added a comment - 2013-07-24 09:19

Collapse comment: Ulli Hafner added a comment - 2013-07-24 21:53

Expand comment: Ulli Hafner added a comment - 2013-07-24 21:53

People

Dates