[JENKINS-45750] GitBlamer causes OutOfMemoryError

Type: Bug
Resolution: Fixed
Priority: Major
Component/s: analysis-core-plugin, tasks-plugin, warnings-plugin
Labels:
None
Environment:
Jenkins ver. 2.46.2, Task Scanner Plugin 4.52 and Warnings Plugin 4.63, Linux x86

Similar Issues:
Powered by SuggestiMate

Show
Released As:
5.0.0-beta3

After updating to the Task Scanner Plugin 4.52 and Warnings Plugin 4.63 I get an OutOfMemory Error when GitBlamer is used to create author and commit information. This change was introduced by ~~~~JENKINS-6748~~.~~

The repository is large but by no means too large:

$ du -hs .
668M .
$ git count-objects --human-readable
247 objects, 169.25 KiB
$ git rev-list --all --count
25881

This is an example error thrown by the Task Scanner Plugin:

[TASKS] Scanning folder '/my/workspace' for files matching the pattern '**/*.java' - excludes: 
[TASKS] Found 4657 files to scan for tasks
[TASKS] Found 1058 open tasks.
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=1a23b8068bf1226fd62085036db6bb30a0edea55, workspace=/my/workspace
 > git rev-parse 1a23b8068bf1226fd62085036db6bb30a0edea55^{commit} # timeout=10
FATAL: Java heap space
java.lang.OutOfMemoryError: Java heap space
 at org.eclipse.jgit.internal.storage.file.PackFile.read(PackFile.java:693)
 at org.eclipse.jgit.internal.storage.file.WindowCache.load(WindowCache.java:289)
 at org.eclipse.jgit.internal.storage.file.WindowCache.getOrLoad(WindowCache.java:368)
 at org.eclipse.jgit.internal.storage.file.WindowCache.get(WindowCache.java:179)
 at org.eclipse.jgit.internal.storage.file.WindowCursor.pin(WindowCursor.java:336)
 at org.eclipse.jgit.internal.storage.file.WindowCursor.copy(WindowCursor.java:237)
 at org.eclipse.jgit.internal.storage.file.PackFile.readFully(PackFile.java:592)
 at org.eclipse.jgit.internal.storage.file.PackFile.load(PackFile.java:767)
 at org.eclipse.jgit.internal.storage.file.PackFile.get(PackFile.java:273)
 at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openPackedObject(ObjectDirectory.java:421)
 at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openPackedFromSelfOrAlternate(ObjectDirectory.java:390)
 at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openObject(ObjectDirectory.java:382)
 at org.eclipse.jgit.internal.storage.file.WindowCursor.open(WindowCursor.java:154)
 at org.eclipse.jgit.treewalk.CanonicalTreeParser.reset(CanonicalTreeParser.java:214)
 at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator0(CanonicalTreeParser.java:248)
 at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator(CanonicalTreeParser.java:226)
 at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator(CanonicalTreeParser.java:70)
 at org.eclipse.jgit.treewalk.TreeWalk.enterSubtree(TreeWalk.java:1210)
 at org.eclipse.jgit.treewalk.TreeWalk.next(TreeWalk.java:828)
 at org.eclipse.jgit.blame.BlameGenerator.find(BlameGenerator.java:955)
 at org.eclipse.jgit.blame.BlameGenerator.processOne(BlameGenerator.java:603)
 at org.eclipse.jgit.blame.BlameGenerator.next(BlameGenerator.java:496)
 at org.eclipse.jgit.blame.BlameResult.computeAll(BlameResult.java:239)
 at org.eclipse.jgit.blame.BlameGenerator.computeBlameResult(BlameGenerator.java:450)
 at org.eclipse.jgit.api.BlameCommand.call(BlameCommand.java:230)
 at hudson.plugins.analysis.util.GitBlamer$BlameCallback.invoke(GitBlamer.java:130)
 at hudson.plugins.analysis.util.GitBlamer$BlameCallback.invoke(GitBlamer.java:104)
 at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.withRepository(AbstractGitAPIImpl.java:29)
 at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.withRepository(CliGitAPIImpl.java:71)
 at hudson.plugins.analysis.util.GitBlamer.loadBlameResultsForFiles(GitBlamer.java:61)
 at hudson.plugins.analysis.util.GitBlamer.blame(GitBlamer.java:54)
 at hudson.plugins.analysis.util.AbstractBlamer$1.invoke(AbstractBlamer.java:62)

is duplicated by

JENKINS-46641 Git Blame kills slave (memory overload)

Resolved

JENKINS-46357 OutOfMemoryError since upgrade to 3.49

Resolved

Philipp Moeller created issue - 2017-07-24 10:46

Philipp Moeller made changes - 2017-07-24 10:46

Issue Type

Original: Improvement [ 4 ]

New: Bug [ 1 ]

Philipp Moeller made changes - 2017-07-24 10:49

Description

Original: After updating to the Task Scanner Plugin 4.52 and Warnings Plugin 4.63 I get an OutOfMemory Error when GitBlamer is used to create author and commit information.

The repository is large but by no means too large:

{code:java}
$ du -hs .
668M .
$ git count-objects --human-readable
247 objects, 169.25 KiB
$ git rev-list --all --count
25881
{code}
This is an example error thrown by the Task Scanner Plugin:
{code:java}
[TASKS] Scanning folder '/my/workspace' for files matching the pattern '**/*.java' - excludes:
[TASKS] Found 4657 files to scan for tasks
[TASKS] Found 1058 open tasks.
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=1a23b8068bf1226fd62085036db6bb30a0edea55, workspace=/my/workspace
> git rev-parse 1a23b8068bf1226fd62085036db6bb30a0edea55^{commit} # timeout=10
FATAL: Java heap space
java.lang.OutOfMemoryError: Java heap space
at org.eclipse.jgit.internal.storage.file.PackFile.read(PackFile.java:693)
at org.eclipse.jgit.internal.storage.file.WindowCache.load(WindowCache.java:289)
at org.eclipse.jgit.internal.storage.file.WindowCache.getOrLoad(WindowCache.java:368)
at org.eclipse.jgit.internal.storage.file.WindowCache.get(WindowCache.java:179)
at org.eclipse.jgit.internal.storage.file.WindowCursor.pin(WindowCursor.java:336)
at org.eclipse.jgit.internal.storage.file.WindowCursor.copy(WindowCursor.java:237)
at org.eclipse.jgit.internal.storage.file.PackFile.readFully(PackFile.java:592)
at org.eclipse.jgit.internal.storage.file.PackFile.load(PackFile.java:767)
at org.eclipse.jgit.internal.storage.file.PackFile.get(PackFile.java:273)
at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openPackedObject(ObjectDirectory.java:421)
at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openPackedFromSelfOrAlternate(ObjectDirectory.java:390)
at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openObject(ObjectDirectory.java:382)
at org.eclipse.jgit.internal.storage.file.WindowCursor.open(WindowCursor.java:154)
at org.eclipse.jgit.treewalk.CanonicalTreeParser.reset(CanonicalTreeParser.java:214)
at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator0(CanonicalTreeParser.java:248)
at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator(CanonicalTreeParser.java:226)
at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator(CanonicalTreeParser.java:70)
at org.eclipse.jgit.treewalk.TreeWalk.enterSubtree(TreeWalk.java:1210)
at org.eclipse.jgit.treewalk.TreeWalk.next(TreeWalk.java:828)
at org.eclipse.jgit.blame.BlameGenerator.find(BlameGenerator.java:955)
at org.eclipse.jgit.blame.BlameGenerator.processOne(BlameGenerator.java:603)
at org.eclipse.jgit.blame.BlameGenerator.next(BlameGenerator.java:496)
at org.eclipse.jgit.blame.BlameResult.computeAll(BlameResult.java:239)
at org.eclipse.jgit.blame.BlameGenerator.computeBlameResult(BlameGenerator.java:450)
at org.eclipse.jgit.api.BlameCommand.call(BlameCommand.java:230)
at hudson.plugins.analysis.util.GitBlamer$BlameCallback.invoke(GitBlamer.java:130)
at hudson.plugins.analysis.util.GitBlamer$BlameCallback.invoke(GitBlamer.java:104)
at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.withRepository(AbstractGitAPIImpl.java:29)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.withRepository(CliGitAPIImpl.java:71)
at hudson.plugins.analysis.util.GitBlamer.loadBlameResultsForFiles(GitBlamer.java:61)
at hudson.plugins.analysis.util.GitBlamer.blame(GitBlamer.java:54)
at hudson.plugins.analysis.util.AbstractBlamer$1.invoke(AbstractBlamer.java:62){code}

New: After updating to the Task Scanner Plugin 4.52 and Warnings Plugin 4.63 I get an OutOfMemory Error when GitBlamer is used to create author and commit information. This change was introduced by -~~JENKINS-6748~~.-

The repository is large but by no means too large:

{code:java}
$ du -hs .
668M .
$ git count-objects --human-readable
247 objects, 169.25 KiB
$ git rev-list --all --count
25881
{code}
This is an example error thrown by the Task Scanner Plugin:
{code:java}
[TASKS] Scanning folder '/my/workspace' for files matching the pattern '**/*.java' - excludes:
[TASKS] Found 4657 files to scan for tasks
[TASKS] Found 1058 open tasks.
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=1a23b8068bf1226fd62085036db6bb30a0edea55, workspace=/my/workspace
> git rev-parse 1a23b8068bf1226fd62085036db6bb30a0edea55^{commit} # timeout=10
FATAL: Java heap space
java.lang.OutOfMemoryError: Java heap space
at org.eclipse.jgit.internal.storage.file.PackFile.read(PackFile.java:693)
at org.eclipse.jgit.internal.storage.file.WindowCache.load(WindowCache.java:289)
at org.eclipse.jgit.internal.storage.file.WindowCache.getOrLoad(WindowCache.java:368)
at org.eclipse.jgit.internal.storage.file.WindowCache.get(WindowCache.java:179)
at org.eclipse.jgit.internal.storage.file.WindowCursor.pin(WindowCursor.java:336)
at org.eclipse.jgit.internal.storage.file.WindowCursor.copy(WindowCursor.java:237)
at org.eclipse.jgit.internal.storage.file.PackFile.readFully(PackFile.java:592)
at org.eclipse.jgit.internal.storage.file.PackFile.load(PackFile.java:767)
at org.eclipse.jgit.internal.storage.file.PackFile.get(PackFile.java:273)
at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openPackedObject(ObjectDirectory.java:421)
at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openPackedFromSelfOrAlternate(ObjectDirectory.java:390)
at org.eclipse.jgit.internal.storage.file.ObjectDirectory.openObject(ObjectDirectory.java:382)
at org.eclipse.jgit.internal.storage.file.WindowCursor.open(WindowCursor.java:154)
at org.eclipse.jgit.treewalk.CanonicalTreeParser.reset(CanonicalTreeParser.java:214)
at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator0(CanonicalTreeParser.java:248)
at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator(CanonicalTreeParser.java:226)
at org.eclipse.jgit.treewalk.CanonicalTreeParser.createSubtreeIterator(CanonicalTreeParser.java:70)
at org.eclipse.jgit.treewalk.TreeWalk.enterSubtree(TreeWalk.java:1210)
at org.eclipse.jgit.treewalk.TreeWalk.next(TreeWalk.java:828)
at org.eclipse.jgit.blame.BlameGenerator.find(BlameGenerator.java:955)
at org.eclipse.jgit.blame.BlameGenerator.processOne(BlameGenerator.java:603)
at org.eclipse.jgit.blame.BlameGenerator.next(BlameGenerator.java:496)
at org.eclipse.jgit.blame.BlameResult.computeAll(BlameResult.java:239)
at org.eclipse.jgit.blame.BlameGenerator.computeBlameResult(BlameGenerator.java:450)
at org.eclipse.jgit.api.BlameCommand.call(BlameCommand.java:230)
at hudson.plugins.analysis.util.GitBlamer$BlameCallback.invoke(GitBlamer.java:130)
at hudson.plugins.analysis.util.GitBlamer$BlameCallback.invoke(GitBlamer.java:104)
at org.jenkinsci.plugins.gitclient.AbstractGitAPIImpl.withRepository(AbstractGitAPIImpl.java:29)
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.withRepository(CliGitAPIImpl.java:71)
at hudson.plugins.analysis.util.GitBlamer.loadBlameResultsForFiles(GitBlamer.java:61)
at hudson.plugins.analysis.util.GitBlamer.blame(GitBlamer.java:54)
at hudson.plugins.analysis.util.AbstractBlamer$1.invoke(AbstractBlamer.java:62){code}

Ulli Hafner made changes - 2017-08-23 11:57

Link

New: This issue is duplicated by ~~JENKINS-46357~~ [ ~~JENKINS-46357~~ ]

Ulli Hafner made changes - 2017-09-05 09:53

Link

New: This issue is duplicated by ~~JENKINS-46641~~ [ ~~JENKINS-46641~~ ]

Ulli Hafner made changes - 2017-09-05 09:53

Summary

Original: GitBlamer causes OutOfMemoryError on reasonably sized repository since Task Scanner Plugin 4.52 and Warnings Plugin 4.63

New: GitBlamer causes OutOfMemoryError

Ulli Hafner made changes - 2018-10-02 23:17

Resolution		New: Fixed [ 1 ]
Status	Original: Open [ 1 ]	New: Fixed but Unreleased [ 10203 ]

Ulli Hafner made changes - 2018-10-05 08:39

Released As		New: 5.0.0-beta3
Status	Original: Fixed but Unreleased [ 10203 ]	New: Resolved [ 5 ]

Assignee:: Ulli Hafner

Reporter:: Philipp Moeller

Votes:: 5 Vote for this issue

Watchers:: 11 Start watching this issue

Created:: 2017-07-24 10:46

Updated:: 2018-10-05 08:39

Resolved:: 2018-10-02 23:17

Jenkins

Details

Description

Attachments

Issue Links

Activity

People

Dates