Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-15652

ArrayIndexOutOfBoundsException from AbstractLazyLoadRunMap.search

      Hello,

      Our Jenkins instance (1.487 - latest at the time of writing) runs as a Windows service on Windows XP and has 2 slaves running on similar boxes. I came in Monday morning to find all executors on all 3 boxes "Dead". When I clicked to see why they were dead I was greeted by this message:

      Caught exception evaluating: item.isStuck(). Reason: java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #749 DESC: lo=39,hi=38,size=39,size2=39

      When I looked in the logs I found the following sequence of stack traces repeated countless times, for the past few hours.

      Any ideas?

      Yannis

      29-Oct-2012 09:16:16 hudson.ExpressionFactory2$JexlExpression evaluate
      WARNING: Caught exception evaluating: item.isStuck(). Reason: java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #749 DESC: lo=39,hi=38,size=39,size2=39
      java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #749 DESC: lo=39,hi=38,size=39,size2=39
      at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418)
      at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:210)
      at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:103)
      at hudson.model.Job.getLastBuildsOverThreshold(Job.java:812)
      at hudson.model.Job.getEstimatedDuration(Job.java:819)
      at hudson.model.Queue$BuildableItem.isStuck(Queue.java:1651)
      at sun.reflect.GeneratedMethodAccessor253.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.commons.jexl.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:258)
      at org.apache.commons.jexl.parser.ASTMethod.execute(ASTMethod.java:104)
      at org.apache.commons.jexl.parser.ASTReference.execute(ASTReference.java:83)
      at org.apache.commons.jexl.parser.ASTReference.value(ASTReference.java:57)
      at org.apache.commons.jexl.parser.ASTReferenceExpression.value(ASTReferenceExpression.java:51)
      at org.apache.commons.jexl.ExpressionImpl.evaluate(ExpressionImpl.java:80)
      at hudson.ExpressionFactory2$JexlExpression.evaluate(ExpressionFactory2.java:72)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$3.run(CoreTagLibrary.java:134)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:161)
      at org.apache.commons.jelly.tags.core.ForEachTag.doTag(ForEachTag.java:150)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:161)
      at org.apache.commons.jelly.tags.core.OtherwiseTag.doTag(OtherwiseTag.java:41)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:161)
      at org.apache.commons.jelly.tags.core.ChooseTag.doTag(ChooseTag.java:38)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.CallTagLibScript$1.run(CallTagLibScript.java:98)
      at org.apache.commons.jelly.tags.define.InvokeBodyTag.doTag(InvokeBodyTag.java:91)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.CallTagLibScript.run(CallTagLibScript.java:119)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.CallTagLibScript.run(CallTagLibScript.java:119)
      at org.kohsuke.stapler.jelly.CallTagLibScript$1.run(CallTagLibScript.java:98)
      at org.apache.commons.jelly.tags.define.InvokeBodyTag.doTag(InvokeBodyTag.java:91)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:161)
      at org.apache.commons.jelly.tags.core.OtherwiseTag.doTag(OtherwiseTag.java:41)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:161)
      at org.apache.commons.jelly.tags.core.ChooseTag.doTag(ChooseTag.java:38)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.CallTagLibScript.run(CallTagLibScript.java:119)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.JellyViewScript.run(JellyViewScript.java:81)
      at org.kohsuke.stapler.jelly.DefaultScriptInvoker.invokeScript(DefaultScriptInvoker.java:63)
      at org.kohsuke.stapler.jelly.DefaultScriptInvoker.invokeScript(DefaultScriptInvoker.java:53)
      at org.kohsuke.stapler.jelly.JellyFacet$1.dispatch(JellyFacet.java:95)
      at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:574)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:659)
      at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:625)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:659)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:488)
      at org.kohsuke.stapler.Stapler.service(Stapler.java:162)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:45)
      at winstone.ServletConfiguration.execute(ServletConfiguration.java:248)
      at winstone.RequestDispatcher.forward(RequestDispatcher.java:333)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:376)
      at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:95)
      at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:206)
      at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:179)
      at net.bull.javamelody.PluginMonitoringFilter.doFilter(PluginMonitoringFilter.java:86)
      at org.jvnet.hudson.plugins.monitoring.HudsonMonitoringFilter.doFilter(HudsonMonitoringFilter.java:84)
      at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:98)
      at hudson.plugins.greenballs.GreenBallFilter.doFilter(GreenBallFilter.java:58)
      at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:98)
      at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:87)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:47)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84)
      at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:76)
      at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:164)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at org.kohsuke.stapler.compression.CompressionFilter.doFilter(CompressionFilter.java:50)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at hudson.util.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:81)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at winstone.RequestDispatcher.forward(RequestDispatcher.java:331)
      at winstone.RequestHandlerThread.processRequest(RequestHandlerThread.java:215)
      at winstone.RequestHandlerThread.run(RequestHandlerThread.java:138)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
      at java.util.concurrent.FutureTask.run(FutureTask.java:138)
      at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:662)
      29-Oct-2012 09:16:16 jenkins.model.lazy.AbstractLazyLoadRunMap search
      WARNING: Assertion error: failing to load #749 DESC: lo=39,hi=38,size=39,size2=39
      java.lang.Exception
      at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:417)
      at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:210)
      at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:103)
      at hudson.model.Job.getLastBuildsOverThreshold(Job.java:812)
      at hudson.model.Job.getEstimatedDuration(Job.java:819)
      at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:320)
      at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:303)
      at hudson.model.Queue.maintain(Queue.java:1033)
      at hudson.model.Queue$MaintainTask.doRun(Queue.java:1759)
      at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:54)
      at java.util.TimerThread.mainLoop(Timer.java:512)
      at java.util.TimerThread.run(Timer.java:462)
      29-Oct-2012 09:16:16 hudson.triggers.SafeTimerTask run
      SEVERE: Timer task hudson.model.Queue$MaintainTask@1c2e53c failed
      java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #749 DESC: lo=39,hi=38,size=39,size2=39
      at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418)
      at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:210)
      at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:103)
      at hudson.model.Job.getLastBuildsOverThreshold(Job.java:812)
      at hudson.model.Job.getEstimatedDuration(Job.java:819)
      at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:320)
      at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:303)
      at hudson.model.Queue.maintain(Queue.java:1033)
      at hudson.model.Queue$MaintainTask.doRun(Queue.java:1759)
      at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:54)
      at java.util.TimerThread.mainLoop(Timer.java:512)
      at java.util.TimerThread.run(Timer.java:462)
      29-Oct-2012 09:16:16 jenkins.model.lazy.AbstractLazyLoadRunMap search
      WARNING: Assertion error: failing to load #749 DESC: lo=39,hi=38,size=39,size2=39
      java.lang.Exception
      at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:417)
      at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:210)
      at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:103)
      at hudson.model.Job.getLastBuildsOverThreshold(Job.java:812)
      at hudson.model.Job.getEstimatedDuration(Job.java:819)
      at hudson.model.Queue$BuildableItem.isStuck(Queue.java:1651)
      at sun.reflect.GeneratedMethodAccessor253.invoke(Unknown Source)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.commons.jexl.util.introspection.UberspectImpl$VelMethodImpl.invoke(UberspectImpl.java:258)
      at org.apache.commons.jexl.parser.ASTMethod.execute(ASTMethod.java:104)
      at org.apache.commons.jexl.parser.ASTReference.execute(ASTReference.java:83)
      at org.apache.commons.jexl.parser.ASTReference.value(ASTReference.java:57)
      at org.apache.commons.jexl.parser.ASTReferenceExpression.value(ASTReferenceExpression.java:51)
      at org.apache.commons.jexl.ExpressionImpl.evaluate(ExpressionImpl.java:80)
      at hudson.ExpressionFactory2$JexlExpression.evaluate(ExpressionFactory2.java:72)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$3.run(CoreTagLibrary.java:134)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:161)
      at org.apache.commons.jelly.tags.core.ForEachTag.doTag(ForEachTag.java:150)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:161)
      at org.apache.commons.jelly.tags.core.OtherwiseTag.doTag(OtherwiseTag.java:41)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.TagSupport.invokeBody(TagSupport.java:161)
      at org.apache.commons.jelly.tags.core.ChooseTag.doTag(ChooseTag.java:38)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.CallTagLibScript$1.run(CallTagLibScript.java:98)
      at org.apache.commons.jelly.tags.define.InvokeBodyTag.doTag(InvokeBodyTag.java:91)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.CallTagLibScript.run(CallTagLibScript.java:119)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.CallTagLibScript.run(CallTagLibScript.java:119)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.CallTagLibScript$1.run(CallTagLibScript.java:98)
      at org.apache.commons.jelly.tags.define.InvokeBodyTag.doTag(InvokeBodyTag.java:91)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$1.run(CoreTagLibrary.java:98)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.CallTagLibScript.run(CallTagLibScript.java:119)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.JellyViewScript.run(JellyViewScript.java:81)
      at org.kohsuke.stapler.jelly.IncludeTag.doTag(IncludeTag.java:146)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.CallTagLibScript$1.run(CallTagLibScript.java:98)
      at org.apache.commons.jelly.tags.define.InvokeBodyTag.doTag(InvokeBodyTag.java:91)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.kohsuke.stapler.jelly.ReallyStaticTagLibrary$1.run(ReallyStaticTagLibrary.java:99)
      at org.apache.commons.jelly.impl.ScriptBlock.run(ScriptBlock.java:95)
      at org.apache.commons.jelly.tags.core.CoreTagLibrary$2.run(CoreTagLibrary.java:105)
      at org.kohsuke.stapler.jelly.CallTagLibScript.run(CallTagLibScript.java:119)
      at org.kohsuke.stapler.jelly.CompressTag.doTag(CompressTag.java:44)
      at org.apache.commons.jelly.impl.TagScript.run(TagScript.java:269)
      at org.kohsuke.stapler.jelly.JellyViewScript.run(JellyViewScript.java:81)
      at org.kohsuke.stapler.jelly.DefaultScriptInvoker.invokeScript(DefaultScriptInvoker.java:63)
      at org.kohsuke.stapler.jelly.DefaultScriptInvoker.invokeScript(DefaultScriptInvoker.java:53)
      at org.kohsuke.stapler.jelly.JellyClassTearOff.serveIndexJelly(JellyClassTearOff.java:107)
      at org.kohsuke.stapler.jelly.JellyFacet.handleIndexRequest(JellyFacet.java:127)
      at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:563)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:659)
      at org.kohsuke.stapler.Stapler.tryInvoke(Stapler.java:625)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:659)
      at org.kohsuke.stapler.Stapler.invoke(Stapler.java:488)
      at org.kohsuke.stapler.Stapler.service(Stapler.java:162)
      at javax.servlet.http.HttpServlet.service(HttpServlet.java:45)
      at winstone.ServletConfiguration.execute(ServletConfiguration.java:248)
      at winstone.RequestDispatcher.forward(RequestDispatcher.java:333)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:376)
      at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:95)
      at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:206)
      at net.bull.javamelody.MonitoringFilter.doFilter(MonitoringFilter.java:179)
      at net.bull.javamelody.PluginMonitoringFilter.doFilter(PluginMonitoringFilter.java:86)
      at org.jvnet.hudson.plugins.monitoring.HudsonMonitoringFilter.doFilter(HudsonMonitoringFilter.java:84)
      at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:98)
      at hudson.plugins.greenballs.GreenBallFilter.doFilter(GreenBallFilter.java:58)
      at hudson.util.PluginServletFilter$1.doFilter(PluginServletFilter.java:98)
      at hudson.util.PluginServletFilter.doFilter(PluginServletFilter.java:87)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at hudson.security.csrf.CrumbFilter.doFilter(CrumbFilter.java:47)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at hudson.security.ChainedServletFilter$1.doFilter(ChainedServletFilter.java:84)
      at hudson.security.ChainedServletFilter.doFilter(ChainedServletFilter.java:76)
      at hudson.security.HudsonFilter.doFilter(HudsonFilter.java:164)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at org.kohsuke.stapler.compression.CompressionFilter.doFilter(CompressionFilter.java:50)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at hudson.util.CharacterEncodingFilter.doFilter(CharacterEncodingFilter.java:81)
      at winstone.FilterConfiguration.execute(FilterConfiguration.java:194)
      at winstone.RequestDispatcher.doFilter(RequestDispatcher.java:366)
      at winstone.RequestDispatcher.forward(RequestDispatcher.java:331)
      at winstone.RequestHandlerThread.processRequest(RequestHandlerThread.java:215)
      at winstone.RequestHandlerThread.run(RequestHandlerThread.java:138)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
      at java.util.concurrent.FutureTask.run(FutureTask.java:138)
      at winstone.BoundedExecutorService$1.run(BoundedExecutorService.java:77)
      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
      at java.lang.Thread.run(Thread.java:662)

          [JENKINS-15652] ArrayIndexOutOfBoundsException from AbstractLazyLoadRunMap.search

          Yannis Lionis created issue -

          Michael Glauche added a comment - - edited

          I'm having exactly the same issue with 1.487
          (running jenkins with jdk 1.6.0_27-b07, on 64bit Windows)

          Michael Glauche added a comment - - edited I'm having exactly the same issue with 1.487 (running jenkins with jdk 1.6.0_27-b07, on 64bit Windows)
          Andreas Zschorn made changes -
          Priority Original: Major [ 3 ] New: Critical [ 2 ]
          Andreas Zschorn made changes -
          Priority Original: Critical [ 2 ] New: Blocker [ 1 ]

          Joseph Benken added a comment -

          In 1.488, all my executors were dead. Stack trace from executors:

          java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #1449 EXACT: lo=9,hi=7,size=10,size2=10
          at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418)
          at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:502)
          at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:355)
          at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:210)
          at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:103)
          at hudson.model.Job.getLastBuildsOverThreshold(Job.java:812)
          at hudson.model.Job.getEstimatedDuration(Job.java:819)
          at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:320)
          at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:303)
          at hudson.model.Queue.maintain(Queue.java:1033)
          at hudson.model.Queue.pop(Queue.java:861)
          at hudson.model.Executor.grabJob(Executor.java:284)
          at hudson.model.Executor.run(Executor.java:205)

          Joseph Benken added a comment - In 1.488, all my executors were dead. Stack trace from executors: java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #1449 EXACT: lo=9,hi=7,size=10,size2=10 at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418) at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:502) at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:355) at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:210) at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:103) at hudson.model.Job.getLastBuildsOverThreshold(Job.java:812) at hudson.model.Job.getEstimatedDuration(Job.java:819) at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:320) at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:303) at hudson.model.Queue.maintain(Queue.java:1033) at hudson.model.Queue.pop(Queue.java:861) at hudson.model.Executor.grabJob(Executor.java:284) at hudson.model.Executor.run(Executor.java:205)

          Roger Scriven added a comment -

          I'm also having a similar issue which is really blocking progress on out CI setup. I'm using Windows Server 2008 R2 with Jenkins running as a service. The problems appeared to start when I upgraded to 1.488 and created new jobs to use the 'View map from file' feature of the Perforce plugin. I subsequently upgraded to 1.489 but have now rolled back to 1.488.

          Any suggestions/workarounds would be appreciated because our CI work is currently at a halt because of this.

          Roger

          Nov 9, 2012 9:10:27 AM hudson.triggers.SafeTimerTask run
          SEVERE: Timer task hudson.model.Queue$MaintainTask@1de2b1 failed
          java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #256 DESC: lo=11,hi=10,size=11,size2=11
          at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418)
          at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:207)
          at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:100)
          at hudson.model.Job.getLastBuildsOverThreshold(Job.java:813)
          at hudson.model.Job.getEstimatedDuration(Job.java:820)
          at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:320)
          at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:303)
          at hudson.model.Queue.maintain(Queue.java:1033)
          at hudson.model.Queue$MaintainTask.doRun(Queue.java:1759)
          at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:54)
          at java.util.TimerThread.mainLoop(Unknown Source)
          at java.util.TimerThread.run(Unknown Source)

          Nov 9, 2012 9:10:27 AM jenkins.model.lazy.AbstractLazyLoadRunMap search
          WARNING: Assertion error: failing to load #256 DESC: lo=11,hi=10,size=11,size2=11
          java.lang.Exception
          at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:417)
          at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:207)
          at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:100)
          at hudson.model.Job.getLastBuildsOverThreshold(Job.java:813)
          at hudson.model.Job.getEstimatedDuration(Job.java:820)

          Roger Scriven added a comment - I'm also having a similar issue which is really blocking progress on out CI setup. I'm using Windows Server 2008 R2 with Jenkins running as a service. The problems appeared to start when I upgraded to 1.488 and created new jobs to use the 'View map from file' feature of the Perforce plugin. I subsequently upgraded to 1.489 but have now rolled back to 1.488. Any suggestions/workarounds would be appreciated because our CI work is currently at a halt because of this. Roger Nov 9, 2012 9:10:27 AM hudson.triggers.SafeTimerTask run SEVERE: Timer task hudson.model.Queue$MaintainTask@1de2b1 failed java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #256 DESC: lo=11,hi=10,size=11,size2=11 at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418) at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:207) at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:100) at hudson.model.Job.getLastBuildsOverThreshold(Job.java:813) at hudson.model.Job.getEstimatedDuration(Job.java:820) at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:320) at hudson.model.queue.MappingWorksheet.<init>(MappingWorksheet.java:303) at hudson.model.Queue.maintain(Queue.java:1033) at hudson.model.Queue$MaintainTask.doRun(Queue.java:1759) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:54) at java.util.TimerThread.mainLoop(Unknown Source) at java.util.TimerThread.run(Unknown Source) Nov 9, 2012 9:10:27 AM jenkins.model.lazy.AbstractLazyLoadRunMap search WARNING: Assertion error: failing to load #256 DESC: lo=11,hi=10,size=11,size2=11 java.lang.Exception at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:417) at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:207) at hudson.model.AbstractBuild.getPreviousBuild(AbstractBuild.java:100) at hudson.model.Job.getLastBuildsOverThreshold(Job.java:813) at hudson.model.Job.getEstimatedDuration(Job.java:820)

          Nearly identical issue, all executors dead on all slaves at item.isStuck(); however, instead of ArrayIndexOutOfBounds we're getting a NullPointerException. Jenkins 1.487 hosted on RHEL, with mixed OSes for the executors.

          Alex Doolittle added a comment - Nearly identical issue, all executors dead on all slaves at item.isStuck(); however, instead of ArrayIndexOutOfBounds we're getting a NullPointerException. Jenkins 1.487 hosted on RHEL, with mixed OSes for the executors.

          Loren Keagle added a comment -

          I'm seeing a similar stack trace randomly. I can generally restart Jenkins and everything will be find for another day or so. Running 1.489 on Windows Server 2008, all 64 bit.

          Here's a snippet of the failure from the build log:

          Time Elapsed 00:04:10.80
          Build step 'Build a Visual Studio project or solution using MSBuild' marked build as failure
          [locks-and-latches] Releasing all the locks
          [locks-and-latches] All the locks released
          Archiving artifacts
          Recording test results
          Processing tests results in file(s) BinaryFiles/Exe/*/_results.trx
          BinaryFiles\Exe\Win32\Debug\UnitTests\gui\test_results.trx
          BinaryFiles\Exe\Win32\Release\UnitTests\gui\test_results.trx
          Description set:
          ERROR: Publisher hudson.tasks.Mailer aborted due to exception
          java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #94 EXACT: lo=8,hi=0,size=9,size2=9
          at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418)
          at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:502)
          at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:355)
          at jenkins.model.lazy.AbstractLazyLoadRunMap.newestBuild(AbstractLazyLoadRunMap.java:297)
          at hudson.model.AbstractProject.getLastBuild(AbstractProject.java:1015)
          at hudson.model.AbstractProject.hasParticipant(AbstractProject.java:1514)
          at hudson.model.User.getProjects(User.java:444)
          at hudson.scm.MailAddressResolverImpl.findMailAddressFor(MailAddressResolverImpl.java:21)
          at hudson.tasks.MailAddressResolver.resolve(MailAddressResolver.java:100)
          at hudson.tasks.Mailer$UserProperty.getAddress(Mailer.java:530)
          at hudson.tasks.MailSender.buildCulpritList(MailSender.java:407)
          at hudson.tasks.MailSender.createEmptyMail(MailSender.java:367)
          at hudson.tasks.MailSender.createFailureMail(MailSender.java:226)
          at hudson.tasks.MailSender.getMail(MailSender.java:153)
          at hudson.tasks.MailSender.execute(MailSender.java:99)
          at hudson.tasks.Mailer.perform(Mailer.java:115)
          at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19)
          at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804)
          at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:779)
          at hudson.model.Build$BuildExecution.post2(Build.java:183)
          at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:726)
          at hudson.model.Run.execute(Run.java:1541)
          at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46)
          at hudson.model.ResourceController.execute(ResourceController.java:88)
          at hudson.model.Executor.run(Executor.java:236)
          Finished: FAILURE

          Loren Keagle added a comment - I'm seeing a similar stack trace randomly. I can generally restart Jenkins and everything will be find for another day or so. Running 1.489 on Windows Server 2008, all 64 bit. Here's a snippet of the failure from the build log: Time Elapsed 00:04:10.80 Build step 'Build a Visual Studio project or solution using MSBuild' marked build as failure [locks-and-latches] Releasing all the locks [locks-and-latches] All the locks released Archiving artifacts Recording test results Processing tests results in file(s) BinaryFiles/Exe/* / _results.trx BinaryFiles\Exe\Win32\Debug\UnitTests\gui\test_results.trx BinaryFiles\Exe\Win32\Release\UnitTests\gui\test_results.trx Description set: ERROR: Publisher hudson.tasks.Mailer aborted due to exception java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #94 EXACT: lo=8,hi=0,size=9,size2=9 at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418) at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:502) at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:355) at jenkins.model.lazy.AbstractLazyLoadRunMap.newestBuild(AbstractLazyLoadRunMap.java:297) at hudson.model.AbstractProject.getLastBuild(AbstractProject.java:1015) at hudson.model.AbstractProject.hasParticipant(AbstractProject.java:1514) at hudson.model.User.getProjects(User.java:444) at hudson.scm.MailAddressResolverImpl.findMailAddressFor(MailAddressResolverImpl.java:21) at hudson.tasks.MailAddressResolver.resolve(MailAddressResolver.java:100) at hudson.tasks.Mailer$UserProperty.getAddress(Mailer.java:530) at hudson.tasks.MailSender.buildCulpritList(MailSender.java:407) at hudson.tasks.MailSender.createEmptyMail(MailSender.java:367) at hudson.tasks.MailSender.createFailureMail(MailSender.java:226) at hudson.tasks.MailSender.getMail(MailSender.java:153) at hudson.tasks.MailSender.execute(MailSender.java:99) at hudson.tasks.Mailer.perform(Mailer.java:115) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19) at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:804) at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:779) at hudson.model.Build$BuildExecution.post2(Build.java:183) at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:726) at hudson.model.Run.execute(Run.java:1541) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:236) Finished: FAILURE

          Loren Keagle added a comment -

          Interestingly, first build failed after a restart. Problem seems to be getting worse. This is a brand new build server for us, and I copied the JENKINS_HOME directory directly from our old build server (same OS, just running 1.486 instead). There seems to be many problems related to this new lazy-loading of projects. I wish there was a way to turn it off. I'd rather have a slower startup than these crashes.

          java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #88 EXACT: lo=6,hi=0,size=7,size2=7
          at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418)
          at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:502)
          at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:355)
          at jenkins.model.lazy.AbstractLazyLoadRunMap.newestBuild(AbstractLazyLoadRunMap.java:297)
          at hudson.model.AbstractProject.getLastBuild(AbstractProject.java:1015)
          at hudson.model.AbstractProject.getLastBuild(AbstractProject.java:139)
          at hudson.model.Job.isLogUpdated(Job.java:264)
          at hudson.model.AbstractProject.getCauseOfBlockage(AbstractProject.java:1205)
          at hudson.model.AbstractProject.isBuildBlocked(AbstractProject.java:1142)
          at hudson.model.Queue.isBuildBlocked(Queue.java:937)
          at hudson.model.Queue.maintain(Queue.java:1000)
          at hudson.model.Queue.pop(Queue.java:861)
          at hudson.model.Executor.grabJob(Executor.java:284)
          at hudson.model.Executor.run(Executor.java:205)

          Loren Keagle added a comment - Interestingly, first build failed after a restart. Problem seems to be getting worse. This is a brand new build server for us, and I copied the JENKINS_HOME directory directly from our old build server (same OS, just running 1.486 instead). There seems to be many problems related to this new lazy-loading of projects. I wish there was a way to turn it off. I'd rather have a slower startup than these crashes. java.lang.ArrayIndexOutOfBoundsException: Assertion error: failing to load #88 EXACT: lo=6,hi=0,size=7,size2=7 at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:418) at jenkins.model.lazy.AbstractLazyLoadRunMap.getByNumber(AbstractLazyLoadRunMap.java:502) at jenkins.model.lazy.AbstractLazyLoadRunMap.search(AbstractLazyLoadRunMap.java:355) at jenkins.model.lazy.AbstractLazyLoadRunMap.newestBuild(AbstractLazyLoadRunMap.java:297) at hudson.model.AbstractProject.getLastBuild(AbstractProject.java:1015) at hudson.model.AbstractProject.getLastBuild(AbstractProject.java:139) at hudson.model.Job.isLogUpdated(Job.java:264) at hudson.model.AbstractProject.getCauseOfBlockage(AbstractProject.java:1205) at hudson.model.AbstractProject.isBuildBlocked(AbstractProject.java:1142) at hudson.model.Queue.isBuildBlocked(Queue.java:937) at hudson.model.Queue.maintain(Queue.java:1000) at hudson.model.Queue.pop(Queue.java:861) at hudson.model.Executor.grabJob(Executor.java:284) at hudson.model.Executor.run(Executor.java:205)

          Andreas Zschorn added a comment - - edited

          Same for us, on windows 2008 RC2 and linux slaves. But the crashes are here all time. All slaves are dead after a short time. If such an unstable mechanism is instruduced, i would have at least the chance to turn it off. Startup time is really a no issue in comparision to not working at all. AbstractLazyLoadRunMap is quite good obfuscated by the programmer. So debugging it is not a suitable option.

          Andreas Zschorn added a comment - - edited Same for us, on windows 2008 RC2 and linux slaves. But the crashes are here all time. All slaves are dead after a short time. If such an unstable mechanism is instruduced, i would have at least the chance to turn it off. Startup time is really a no issue in comparision to not working at all. AbstractLazyLoadRunMap is quite good obfuscated by the programmer. So debugging it is not a suitable option.

            Unassigned Unassigned
            yannislionis Yannis Lionis
            Votes:
            25 Vote for this issue
            Watchers:
            39 Start watching this issue

              Created:
              Updated:
              Resolved: