• Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Major Major
    • core
    • Fedora 10 x86_64 Master, Win7 32bit Slave

      We are running 1.380. I can watch a 300MB tarball get transferred to the Hudson master slowly over 30+ minutes. An scp between the same machines and same files/directories takes less than 3 minutes.

          [JENKINS-7813] Archiving artifacts very slow

          gtuhl created issue -

          davidkarlsen added a comment -

          Got the same problem - it's been like that for ages...

          davidkarlsen added a comment - Got the same problem - it's been like that for ages...

          davidkarlsen added a comment -

          davidkarlsen added a comment - Same type of issue here: http://issues.jenkins-ci.org/browse/JENKINS-3799

          jsmigel added a comment -

          Same here. I can see this on 3 different master/slave combinations (linux/linux) using the POM in JENKINS-3922. It usually transfers < 100 bytes/second. I can confirm that it's calling FilePath.copyTo. To make it as simple as possible, I've been testing with an SSH slave on localhost.

          I could not reproduce this on OS X 10.6 using the same setup and POM.

          I am using 1.381 in all cases, but davidkarsen's right - this problem's been around way longer than that.

          jsmigel added a comment - Same here. I can see this on 3 different master/slave combinations (linux/linux) using the POM in JENKINS-3922 . It usually transfers < 100 bytes/second. I can confirm that it's calling FilePath.copyTo. To make it as simple as possible, I've been testing with an SSH slave on localhost. I could not reproduce this on OS X 10.6 using the same setup and POM. I am using 1.381 in all cases, but davidkarsen's right - this problem's been around way longer than that.
          pancake made changes -
          Link New: This issue is duplicated by JENKINS-7921 [ JENKINS-7921 ]

          salimfadhley added a comment -

          I'm using 1.359 on Windows XP 32bit.

          I also get this - typically artifacts < 5mb take about 15 minutes to archive.

          salimfadhley added a comment - I'm using 1.359 on Windows XP 32bit. I also get this - typically artifacts < 5mb take about 15 minutes to archive.

          salimfadhley added a comment -

          I'm watching the build's archive directory as the files get collected.

          Typically what happens is that the file streams in very slowly (at about 3-15k per second) and then abruptly stops when 800-1500k of data has been copied.

          Sometimes when I kill the process it's recorded as a "Blue" even thouh it's actually an abort.

          Any suggestions as to how I can work-around this bug would be much appreciated.

          Sal

          salimfadhley added a comment - I'm watching the build's archive directory as the files get collected. Typically what happens is that the file streams in very slowly (at about 3-15k per second) and then abruptly stops when 800-1500k of data has been copied. Sometimes when I kill the process it's recorded as a "Blue" even thouh it's actually an abort. Any suggestions as to how I can work-around this bug would be much appreciated. Sal

          salimfadhley added a comment - - edited

          I got this exception... is it relevant? Note that despite being a failure this is reported as SUCCESS.

          C:\hudson1\workspace\build_calyon_egg\integration_src>exit 0 Archiving artifacts
          ERROR: Failed to archive artifacts: out/* hudson.util.IOException2: hudson.util.IOException2: Failed to extract c:\hudson1\workspace\build_calyon_egg/out/* at hudson.FilePath.readFromTar(FilePath.java:1577) at hudson.FilePath.copyRecursiveTo(FilePath.java:1491) at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:117) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19) at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:601) at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:580) at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:558) at hudson.model.Build$RunnerImpl.post2(Build.java:158) at hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:528) at hudson.model.Run.run(Run.java:1264) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:122) Caused by: java.io.IOException at hudson.remoting.FastPipedInputStream.read(FastPipedInputStream.java:173) at hudson.util.HeadBufferingStream.read(HeadBufferingStream.java:61) at java.util.zip.InflaterInputStream.fill(InflaterInputStream.java:221) at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:141) at java.util.zip.GZIPInputStream.read(GZIPInputStream.java:92) at org.apache.tools.tar.TarBuffer.readBlock(TarBuffer.java:257) at org.apache.tools.tar.TarBuffer.readRecord(TarBuffer.java:223) at hudson.org.apache.tools.tar.TarInputStream.read(TarInputStream.java:345) at java.io.FilterInputStream.read(FilterInputStream.java:90) at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1025) at org.apache.commons.io.IOUtils.copy(IOUtils.java:999) at hudson.util.IOUtils.copy(IOUtils.java:29) at hudson.FilePath.readFromTar(FilePath.java:1565) ... 12 more at hudson.FilePath.copyRecursiveTo(FilePath.java:1498) at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:117) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19) at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:601) at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:580) at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:558) at hudson.model.Build$RunnerImpl.post2(Build.java:158) at hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:528) at hudson.model.Run.run(Run.java:1264) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:122) Caused by: java.util.concurrent.ExecutionException: hudson.remoting.RequestAbortedException: java.net.SocketTimeoutException: Read timed out at hudson.remoting.Request$1.get(Request.java:236) at hudson.remoting.Request$1.get(Request.java:172) at hudson.remoting.FutureAdapter.get(FutureAdapter.java:59) at hudson.FilePath.copyRecursiveTo(FilePath.java:1494) ... 11 more Caused by: hudson.remoting.RequestAbortedException: java.net.SocketTimeoutException: Read timed out at hudson.remoting.Request.abort(Request.java:257) at hudson.remoting.Channel.terminate(Channel.java:598) at hudson.remoting.Channel$ReaderThread.run(Channel.java:880) Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:258) at java.io.BufferedInputStream.read(BufferedInputStream.java:317) at java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2266) at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream.java:2668) at java.io.ObjectInputStream$BlockDataInputStream.readFully(ObjectInputStream.java:2698) at java.io.ObjectInputStream.readArray(ObjectInputStream.java:1648) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1323) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1947) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1871) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1753) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1329) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:351) at hudson.remoting.Channel$ReaderThread.run(Channel.java:856) Recording test results
          Recording fingerprints
          Triggering a new build of publish_calyon_egg #2956 Notifying upstream projects of job completion Finished: SUCCESS 
          

          salimfadhley added a comment - - edited I got this exception... is it relevant? Note that despite being a failure this is reported as SUCCESS. C:\hudson1\workspace\build_calyon_egg\integration_src>exit 0 Archiving artifacts ERROR: Failed to archive artifacts: out/* hudson.util.IOException2: hudson.util.IOException2: Failed to extract c:\hudson1\workspace\build_calyon_egg/out/* at hudson.FilePath.readFromTar(FilePath.java:1577) at hudson.FilePath.copyRecursiveTo(FilePath.java:1491) at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:117) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19) at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:601) at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:580) at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:558) at hudson.model.Build$RunnerImpl.post2(Build.java:158) at hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:528) at hudson.model.Run.run(Run.java:1264) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:122) Caused by: java.io.IOException at hudson.remoting.FastPipedInputStream.read(FastPipedInputStream.java:173) at hudson.util.HeadBufferingStream.read(HeadBufferingStream.java:61) at java.util.zip.InflaterInputStream.fill(InflaterInputStream.java:221) at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:141) at java.util.zip.GZIPInputStream.read(GZIPInputStream.java:92) at org.apache.tools.tar.TarBuffer.readBlock(TarBuffer.java:257) at org.apache.tools.tar.TarBuffer.readRecord(TarBuffer.java:223) at hudson.org.apache.tools.tar.TarInputStream.read(TarInputStream.java:345) at java.io.FilterInputStream.read(FilterInputStream.java:90) at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1025) at org.apache.commons.io.IOUtils.copy(IOUtils.java:999) at hudson.util.IOUtils.copy(IOUtils.java:29) at hudson.FilePath.readFromTar(FilePath.java:1565) ... 12 more at hudson.FilePath.copyRecursiveTo(FilePath.java:1498) at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:117) at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:19) at hudson.model.AbstractBuild$AbstractRunner.perform(AbstractBuild.java:601) at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:580) at hudson.model.AbstractBuild$AbstractRunner.performAllBuildSteps(AbstractBuild.java:558) at hudson.model.Build$RunnerImpl.post2(Build.java:158) at hudson.model.AbstractBuild$AbstractRunner.post(AbstractBuild.java:528) at hudson.model.Run.run(Run.java:1264) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:46) at hudson.model.ResourceController.execute(ResourceController.java:88) at hudson.model.Executor.run(Executor.java:122) Caused by: java.util.concurrent.ExecutionException: hudson.remoting.RequestAbortedException: java.net.SocketTimeoutException: Read timed out at hudson.remoting.Request$1.get(Request.java:236) at hudson.remoting.Request$1.get(Request.java:172) at hudson.remoting.FutureAdapter.get(FutureAdapter.java:59) at hudson.FilePath.copyRecursiveTo(FilePath.java:1494) ... 11 more Caused by: hudson.remoting.RequestAbortedException: java.net.SocketTimeoutException: Read timed out at hudson.remoting.Request.abort(Request.java:257) at hudson.remoting.Channel.terminate(Channel.java:598) at hudson.remoting.Channel$ReaderThread.run(Channel.java:880) Caused by: java.net.SocketTimeoutException: Read timed out at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:129) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:258) at java.io.BufferedInputStream.read(BufferedInputStream.java:317) at java.io.ObjectInputStream$PeekInputStream.read(ObjectInputStream.java:2266) at java.io.ObjectInputStream$BlockDataInputStream.read(ObjectInputStream.java:2668) at java.io.ObjectInputStream$BlockDataInputStream.readFully(ObjectInputStream.java:2698) at java.io.ObjectInputStream.readArray(ObjectInputStream.java:1648) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1323) at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1947) at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1871) at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1753) at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1329) at java.io.ObjectInputStream.readObject(ObjectInputStream.java:351) at hudson.remoting.Channel$ReaderThread.run(Channel.java:856) Recording test results Recording fingerprints Triggering a new build of publish_calyon_egg #2956 Notifying upstream projects of job completion Finished: SUCCESS

          Same problem here with Jenkins v1.404

          Alessandro Mecca added a comment - Same problem here with Jenkins v1.404
          166_MMX made changes -
          Link New: This issue is related to JENKINS-3922 [ JENKINS-3922 ]

            Unassigned Unassigned
            gtuhl gtuhl
            Votes:
            40 Vote for this issue
            Watchers:
            46 Start watching this issue

              Created:
              Updated:
              Resolved: