Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-64402

Broken pipe (Write failed) on archiving large artifacts

    XMLWordPrintable

Details

    • Bug
    • Status: Open (View Workflow)
    • Major
    • Resolution: Unresolved
    • None
    • AWS EC2 instance
      Jenkins: 2.229
      artifact-manager-s3: 1.12
      java.runtime.name: OpenJDK Runtime Environment
      java.runtime.version: 1.8.0_232-b09
      os.arch: amd64
      os.name: Linux
      os.version: 3.10.0-1062.9.1.el7.x86_64

    Description

      We get this exception during the Archiving artifacts step when uploading 6GB files or larger. Only the smaller files are getting uploaded to s3.

      Started by user Taras Dyshkant
      Running as SYSTEM
      [EnvInject] - Loading node environment variables.
      Building in workspace /var/lib/jenkins/workspace/s3-artifact-test
      [WS-CLEANUP] Deleting project workspace...
      [WS-CLEANUP] Deferred wipeout is used...
      [WS-CLEANUP] Done
      [s3-artifact-test] $ /bin/sh -xe /tmp/jenkins8357054789769111063.sh
      + for s in 1K 1M 6G
      + fallocate -l 1K 1K.file
      + for s in 1K 1M 6G
      + fallocate -l 1M 1M.file
      + for s in 1K 1M 6G
      + fallocate -l 6G 6G.file
      Archiving artifacts
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      ERROR: Step ‘Archive the artifacts’ aborted due to exception: 
      java.net.SocketException: Broken pipe (Write failed)
      	at java.net.SocketOutputStream.socketWrite0(Native Method)
      	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
      	at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
      	at sun.security.ssl.OutputRecord.writeBuffer(OutputRecord.java:431)
      	at sun.security.ssl.OutputRecord.write(OutputRecord.java:417)
      	at sun.security.ssl.SSLSocketImpl.writeRecordInternal(SSLSocketImpl.java:879)
      	at sun.security.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:850)
      	at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:123)
      	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:124)
      	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:136)
      	at org.apache.http.impl.io.SessionOutputBufferImpl.write(SessionOutputBufferImpl.java:167)
      	at org.apache.http.impl.io.ContentLengthOutputStream.write(ContentLengthOutputStream.java:113)
      	at org.apache.http.entity.FileEntity.writeTo(FileEntity.java:113)
      	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:156)
      	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:152)
      	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:238)
      	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
      	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
      	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
      	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
      	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
      	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
      	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
      	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
      	at io.jenkins.plugins.httpclient.RobustHTTPClient.lambda$uploadFile$1(RobustHTTPClient.java:255)
      	at io.jenkins.plugins.httpclient.RobustHTTPClient.lambda$connect$0(RobustHTTPClient.java:167)
      	at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
      	at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      Finished: FAILURE

      Attachments

        Activity

          taras_dyshkant Taras added a comment -

          Does this plugin support multipart upload?
          Because if not it may be the reason why files larger then 5Gb are failing to upload.

          taras_dyshkant Taras added a comment - Does this plugin support multipart upload ? Because if not it may be the reason why files larger then 5Gb are failing to upload.

          People

            Unassigned Unassigned
            taras_dyshkant Taras
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: