Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-64402

Broken pipe (Write failed) on archiving large artifacts

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Open (View Workflow)
    • Priority: Major
    • Resolution: Unresolved
    • Labels:
      None
    • Environment:
      AWS EC2 instance
      Jenkins: 2.229
      artifact-manager-s3: 1.12
      java.runtime.name: OpenJDK Runtime Environment
      java.runtime.version: 1.8.0_232-b09
      os.arch: amd64
      os.name: Linux
      os.version: 3.10.0-1062.9.1.el7.x86_64
    • Similar Issues:

      Description

      We get this exception during the Archiving artifacts step when uploading 6GB files or larger. Only the smaller files are getting uploaded to s3.

      Started by user Taras Dyshkant
      Running as SYSTEM
      [EnvInject] - Loading node environment variables.
      Building in workspace /var/lib/jenkins/workspace/s3-artifact-test
      [WS-CLEANUP] Deleting project workspace...
      [WS-CLEANUP] Deferred wipeout is used...
      [WS-CLEANUP] Done
      [s3-artifact-test] $ /bin/sh -xe /tmp/jenkins8357054789769111063.sh
      + for s in 1K 1M 6G
      + fallocate -l 1K 1K.file
      + for s in 1K 1M 6G
      + fallocate -l 1M 1M.file
      + for s in 1K 1M 6G
      + fallocate -l 6G 6G.file
      Archiving artifacts
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      Retrying upload after: java.net.SocketException: Broken pipe (Write failed)
      ERROR: Step ‘Archive the artifacts’ aborted due to exception: 
      java.net.SocketException: Broken pipe (Write failed)
      	at java.net.SocketOutputStream.socketWrite0(Native Method)
      	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
      	at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
      	at sun.security.ssl.OutputRecord.writeBuffer(OutputRecord.java:431)
      	at sun.security.ssl.OutputRecord.write(OutputRecord.java:417)
      	at sun.security.ssl.SSLSocketImpl.writeRecordInternal(SSLSocketImpl.java:879)
      	at sun.security.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:850)
      	at sun.security.ssl.AppOutputStream.write(AppOutputStream.java:123)
      	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:124)
      	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:136)
      	at org.apache.http.impl.io.SessionOutputBufferImpl.write(SessionOutputBufferImpl.java:167)
      	at org.apache.http.impl.io.ContentLengthOutputStream.write(ContentLengthOutputStream.java:113)
      	at org.apache.http.entity.FileEntity.writeTo(FileEntity.java:113)
      	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:156)
      	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:152)
      	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:238)
      	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
      	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
      	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:186)
      	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
      	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
      	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
      	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
      	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
      	at io.jenkins.plugins.httpclient.RobustHTTPClient.lambda$uploadFile$1(RobustHTTPClient.java:255)
      	at io.jenkins.plugins.httpclient.RobustHTTPClient.lambda$connect$0(RobustHTTPClient.java:167)
      	at jenkins.util.ContextResettingExecutorService$2.call(ContextResettingExecutorService.java:46)
      	at jenkins.security.ImpersonatingExecutorService$2.call(ImpersonatingExecutorService.java:71)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      	at java.lang.Thread.run(Thread.java:748)
      Finished: FAILURE

        Attachments

          Activity

          Hide
          taras_dyshkant Taras added a comment -

          Does this plugin support multipart upload?
          Because if not it may be the reason why files larger then 5Gb are failing to upload.

          Show
          taras_dyshkant Taras added a comment - Does this plugin support multipart upload ? Because if not it may be the reason why files larger then 5Gb are failing to upload.

            People

            Assignee:
            Unassigned Unassigned
            Reporter:
            taras_dyshkant Taras
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Dates

              Created:
              Updated: