Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-34837

Uploading 'lots' of files gives 'too many open files' error

    XMLWordPrintable

Details

    • Bug
    • Status: Open (View Workflow)
    • Minor
    • Resolution: Unresolved
    • s3-plugin
    • None
    • 0.10.2 (Jenkins 1.656, Tomcat 7, Ubuntu 12.04)

    Description

      I've tried boosting the maximum number of open files to >1000000, and still get this error. But I may not have upped the limit properly (although "ulimit -n" for tomcat does show the updated limit).

      ...
      Publish artifacts to S3 Bucket bucket=testing-content-pugpig, file=video.css region=eu-west-1, will be uploaded from slave=false managed=false , server encryption false
      ERROR: Failed to upload files
      java.io.IOException: Call fails for Destination [bucketName=testing-content-pugpig, objectName=templatestest/generic/generated/page-256.html]: java.io.FileNotFoundException: /home/tomcat/.jenkins/jobs/kaldor-templatestest-server-dev/workspace/templatestest/generic/generated/page-256.html (Too many open files):: Failed after 1 tries.
      	at hudson.plugins.s3.S3Profile.repeat(S3Profile.java:249)
      	at hudson.plugins.s3.S3Profile.upload(S3Profile.java:156)
      	at hudson.plugins.s3.S3BucketPublisher.parallelUpload(S3BucketPublisher.java:241)
      	at hudson.plugins.s3.S3BucketPublisher.perform(S3BucketPublisher.java:170)
      	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:78)
      	at hudson.plugins.promoted_builds.Promotion$RunnerImpl.build(Promotion.java:403)
      	at hudson.plugins.promoted_builds.Promotion$RunnerImpl.doRun(Promotion.java:345)
      	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
      	at hudson.model.Run.execute(Run.java:1738)
      	at hudson.model.Run.run(Run.java:1676)
      	at hudson.plugins.promoted_builds.Promotion.run(Promotion.java:284)
      	at hudson.model.ResourceController.execute(ResourceController.java:98)
      	at hudson.model.Executor.run(Executor.java:410)
      Caused by: java.io.FileNotFoundException: /home/tomcat/.jenkins/jobs/kaldor-templatestest-server-dev/workspace/templatestest/generic/generated/page-256.html (Too many open files)
      	at java.io.FileInputStream.open(Native Method)
      	at java.io.FileInputStream.<init>(FileInputStream.java:138)
      	at hudson.FilePath.read(FilePath.java:1751)
      	at hudson.plugins.s3.MD5.generateFromFile(MD5.java:19)
      	at hudson.plugins.s3.callable.S3UploadCallable.invoke(S3UploadCallable.java:30)
      	at hudson.plugins.s3.S3Profile$1.call(S3Profile.java:163)
      	at hudson.plugins.s3.S3Profile$1.call(S3Profile.java:156)
      	at hudson.plugins.s3.S3Profile.repeat(S3Profile.java:245)
      	... 12 more
      build hudson.plugins.s3.S3BucketPublisher@6820b43b UNSTABLE
      

      Attachments

        Activity

          There are no comments yet on this issue.

          People

            jimilian Alexander A
            sthartle Stephen Hartley
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: