Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-34837

Uploading 'lots' of files gives 'too many open files' error

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Minor Minor
    • s3-plugin
    • None
    • 0.10.2 (Jenkins 1.656, Tomcat 7, Ubuntu 12.04)

      I've tried boosting the maximum number of open files to >1000000, and still get this error. But I may not have upped the limit properly (although "ulimit -n" for tomcat does show the updated limit).

      ...
Publish artifacts to S3 Bucket bucket=testing-content-pugpig, file=video.css region=eu-west-1, will be uploaded from slave=false managed=false , server encryption false
ERROR: Failed to upload files
java.io.IOException: Call fails for Destination [bucketName=testing-content-pugpig, objectName=templatestest/generic/generated/page-256.html]: java.io.FileNotFoundException: /home/tomcat/.jenkins/jobs/kaldor-templatestest-server-dev/workspace/templatestest/generic/generated/page-256.html (Too many open files):: Failed after 1 tries.
	at hudson.plugins.s3.S3Profile.repeat(S3Profile.java:249)
	at hudson.plugins.s3.S3Profile.upload(S3Profile.java:156)
	at hudson.plugins.s3.S3BucketPublisher.parallelUpload(S3BucketPublisher.java:241)
	at hudson.plugins.s3.S3BucketPublisher.perform(S3BucketPublisher.java:170)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:78)
	at hudson.plugins.promoted_builds.Promotion$RunnerImpl.build(Promotion.java:403)
	at hudson.plugins.promoted_builds.Promotion$RunnerImpl.doRun(Promotion.java:345)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
	at hudson.model.Run.execute(Run.java:1738)
	at hudson.model.Run.run(Run.java:1676)
	at hudson.plugins.promoted_builds.Promotion.run(Promotion.java:284)
	at hudson.model.ResourceController.execute(ResourceController.java:98)
	at hudson.model.Executor.run(Executor.java:410)
Caused by: java.io.FileNotFoundException: /home/tomcat/.jenkins/jobs/kaldor-templatestest-server-dev/workspace/templatestest/generic/generated/page-256.html (Too many open files)
	at java.io.FileInputStream.open(Native Method)
	at java.io.FileInputStream.<init>(FileInputStream.java:138)
	at hudson.FilePath.read(FilePath.java:1751)
	at hudson.plugins.s3.MD5.generateFromFile(MD5.java:19)
	at hudson.plugins.s3.callable.S3UploadCallable.invoke(S3UploadCallable.java:30)
	at hudson.plugins.s3.S3Profile$1.call(S3Profile.java:163)
	at hudson.plugins.s3.S3Profile$1.call(S3Profile.java:156)
	at hudson.plugins.s3.S3Profile.repeat(S3Profile.java:245)
	... 12 more
build hudson.plugins.s3.S3BucketPublisher@6820b43b UNSTABLE

            jimilian Alexander A
            sthartle Stephen Hartley
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated: