Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-30233

S3 sync rather than simple updoad

XMLWordPrintable

    • Icon: New Feature New Feature
    • Resolution: Unresolved
    • Icon: Minor Minor
    • s3-plugin
    • None

      I am currently attempting to use the S3 Plugin to upload artifacts to a an S3 bucket. This issue is that I see in the logs that everything is successful. However, when looking in S3 none of the files have been updated.

      Is there anyway to sync the files perhaps also deleting removed files? I have been googling but I can't see anything. I also can not see any configuration either.

      The only option I can see is using the actual AWS cli rather than this plugin.

      I hope I am just missing something.

          [JENKINS-30233] S3 sync rather than simple updoad

          Daniel Lafraia added a comment -

          I would threat this more like a feature than a bug. Considering the number of artifacts, a build with many artifacts would benefit from this. Also, with Amazon's versioning it's better to have only changed files as new versions.

          FYI: AWS CLI does have a sync feature that could be used as a source of ideas for this feature
          http://docs.aws.amazon.com/cli/latest/reference/s3/sync.html

          I would feel much more comfortable if we had a sync feature within this plugin. Something like:

          [ ] Upload only modified files

          • Compare object content
          • Compare object date/time (bad for distributed builds)
          • Compare object size

          This could be done by checking file size (AWS CLI has --size-only) or a safer method would be to download the object, compare it and upload only if it has changed. In this case a "GetObject" permission would be required.

          Daniel Lafraia added a comment - I would threat this more like a feature than a bug. Considering the number of artifacts, a build with many artifacts would benefit from this. Also, with Amazon's versioning it's better to have only changed files as new versions. FYI: AWS CLI does have a sync feature that could be used as a source of ideas for this feature http://docs.aws.amazon.com/cli/latest/reference/s3/sync.html I would feel much more comfortable if we had a sync feature within this plugin. Something like: [ ] Upload only modified files Compare object content Compare object date/time (bad for distributed builds) Compare object size This could be done by checking file size (AWS CLI has --size-only) or a safer method would be to download the object, compare it and upload only if it has changed. In this case a "GetObject" permission would be required.

            Unassigned Unassigned
            jeffxor Jeffrey Williams
            Votes:
            2 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated: