Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-22171

Optimize the files structure to reduce the number of files in the system

XMLWordPrintable

      The current implementation creates many small files. Such issue affects overall filesystem performance on backup/migration operations. It also may cause DoS on systems with a limited INodes number.

      I think it would be useful to re-consider the file structure for large Jenkins installations.

      P.S. As example, my installation produces about 1 million history entries per month. It exceeds the overall number of other files in the system.

          [JENKINS-22171] Optimize the files structure to reduce the number of files in the system

          Oleg Nenashev created issue -
          Mirko Friedenhagen made changes -
          Assignee Original: Mirko Friedenhagen [ mfriedenhagen ] New: Stefan Brausch [ stefanbrausch ]

          Mirko Friedenhagen added a comment -

          Oleg,

          • We considered offering git as an alternative to plain files, what do you think?
          • Do you ever delete old configurations?

          Mirko Friedenhagen added a comment - Oleg, We considered offering git as an alternative to plain files, what do you think? Do you ever delete old configurations?

          Oleg Nenashev added a comment -

          @Mirko,

          > We considered offering git as an alternative to plain files, what do you think?
          I definitely vote for such approach.
          BTW, there is a "SCM Sync configuration plugin" for such purpose, but it is very unstable.

          > Do you ever delete old configurations?
          We have a two-month retention policy. BTW, we'd prefer to store deeper histories in future.

          Oleg Nenashev added a comment - @Mirko, > We considered offering git as an alternative to plain files, what do you think? I definitely vote for such approach. BTW, there is a "SCM Sync configuration plugin" for such purpose, but it is very unstable. > Do you ever delete old configurations? We have a two-month retention policy. BTW, we'd prefer to store deeper histories in future.
          Oleg Nenashev made changes -
          Link New: This issue depends on JENKINS-22273 [ JENKINS-22273 ]
          R. Tyler Croy made changes -
          Workflow Original: JNJira [ 154250 ] New: JNJira + In-Review [ 178738 ]

            stefanbrausch Stefan Brausch
            oleg_nenashev Oleg Nenashev
            Votes:
            3 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated: