Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-44717

Need a disk full threshold to stop queue

    XMLWordPrintable

Details

    Description

      We need a disk full threshold on the master that can stop the queue.

      It is all too easy for a Jenkins deployment to fill up disk space on the master and have jobs fail or get stuck in unpredictable ways.  The jobs keep coming, making matters worse, and require human time to investigate.

      We already have a threshold that will take slaves offline, and it appears there is an advisory that will pop up an alert on the admin console if the master is low on disk space, but we also need an emergency action when storage is critical.

      Please add an option for a disk space threshold that will stop the Jenkins queue when storage on the master is critical.

      Attachments

        Issue Links

          Activity

            wgc123 D Pasto created issue -
            wgc123 D Pasto added a comment -

            It looks like this was considered and rejected three years ago in JENKINS-7126 - can we revisit?

            wgc123 D Pasto added a comment - It looks like this was considered and rejected three years ago in  JENKINS-7126  - can we revisit?
            wgc123 D Pasto made changes -
            Field Original Value New Value
            Link This issue relates to JENKINS-7126 [ JENKINS-7126 ]
            oleg_nenashev Oleg Nenashev added a comment -

            wgc123 of course we can reopen it.

            But generally it requires a person who is ready to dedicate hist time for implementing such fix. In this case it can be actually done in a plugin (e.g. by extending http://javadoc.jenkins.io/hudson/model/Queue.QueueDecisionHandler.html ), hence it does not require so much Jenkins developer experience. If you are ready to contribute, I can provide on-demand code reviews.

            oleg_nenashev Oleg Nenashev added a comment - wgc123 of course we can reopen it. But generally it requires a person who is ready to dedicate hist time for implementing such fix. In this case it can be actually done in a plugin (e.g. by extending http://javadoc.jenkins.io/hudson/model/Queue.QueueDecisionHandler.html ), hence it does not require so much Jenkins developer experience. If you are ready to contribute, I can provide on-demand code reviews.
            danielbeck Daniel Beck made changes -
            Issue Type Improvement [ 4 ] New Feature [ 2 ]
            danielbeck Daniel Beck made changes -
            Component/s plugin-proposals [ 15491 ]
            danielbeck Daniel Beck made changes -
            Labels newbie-friendly

            Hi! I have created a plugin which solves this issue. https://github.com/AbhyudayaSharma/disk-threshold-plugin . oleg_nenashev Could you please provide a review?

            abhyudaya Abhyudaya Sharma added a comment - Hi! I have created a plugin which solves this issue.  https://github.com/AbhyudayaSharma/disk-threshold-plugin . oleg_nenashev Could you please provide a review?
            abhyudaya Abhyudaya Sharma made changes -
            Assignee Abhyudaya Sharma [ abhyudaya ]

            Can this be moved forward?

            brianjmurrell Brian J Murrell added a comment - Can this be moved forward?
            oleg_nenashev Oleg Nenashev added a comment -

            Sorry, I completely forgot about this story. The code in the plugin would benefit from an update to the new Jenkins core baseline, but generally it should work. Have you tried building it from sources brianjmurrell?

            oleg_nenashev Oleg Nenashev added a comment - Sorry, I completely forgot about this story. The code in the plugin would benefit from an update to the new Jenkins core baseline, but generally it should work. Have you tried building it from sources brianjmurrell ?

            I have not oleg_nenashev.  We're not at all set up here to build anything in Java, never mind Jenkins plugins.  We're just plain old common end-users of Jenkins at this point.

            Although the itchiness of Jenkins and it's plugins, every day makes we wonder if we don't need to start rolling up our sleeves.  I just have zero mandate to spend any time doing that at this point.

            brianjmurrell Brian J Murrell added a comment - I have not oleg_nenashev .  We're not at all set up here to build anything in Java, never mind Jenkins plugins.  We're just plain old common end-users of Jenkins at this point. Although the itchiness of Jenkins and it's plugins, every day makes we wonder if we don't need to start rolling up our sleeves.  I just have zero mandate to spend any time doing that at this point.

            People

              abhyudaya Abhyudaya Sharma
              wgc123 D Pasto
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: