Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-68181

GerrtTriggerTimerTask timer thread abruptly terminated during updating dynamic config url

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Critical Critical
    • gerrit-trigger-plugin
    • None
    • Jenkins version: 2.249.3
      GerritTrigger Plugin version: 2.34.0

      Problem

       

      We have a large jenkins instance which hosts nearly up to 1000 Pipeline Jobs, and we mainly use gerrit trigger plugin to interact with gerrit server. But somehow we met some unexpected behavior on gerrit-trigger plugin.  The one listed below is a critical one that may affect our codebase quality.

       

      Issue

      Sometimes, part of job can not be triggered by gerrit changes event, we checked the dynamic config url setting and its content, Comparing to the other job, the setting and content is totaly the same. It seems some job just stop working.

       

      Temp Workaround:

      Manually re-save the job, "Configure -> "Save", would fix the problem. The "broken" job can finally behavior as normal. 

       

      Logs

       

      But this problem happens from time to time, so we debugged into it and found some useful logging information for your information, as attached:

       

      1. Timer task which updating the same one dynamic config url file,  going bad from some point.

       

      2. In some other case, a exception was thrown saying this is not a SafeTimerTask.

       

      3. Study & Investigate

      By looking into source code, we found the timertask use "TimerTask", which generally also bring problem and confusion to other people.

       https://stackoverflow.com/questions/19944784/if-a-task-encounters-an-exception-its-further-executions-are-suppressed-why
      https://docs.oracle.com/javase/7/docs/api/java/util/concurrent/ScheduledExecutorService.html

       

       
       

       
       
       
      Suggest Solution
       
      May be we could use SafeTimerTask instead.
       

       

       

        1. image-2022-04-02-16-23-56-733.png
          99 kB
          chen kent
        2. image-2022-04-02-16-41-48-407.png
          236 kB
          chen kent
        3. image-2022-04-02-16-52-01-633.png
          82 kB
          chen kent
        4. image-2022-04-02-16-53-46-428.png
          96 kB
          chen kent
        5. image-2022-04-02-16-55-00-134.png
          71 kB
          chen kent

            rsandell rsandell
            kentchen007 chen kent
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: