Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-60850

Jenkins log flooded with SSE gateway plugins related warnings

    • Icon: Bug Bug
    • Resolution: Fixed
    • Icon: Major Major
    • sse-gateway-plugin
    • Jenkins version: 2.190.1, Server Sent Events (SSE) Gateway Plugin version: 1.20

      Hi,

      Jenkins log is flooded with below warnings. Can you please help to fix the issue.  Please let me know if any additional information is needed from my end.

      Jan 23, 2020 7:37:19 PM SEVERE org.jenkinsci.plugins.ssegateway.sse.EventDispatcher dispatchReload
      Unable to send reload event to client. java.lang.IllegalStateException: The request associated with the AsyncContext has already completed processing. at org.apache.catalina.core.AsyncContextImpl.check(AsyncContextImpl.java:509) at org.apache.catalina.core.AsyncContextImpl.getResponse(AsyncContextImpl.java:227) at org.jenkinsci.plugins.ssegateway.sse.AsynchEventDispatcher.getResponse(AsynchEventDispatcher.java:104) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.dispatchEvent(EventDispatcher.java:170) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.dispatchReload(EventDispatcher.java:337) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.processRetries(EventDispatcher.java:394) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

          [JENKINS-60850] Jenkins log flooded with SSE gateway plugins related warnings

          Ganesh Saraf created issue -
          Ganesh Saraf made changes -
          Description Original: Hi,

          Jenkins log is flooded with below warnings. Can you please help to fix the issue.  PLease let me know if any additional information is needed from my end.
          Jan 23, 2020 7:37:19 PM SEVERE org.jenkinsci.plugins.ssegateway.sse.EventDispatcher dispatchReload
          Unable to send reload event to client. java.lang.IllegalStateException: The request associated with the AsyncContext has already completed processing. at org.apache.catalina.core.AsyncContextImpl.check(AsyncContextImpl.java:509) at org.apache.catalina.core.AsyncContextImpl.getResponse(AsyncContextImpl.java:227) at org.jenkinsci.plugins.ssegateway.sse.AsynchEventDispatcher.getResponse(AsynchEventDispatcher.java:104) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.dispatchEvent(EventDispatcher.java:170) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.dispatchReload(EventDispatcher.java:337) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.processRetries(EventDispatcher.java:394) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
          New: Hi,

          Jenkins log is flooded with below warnings. Can you please help to fix the issue.  Please let me know if any additional information is needed from my end.


           Jan 23, 2020 7:37:19 PM SEVERE org.jenkinsci.plugins.ssegateway.sse.EventDispatcher dispatchReload
           Unable to send reload event to client. java.lang.IllegalStateException: The request associated with the AsyncContext has already completed processing. at org.apache.catalina.core.AsyncContextImpl.check(AsyncContextImpl.java:509) at org.apache.catalina.core.AsyncContextImpl.getResponse(AsyncContextImpl.java:227) at org.jenkinsci.plugins.ssegateway.sse.AsynchEventDispatcher.getResponse(AsynchEventDispatcher.java:104) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.dispatchEvent(EventDispatcher.java:170) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.dispatchReload(EventDispatcher.java:337) at org.jenkinsci.plugins.ssegateway.sse.EventDispatcher.processRetries(EventDispatcher.java:394) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

          Happens to me too after updating Jenkins to 2.190.1 and SSE is at 1.21.

          There are thousands of records generated daily.

          Mihai Stoichitescu added a comment - Happens to me too after updating Jenkins to 2.190.1 and SSE is at  1.21 . There are thousands of records generated daily.

          Devin Nusbaum added a comment -

          Is anyone seeing this using the Jetty servlet container embedded in Jenkins, or does it only occur when running Jenkins on Tomcat?

          Devin Nusbaum added a comment - Is anyone seeing this using the Jetty servlet container embedded in Jenkins, or does it only occur when running Jenkins on Tomcat?

          Can't test with Jetty, but for us yes it's occurring on Tomcat 9.0.14 dnusbaum

          Mihai Stoichitescu added a comment - Can't test with Jetty, but for us yes it's occurring on Tomcat 9.0.14 dnusbaum
          Olivier Lamy made changes -
          Status Original: Open [ 1 ] New: In Progress [ 3 ]
          Olivier Lamy made changes -
          Priority Original: Minor [ 4 ] New: Major [ 3 ]

          Olivier Lamy added a comment -

          https://github.com/jenkinsci/sse-gateway-plugin/pull/59

          stoiky ganeshsrf  FYI if you can test with the PR it would be great.

          To mitigate this issue you can use those properties (even smaller values if you still have problems)

          -Dorg.jenkinsci.plugins.ssegateway.sse.EventDispatcher.RETRY_QUEUE_EVENT_LIFETIME=60000

          -Dorg.jenkinsci.plugins.ssegateway.sse.EventDispatcher.TIMEOUT_DISPATCHERFAIL=900000

           

          To reproduce just look at a pipeline generating a lot of events via BlueOcean and close browsers/tabs abruptly

           

          Olivier Lamy added a comment - https://github.com/jenkinsci/sse-gateway-plugin/pull/59 stoiky ganeshsrf   FYI if you can test with the PR it would be great. To mitigate this issue you can use those properties (even smaller values if you still have problems) -Dorg.jenkinsci.plugins.ssegateway.sse.EventDispatcher.RETRY_QUEUE_EVENT_LIFETIME=60000 -Dorg.jenkinsci.plugins.ssegateway.sse.EventDispatcher.TIMEOUT_DISPATCHERFAIL=900000   To reproduce just look at a pipeline generating a lot of events via BlueOcean and close browsers/tabs abruptly  

          Olivier Lamy added a comment -

          see-gateway plugin 1.24 released

          Olivier Lamy added a comment - see-gateway plugin 1.24 released
          Olivier Lamy made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: In Progress [ 3 ] New: Resolved [ 5 ]

            olamy Olivier Lamy
            ganeshsrf Ganesh Saraf
            Votes:
            2 Vote for this issue
            Watchers:
            7 Start watching this issue

              Created:
              Updated:
              Resolved: