Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-25026

Console output stops populating after several seconds

    • Icon: Bug Bug
    • Resolution: Not A Defect
    • Icon: Major Major
    • core
    • Jenkins 1.582 from Bitnami, running on AWS in m3.medium instance type
      Server OS: Ubuntu 14.04 64bit
      JDK: Oracle JDK 1.7.0_67
      Browser: Chrome 37 64bit

      Console output is populating log in browser window, but after several seconds stops. User has to refresh the page but it happens again. It looks like populating works only when log grown quickly and stops when job doesn't log for a while.

      It seems that problem is on the server side, browser repeats AJAX requests to progressiveHtml path and all of them have "X-More-Data: true" response header, but the last one hasn't (wrongly, because job logging on server side continues).

      Latest version I have seen this working: 1.466

          [JENKINS-25026] Console output stops populating after several seconds

          Daniel Beck added a comment -

          Interesting attachment.

          Here's the problem, it looks like it's not Jenkins who's responding, or it's an irregular response. There's no code path for the console log updates that does not set an X-Something header.

          https://github.com/stapler/stapler/blob/master/core/src/main/java/org/kohsuke/stapler/framework/io/LargeText.java#L264

          Check your Jenkins log, e.g. on the UI at the /log/all URL. Something may throw an exception to get out of the regular flow. Maybe this is JENKINS-23971?

          Daniel Beck added a comment - Interesting attachment. Here's the problem, it looks like it's not Jenkins who's responding, or it's an irregular response. There's no code path for the console log updates that does not set an X-Something header. https://github.com/stapler/stapler/blob/master/core/src/main/java/org/kohsuke/stapler/framework/io/LargeText.java#L264 Check your Jenkins log, e.g. on the UI at the /log/all URL. Something may throw an exception to get out of the regular flow. Maybe this is JENKINS-23971 ?

          Thomas Muguet added a comment -

          Nothing in the logs.
          Here are the logs that are enabled by the way:

          org.acegisecurity.userdetails ALL
          org.acegisecurity.ldap.LdapUtils ALL
          org.acegisecurity.ldap.search ALL
          org.acegisecurity.providers.ldap ALL
          org.acegisecurity.ldap ALL
          org.apache.sshd WARNING
          hudson.plugins.git ALL
          org.jenkinsci.plugins.gitclient ALL
          org.apache.catalina.core.ContainerBase.[Catalina].[localhost] INFO
          jenkins.plugins.git ALL
          org.acegisecurity.providers.ldap.authenticator ALL

          Thomas Muguet added a comment - Nothing in the logs. Here are the logs that are enabled by the way: org.acegisecurity.userdetails ALL org.acegisecurity.ldap.LdapUtils ALL org.acegisecurity.ldap.search ALL org.acegisecurity.providers.ldap ALL org.acegisecurity.ldap ALL org.apache.sshd WARNING hudson.plugins.git ALL org.jenkinsci.plugins.gitclient ALL org.apache.catalina.core.ContainerBase. [Catalina] . [localhost] INFO jenkins.plugins.git ALL org.acegisecurity.providers.ldap.authenticator ALL

          Daniel Beck added a comment -

          The interesting line is the one without logger name, just log level.

          Daniel Beck added a comment - The interesting line is the one without logger name, just log level.

          Thomas Muguet added a comment -

          Thanks for your quick answer.

          I guess I won't be really helpful because I did not have a default log level (it seems it is removed on startup), and setting it to ALL does not produce any more info in the logs.

          Thomas Muguet added a comment - Thanks for your quick answer. I guess I won't be really helpful because I did not have a default log level (it seems it is removed on startup), and setting it to ALL does not produce any more info in the logs.

          Daniel Beck added a comment -

          Is snyone experiencing this issue...

          • Without Apache in front of Jenkins?
          • Without Tomcat running Jenkins?
          • On a box that's not Bitnami?

          Daniel Beck added a comment - Is snyone experiencing this issue... Without Apache in front of Jenkins? Without Tomcat running Jenkins? On a box that's not Bitnami?

          Daniel Beck added a comment -

          Cannot reproduce the problem on the VMware VM bitnami-jenkins-1.596-0-ubuntu-14.04 I just downloaded. Tested with freestyle project executing the following build script:

          for I in $( seq 0 1000 ) ; do
            sleep 1
            echo JENKINS-25026 $I
          done

          The console output keeps updating.

          Neither Chrome 39 nor Firefox 34.0.5 on OS X show the reported issue when accessing the mentioned instance.

          Any console annotators enabled, like Timestamper, or Ant plugin or Gradle plugin adding a list of executed targets/tasks?

          Daniel Beck added a comment - Cannot reproduce the problem on the VMware VM bitnami-jenkins-1.596-0-ubuntu-14.04 I just downloaded. Tested with freestyle project executing the following build script: for I in $( seq 0 1000 ) ; do sleep 1 echo JENKINS-25026 $I done The console output keeps updating. Neither Chrome 39 nor Firefox 34.0.5 on OS X show the reported issue when accessing the mentioned instance. Any console annotators enabled, like Timestamper, or Ant plugin or Gradle plugin adding a list of executed targets/tasks?

          Thomas Muguet added a comment -

          When using a freestyle project executing the script you gave (without any console annotators), it seems to works. But putting the sleep value at 2 fails.
          I have a bunch of console annotators installed though, I will try to check that if you still can't reproduce this issue with a greater sleep value.

          Thomas Muguet added a comment - When using a freestyle project executing the script you gave (without any console annotators), it seems to works. But putting the sleep value at 2 fails. I have a bunch of console annotators installed though, I will try to check that if you still can't reproduce this issue with a greater sleep value.

          Daniel Beck added a comment -

          Reproduced with sleep 3. Investigating...

          Daniel Beck added a comment - Reproduced with sleep 3 . Investigating...

          Daniel Beck added a comment -

          And that's why you don't use some random vendor's preconfigured shit. It's broken.

          Disable mod_pagespeed (whatever the hell that is) in Apache and things start working.

          What a waste of time.

          Daniel Beck added a comment - And that's why you don't use some random vendor's preconfigured shit. It's broken. Disable mod_pagespeed (whatever the hell that is) in Apache and things start working. What a waste of time.

          Thomas Muguet added a comment -

          Thank you very much for your help. It's always good to know that this configuration is broken.

          Thomas Muguet added a comment - Thank you very much for your help. It's always good to know that this configuration is broken.

            Unassigned Unassigned
            mschayna Martin Schayna
            Votes:
            4 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: