Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-25869

Jenkins is getting crashed and shutting down once in a while

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not A Defect
    • Icon: Blocker Blocker
    • core
    • Jenkins version=1.580.1, OS=Linux, Flavor=SLES11, Java version=1.6 Container=Tomcat 7.0.47

      Our Jenkins master instance got crashed around 3 times in one week and it is getting shutdown by itself once in a while(once or twice per a day). I had mentioned the Environment details in the Environment Field. I am also attaching the last three Jenkins crash logs. This is a serious blocker for our Team, Please let us know what is the issue and remedy.

      Please do let me know if you need further details

      Quick response will be much useful !! Thanks in advance

      Regards,
      Vamsi Hari

        1. hs_err_pid12702.log
          124 kB
        2. hs_err_pid13387.log
          131 kB
        3. hs_err_pid22195.log
          106 kB
        4. hs_err_pid26226.log
          126 kB
        5. hs_err_pid5705.log
          122 kB
        6. PortalEXT-EAR-deployment-PEO-config.xml
          11 kB
        7. PortalEXT-myts-static-STATIC-deployment-config.xml
          8 kB
        8. support.zip
          1.16 MB
        9. System Information [Jenkins].htm
          37 kB

          [JENKINS-25869] Jenkins is getting crashed and shutting down once in a while

          Daniel Beck added a comment -

          That looks like a completely different issue. What is the relation of that to the earlier reported JRE crashes?

          Daniel Beck added a comment - That looks like a completely different issue. What is the relation of that to the earlier reported JRE crashes?

          Vamsi Hari added a comment -

          I am not sure, I had added that as you said you saw some proxy related code in the error log. But from every JVM crash log there are some logs related svn and proxy. BTW We are still having our Jenkins instance crashed regularly, we had recent crash on Jan 1. I am attaching the recent crash log too.

          Vamsi Hari added a comment - I am not sure, I had added that as you said you saw some proxy related code in the error log. But from every JVM crash log there are some logs related svn and proxy. BTW We are still having our Jenkins instance crashed regularly, we had recent crash on Jan 1. I am attaching the recent crash log too.

          Vamsi Hari added a comment -

          crash log on Jan 1 2015

          Vamsi Hari added a comment - crash log on Jan 1 2015

          Daniel Beck added a comment -

          Please provide the configuration of the job PortalEXT-EAR-deployment-PEO and PortalEXT-myts-static-STATIC-deployment and the output on the /systemInfo URL. Or better yet, install https://wiki.jenkins-ci.org/display/JENKINS/Support+Core+Plugin and attach a support bundle to this issue (in addition to the two job configurations, since they're not in the bundle).

          Daniel Beck added a comment - Please provide the configuration of the job PortalEXT-EAR-deployment-PEO and PortalEXT-myts-static-STATIC-deployment and the output on the /systemInfo URL. Or better yet, install https://wiki.jenkins-ci.org/display/JENKINS/Support+Core+Plugin and attach a support bundle to this issue (in addition to the two job configurations, since they're not in the bundle).

          Vamsi Hari added a comment -

          Daniel - I had attached all the info requested by you. FYI, In the job config files i had commented host names and mentioned respective details over there.

          Vamsi Hari added a comment - Daniel - I had attached all the info requested by you. FYI, In the job config files i had commented host names and mentioned respective details over there.

          Daniel Beck added a comment -

          I'd try to make sure to unset the http_proxy and related environment variables before starting the Jenkins process (or rather Tomcat in your case?), instead (if necessary) using proxy configuration in Jenkins (Manage Jenkins » Manage Plugins » Advanced). This may result in child processes (e.g. shell scripts and the tools they run) not inheriting the proxy configuration by default though.

          The bug may well be in the gconf (Gnome) library or the JDK, as that's where the crash occurs.
          http://hg.openjdk.java.net/jdk7u/jdk7u/jdk/file/54acd5cd0485/src/solaris/native/sun/net/spi/DefaultProxySelector.c#l155

          Please also note that the user and password to the proxy are included in plain text in the support bundle (nodes/master/environment.txt), so you should change those now.

          Daniel Beck added a comment - I'd try to make sure to unset the http_proxy and related environment variables before starting the Jenkins process (or rather Tomcat in your case?), instead (if necessary) using proxy configuration in Jenkins (Manage Jenkins » Manage Plugins » Advanced). This may result in child processes (e.g. shell scripts and the tools they run) not inheriting the proxy configuration by default though. The bug may well be in the gconf (Gnome) library or the JDK, as that's where the crash occurs. http://hg.openjdk.java.net/jdk7u/jdk7u/jdk/file/54acd5cd0485/src/solaris/native/sun/net/spi/DefaultProxySelector.c#l155 Please also note that the user and password to the proxy are included in plain text in the support bundle (nodes/master/environment.txt), so you should change those now.

          Vamsi Hari added a comment -

          Thanks Daniel for your help,
          I will try removing all the proxy related environment variables and restarting the Jenkins container(Tomcat) and let you know about the result.

          Vamsi Hari added a comment - Thanks Daniel for your help, I will try removing all the proxy related environment variables and restarting the Jenkins container(Tomcat) and let you know about the result.

          Vamsi Hari added a comment -

          Hey Daniel - We had tried by commenting the proxy related env variables in the host. we had only specified the proxy settings in the Jenkins UI, but the Jenkins crashes still persists. I am attaching the most recent crash log. Please verify,

          We truly appreciate your help,
          Thanks and Regards,
          Vamsi Hari

          Vamsi Hari added a comment - Hey Daniel - We had tried by commenting the proxy related env variables in the host. we had only specified the proxy settings in the Jenkins UI, but the Jenkins crashes still persists. I am attaching the most recent crash log. Please verify, We truly appreciate your help, Thanks and Regards, Vamsi Hari

          Daniel Beck added a comment -

          This appears to be a bug in your JDK, and has nothing to do with Jenkins (except that it runs code that causes the JDK code to run).

          See:
          http://bugs.java.com/bugdatabase/view_bug.do?bug_id=7188755
          https://bugs.launchpad.net/ubuntu/+source/openjdk-6/+bug/885195
          http://mail.openjdk.java.net/pipermail/jdk7u-dev/2012-August/003911.html

          Daniel Beck added a comment - This appears to be a bug in your JDK, and has nothing to do with Jenkins (except that it runs code that causes the JDK code to run). See: http://bugs.java.com/bugdatabase/view_bug.do?bug_id=7188755 https://bugs.launchpad.net/ubuntu/+source/openjdk-6/+bug/885195 http://mail.openjdk.java.net/pipermail/jdk7u-dev/2012-August/003911.html

          Vamsi Hari added a comment -

          Thanks Daniel for your help,
          We will keep posted if we find any solution for this java bug.

          Cheers,
          Vamsi Hari

          Vamsi Hari added a comment - Thanks Daniel for your help, We will keep posted if we find any solution for this java bug. Cheers, Vamsi Hari

            Unassigned Unassigned
            hvamsik Vamsi Hari
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: