Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-24453

Jenkins server got blue screen to death

    XMLWordPrintable

    Details

    • Similar Issues:

      Description

      Jenkins Server get blue screen to death crash about twice a day. After sending the dump to microsoft, it turns out there The Java related binary D:\Jenkins_CI\war\WEB-INF\lib\winp.x64.35A3F35D2ED629A6CEC5B41DD1D280C3.dll has called to Terminate the csrss.exe and csrss.exe is a critical process since it was called to Terminate this process the machine Bug Checked.
      What is CSRSS.EXE?
      This is the user-mode portion of the Win32 subsystem (with Win32.sys being the kernel-mode portion). Csrss stands for client/server run-time subsystem and is an essential subsystem that must be running at all times. Csrss is responsible for console windows, creating and/or deleting threads, and some parts of the 16-bit virtual MS-DOS environment

        Attachments

          Issue Links

            Activity

            sharon_xia sharon xia created issue -
            Hide
            sharon_xia sharon xia added a comment -

            System Properties
            Name ↓ Value
            awt.toolkit sun.awt.windows.WToolkit
            executable-war D:\Jenkins_CI\jenkins.war
            file.encoding Cp1252
            file.encoding.pkg sun.io
            file.separator \
            hudson.diyChunking true
            hudson.lifecycle hudson.lifecycle.WindowsServiceLifecycle
            java.awt.graphicsenv sun.awt.Win32GraphicsEnvironment
            java.awt.headless true
            java.awt.printerjob sun.awt.windows.WPrinterJob
            java.class.path D:\Jenkins_CI\jenkins.war
            java.class.version 51.0
            java.endorsed.dirs C:\Program Files\Java\jre7\lib\endorsed
            java.ext.dirs C:\Program Files\Java\jre7\lib\ext;C:\Windows\Sun\Java\lib\ext
            java.home C:\Program Files\Java\jre7
            java.io.tmpdir C:\Users\ADMINI~1\AppData\Local\Temp\
            java.library.path C:\Program Files\Java\jre7\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Java\jre7\bin;C:\Python27;C:\Program Files (x86)\Git\bin;.
            java.runtime.name Java(TM) SE Runtime Environment
            java.runtime.version 1.7.0_60-b19
            java.specification.name Java Platform API Specification
            java.specification.vendor Oracle Corporation
            java.specification.version 1.7
            java.vendor Oracle Corporation
            java.vendor.url http://java.oracle.com/
            java.vendor.url.bug http://bugreport.sun.com/bugreport/
            java.version 1.7.0_60
            java.vm.info mixed mode
            java.vm.name Java HotSpot(TM) 64-Bit Server VM
            java.vm.specification.name Java Virtual Machine Specification
            java.vm.specification.vendor Oracle Corporation
            java.vm.specification.version 1.7
            java.vm.vendor Oracle Corporation
            java.vm.version 24.60-b09
            javamelody.analytics-id UA-1335263-7
            javamelody.gzip-compression-disabled true
            javamelody.http-transform-pattern /\d+/|/site/.|avadoc/.|/ws/.|obertura/.|estReport/.|iolations/file/.|/user/.|/static/\w/
            javamelody.no-database true
            javamelody.storage-directory /D:\Jenkins_CI\monitoring
            javamelody.system-actions-enabled true
            line.separator
            mail.smtp.sendpartial true
            mail.smtps.sendpartial true
            os.arch amd64
            os.name Windows Server 2008 R2
            os.version 6.1
            path.separator ;
            pid 1340
            sun.arch.data.model 64
            sun.awt.enableExtraMouseButtons true
            sun.boot.class.path C:\Program Files\Java\jre7\lib\resources.jar;C:\Program Files\Java\jre7\lib\rt.jar;C:\Program Files\Java\jre7\lib\sunrsasign.jar;C:\Program Files\Java\jre7\lib\jsse.jar;C:\Program Files\Java\jre7\lib\jce.jar;C:\Program Files\Java\jre7\lib\charsets.jar;C:\Program Files\Java\jre7\lib\jfr.jar;C:\Program Files\Java\jre7\classes
            sun.boot.library.path C:\Program Files\Java\jre7\bin
            sun.cpu.endian little
            sun.cpu.isalist amd64
            sun.desktop windows
            sun.io.unicode.encoding UnicodeLittle
            sun.java.command D:\Jenkins_CI\jenkins.war --httpPort=8080 --httpsPort=443 --httpsKeyStore=D:\Jenkins_CI\jre\bin\jenkins.jks --httpsKeyStorePassword=******
            sun.java.launcher SUN_STANDARD
            sun.jnu.encoding Cp1252
            sun.management.compiler HotSpot 64-Bit Tiered Compilers
            sun.os.patch.level Service Pack 1
            svnkit.http.methods Digest,Basic,NTLM,Negotiate
            svnkit.ssh2.persistent false
            svnkit.symlinks false
            user.country US
            user.dir D:\Jenkins_CI
            user.home C:\Users\Administrator
            user.language en
            user.name Administrator
            user.script
            user.timezone America/New_York
            user.variant
            Environment Variables
            Name ↓ Value
            ALLUSERSPROFILE C:\ProgramData
            APPDATA C:\Users\Administrator\AppData\Roaming
            BASE D:\Jenkins_CI
            CommonProgramFiles C:\Program Files\Common Files
            CommonProgramFiles(x86) C:\Program Files (x86)\Common Files
            CommonProgramW6432 C:\Program Files\Common Files
            COMPUTERNAME WIN2K8-R2-0
            ComSpec C:\Windows\system32\cmd.exe
            FP_NO_HOST_CHECK NO
            JAVA_HOME C:\Program Files (x86)\Java\jre7\bin
            JENKINS_HOME D:\Jenkins_CI
            LOCALAPPDATA C:\Users\Administrator\AppData\Local
            NUMBER_OF_PROCESSORS 12
            OS Windows_NT
            Path C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Java\jre7\bin;C:\Python27;C:\Program Files (x86)\Git\bin
            PATHEXT .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC
            PROCESSOR_ARCHITECTURE AMD64
            PROCESSOR_IDENTIFIER Intel64 Family 6 Model 44 Stepping 2, GenuineIntel
            PROCESSOR_LEVEL 6
            PROCESSOR_REVISION 2c02
            ProgramData C:\ProgramData
            ProgramFiles C:\Program Files
            ProgramFiles(x86) C:\Program Files (x86)
            ProgramW6432 C:\Program Files
            PSModulePath C:\Windows\system32\WindowsPowerShell\v1.0\Modules\
            PUBLIC C:\Users\Public
            SystemDrive C:
            SystemRoot C:\Windows
            TEMP C:\Users\ADMINI~1\AppData\Local\Temp
            TMP C:\Users\ADMINI~1\AppData\Local\Temp
            USERDOMAIN WIN2K8-R2-0
            USERNAME Administrator
            USERPROFILE C:\Users\Administrator
            windir C:\Windows
            windows_tracing_flags 3
            windows_tracing_logfile C:\BVTBin\Tests\installpackage\csilogfile.log
            Plugins
            Name ↓ Version Enabled Pinned
            active-directory 1.22 true false
            ant 1.2 true false
            antisamy-markup-formatter 1.0 true false
            artifactory 1.1.0 false false
            async-http-client 1.7.8 true false
            backup 1.6 true false
            build-name-setter 1.0 true false
            build-timeout 1.12.2 true false
            buildgraph-view 1.1 true false
            cloudbees-credentials 3.2 false false
            cloudbees-deployer-plugin 4.3 false false
            cloudbees-plugin-gateway 4.1 false false
            cloudbees-registration 3.11 false false
            cloudbees-wasted-minutes-tracker 3.5 false false
            clover 3.0.2 false false
            cobertura 1.9.3 true false
            conditional-buildstep 1.3.3 true false
            copy-to-slave 1.2.1 true false
            copyartifact 1.14 true false
            coverity 1.2.7 true false
            cppcheck 1.14 true false
            credentials 1.14 true true
            cron_column 1.003 true false
            cvs 2.11 true false
            dashboard-view 2.0 true false
            dependencyanalyzer 0.6 true false
            deployed-on-column 1.7 true false
            disk-usage 0.21 true false
            downstream-buildview 1.8 true false
            downstream-ext 1.6 true false
            doxygen 0.6 true false
            email-ext 2.38.1 true false
            emotional-hudson 1.2 false false
            envinject 1.89 true false
            extended-choice-parameter 0.4 true false
            external-monitor-job 1.2 true false
            files-found-trigger 1.1.3 true false
            flow 1.2 true false
            gallio 1.6 true false
            gcal 0.3 false false
            git 2.2.1 true false
            git-client 1.9.1 true false
            greenballs 1.10 true false
            groovy 1.4 true false
            htmlpublisher 1.3 true false
            javadoc 1.1 true false
            jenkins-multijob-plugin 1.10 true false
            jenkinswalldisplay 0.5.9 true false
            job-dsl 1.16 true false
            jobConfigHistory 1.5 true false
            jobtype-column 1.0 false false
            join 1.9 true false
            ldap 1.10.2 true true
            locks-and-latches 0.6 true false
            log-parser 1.0.4 false false
            mailer 1.6 true false
            matrix-auth 1.1 true false
            maven-plugin 2.1 true false
            monitoring 1.43.0 true false
            multiple-scms 0.3 true false
            nodenamecolumn 1.1 true false
            nunit 0.15 true false
            pam-auth 1.1 true false
            parameterized-trigger 2.12 true false
            platformlabeler 1.1 true false
            plot 1.7 true false
            postbuild-task 1.8 true false
            PrioritySorter 1.1 true false
            rebuild 1.14 true false
            regexemail 0.3 true false
            regression-report-plugin 1.1 true false
            run-condition 1.0 true false
            scm-api 0.2 true false
            screenshot 1.1 true false
            sectioned-view 1.12 true false
            sidebar-link 1.5 true false
            sonar 2.1 true false
            sonargraph-plugin 1.2 true false
            sounds 0.2 false false
            speaks 0.1.1 false false
            ssh-credentials 1.7.1 true true
            ssh-slaves 0.14 true true
            status-view 1.0 true false
            statusmonitor 1.2 true false
            subversion 1.23 true true
            svn-release-mgr 1.2 true false
            svn-tag 1.14 true false
            test-stability 1.0 true false
            testInProgress 1.1 true false
            testlink 2.3.1 true false
            timestamper 1.2.2 true false
            token-macro 1.10 true false
            trac 1.10 true false
            translation 1.10 true false
            valgrind 0.20 true false
            violations 0.7.15-SNAPSHOT (private-01/22/2014 20:25-tanakd1) true false
            vsphere-cloud 1.1.10 false false
            windows-slaves 1.0 true false
            xunit 1.80 false false
            Thread Dumps

            Visit this page for master and slave thread dumps.
            Help us localize this page

            Show
            sharon_xia sharon xia added a comment - System Properties Name ↓ Value awt.toolkit sun.awt.windows.WToolkit executable-war D:\Jenkins_CI\jenkins.war file.encoding Cp1252 file.encoding.pkg sun.io file.separator \ hudson.diyChunking true hudson.lifecycle hudson.lifecycle.WindowsServiceLifecycle java.awt.graphicsenv sun.awt.Win32GraphicsEnvironment java.awt.headless true java.awt.printerjob sun.awt.windows.WPrinterJob java.class.path D:\Jenkins_CI\jenkins.war java.class.version 51.0 java.endorsed.dirs C:\Program Files\Java\jre7\lib\endorsed java.ext.dirs C:\Program Files\Java\jre7\lib\ext;C:\Windows\Sun\Java\lib\ext java.home C:\Program Files\Java\jre7 java.io.tmpdir C:\Users\ADMINI~1\AppData\Local\Temp\ java.library.path C:\Program Files\Java\jre7\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Java\jre7\bin;C:\Python27;C:\Program Files (x86)\Git\bin;. java.runtime.name Java(TM) SE Runtime Environment java.runtime.version 1.7.0_60-b19 java.specification.name Java Platform API Specification java.specification.vendor Oracle Corporation java.specification.version 1.7 java.vendor Oracle Corporation java.vendor.url http://java.oracle.com/ java.vendor.url.bug http://bugreport.sun.com/bugreport/ java.version 1.7.0_60 java.vm.info mixed mode java.vm.name Java HotSpot(TM) 64-Bit Server VM java.vm.specification.name Java Virtual Machine Specification java.vm.specification.vendor Oracle Corporation java.vm.specification.version 1.7 java.vm.vendor Oracle Corporation java.vm.version 24.60-b09 javamelody.analytics-id UA-1335263-7 javamelody.gzip-compression-disabled true javamelody.http-transform-pattern /\d+/|/site/. |avadoc/. |/ws/. |obertura/. |estReport/. |iolations/file/. |/user/. |/static/\w / javamelody.no-database true javamelody.storage-directory /D:\Jenkins_CI\monitoring javamelody.system-actions-enabled true line.separator mail.smtp.sendpartial true mail.smtps.sendpartial true os.arch amd64 os.name Windows Server 2008 R2 os.version 6.1 path.separator ; pid 1340 sun.arch.data.model 64 sun.awt.enableExtraMouseButtons true sun.boot.class.path C:\Program Files\Java\jre7\lib\resources.jar;C:\Program Files\Java\jre7\lib\rt.jar;C:\Program Files\Java\jre7\lib\sunrsasign.jar;C:\Program Files\Java\jre7\lib\jsse.jar;C:\Program Files\Java\jre7\lib\jce.jar;C:\Program Files\Java\jre7\lib\charsets.jar;C:\Program Files\Java\jre7\lib\jfr.jar;C:\Program Files\Java\jre7\classes sun.boot.library.path C:\Program Files\Java\jre7\bin sun.cpu.endian little sun.cpu.isalist amd64 sun.desktop windows sun.io.unicode.encoding UnicodeLittle sun.java.command D:\Jenkins_CI\jenkins.war --httpPort=8080 --httpsPort=443 --httpsKeyStore=D:\Jenkins_CI\jre\bin\jenkins.jks --httpsKeyStorePassword=****** sun.java.launcher SUN_STANDARD sun.jnu.encoding Cp1252 sun.management.compiler HotSpot 64-Bit Tiered Compilers sun.os.patch.level Service Pack 1 svnkit.http.methods Digest,Basic,NTLM,Negotiate svnkit.ssh2.persistent false svnkit.symlinks false user.country US user.dir D:\Jenkins_CI user.home C:\Users\Administrator user.language en user.name Administrator user.script user.timezone America/New_York user.variant Environment Variables Name ↓ Value ALLUSERSPROFILE C:\ProgramData APPDATA C:\Users\Administrator\AppData\Roaming BASE D:\Jenkins_CI CommonProgramFiles C:\Program Files\Common Files CommonProgramFiles(x86) C:\Program Files (x86)\Common Files CommonProgramW6432 C:\Program Files\Common Files COMPUTERNAME WIN2K8-R2-0 ComSpec C:\Windows\system32\cmd.exe FP_NO_HOST_CHECK NO JAVA_HOME C:\Program Files (x86)\Java\jre7\bin JENKINS_HOME D:\Jenkins_CI LOCALAPPDATA C:\Users\Administrator\AppData\Local NUMBER_OF_PROCESSORS 12 OS Windows_NT Path C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Java\jre7\bin;C:\Python27;C:\Program Files (x86)\Git\bin PATHEXT .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE AMD64 PROCESSOR_IDENTIFIER Intel64 Family 6 Model 44 Stepping 2, GenuineIntel PROCESSOR_LEVEL 6 PROCESSOR_REVISION 2c02 ProgramData C:\ProgramData ProgramFiles C:\Program Files ProgramFiles(x86) C:\Program Files (x86) ProgramW6432 C:\Program Files PSModulePath C:\Windows\system32\WindowsPowerShell\v1.0\Modules\ PUBLIC C:\Users\Public SystemDrive C: SystemRoot C:\Windows TEMP C:\Users\ADMINI~1\AppData\Local\Temp TMP C:\Users\ADMINI~1\AppData\Local\Temp USERDOMAIN WIN2K8-R2-0 USERNAME Administrator USERPROFILE C:\Users\Administrator windir C:\Windows windows_tracing_flags 3 windows_tracing_logfile C:\BVTBin\Tests\installpackage\csilogfile.log Plugins Name ↓ Version Enabled Pinned active-directory 1.22 true false ant 1.2 true false antisamy-markup-formatter 1.0 true false artifactory 1.1.0 false false async-http-client 1.7.8 true false backup 1.6 true false build-name-setter 1.0 true false build-timeout 1.12.2 true false buildgraph-view 1.1 true false cloudbees-credentials 3.2 false false cloudbees-deployer-plugin 4.3 false false cloudbees-plugin-gateway 4.1 false false cloudbees-registration 3.11 false false cloudbees-wasted-minutes-tracker 3.5 false false clover 3.0.2 false false cobertura 1.9.3 true false conditional-buildstep 1.3.3 true false copy-to-slave 1.2.1 true false copyartifact 1.14 true false coverity 1.2.7 true false cppcheck 1.14 true false credentials 1.14 true true cron_column 1.003 true false cvs 2.11 true false dashboard-view 2.0 true false dependencyanalyzer 0.6 true false deployed-on-column 1.7 true false disk-usage 0.21 true false downstream-buildview 1.8 true false downstream-ext 1.6 true false doxygen 0.6 true false email-ext 2.38.1 true false emotional-hudson 1.2 false false envinject 1.89 true false extended-choice-parameter 0.4 true false external-monitor-job 1.2 true false files-found-trigger 1.1.3 true false flow 1.2 true false gallio 1.6 true false gcal 0.3 false false git 2.2.1 true false git-client 1.9.1 true false greenballs 1.10 true false groovy 1.4 true false htmlpublisher 1.3 true false javadoc 1.1 true false jenkins-multijob-plugin 1.10 true false jenkinswalldisplay 0.5.9 true false job-dsl 1.16 true false jobConfigHistory 1.5 true false jobtype-column 1.0 false false join 1.9 true false ldap 1.10.2 true true locks-and-latches 0.6 true false log-parser 1.0.4 false false mailer 1.6 true false matrix-auth 1.1 true false maven-plugin 2.1 true false monitoring 1.43.0 true false multiple-scms 0.3 true false nodenamecolumn 1.1 true false nunit 0.15 true false pam-auth 1.1 true false parameterized-trigger 2.12 true false platformlabeler 1.1 true false plot 1.7 true false postbuild-task 1.8 true false PrioritySorter 1.1 true false rebuild 1.14 true false regexemail 0.3 true false regression-report-plugin 1.1 true false run-condition 1.0 true false scm-api 0.2 true false screenshot 1.1 true false sectioned-view 1.12 true false sidebar-link 1.5 true false sonar 2.1 true false sonargraph-plugin 1.2 true false sounds 0.2 false false speaks 0.1.1 false false ssh-credentials 1.7.1 true true ssh-slaves 0.14 true true status-view 1.0 true false statusmonitor 1.2 true false subversion 1.23 true true svn-release-mgr 1.2 true false svn-tag 1.14 true false test-stability 1.0 true false testInProgress 1.1 true false testlink 2.3.1 true false timestamper 1.2.2 true false token-macro 1.10 true false trac 1.10 true false translation 1.10 true false valgrind 0.20 true false violations 0.7.15-SNAPSHOT (private-01/22/2014 20:25-tanakd1) true false vsphere-cloud 1.1.10 false false windows-slaves 1.0 true false xunit 1.80 false false Thread Dumps Visit this page for master and slave thread dumps. Help us localize this page
            Hide
            danielbeck Daniel Beck added a comment -

            Please specify your Jenkins version.

            Show
            danielbeck Daniel Beck added a comment - Please specify your Jenkins version.
            Hide
            danielbeck Daniel Beck added a comment -

            Also, it helps if you're not running Jenkins as Local System or a similarly privileged user.

            Show
            danielbeck Daniel Beck added a comment - Also, it helps if you're not running Jenkins as Local System or a similarly privileged user.
            Hide
            sharon_xia sharon xia added a comment -

            Jenkins Version: Jenkins ver. 1.554.3

            Show
            sharon_xia sharon xia added a comment - Jenkins Version: Jenkins ver. 1.554.3
            Hide
            sharon_xia sharon xia added a comment -

            Actually we are running Jenkins as Local System account "Administrator", does it matter? Will this trigger this issue?

            Show
            sharon_xia sharon xia added a comment - Actually we are running Jenkins as Local System account "Administrator", does it matter? Will this trigger this issue?
            Hide
            sharon_xia sharon xia added a comment -

            Do you mean if we do not run it as Local System then we can get more debugging information or it will trigger this issue? For now I have to move the winp.x64.35A3F35D2ED629A6CEC5B41DD1D280C3.dll out of the WEN-INF/lib folder, however I am not sure what plugin or what function of jenkins will rely on it

            Show
            sharon_xia sharon xia added a comment - Do you mean if we do not run it as Local System then we can get more debugging information or it will trigger this issue? For now I have to move the winp.x64.35A3F35D2ED629A6CEC5B41DD1D280C3.dll out of the WEN-INF/lib folder, however I am not sure what plugin or what function of jenkins will rely on it
            Hide
            danielbeck Daniel Beck added a comment -

            If you run Jenkins as an unprivileged user it doesn't get to kill csrss, so yes, that should be a workaround.

            winp is used as a process killer, usually however only for processes that are started in your builds. This is designed as regular "clean up" after a build finishes.

            Show
            danielbeck Daniel Beck added a comment - If you run Jenkins as an unprivileged user it doesn't get to kill csrss, so yes, that should be a workaround. winp is used as a process killer, usually however only for processes that are started in your builds. This is designed as regular "clean up" after a build finishes.
            Hide
            sharon_xia sharon xia added a comment -

            However when I installed the newest LTS version of jenkins it does not have this dll in it. Do you know which plugin/version might use it?
            Does it work if I upgrade my jenkins to the latest one 1.556.1?

            Also, By default the jenkins will run as Local System and we didn't have this issue before for several years. Why it turns out only recently?

            Show
            sharon_xia sharon xia added a comment - However when I installed the newest LTS version of jenkins it does not have this dll in it. Do you know which plugin/version might use it? Does it work if I upgrade my jenkins to the latest one 1.556.1? Also, By default the jenkins will run as Local System and we didn't have this issue before for several years. Why it turns out only recently?
            Hide
            danielbeck Daniel Beck added a comment -

            winp is used by Jenkins core, only indirectly by plugins.

            There have been a few changes to winp/process killing recently. As I don't use Windows I cannot say for sure what the current status is, generally, killing processes has always been a bit brittle/prone to error. In this case, the fix for JENKINS-22685 comes to mind as a potential candidate.

            Show
            danielbeck Daniel Beck added a comment - winp is used by Jenkins core, only indirectly by plugins. There have been a few changes to winp/process killing recently. As I don't use Windows I cannot say for sure what the current status is, generally, killing processes has always been a bit brittle/prone to error. In this case, the fix for JENKINS-22685 comes to mind as a potential candidate.
            Hide
            sharon_xia sharon xia added a comment -

            Does that mean the latest 1.556.1 still has this issue? Is it OK if I remove winp.x64.35A3F35D2ED629A6CEC5B41DD1D280C3.dll from the WEB-INF/lib folder?

            Show
            sharon_xia sharon xia added a comment - Does that mean the latest 1.556.1 still has this issue? Is it OK if I remove winp.x64.35A3F35D2ED629A6CEC5B41DD1D280C3.dll from the WEB-INF/lib folder?
            Hide
            oleg_nenashev Oleg Nenashev added a comment -

            @sharon

            > Does that mean the latest 1.556.1 still has this issue?

            Most probably, the answer is yes.
            BTW, I cannot find any similar issues in Jenkins JIRA, hence I suppose that the issue does not appear on every Windows installation.
            Probably, it is somehow related to your system configurations or jobs running on the master node (they have Administrator privileges as well)

            > Is it OK if I remove winp.x64.35A3F35D2ED629A6CEC5B41DD1D280C3.dll from the WEB-INF/lib folder?

            No. You'll just corrupt the Jenkins installation with the unpredictable further behavior

            Show
            oleg_nenashev Oleg Nenashev added a comment - @sharon > Does that mean the latest 1.556.1 still has this issue? Most probably, the answer is yes. BTW, I cannot find any similar issues in Jenkins JIRA, hence I suppose that the issue does not appear on every Windows installation. Probably, it is somehow related to your system configurations or jobs running on the master node (they have Administrator privileges as well) > Is it OK if I remove winp.x64.35A3F35D2ED629A6CEC5B41DD1D280C3.dll from the WEB-INF/lib folder? No. You'll just corrupt the Jenkins installation with the unpredictable further behavior
            Hide
            sharon_xia sharon xia added a comment -

            No we did almost all of the tasks on slave jobs and the only job on master does not even run when this issue happen and does not have progress killing related command.

            I believe this might problably related to the last two LFS version. We plan to do a downgrade to 1.532.3 next Monday(we stayed on this version for months and didn't see this issue) to check this issue will be gone or not. Currently even if I delete this dll, it will be generated again automatically. And I don't find a hint which job might trigger it yet.

            Show
            sharon_xia sharon xia added a comment - No we did almost all of the tasks on slave jobs and the only job on master does not even run when this issue happen and does not have progress killing related command. I believe this might problably related to the last two LFS version. We plan to do a downgrade to 1.532.3 next Monday(we stayed on this version for months and didn't see this issue) to check this issue will be gone or not. Currently even if I delete this dll, it will be generated again automatically. And I don't find a hint which job might trigger it yet.
            Hide
            sharon_xia sharon xia added a comment -

            Still see this issue on Jenkins ver. 1.532.3

            Show
            sharon_xia sharon xia added a comment - Still see this issue on Jenkins ver. 1.532.3
            Hide
            sharon_xia sharon xia added a comment -

            Could you please let me know how to run a normal user(not administrator)run jenkins? I followed the guide but it failed: http://technet.microsoft.com/en-us/library/cc787533%28v=WS.10%29.aspx

            Currently this crash issue happens more than once a day...

            Show
            sharon_xia sharon xia added a comment - Could you please let me know how to run a normal user(not administrator)run jenkins? I followed the guide but it failed: http://technet.microsoft.com/en-us/library/cc787533%28v=WS.10%29.aspx Currently this crash issue happens more than once a day...
            Hide
            sharon_xia sharon xia added a comment -

            I took a look at the windows dump file, the blue screen is caused by java.exe which called jenkins.

            GetPointerFromAddress: unable to read from fffff800018be000
            PROCESS fffffa804b96db30
            SessionId: none Cid: 053c Peb: 7fffffd5000 ParentCid: 04f8
            DirBase: 82c93e000 ObjectTable: fffff8a001823860 HandleCount: <Data Not Accessible>
            Image: java.exe
            VadRoot fffffa804bdb6680 Vads 972 Clone 0 Private 744164. Modified 258616. Locked 58.
            DeviceMap fffff8a0019d4cc0
            Token fffff8a001c0da30
            ReadMemory error: Cannot get nt!KeMaximumIncrement value.
            fffff78000000000: Unable to get shared data
            ElapsedTime 00:00:00.000
            UserTime 00:00:00.000
            KernelTime 00:00:00.000
            QuotaPoolUsage[PagedPool] 0
            QuotaPoolUsage[NonPagedPool] 0
            Working Set Sizes (now,min,max) (746794, 50, 345) (2987176KB, 200KB, 1380KB)
            PeakWorkingSetSize 747257
            VirtualSize 20052 Mb
            PeakVirtualSize 20075 Mb
            PageFaultCount 1577231
            MemoryPriority BACKGROUND
            BasePriority 8
            CommitCharge 1015778

                • Error in reading nt!_ETHREAD @ fffffa804b971a30
            Show
            sharon_xia sharon xia added a comment - I took a look at the windows dump file, the blue screen is caused by java.exe which called jenkins. GetPointerFromAddress: unable to read from fffff800018be000 PROCESS fffffa804b96db30 SessionId: none Cid: 053c Peb: 7fffffd5000 ParentCid: 04f8 DirBase: 82c93e000 ObjectTable: fffff8a001823860 HandleCount: <Data Not Accessible> Image: java.exe VadRoot fffffa804bdb6680 Vads 972 Clone 0 Private 744164. Modified 258616. Locked 58. DeviceMap fffff8a0019d4cc0 Token fffff8a001c0da30 ReadMemory error: Cannot get nt!KeMaximumIncrement value. fffff78000000000: Unable to get shared data ElapsedTime 00:00:00.000 UserTime 00:00:00.000 KernelTime 00:00:00.000 QuotaPoolUsage [PagedPool] 0 QuotaPoolUsage [NonPagedPool] 0 Working Set Sizes (now,min,max) (746794, 50, 345) (2987176KB, 200KB, 1380KB) PeakWorkingSetSize 747257 VirtualSize 20052 Mb PeakVirtualSize 20075 Mb PageFaultCount 1577231 MemoryPriority BACKGROUND BasePriority 8 CommitCharge 1015778 Error in reading nt!_ETHREAD @ fffffa804b971a30
            Hide
            sharon_xia sharon xia added a comment -

            This issue is not seen after upgrade jenkins to 1.565.1.
            But we are seeing download issue on 1.565.1. See https://issues.jenkins-ci.org/browse/JENKINS-23868?focusedCommentId=211163#comment-211163

            Show
            sharon_xia sharon xia added a comment - This issue is not seen after upgrade jenkins to 1.565.1. But we are seeing download issue on 1.565.1. See https://issues.jenkins-ci.org/browse/JENKINS-23868?focusedCommentId=211163#comment-211163
            Hide
            scm_issue_link SCM/JIRA link daemon added a comment -

            Code changed in jenkins
            User: Kohsuke Kawaguchi
            Path:
            changelog.html
            http://jenkins-ci.org/commit/jenkins/d000cd65a7b0152334532bc7abd148095d5cee09
            Log:
            [FIXED JENKINS-24453]

            The actual fix is made in 040b7d4047b324f17c0971f2511f954eb173fa23
            through winp.

            Show
            scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Kohsuke Kawaguchi Path: changelog.html http://jenkins-ci.org/commit/jenkins/d000cd65a7b0152334532bc7abd148095d5cee09 Log: [FIXED JENKINS-24453] The actual fix is made in 040b7d4047b324f17c0971f2511f954eb173fa23 through winp.
            scm_issue_link SCM/JIRA link daemon made changes -
            Field Original Value New Value
            Resolution Fixed [ 1 ]
            Status Open [ 1 ] Resolved [ 5 ]
            Hide
            kohsuke Kohsuke Kawaguchi added a comment -

            csrss.exe wouldn't have the right environment variables, so it should never match the killing criteria.

            In 1.583 we made a change to winp so that at least it won't terminate a critical process, but we'll likely still have to figure out why that process was selected as a target of killing.

            Show
            kohsuke Kohsuke Kawaguchi added a comment - csrss.exe wouldn't have the right environment variables, so it should never match the killing criteria. In 1.583 we made a change to winp so that at least it won't terminate a critical process, but we'll likely still have to figure out why that process was selected as a target of killing.
            Hide
            dogfood dogfood added a comment -

            Integrated in jenkins_main_trunk #3700
            [FIXED JENKINS-24453] (Revision d000cd65a7b0152334532bc7abd148095d5cee09)

            Result = SUCCESS
            kohsuke : d000cd65a7b0152334532bc7abd148095d5cee09
            Files :

            • changelog.html
            Show
            dogfood dogfood added a comment - Integrated in jenkins_main_trunk #3700 [FIXED JENKINS-24453] (Revision d000cd65a7b0152334532bc7abd148095d5cee09) Result = SUCCESS kohsuke : d000cd65a7b0152334532bc7abd148095d5cee09 Files : changelog.html
            Hide
            vynce Michael Vincent added a comment -

            We've been running into this issue since at least March 2013. One out of our 5 nodes seems to blue screen every few days. I always figured it was something in Java or driver issue since I didn't think it was possible for a userspace program to crash the whole machine, so I just worked around it.

            We're currently running Jenkins LTS 1.565.2 on a Linux master with Windows 7 64-bit slaves.

            I have a complete crash dump (8.3 GB) from a BSOD today. Here's it's bugcheck analysis. I'm not familiar enough with Windows internals to really dig much deeper, but let me know if I can help debug further.

            Kernel Complete Dump File: Full address space is available
            
            Symbol search path is: srv*D:\MSSymbols*http://msdl.microsoft.com/download/symbols
            Executable search path is: 
            Windows 7 Kernel Version 7601 (Service Pack 1) MP (8 procs) Free x64
            Product: WinNt, suite: TerminalServer SingleUserTS
            Built by: 7601.18229.amd64fre.win7sp1_gdr.130801-1533
            Machine Name:
            Kernel base = 0xfffff800`03049000 PsLoadedModuleList = 0xfffff800`0328c6d0
            Debug session time: Thu Sep 25 13:58:37.568 2014 (UTC - 5:00)
            System Uptime: 2 days 1:04:26.686
            Loading Kernel Symbols
            ...............................................................
            ................................................................
            ....
            Loading User Symbols
            .......................................................
            Loading unloaded module list
            ........Unable to enumerate user-mode unloaded modules, NTSTATUS 0xC0000147
            *******************************************************************************
            *                                                                             *
            *                        Bugcheck Analysis                                    *
            *                                                                             *
            *******************************************************************************
            
            Use !analyze -v to get detailed debugging information.
            
            BugCheck F4, {3, fffffa800aa49060, fffffa800aa49340, fffff800033c50d0}
            
            *** ERROR: Symbol file could not be found.  Defaulted to export symbols for winp.x64.FEF9CB80B43534DCA303AC36686258E8.dll - 
            Probably caused by : _
            
            Followup: MachineOwner
            ---------
            
            2: kd> !analyze -v
            *******************************************************************************
            *                                                                             *
            *                        Bugcheck Analysis                                    *
            *                                                                             *
            *******************************************************************************
            
            CRITICAL_OBJECT_TERMINATION (f4)
            A process or thread crucial to system operation has unexpectedly exited or been
            terminated.
            Several processes and threads are necessary for the operation of the
            system; when they are terminated (for any reason), the system can no
            longer function.
            Arguments:
            Arg1: 0000000000000003, Process
            Arg2: fffffa800aa49060, Terminating object
            Arg3: fffffa800aa49340, Process image file name
            Arg4: fffff800033c50d0, Explanatory message (ascii)
            
            Debugging Details:
            ------------------
            
            
            PROCESS_OBJECT: fffffa800aa49060
            
            IMAGE_NAME:  _
            
            DEBUG_FLR_IMAGE_TIMESTAMP:  0
            
            MODULE_NAME: _
            
            FAULTING_MODULE: 0000000000000000 
            
            PROCESS_NAME:  java.exe
            
            BUGCHECK_STR:  0xF4_java.exe
            
            DEFAULT_BUCKET_ID:  VISTA_DRIVER_FAULT
            
            CURRENT_IRQL:  0
            
            LAST_CONTROL_TRANSFER:  from fffff8000344cd92 to fffff800030beb80
            
            STACK_TEXT:  
            fffff880`072b89c8 fffff800`0344cd92 : 00000000`000000f4 00000000`00000003 fffffa80`0aa49060 fffffa80`0aa49340 : nt!KeBugCheckEx
            fffff880`072b89d0 fffff800`033f91db : ffffffff`ffffffff fffffa80`10987b50 fffffa80`0aa49060 fffffa80`0a3ccb30 : nt!PspCatchCriticalBreak+0x92
            fffff880`072b8a10 fffff800`03378ec4 : ffffffff`ffffffff 00000000`00000001 fffffa80`0aa49060 00000000`00000008 : nt! ?? ::NNGAKEGL::`string'+0x17476
            fffff880`072b8a60 fffff800`030bde13 : fffffa80`0aa49060 00000000`ffffffff fffffa80`10987b50 00000000`00000000 : nt!NtTerminateProcess+0xf4
            fffff880`072b8ae0 00000000`770c157a : 000007fe`fd35402f 00000000`00000000 00000000`00000000 00000000`12c2ec30 : nt!KiSystemServiceCopyEnd+0x13
            00000000`12c2e998 000007fe`fd35402f : 00000000`00000000 00000000`00000000 00000000`12c2ec30 00000000`00000ab0 : ntdll!NtTerminateProcess+0xa
            00000000`12c2e9a0 000007fe`fa3c193c : 00000000`0000075c 00000000`00000001 00000000`00000000 00000000`0000075c : KERNELBASE!TerminateProcess+0x2f
            00000000`12c2e9d0 00000000`0000075c : 00000000`00000001 00000000`00000000 00000000`0000075c 00000000`0052c290 : winp_x64_FEF9CB80B43534DCA303AC36686258E8!Java_org_jvnet_winp_Native_noop+0x178
            00000000`12c2e9d8 00000000`00000001 : 00000000`00000000 00000000`0000075c 00000000`0052c290 000007fe`fa3c1a40 : 0x75c
            00000000`12c2e9e0 00000000`00000000 : 00000000`0000075c 00000000`0052c290 000007fe`fa3c1a40 00000000`000007f0 : 0x1
            
            
            STACK_COMMAND:  kb
            
            FOLLOWUP_NAME:  MachineOwner
            
            FAILURE_BUCKET_ID:  X64_0xF4_java.exe_IMAGE__
            
            BUCKET_ID:  X64_0xF4_java.exe_IMAGE__
            
            Followup: MachineOwner
            ---------
            
            Show
            vynce Michael Vincent added a comment - We've been running into this issue since at least March 2013. One out of our 5 nodes seems to blue screen every few days. I always figured it was something in Java or driver issue since I didn't think it was possible for a userspace program to crash the whole machine, so I just worked around it. We're currently running Jenkins LTS 1.565.2 on a Linux master with Windows 7 64-bit slaves. I have a complete crash dump (8.3 GB) from a BSOD today. Here's it's bugcheck analysis. I'm not familiar enough with Windows internals to really dig much deeper, but let me know if I can help debug further. Kernel Complete Dump File: Full address space is available Symbol search path is: srv*D:\MSSymbols*http://msdl.microsoft.com/download/symbols Executable search path is: Windows 7 Kernel Version 7601 (Service Pack 1) MP (8 procs) Free x64 Product: WinNt, suite: TerminalServer SingleUserTS Built by: 7601.18229.amd64fre.win7sp1_gdr.130801-1533 Machine Name: Kernel base = 0xfffff800`03049000 PsLoadedModuleList = 0xfffff800`0328c6d0 Debug session time: Thu Sep 25 13:58:37.568 2014 (UTC - 5:00) System Uptime: 2 days 1:04:26.686 Loading Kernel Symbols ............................................................... ................................................................ .... Loading User Symbols ....................................................... Loading unloaded module list ........Unable to enumerate user-mode unloaded modules, NTSTATUS 0xC0000147 ******************************************************************************* * * * Bugcheck Analysis * * * ******************************************************************************* Use !analyze -v to get detailed debugging information. BugCheck F4, {3, fffffa800aa49060, fffffa800aa49340, fffff800033c50d0} *** ERROR: Symbol file could not be found. Defaulted to export symbols for winp.x64.FEF9CB80B43534DCA303AC36686258E8.dll - Probably caused by : _ Followup: MachineOwner --------- 2: kd> !analyze -v ******************************************************************************* * * * Bugcheck Analysis * * * ******************************************************************************* CRITICAL_OBJECT_TERMINATION (f4) A process or thread crucial to system operation has unexpectedly exited or been terminated. Several processes and threads are necessary for the operation of the system; when they are terminated (for any reason), the system can no longer function. Arguments: Arg1: 0000000000000003, Process Arg2: fffffa800aa49060, Terminating object Arg3: fffffa800aa49340, Process image file name Arg4: fffff800033c50d0, Explanatory message (ascii) Debugging Details: ------------------ PROCESS_OBJECT: fffffa800aa49060 IMAGE_NAME: _ DEBUG_FLR_IMAGE_TIMESTAMP: 0 MODULE_NAME: _ FAULTING_MODULE: 0000000000000000 PROCESS_NAME: java.exe BUGCHECK_STR: 0xF4_java.exe DEFAULT_BUCKET_ID: VISTA_DRIVER_FAULT CURRENT_IRQL: 0 LAST_CONTROL_TRANSFER: from fffff8000344cd92 to fffff800030beb80 STACK_TEXT: fffff880`072b89c8 fffff800`0344cd92 : 00000000`000000f4 00000000`00000003 fffffa80`0aa49060 fffffa80`0aa49340 : nt!KeBugCheckEx fffff880`072b89d0 fffff800`033f91db : ffffffff`ffffffff fffffa80`10987b50 fffffa80`0aa49060 fffffa80`0a3ccb30 : nt!PspCatchCriticalBreak+0x92 fffff880`072b8a10 fffff800`03378ec4 : ffffffff`ffffffff 00000000`00000001 fffffa80`0aa49060 00000000`00000008 : nt! ?? ::NNGAKEGL::`string'+0x17476 fffff880`072b8a60 fffff800`030bde13 : fffffa80`0aa49060 00000000`ffffffff fffffa80`10987b50 00000000`00000000 : nt!NtTerminateProcess+0xf4 fffff880`072b8ae0 00000000`770c157a : 000007fe`fd35402f 00000000`00000000 00000000`00000000 00000000`12c2ec30 : nt!KiSystemServiceCopyEnd+0x13 00000000`12c2e998 000007fe`fd35402f : 00000000`00000000 00000000`00000000 00000000`12c2ec30 00000000`00000ab0 : ntdll!NtTerminateProcess+0xa 00000000`12c2e9a0 000007fe`fa3c193c : 00000000`0000075c 00000000`00000001 00000000`00000000 00000000`0000075c : KERNELBASE!TerminateProcess+0x2f 00000000`12c2e9d0 00000000`0000075c : 00000000`00000001 00000000`00000000 00000000`0000075c 00000000`0052c290 : winp_x64_FEF9CB80B43534DCA303AC36686258E8!Java_org_jvnet_winp_Native_noop+0x178 00000000`12c2e9d8 00000000`00000001 : 00000000`00000000 00000000`0000075c 00000000`0052c290 000007fe`fa3c1a40 : 0x75c 00000000`12c2e9e0 00000000`00000000 : 00000000`0000075c 00000000`0052c290 000007fe`fa3c1a40 00000000`000007f0 : 0x1 STACK_COMMAND: kb FOLLOWUP_NAME: MachineOwner FAILURE_BUCKET_ID: X64_0xF4_java.exe_IMAGE__ BUCKET_ID: X64_0xF4_java.exe_IMAGE__ Followup: MachineOwner ---------
            vynce Michael Vincent made changes -
            Labels jenkins winp jenkins lts-candidate winp
            Hide
            scm_issue_link SCM/JIRA link daemon added a comment -

            Code changed in jenkins
            User: Kohsuke Kawaguchi
            Path:
            core/pom.xml
            http://jenkins-ci.org/commit/jenkins/21fb398bfa7068f6f72154763bdbb09baddf313d
            Log:
            JENKINS-24453[ZD-20503] Incorporated a newer version of winp.

            This version checks the critical flag of the process, as killing such a
            process results in BSoD.

            (cherry picked from commit 040b7d4047b324f17c0971f2511f954eb173fa23)

            Conflicts:
            changelog.html

            Compare: https://github.com/jenkinsci/jenkins/compare/b105627b7357^...21fb398bfa70

            Show
            scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Kohsuke Kawaguchi Path: core/pom.xml http://jenkins-ci.org/commit/jenkins/21fb398bfa7068f6f72154763bdbb09baddf313d Log: JENKINS-24453 [ZD-20503] Incorporated a newer version of winp. This version checks the critical flag of the process, as killing such a process results in BSoD. (cherry picked from commit 040b7d4047b324f17c0971f2511f954eb173fa23) Conflicts: changelog.html Compare: https://github.com/jenkinsci/jenkins/compare/b105627b7357 ^...21fb398bfa70
            olivergondza Oliver Gondža made changes -
            Labels jenkins lts-candidate winp 1.580.1-fixed jenkins winp
            Hide
            dogfood dogfood added a comment -

            Integrated in jenkins_main_trunk #4292
            JENKINS-24453[ZD-20503] Incorporated a newer version of winp. (Revision 21fb398bfa7068f6f72154763bdbb09baddf313d)

            Result = UNSTABLE
            ogondza : 21fb398bfa7068f6f72154763bdbb09baddf313d
            Files :

            • core/pom.xml
            Show
            dogfood dogfood added a comment - Integrated in jenkins_main_trunk #4292 JENKINS-24453 [ZD-20503] Incorporated a newer version of winp. (Revision 21fb398bfa7068f6f72154763bdbb09baddf313d) Result = UNSTABLE ogondza : 21fb398bfa7068f6f72154763bdbb09baddf313d Files : core/pom.xml
            rtyler R. Tyler Croy made changes -
            Workflow JNJira [ 157434 ] JNJira + In-Review [ 195708 ]
            Anonymous made changes -
            Status Resolved [ 5 ] In Review [ 10005 ]
            danielbeck Daniel Beck made changes -
            Status In Review [ 10005 ] In Progress [ 3 ]
            danielbeck Daniel Beck made changes -
            Status In Progress [ 3 ] Resolved [ 5 ]
            Hide
            p55p Peter p55p added a comment - - edited

            Hello, we are facing similar issue as described in this thread. Based on comments I thought the issue was solved in version 1.580.1 but we are running version 2.19.1 and we got the strange behavior also there.
            One of our Windows boxes resulted in BSOD. When we inspected memory dump we found following details.

            Debugging Details:
            ------------------

            DUMP_CLASS: 1

            DUMP_QUALIFIER: 401

            BUILD_VERSION_STRING: 7601.23572.amd64fre.win7sp1_ldr.161011-0600

            SYSTEM_MANUFACTURER: VMware, Inc.

            VIRTUAL_MACHINE: VMware

            SYSTEM_PRODUCT_NAME: VMware Virtual Platform

            SYSTEM_VERSION: None

            BIOS_VENDOR: Phoenix Technologies LTD

            BIOS_VERSION: 6.00

            BIOS_DATE: 09/17/2015

            BASEBOARD_MANUFACTURER: Intel Corporation

            BASEBOARD_PRODUCT: 440BX Desktop Reference Platform

            BASEBOARD_VERSION: None

            DUMP_TYPE: 1

            BUGCHECK_P1: 3

            BUGCHECK_P2: fffffa8182e4c2a0

            BUGCHECK_P3: fffffa8182e4c580

            BUGCHECK_P4: fffff80001994b70

            PROCESS_NAME: csrss.exe

            CRITICAL_PROCESS: csrss.exe

            IMAGE_NAME: csrss.exe

            DEBUG_FLR_IMAGE_TIMESTAMP: 0

            MODULE_NAME: csrss

            FAULTING_MODULE: 0000000000000000

            EXCEPTION_CODE: (HRESULT) 0x855ee060 (2237587552) - <Unable to get error code text>

            ERROR_CODE: (NTSTATUS) 0x855ee060 - <Unable to get error code text>

            CPU_COUNT: 4

            CPU_MHZ: 960

            CPU_VENDOR: GenuineIntel

            CPU_FAMILY: 6

            CPU_MODEL: f

            CPU_STEPPING: 1

            CPU_MICROCODE: 6,f,1,0 (F,M,S,R) SIG: 428'00000000 (cache) 428'00000000 (init)

            DEFAULT_BUCKET_ID: WIN7_DRIVER_FAULT

            BUGCHECK_STR: 0xF4

            CURRENT_IRQL: 0

            ANALYSIS_SESSION_HOST: NVPC100

            ANALYSIS_SESSION_TIME: 03-01-2017 12:25:49.0246

            ANALYSIS_VERSION: 10.0.14321.1024 amd64fre

            STACK_TEXT:
            fffff880`069abb18 fffff800`01a1e852 : 00000000`000000f4 00000000`00000003 fffffa81`82e4c2a0 fffffa81`82e4c580 : nt!KeBugCheckEx
            fffff880`069abb20 fffff800`019dc09b : 00000000`00000001 fffffa81`855ee060 fffffa81`82e4c2a0 fffffa81`83d68b01 : nt!PspCatchCriticalBreak+0x92
            fffff880`069abb60 fffff800`01945454 : 00000000`00000001 00000000`00000328 fffffa81`82e4c2a0 fffffa81`00000008 : nt! ?? ::NNGAKEGL::`string'+0x27296
            fffff880`069abbb0 fffff800`01689693 : 00000000`00000328 fffffa81`855ee060 fffffa81`82e4c2a0 00000000`00000328 : nt!NtTerminateProcess+0x284
            fffff880`069abc20 00000000`776cbffa : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : nt!KiSystemServiceCopyEnd+0x13
            00000000`1ac8e008 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x776cbffa

            STACK_COMMAND: kb

            FOLLOWUP_NAME: MachineOwner

            FAILURE_BUCKET_ID: X64_0xF4_csrss.exe_BUGCHECK_CRITICAL_PROCESS_TERMINATED_BY_jenkins-slave.exe_855ee060

            BUCKET_ID: X64_0xF4_csrss.exe_BUGCHECK_CRITICAL_PROCESS_TERMINATED_BY_jenkins-slave.exe_855ee060

            PRIMARY_PROBLEM_CLASS: X64_0xF4_csrss.exe_BUGCHECK_CRITICAL_PROCESS_TERMINATED_BY_jenkins-slave.exe_855ee060

            TARGET_TIME: 2017-03-01T09:52:59.000Z

            OSBUILD: 7601

            OSSERVICEPACK: 1000

            SERVICEPACK_NUMBER: 0

            OS_REVISION: 0

            SUITE_MASK: 400

            PRODUCT_TYPE: 3

            OSPLATFORM_TYPE: x64

            OSNAME: Windows 7

            OSEDITION: Windows 7 Server (Service Pack 1) TerminalServer DataCenter SingleUserTS

            OS_LOCALE:

            USER_LCID: 0

            OSBUILD_TIMESTAMP: 2016-10-11 16:57:55

            BUILDDATESTAMP_STR: 161011-0600

            BUILDLAB_STR: win7sp1_ldr

            BUILDOSVER_STR: 6.1.7601.23572.amd64fre.win7sp1_ldr.161011-0600

            ANALYSIS_SESSION_ELAPSED_TIME: 9e0

            ANALYSIS_SOURCE: KM

            FAILURE_ID_HASH_STRING: km:x64_0xf4_csrss.exe_bugcheck_critical_process_terminated_by_jenkins-slave.exe_855ee060

            FAILURE_ID_HASH:

            {795c17b0-7869-c608-f0a3-7708c7ee022c}

            Followup: MachineOwner

            Show
            p55p Peter p55p added a comment - - edited Hello, we are facing similar issue as described in this thread. Based on comments I thought the issue was solved in version 1.580.1 but we are running version 2.19.1 and we got the strange behavior also there. One of our Windows boxes resulted in BSOD. When we inspected memory dump we found following details. Debugging Details: ------------------ DUMP_CLASS: 1 DUMP_QUALIFIER: 401 BUILD_VERSION_STRING: 7601.23572.amd64fre.win7sp1_ldr.161011-0600 SYSTEM_MANUFACTURER: VMware, Inc. VIRTUAL_MACHINE: VMware SYSTEM_PRODUCT_NAME: VMware Virtual Platform SYSTEM_VERSION: None BIOS_VENDOR: Phoenix Technologies LTD BIOS_VERSION: 6.00 BIOS_DATE: 09/17/2015 BASEBOARD_MANUFACTURER: Intel Corporation BASEBOARD_PRODUCT: 440BX Desktop Reference Platform BASEBOARD_VERSION: None DUMP_TYPE: 1 BUGCHECK_P1: 3 BUGCHECK_P2: fffffa8182e4c2a0 BUGCHECK_P3: fffffa8182e4c580 BUGCHECK_P4: fffff80001994b70 PROCESS_NAME: csrss.exe CRITICAL_PROCESS: csrss.exe IMAGE_NAME: csrss.exe DEBUG_FLR_IMAGE_TIMESTAMP: 0 MODULE_NAME: csrss FAULTING_MODULE: 0000000000000000 EXCEPTION_CODE: (HRESULT) 0x855ee060 (2237587552) - <Unable to get error code text> ERROR_CODE: (NTSTATUS) 0x855ee060 - <Unable to get error code text> CPU_COUNT: 4 CPU_MHZ: 960 CPU_VENDOR: GenuineIntel CPU_FAMILY: 6 CPU_MODEL: f CPU_STEPPING: 1 CPU_MICROCODE: 6,f,1,0 (F,M,S,R) SIG: 428'00000000 (cache) 428'00000000 (init) DEFAULT_BUCKET_ID: WIN7_DRIVER_FAULT BUGCHECK_STR: 0xF4 CURRENT_IRQL: 0 ANALYSIS_SESSION_HOST: NVPC100 ANALYSIS_SESSION_TIME: 03-01-2017 12:25:49.0246 ANALYSIS_VERSION: 10.0.14321.1024 amd64fre STACK_TEXT: fffff880`069abb18 fffff800`01a1e852 : 00000000`000000f4 00000000`00000003 fffffa81`82e4c2a0 fffffa81`82e4c580 : nt!KeBugCheckEx fffff880`069abb20 fffff800`019dc09b : 00000000`00000001 fffffa81`855ee060 fffffa81`82e4c2a0 fffffa81`83d68b01 : nt!PspCatchCriticalBreak+0x92 fffff880`069abb60 fffff800`01945454 : 00000000`00000001 00000000`00000328 fffffa81`82e4c2a0 fffffa81`00000008 : nt! ?? ::NNGAKEGL::`string'+0x27296 fffff880`069abbb0 fffff800`01689693 : 00000000`00000328 fffffa81`855ee060 fffffa81`82e4c2a0 00000000`00000328 : nt!NtTerminateProcess+0x284 fffff880`069abc20 00000000`776cbffa : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : nt!KiSystemServiceCopyEnd+0x13 00000000`1ac8e008 00000000`00000000 : 00000000`00000000 00000000`00000000 00000000`00000000 00000000`00000000 : 0x776cbffa STACK_COMMAND: kb FOLLOWUP_NAME: MachineOwner FAILURE_BUCKET_ID: X64_0xF4_csrss.exe_BUGCHECK_CRITICAL_PROCESS_TERMINATED_BY_jenkins-slave.exe_855ee060 BUCKET_ID: X64_0xF4_csrss.exe_BUGCHECK_CRITICAL_PROCESS_TERMINATED_BY_jenkins-slave.exe_855ee060 PRIMARY_PROBLEM_CLASS: X64_0xF4_csrss.exe_BUGCHECK_CRITICAL_PROCESS_TERMINATED_BY_jenkins-slave.exe_855ee060 TARGET_TIME: 2017-03-01T09:52:59.000Z OSBUILD: 7601 OSSERVICEPACK: 1000 SERVICEPACK_NUMBER: 0 OS_REVISION: 0 SUITE_MASK: 400 PRODUCT_TYPE: 3 OSPLATFORM_TYPE: x64 OSNAME: Windows 7 OSEDITION: Windows 7 Server (Service Pack 1) TerminalServer DataCenter SingleUserTS OS_LOCALE: USER_LCID: 0 OSBUILD_TIMESTAMP: 2016-10-11 16:57:55 BUILDDATESTAMP_STR: 161011-0600 BUILDLAB_STR: win7sp1_ldr BUILDOSVER_STR: 6.1.7601.23572.amd64fre.win7sp1_ldr.161011-0600 ANALYSIS_SESSION_ELAPSED_TIME: 9e0 ANALYSIS_SOURCE: KM FAILURE_ID_HASH_STRING: km:x64_0xf4_csrss.exe_bugcheck_critical_process_terminated_by_jenkins-slave.exe_855ee060 FAILURE_ID_HASH: {795c17b0-7869-c608-f0a3-7708c7ee022c} Followup: MachineOwner
            p55p Peter p55p made changes -
            Resolution Fixed [ 1 ]
            Status Resolved [ 5 ] Reopened [ 4 ]
            Hide
            oleg_nenashev Oleg Nenashev added a comment -

            Yes, there is a known issue with WinP: https://github.com/kohsuke/winp/issues/22 . This fix has been released in winp-1.24 and then integrated into Jenkins 2.34: https://github.com/jenkinsci/jenkins/commit/63c2f6c5d7d154a3a0f58c54f04f9b1a25ea5385.

            According to the code the fix has been also backported to Jenkins 2.32.1 though changelogs do not say it explicitly. I will make sure that changelogs get updated.

            The recommendation is to update the core to the latest LTS

            Show
            oleg_nenashev Oleg Nenashev added a comment - Yes, there is a known issue with WinP: https://github.com/kohsuke/winp/issues/22 . This fix has been released in winp-1.24 and then integrated into Jenkins 2.34: https://github.com/jenkinsci/jenkins/commit/63c2f6c5d7d154a3a0f58c54f04f9b1a25ea5385 . According to the code the fix has been also backported to Jenkins 2.32.1 though changelogs do not say it explicitly. I will make sure that changelogs get updated. The recommendation is to update the core to the latest LTS
            Hide
            p55p Peter p55p added a comment -

            Thank you Oleg for your quick response. We will do the upgrade and will let you know if the issue reoccur.

            Show
            p55p Peter p55p added a comment - Thank you Oleg for your quick response. We will do the upgrade and will let you know if the issue reoccur.
            p55p Peter p55p made changes -
            Resolution Fixed [ 1 ]
            Status Reopened [ 4 ] Resolved [ 5 ]
            oleg_nenashev Oleg Nenashev made changes -
            Labels 1.580.1-fixed jenkins winp 1.580.1-fixed 2.32.1-fixed jenkins winp
            Hide
            scm_issue_link SCM/JIRA link daemon added a comment -

            Code changed in jenkins
            User: Oleg Nenashev
            Path:
            content/_data/changelogs/lts.yml
            content/_partials/changelog-weekly.html
            http://jenkins-ci.org/commit/jenkins.io/1e74ef665f37621c5d7fda4c0f5a42e3e4462a59
            Log:
            JENKINS-24453 - Noting fix in Jenkins 2.34 and 2.32.1

            It was a missing fix, since I didn't notice there is a Jenkins JIRA issue for it.
            This PR updates the Weekly release entry and also adds the missing entry for the Stable release

            Show
            scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: Oleg Nenashev Path: content/_data/changelogs/lts.yml content/_partials/changelog-weekly.html http://jenkins-ci.org/commit/jenkins.io/1e74ef665f37621c5d7fda4c0f5a42e3e4462a59 Log: JENKINS-24453 - Noting fix in Jenkins 2.34 and 2.32.1 It was a missing fix, since I didn't notice there is a Jenkins JIRA issue for it. This PR updates the Weekly release entry and also adds the missing entry for the Stable release
            Hide
            scm_issue_link SCM/JIRA link daemon added a comment -

            Code changed in jenkins
            User: R. Tyler Croy
            Path:
            content/_data/changelogs/lts.yml
            content/_partials/changelog-weekly.html
            http://jenkins-ci.org/commit/jenkins.io/89b2c800c392195aca397baac4ceb91af08ad7f4
            Log:
            Merge pull request #723 from oleg-nenashev/changelog/JENKINS-24453

            JENKINS-24453 - Noting fix in Jenkins 2.34 and 2.32.1

            Compare: https://github.com/jenkins-infra/jenkins.io/compare/c49bb48b33bc...89b2c800c392

            Show
            scm_issue_link SCM/JIRA link daemon added a comment - Code changed in jenkins User: R. Tyler Croy Path: content/_data/changelogs/lts.yml content/_partials/changelog-weekly.html http://jenkins-ci.org/commit/jenkins.io/89b2c800c392195aca397baac4ceb91af08ad7f4 Log: Merge pull request #723 from oleg-nenashev/changelog/ JENKINS-24453 JENKINS-24453 - Noting fix in Jenkins 2.34 and 2.32.1 Compare: https://github.com/jenkins-infra/jenkins.io/compare/c49bb48b33bc...89b2c800c392
            oleg_nenashev Oleg Nenashev made changes -
            Link This issue is duplicated by JENKINS-36378 [ JENKINS-36378 ]

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              sharon_xia sharon xia
              Votes:
              1 Vote for this issue
              Watchers:
              8 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: