Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-66491

Memory consumption greater in jdk11 images than in jdk8 images

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Duplicate
    • Icon: Major Major
    • core

      We noticed our Jenkins deployment in Kubernetes was going over our resource limits for memory a 4Gi on existing deployments and on new deployments.  This was causing restarts everytime we viewed a job or sent a remove build command to Jenkins. We noticed this on August 26th 2021

      We usually never hit that limit unless we are doing something abnormal. This issue was hapenning when nothing was going on with jenkins and persisted after deployment restarts, etc.

      The solution we found was to switch from the LTS image to the 2.306 image. We tried other images and they all had the same problem. Changing helm chart versions did not help either. After the switch to the 2.306 image, we had a 50% reduction in memory consumption and it stayed that way.

        1. image-2021-08-30-13-02-14-530.png
          image-2021-08-30-13-02-14-530.png
          24 kB
        2. image-2021-08-30-13-01-09-342.png
          image-2021-08-30-13-01-09-342.png
          8 kB

          [JENKINS-66491] Memory consumption greater in jdk11 images than in jdk8 images

          Neil created issue -
          Neil made changes -
          Description Original: We noticed our Jenkins deployment in Kubernetes was going over our resource limits for memory a 4Gi on existing deployments and on new deployments.  This was causing restarts everytime we viewed a job or sent a remove build command to Jenkins.

          !image-2021-08-30-13-01-09-342.png!

          We usually never hit that limit unless we are doing something abnormal. This issue was hapenning when nothing was going on with jenkins and persisted after deployment restarts, etc.

          The solution we found was to switch from the LTS image to the 2.306 image. We tried other images and they all had the same problem. Changing helm chart versions did not help either. After the switch to the 2.306 image, we had a 50% reduction in memory consumption and it stayed that way.

          !image-2021-08-30-13-02-14-530.png!           		New: We noticed our Jenkins deployment in Kubernetes was going over our resource limits for memory a 4Gi on existing deployments and on new deployments.  This was causing restarts everytime we viewed a job or sent a remove build command to Jenkins. We noticed this on August 26th 2021

          !image-2021-08-30-13-01-09-342.png!

          We usually never hit that limit unless we are doing something abnormal. This issue was hapenning when nothing was going on with jenkins and persisted after deployment restarts, etc.

          The solution we found was to switch from the LTS image to the 2.306 image. We tried other images and they all had the same problem. Changing helm chart versions did not help either. After the switch to the 2.306 image, we had a 50% reduction in memory consumption and it stayed that way.

          !image-2021-08-30-13-02-14-530.png!
          Neil made changes -
          Environment Original: Jenkins: LTS; OS: Amazon Linux 2; Jenkins Helm Chart: 2.6.4
          --
          - Parameterized-Remote-Trigger:3.1.5.1
              - ace-editor:1.1
              - apache-httpcomponents-client-4-api:4.5.13-1.0
              - authentication-tokens:1.4
              - blueocean:1.24.7
              - blueocean-autofavorite:1.2.4
              - blueocean-bitbucket-pipeline:1.24.7
              - blueocean-commons:1.24.7
              - blueocean-config:1.24.7
              - blueocean-core-js:1.24.7
              - blueocean-dashboard:1.24.7
              - blueocean-display-url:2.4.1
              - blueocean-events:1.24.7
              - blueocean-git-pipeline:1.24.7
              - blueocean-github-pipeline:1.24.7
              - blueocean-i18n:1.24.7
              - blueocean-jira:1.24.7
              - blueocean-jwt:1.24.7
              - blueocean-personalization:1.24.7
              - blueocean-pipeline-api-impl:1.24.7
              - blueocean-pipeline-editor:1.24.7
              - blueocean-pipeline-scm-api:1.24.7
              - blueocean-rest:1.24.7
              - blueocean-rest-impl:1.24.7
              - blueocean-web:1.24.7
              - bootstrap4-api:4.6.0-3
              - bootstrap5-api:5.0.1-2
              - bouncycastle-api:2.20
              - branch-api:2.6.4
              - build-blocker-plugin:1.7.7
              - build-failure-analyzer:2.0.0
              - build-monitor-plugin:1.12+build.201809061734
              - build-timeout:1.20
              - build-token-root:1.7
              - caffeine-api:2.9.1-23.v51c4e2c879c8
              - checks-api:1.7.0
              - cloudbees-bitbucket-branch-source:2.9.9
              - cloudbees-folder:6.15
              - command-launcher:1.6
              - copyartifact:1.46.1
              - credentials:2.5
              - credentials-binding:1.27
              - cucumber-reports:5.5.0
              - display-url-api:2.3.5
              - docker-commons:1.17
              - docker-workflow:1.26
              - durable-task:1.37
              - echarts-api:5.1.2-2
              - favorite:2.3.3
              - font-awesome-api:5.15.3-3
              - git:4.7.2
              - git-client:3.7.2
              - git-server:1.10
              - github:1.33.1
              - github-api:1.123
              - github-branch-source:2.11.1
              - google-oauth-plugin:1.0.6
              - handlebars:3.0.8
              - handy-uri-templates-2-api:2.1.8-1.0
              - htmlpublisher:1.25
              - jackson2-api:2.12.3
              - jdk-tool:1.5
              - jenkins-design-language:1.24.7
              - jira:3.5
              - jjwt-api:0.11.2-9.c8b45b8bb173
              - job-dsl:1.77
              - jquery-detached:1.2.1
              - jquery3-api:3.6.0-1
              - jsch:0.1.55.2
              - junit:1.51
              - kubernetes:1.30.1
              - kubernetes-client-api:5.4.1
              - kubernetes-credentials:0.9.0
              - labelled-steps:1.0
              - lockable-resources:2.11
              - mailer:1.34
              - mask-passwords:3.0
              - matrix-project:1.19
              - mercurial:2.15
              - metrics:4.0.2.8
              - momentjs:1.1.1
              - monitoring:1.87.0
              - nested-view:1.20
              - oauth-credentials:0.4
              - okhttp-api:3.14.9
              - pipeline-build-step:2.13
              - pipeline-graph-analysis:1.11
              - pipeline-input-step:2.12
              - pipeline-milestone-step:1.3.2
              - pipeline-model-api:1.8.5
              - pipeline-model-declarative-agent:1.1.1
              - pipeline-model-definition:1.8.5
              - pipeline-model-extensions:1.8.5
              - pipeline-rest-api:2.19
              - pipeline-stage-step:2.5
              - pipeline-stage-tags-metadata:1.8.5
              - pipeline-stage-view:2.19
              - pipeline-utility-steps:2.8.0
              - plain-credentials:1.7
              - plugin-util-api:2.3.0
              - popper-api:1.16.1-2
              - popper2-api:2.5.4-2
              - pubsub-light:1.16
              - rebuild:1.32
              - scm-api:2.6.4
              - script-security:1.77
              - snakeyaml-api:1.29.1
              - sse-gateway:1.24
              - ssh-credentials:1.19
              - sshd:3.0.4
              - structs:1.23
              - timestamper:1.13
              - token-macro:2.15
              - trilead-api:1.0.13
              - variant:1.4
              - view-job-filters:2.3
              - workflow-aggregator:2.6
              - workflow-api:2.46
              - workflow-basic-steps:2.23
              - workflow-cps:2.92
              - workflow-cps-global-lib:2.21
              - workflow-durable-task-step:2.39
              - workflow-job:2.41
              - workflow-multibranch:2.26
              - workflow-scm-step:2.13
              - workflow-step-api:2.24
              - workflow-support:3.8
          		New: Jenkins: LTS; OS: Amazon Linux 2; Jenkins Helm Chart: 2.6.4

          Plugins
          --
          - Parameterized-Remote-Trigger:3.1.5.1
              - ace-editor:1.1
              - apache-httpcomponents-client-4-api:4.5.13-1.0
              - authentication-tokens:1.4
              - blueocean:1.24.7
              - blueocean-autofavorite:1.2.4
              - blueocean-bitbucket-pipeline:1.24.7
              - blueocean-commons:1.24.7
              - blueocean-config:1.24.7
              - blueocean-core-js:1.24.7
              - blueocean-dashboard:1.24.7
              - blueocean-display-url:2.4.1
              - blueocean-events:1.24.7
              - blueocean-git-pipeline:1.24.7
              - blueocean-github-pipeline:1.24.7
              - blueocean-i18n:1.24.7
              - blueocean-jira:1.24.7
              - blueocean-jwt:1.24.7
              - blueocean-personalization:1.24.7
              - blueocean-pipeline-api-impl:1.24.7
              - blueocean-pipeline-editor:1.24.7
              - blueocean-pipeline-scm-api:1.24.7
              - blueocean-rest:1.24.7
              - blueocean-rest-impl:1.24.7
              - blueocean-web:1.24.7
              - bootstrap4-api:4.6.0-3
              - bootstrap5-api:5.0.1-2
              - bouncycastle-api:2.20
              - branch-api:2.6.4
              - build-blocker-plugin:1.7.7
              - build-failure-analyzer:2.0.0
              - build-monitor-plugin:1.12+build.201809061734
              - build-timeout:1.20
              - build-token-root:1.7
              - caffeine-api:2.9.1-23.v51c4e2c879c8
              - checks-api:1.7.0
              - cloudbees-bitbucket-branch-source:2.9.9
              - cloudbees-folder:6.15
              - command-launcher:1.6
              - copyartifact:1.46.1
              - credentials:2.5
              - credentials-binding:1.27
              - cucumber-reports:5.5.0
              - display-url-api:2.3.5
              - docker-commons:1.17
              - docker-workflow:1.26
              - durable-task:1.37
              - echarts-api:5.1.2-2
              - favorite:2.3.3
              - font-awesome-api:5.15.3-3
              - git:4.7.2
              - git-client:3.7.2
              - git-server:1.10
              - github:1.33.1
              - github-api:1.123
              - github-branch-source:2.11.1
              - google-oauth-plugin:1.0.6
              - handlebars:3.0.8
              - handy-uri-templates-2-api:2.1.8-1.0
              - htmlpublisher:1.25
              - jackson2-api:2.12.3
              - jdk-tool:1.5
              - jenkins-design-language:1.24.7
              - jira:3.5
              - jjwt-api:0.11.2-9.c8b45b8bb173
              - job-dsl:1.77
              - jquery-detached:1.2.1
              - jquery3-api:3.6.0-1
              - jsch:0.1.55.2
              - junit:1.51
              - kubernetes:1.30.1
              - kubernetes-client-api:5.4.1
              - kubernetes-credentials:0.9.0
              - labelled-steps:1.0
              - lockable-resources:2.11
              - mailer:1.34
              - mask-passwords:3.0
              - matrix-project:1.19
              - mercurial:2.15
              - metrics:4.0.2.8
              - momentjs:1.1.1
              - monitoring:1.87.0
              - nested-view:1.20
              - oauth-credentials:0.4
              - okhttp-api:3.14.9
              - pipeline-build-step:2.13
              - pipeline-graph-analysis:1.11
              - pipeline-input-step:2.12
              - pipeline-milestone-step:1.3.2
              - pipeline-model-api:1.8.5
              - pipeline-model-declarative-agent:1.1.1
              - pipeline-model-definition:1.8.5
              - pipeline-model-extensions:1.8.5
              - pipeline-rest-api:2.19
              - pipeline-stage-step:2.5
              - pipeline-stage-tags-metadata:1.8.5
              - pipeline-stage-view:2.19
              - pipeline-utility-steps:2.8.0
              - plain-credentials:1.7
              - plugin-util-api:2.3.0
              - popper-api:1.16.1-2
              - popper2-api:2.5.4-2
              - pubsub-light:1.16
              - rebuild:1.32
              - scm-api:2.6.4
              - script-security:1.77
              - snakeyaml-api:1.29.1
              - sse-gateway:1.24
              - ssh-credentials:1.19
              - sshd:3.0.4
              - structs:1.23
              - timestamper:1.13
              - token-macro:2.15
              - trilead-api:1.0.13
              - variant:1.4
              - view-job-filters:2.3
              - workflow-aggregator:2.6
              - workflow-api:2.46
              - workflow-basic-steps:2.23
              - workflow-cps:2.92
              - workflow-cps-global-lib:2.21
              - workflow-durable-task-step:2.39
              - workflow-job:2.41
              - workflow-multibranch:2.26
              - workflow-scm-step:2.13
              - workflow-step-api:2.24
              - workflow-support:3.8
          Mark Waite made changes -
          Summary Original: Memory consumption in 2.306 vs LTS New: Memory consumption greater in 2.306 than in 2.303.1
          Mark Waite made changes -
          Summary Original: Memory consumption greater in 2.306 than in 2.303.1 New: Memory consumption greater in 2.303.1 than in 2.306
          Neil made changes -
          Summary Original: Memory consumption greater in 2.303.1 than in 2.306 New: Memory consumption greater in jdk8 images than in jdk11 images
          Mark Waite made changes -
          Summary Original: Memory consumption greater in jdk8 images than in jdk11 images New: Memory consumption greater in jdk11 images than in jdk8 images
          Basil Crow made changes -
          Epic Link New: JENKINS-67688 [ 214193 ]
          Basil Crow made changes -
          Link New: This issue duplicates JENKINS-63766 [ JENKINS-63766 ]
          Basil Crow made changes -
          Resolution New: Duplicate [ 3 ]
          Status Original: Open [ 1 ] New: Closed [ 6 ]

            Unassigned Unassigned
            nsewardep Neil
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: