Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-16095

Heap memory leak (possibly jclouds plugin related)

      We're running into a memory leak that might be related to the jclouds plugin. Running with a heap of 5.5gb, old gen becomes full after a couple of days with moderate to heavy load.

      We have a setup with jenkins & jclouds provisioning test instances on a private nova-compute cloud.

      When I look at the heap dump it seems that there's a guava cache that occupies 70% of the heap. Any idea how to proceed debugging this?

      This is jeknins 1.492, jclouds plugin 2.3.1

        1. screenshot-leak.png
          screenshot-leak.png
          98 kB
        2. screenshot-leak2.png
          screenshot-leak2.png
          79 kB
        3. screenshot-leak3.png
          screenshot-leak3.png
          185 kB
        4. screenshot-leak-4.png
          screenshot-leak-4.png
          51 kB
        5. screenshot-leak-5.png
          screenshot-leak-5.png
          214 kB

          [JENKINS-16095] Heap memory leak (possibly jclouds plugin related)

          onemanbucket created issue -
          onemanbucket made changes -
          Description Original: We're running into a memory leak that might be related to the jclouds plugin. Running with a heap of 5.5gb, old gen becomes full after a couple of days with moderate to heavy load.

          We have a setup with jenkins & jclouds provisioning test instances on a private nova-compute cloud.

          When I look at the heap dump it seems that there's a guava cache that occupies 70% of the heap. Any idea how to proceed debugging this?
          New: We're running into a memory leak that might be related to the jclouds plugin. Running with a heap of 5.5gb, old gen becomes full after a couple of days with moderate to heavy load.

          We have a setup with jenkins & jclouds provisioning test instances on a private nova-compute cloud.

          When I look at the heap dump it seems that there's a guava cache that occupies 70% of the heap. Any idea how to proceed debugging this?

          This is jeknins 1.492, jclouds plugin 2.3.1

          Andrew Bayer added a comment -

          Lemme see what other jclouds people think.

          Andrew Bayer added a comment - Lemme see what other jclouds people think.

          onemanbucket added a comment -

          Ok cool. There's a lot of reflect.Method objects (1.2gb shallow heap) that are cached by jclouds if that could help investigate this further. Attaching 2 more screenshots.

          onemanbucket added a comment - Ok cool. There's a lot of reflect.Method objects (1.2gb shallow heap) that are cached by jclouds if that could help investigate this further. Attaching 2 more screenshots.
          onemanbucket made changes -
          Attachment New: screenshot-leak-4.png [ 22959 ]
          Attachment New: screenshot-leak-5.png [ 22960 ]

          onemanbucket added a comment -

          abayer, did you check with the jclouds people? Is there anything else I can do to help?

          onemanbucket added a comment - abayer, did you check with the jclouds people? Is there anything else I can do to help?

          onemanbucket added a comment -

          After discussion on IRC this should be solved in jclouds 1.6. I'll do some testing and post results here

          onemanbucket added a comment - After discussion on IRC this should be solved in jclouds 1.6. I'll do some testing and post results here

          onemanbucket added a comment -

          We've used a jclouds-plugin build based on jclouds 1.6.0-snapshot, for a week now and the leak seems to be gone.

          onemanbucket added a comment - We've used a jclouds-plugin build based on jclouds 1.6.0-snapshot, for a week now and the leak seems to be gone.
          Jesse Glick made changes -
          Labels New: memory-leak performance

          Daniel Beck added a comment -

          Most recent comment indicates this was resolved long ago.

          Daniel Beck added a comment - Most recent comment indicates this was resolved long ago.
          Daniel Beck made changes -
          Resolution New: Fixed [ 1 ]
          Status Original: Open [ 1 ] New: Resolved [ 5 ]

            abayer Andrew Bayer
            onemanbucket onemanbucket
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: