Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-62293

Unable to Save an Agent Config at configureClouds - Jenkins 2.234

      We are not able to save any new agent configuration under configureClouds in  Jenkins since our last upgrade to version Jenkins 2.234   .  It throws us out to a login page with the below.

      I tried this multiple times, but no luck. We are blocked. Please help.

       Oops!

      A problem occurred while processing the request.

      Logging ID=2305ce12-f9e6-4778-ae3b-ccc6c9b80731

          [JENKINS-62293] Unable to Save an Agent Config at configureClouds - Jenkins 2.234

          Vinod Radhakrishnan created issue -

          Apologies, I am not sure which component this is part of, hence assigned to ec2-plugin and jcloud. 

          Vinod Radhakrishnan added a comment - Apologies, I am not sure which component this is part of, hence assigned to ec2-plugin and jcloud. 
          Vinod Radhakrishnan made changes -
          Summary Original: Unable to Save an Agent Config at configureClouds New: Unable to Save an Agent Config at configureClouds - Jenkins 2.234
          Vinod Radhakrishnan made changes -
          Component/s New: core [ 15593 ]
          Component/s Original: ec2-plugin [ 15625 ]
          Component/s Original: jclouds-plugin [ 16529 ]

          Oleg Nenashev added a comment -

          vinodkrishna6 could you please provide a full stacktrace. AFAICT the image has not been included, and text would be preferable

          Oleg Nenashev added a comment - vinodkrishna6 could you please provide a full stacktrace. AFAICT the image has not been included, and text would be preferable

          oleg_nenashev , Thanks for reaching out!  All I see is the below when I try to save the configuration from the UI

          http://<mycompany>/configureClouds/configure.  Do you think this might be a permission issue to any files? 

           

          A problem occurred while processing the request.

          Logging ID=a0aa1d54-56a4-4eae-ba5f-ebf12d7a9539

          Vinod Radhakrishnan added a comment - oleg_nenashev , Thanks for reaching out!  All I see is the below when I try to save the configuration from the UI http://<mycompany>/configureClouds/configure.  Do you think this might be a permission issue to any files?    A problem occurred while processing the request. Logging ID=a0aa1d54-56a4-4eae-ba5f-ebf12d7a9539

          more logs from the server, with my latest try. 

           
          "message": "2020-05-15 13:40:18.468+0000 [id=152913]\tWARNING\th.i.i.InstallUncaughtExceptionHandler#handleException: Caught unhandled exception with ID ae32e582-784c-4d18-896e-54fc9a78ae06",
           

          Vinod Radhakrishnan added a comment - more logs from the server, with my latest try.    "message": "2020-05-15 13:40:18.468+0000 [id=152913] \tWARNING\th.i.i.InstallUncaughtExceptionHandler#handleException: Caught unhandled exception with ID ae32e582-784c-4d18-896e-54fc9a78ae06",  

          Oleg Nenashev added a comment -

          I cannot say anything without a full stacktrace vinodkrishna6

          "Caught unhandled exception" definitely suggests a bug in a Cloud plugin or in the Jenkins core, but I cannot pinpoint a root cause without more data. 

           

          Oleg Nenashev added a comment - I cannot say anything without a full stacktrace vinodkrishna6 "Caught unhandled exception" definitely suggests a bug in a Cloud plugin or in the Jenkins core, but I cannot pinpoint a root cause without more data.   

          oleg_nenashev , more logs below. Looks like this is some ECS throttling issue

           

          {"log":"com.amazonaws.services.ecs.model.AmazonECSException: Rate exceeded (Service: AmazonECS; Status Code: 400; Error Code: ThrottlingException; Request ID: 826a17c3-5046-4c80-af51-e9edeba79ed7)\n","stream":"stderr","time":"2020-05-15T15:00:23.521281981Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1799)\n","stream":"stderr","time":"2020-05-15T15:00:23.521286236Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1383)\n","stream":"stderr","time":"2020-05-15T15:00:23.52128993Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1359)\n","stream":"stderr","time":"2020-05-15T15:00:23.521293138Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1139)\n","stream":"stderr","time":"2020-05-15T15:00:23.521296174Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:796)\n","stream":"stderr","time":"2020-05-15T15:00:23.521298921Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:764)\n","stream":"stderr","time":"2020-05-15T15:00:23.521301735Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:738)\n","stream":"stderr","time":"2020-05-15T15:00:23.521304416Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:698)\n","stream":"stderr","time":"2020-05-15T15:00:23.521307206Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:680)\n","stream":"stderr","time":"2020-05-15T15:00:23.521309918Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:544)\n","stream":"stderr","time":"2020-05-15T15:00:23.521314666Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:524)\n","stream":"stderr","time":"2020-05-15T15:00:23.521318806Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.doInvoke(AmazonECSClient.java:4238)\n","stream":"stderr","time":"2020-05-15T15:00:23.521322291Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.invoke(AmazonECSClient.java:4205)\n","stream":"stderr","time":"2020-05-15T15:00:23.521326029Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.invoke(AmazonECSClient.java:4194)\n","stream":"stderr","time":"2020-05-15T15:00:23.521329318Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.executeRegisterTaskDefinition(AmazonECSClient.java:2923)\n","stream":"stderr","time":"2020-05-15T15:00:23.521333095Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.registerTaskDefinition(AmazonECSClient.java:2893)\n","stream":"stderr","time":"2020-05-15T15:00:23.521336939Z"} {"log":"\u0009at com.cloudbees.jenkins.plugins.amazonecs.ECSTaskTemplate.setOwer(ECSTaskTemplate.java:470)\n","stream":"stderr","time":"2020-05-15T15:00:23.521340538Z"} {"log":"\u0009at com.cloudbees.jenkins.plugins.amazonecs.ECSCloud.\u003cinit\u003e(ECSCloud.java:110)\n","stream":"stderr","time":"2020-05-15T15:00:23.521344499Z"} {"log":"\u0009at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n","stream":"stderr","time":"2020-05-15T15:00:23.521349318Z"} {"log":"\u0009at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n","stream":"stderr","time":"2020-05-15T15:00:23.52135307Z"} {"log":"\u0009at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n","stream":"stderr","time":"2020-05-15T15:00:23.521356995Z"} {"log":"\u0009at java.lang.reflect.Constructor.newInstance(Constructor.java:423)\n","stream":"stderr","time":"2020-05-15T15:00:23.521361249Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.invokeConstructor(RequestImpl.java:529)\n","stream":"stderr","time":"2020-05-15T15:00:23.521365025Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.instantiate(RequestImpl.java:784)\n","stream":"stderr","time":"2020-05-15T15:00:23.521369426Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.access$200(RequestImpl.java:83)\n","stream":"stderr","time":"2020-05-15T15:00:23.521376726Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl$TypePair.convertJSON(RequestImpl.java:678)\n","stream":"stderr","time":"2020-05-15T15:00:23.521380483Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.bindJSON(RequestImpl.java:478)\n","stream":"stderr","time":"2020-05-15T15:00:23.521384282Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.bindJSON(RequestImpl.java:474)\n","stream":"stderr","time":"2020-05-15T15:00:23.521388194Z"}

          Vinod Radhakrishnan added a comment - oleg_nenashev , more logs below. Looks like this is some ECS throttling issue   {"log":"com.amazonaws.services.ecs.model.AmazonECSException: Rate exceeded (Service: AmazonECS; Status Code: 400; Error Code: ThrottlingException; Request ID: 826a17c3-5046-4c80-af51-e9edeba79ed7)\n","stream":"stderr","time":"2020-05-15T15:00:23.521281981Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1799)\n","stream":"stderr","time":"2020-05-15T15:00:23.521286236Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1383)\n","stream":"stderr","time":"2020-05-15T15:00:23.52128993Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1359)\n","stream":"stderr","time":"2020-05-15T15:00:23.521293138Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1139)\n","stream":"stderr","time":"2020-05-15T15:00:23.521296174Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:796)\n","stream":"stderr","time":"2020-05-15T15:00:23.521298921Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:764)\n","stream":"stderr","time":"2020-05-15T15:00:23.521301735Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:738)\n","stream":"stderr","time":"2020-05-15T15:00:23.521304416Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:698)\n","stream":"stderr","time":"2020-05-15T15:00:23.521307206Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:680)\n","stream":"stderr","time":"2020-05-15T15:00:23.521309918Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:544)\n","stream":"stderr","time":"2020-05-15T15:00:23.521314666Z"} {"log":"\u0009at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:524)\n","stream":"stderr","time":"2020-05-15T15:00:23.521318806Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.doInvoke(AmazonECSClient.java:4238)\n","stream":"stderr","time":"2020-05-15T15:00:23.521322291Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.invoke(AmazonECSClient.java:4205)\n","stream":"stderr","time":"2020-05-15T15:00:23.521326029Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.invoke(AmazonECSClient.java:4194)\n","stream":"stderr","time":"2020-05-15T15:00:23.521329318Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.executeRegisterTaskDefinition(AmazonECSClient.java:2923)\n","stream":"stderr","time":"2020-05-15T15:00:23.521333095Z"} {"log":"\u0009at com.amazonaws.services.ecs.AmazonECSClient.registerTaskDefinition(AmazonECSClient.java:2893)\n","stream":"stderr","time":"2020-05-15T15:00:23.521336939Z"} {"log":"\u0009at com.cloudbees.jenkins.plugins.amazonecs.ECSTaskTemplate.setOwer(ECSTaskTemplate.java:470)\n","stream":"stderr","time":"2020-05-15T15:00:23.521340538Z"} {"log":"\u0009at com.cloudbees.jenkins.plugins.amazonecs.ECSCloud.\u003cinit\u003e(ECSCloud.java:110)\n","stream":"stderr","time":"2020-05-15T15:00:23.521344499Z"} {"log":"\u0009at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n","stream":"stderr","time":"2020-05-15T15:00:23.521349318Z"} {"log":"\u0009at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n","stream":"stderr","time":"2020-05-15T15:00:23.52135307Z"} {"log":"\u0009at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n","stream":"stderr","time":"2020-05-15T15:00:23.521356995Z"} {"log":"\u0009at java.lang.reflect.Constructor.newInstance(Constructor.java:423)\n","stream":"stderr","time":"2020-05-15T15:00:23.521361249Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.invokeConstructor(RequestImpl.java:529)\n","stream":"stderr","time":"2020-05-15T15:00:23.521365025Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.instantiate(RequestImpl.java:784)\n","stream":"stderr","time":"2020-05-15T15:00:23.521369426Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.access$200(RequestImpl.java:83)\n","stream":"stderr","time":"2020-05-15T15:00:23.521376726Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl$TypePair.convertJSON(RequestImpl.java:678)\n","stream":"stderr","time":"2020-05-15T15:00:23.521380483Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.bindJSON(RequestImpl.java:478)\n","stream":"stderr","time":"2020-05-15T15:00:23.521384282Z"} {"log":"\u0009at org.kohsuke.stapler.RequestImpl.bindJSON(RequestImpl.java:474)\n","stream":"stderr","time":"2020-05-15T15:00:23.521388194Z"}
          Oleg Nenashev made changes -
          Component/s New: ec2-plugin [ 15625 ]
          Component/s Original: core [ 15593 ]

            roehrijn2 Jan Roehrich
            vinodkrishna6 Vinod Radhakrishnan
            Votes:
            2 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated: