Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-66590

Kinesis consumer fails shutting down workers

XMLWordPrintable

    • 1.0.3

      Shutdown jenkins and observe the following exception in the logs:

      2021-09-08 20:19:15.731+0000 [id=116]	WARNING	s.amazon.awssdk.utils.Logger#warn: A non-I/O exception occurred on a channel (c9738107/1) that was not in use. The channel has been closed to prevent any ongoing issues.
      software.amazon.awssdk.http.SdkCancellationException: Subscriber cancelled before all events were published
      	at software.amazon.awssdk.http.nio.netty.internal.ResponseHandler$PublisherAdapter$1.onCancel(ResponseHandler.java:241)
      	at software.amazon.awssdk.http.nio.netty.internal.ResponseHandler$OnCancelSubscription.cancel(ResponseHandler.java:330)
      	at software.amazon.awssdk.awscore.eventstream.EventStreamAsyncResponseTransformer$EventPublisher$1.cancel(EventStreamAsyncResponseTransformer.java:438)
      	at software.amazon.kinesis.retrieval.fanout.FanOutRecordsPublisher$RecordSubscription.cancel(FanOutRecordsPublisher.java:920)
      	at software.amazon.kinesis.retrieval.fanout.FanOutRecordsPublisher$RecordFlow.cancel(FanOutRecordsPublisher.java:872)
      	at software.amazon.kinesis.retrieval.fanout.FanOutRecordsPublisher$1.cancel(FanOutRecordsPublisher.java:647)
      	at io.reactivex.internal.subscriptions.SubscriptionHelper.cancel(SubscriptionHelper.java:189)
      	at io.reactivex.internal.operators.flowable.FlowableSubscribeOn$SubscribeOnSubscriber.cancel(FlowableSubscribeOn.java:141)
      	at io.reactivex.internal.operators.flowable.FlowableObserveOn$BaseObserveOnSubscriber.cancel(FlowableObserveOn.java:154)
      	at io.reactivex.internal.subscriptions.SubscriptionHelper.cancel(SubscriptionHelper.java:189)
      	at io.reactivex.internal.subscribers.StrictSubscriber.cancel(StrictSubscriber.java:77)
      	at software.amazon.kinesis.lifecycle.ShardConsumerSubscriber.cancel(ShardConsumerSubscriber.java:219)
      	at software.amazon.kinesis.lifecycle.ShardConsumer.gracefulShutdown(ShardConsumer.java:408)
      	at software.amazon.kinesis.coordinator.Scheduler.lambda$createWorkerShutdownCallable$20(Scheduler.java:779)
      	at software.amazon.kinesis.coordinator.GracefulShutdownCoordinator$GracefulShutdownCallable.call(GracefulShutdownCoordinator.java:152)
      	at software.amazon.kinesis.coordinator.GracefulShutdownCoordinator$GracefulShutdownCallable.call(GracefulShutdownCoordinator.java:38)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      Caused: software.amazon.awssdk.http.nio.netty.internal.FutureCancelledException
      	at software.amazon.awssdk.http.nio.netty.internal.NettyRequestExecutor.lambda$null$1(NettyRequestExecutor.java:124)
      	at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98)
      	at io.netty.util.concurrent.PromiseTask.run(PromiseTask.java:106)
      	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
      	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
      	at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:500)
      	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
      	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
      	at java.lang.Thread.run(Thread.java:748)
      

            ponch F Ponciroli
            syntonyze Antonio
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: