-
Bug
-
Resolution: Unresolved
-
Blocker
-
None
After updating to v7.4 the log-in page for our Jenkins instance was rejecting all authentication attempts (c.f. jenkins_plugins_list.txt where each line is "<plugin name>: <plugin version>").
I wasn't able to find a direct indication of the bug, but I did see other plugins warning of the issue:
Jul 14 10:07:12 Hemera jenkins[1011417]: 2022-07-14 16:07:12.150+0000 [id=41779] WARNING h.p.e.ExtendedEmailPublisher#sendMail: Could not send email. Jul 14 10:07:12 Hemera jenkins[1011417]: java.lang.NullPointerException Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.Util.fileToPath(Util.java:1735) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.model.UserIdMapper.createDirectoryForNewUser(UserIdMapper.java:145) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.model.UserIdMapper.putIfAbsent(UserIdMapper.java:92) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.model.User.putUserFolderIfAbsent(User.java:827) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.model.User.constructUserConfigFile(User.java:823) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.model.User.save(User.java:817) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.model.User.addProperty(User.java:337) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.plugins.git.GitChangeSet.setMail(GitChangeSet.java:494) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.plugins.git.GitChangeSet.findOrCreateUser(GitChangeSet.java:474) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.plugins.git.GitChangeSet.getAuthor(GitChangeSet.java:546) Jul 14 10:07:12 Hemera jenkins[1011417]: at jenkins.scm.RunWithSCM.calculateCulprits(RunWithSCM.java:141) Jul 14 10:07:12 Hemera jenkins[1011417]: at jenkins.scm.RunWithSCM.getCulprits(RunWithSCM.java:96) Jul 14 10:07:12 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.job.WorkflowRun.getCulprits(WorkflowRun.java:859) Jul 14 10:07:12 Hemera jenkins[1011417]: at jenkins.scm.RunWithSCM.calculateCulprits(RunWithSCM.java:136) Jul 14 10:07:12 Hemera jenkins[1011417]: at jenkins.scm.RunWithSCM.getCulprits(RunWithSCM.java:96) Jul 14 10:07:12 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.job.WorkflowRun.getCulprits(WorkflowRun.java:859) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.plugins.emailext.plugins.recipients.CulpritsRecipientProvider.addRecipients(CulpritsRecipientProvider.java:59) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.plugins.emailext.ExtendedEmailPublisher.createMail(ExtendedEmailPublisher.java:926) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.plugins.emailext.ExtendedEmailPublisher.sendMail(ExtendedEmailPublisher.java:494) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.plugins.emailext.EmailExtStep$EmailExtStepExecution.run(EmailExtStep.java:249) Jul 14 10:07:12 Hemera jenkins[1011417]: at hudson.plugins.emailext.EmailExtStep$EmailExtStepExecution.run(EmailExtStep.java:182) Jul 14 10:07:12 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.steps.SynchronousNonBlockingStepExecution.lambda$start$0(SynchronousNonBlockingStepExecution.java:47) Jul 14 10:07:12 Hemera jenkins[1011417]: at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) Jul 14 10:07:12 Hemera jenkins[1011417]: at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) Jul 14 10:07:12 Hemera jenkins[1011417]: at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) Jul 14 10:07:12 Hemera jenkins[1011417]: at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) Jul 14 10:07:12 Hemera jenkins[1011417]: at java.base/java.lang.Thread.run(Thread.java:829) Jul 14 10:07:12 Hemera jenkins[1011417]: 2022-07-14 16:07:12.502+0000 [id=7202] INFO o.j.p.workflow.job.WorkflowRun#finish: Toolbox_MATLAB_Test_Suite-Simple/bugfix%2FSP-6510-checkerboard-rois-fiducial-marks #4 completed: UNSTABLE Jul 14 10:07:13 Hemera jenkins[1011417]: 2022-07-14 16:07:13.031+0000 [id=7202] WARNING o.j.p.workflow.job.WorkflowRun#getLogFile: Avoid calling getLogFile on Toolbox_MATLAB_Test_Suite-Simple/bugfix%2FSP-6510-checkerboard-rois-fiducial-marks #4 Jul 14 10:07:13 Hemera jenkins[1011417]: java.lang.UnsupportedOperationException Jul 14 10:07:13 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.job.WorkflowRun.getLogFile(WorkflowRun.java:1173) Jul 14 10:07:13 Hemera jenkins[1011417]: at org.jenkinsci.plugins.compressbuildlog.BuildLogCompressor$CompressBuildlogRunListener.onFinalized(BuildLogCompressor.java:85) Jul 14 10:07:13 Hemera jenkins[1011417]: at hudson.model.listeners.RunListener.lambda$fireFinalized$3(RunListener.java:244) Jul 14 10:07:13 Hemera jenkins[1011417]: at jenkins.util.Listeners.lambda$notify$0(Listeners.java:59) Jul 14 10:07:13 Hemera jenkins[1011417]: at jenkins.util.Listeners.notify(Listeners.java:67) Jul 14 10:07:13 Hemera jenkins[1011417]: at hudson.model.listeners.RunListener.fireFinalized(RunListener.java:242) Jul 14 10:07:13 Hemera jenkins[1011417]: at hudson.model.Run.onEndBuilding(Run.java:2059) Jul 14 10:07:13 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.job.WorkflowRun.finish(WorkflowRun.java:646) Jul 14 10:07:13 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.job.WorkflowRun.access$800(WorkflowRun.java:138) Jul 14 10:07:13 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.job.WorkflowRun$GraphL.onNewHead(WorkflowRun.java:1049) Jul 14 10:07:13 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.cps.CpsFlowExecution.notifyListeners(CpsFlowExecution.java:1518) Jul 14 10:07:13 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$3.run(CpsThreadGroup.java:509) Jul 14 10:07:13 Hemera jenkins[1011417]: at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$1.run(CpsVmExecutorService.java:38) Jul 14 10:07:13 Hemera jenkins[1011417]: at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:139) Jul 14 10:07:13 Hemera jenkins[1011417]: at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:30) Jul 14 10:07:13 Hemera jenkins[1011417]: at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:70) Jul 14 10:07:13 Hemera jenkins[1011417]: at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) Jul 14 10:07:13 Hemera jenkins[1011417]: at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) Jul 14 10:07:13 Hemera jenkins[1011417]: at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) Jul 14 10:07:13 Hemera jenkins[1011417]: at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) Jul 14 10:07:13 Hemera jenkins[1011417]: at java.base/java.lang.Thread.run(Thread.java:829)
Essentially somehow Jenkins is no longer able to get the correct path to the /var/lib/jenkins/users directory, wherein its internal database is stored (that is how our instance is configured for authentication), after the v7.4 plugin is installed.
I was able to determine that the v7.4 plugin was the issue by repeadetly re-installing jenkins and installing collections of plugins from the list (roughly using a binary search algorithm) until it was clear that when the v7.4 plugin was present with the others, authentication was broken. If I removed it, or downgrade to v7.3, authentication worked.