[JENKINS-65152] Jenkins stucks on "Jenkins doesn't have label one some images"

David Koenig created issue - 2021-03-17 14:35

David Koenig made changes - 2021-03-17 16:53

Description

Original: Hi,

found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

In best case it should be restricted by the interface (better by the API). At minimum an information must be shown in the logfiles.

New:

i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

In best case it should be restricted by the interface (better by the API). At minimum an information must be shown in the logfiles.

David Koenig made changes - 2021-03-17 16:53

Summary

Original: Jenkins stucks on "Jenkins doesn't have label one some images" when tag is too long

New: Jenkins stucks on "Jenkins doesn't have label one some images"

David Koenig made changes - 2021-03-17 17:03

Description

Original:

i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

In best case it should be restricted by the interface (better by the API). At minimum an information must be shown in the logfiles.

New:

i thought found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the refrenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Any idea, what do

Here is my casc.yml

{quote}credentials:
  system:
    domainCredentials:
    - credentials:
      - usernamePassword:
          description: "User to access gitea with a token"
          id: "api_service_user_giteatoken"
          password: "#API_SERVICE_USER_GITEATOKEN#"
          scope: SYSTEM
          username: "#API_SERVICE_USER_NAME#"
      - usernamePassword:
          description: "User to access all systems (except gitea, because token is needed)"
          id: "api_service_user_password"
          password: "#API_SERVICE_USER_PASSWORD#"
          scope: SYSTEM
          username: "#API_SERVICE_USER_NAME#"
jenkins:
  agentProtocols:
  - "JNLP4-connect"
  - "Ping"
  clouds:
    - docker:
        containerCap: 6
        dockerApi:
          connectTimeout: 60
          dockerHost:
            uri: "unix:///var/run/docker.sock"
          readTimeout: 60
        errorDuration: 60
        name: "lcl-slave-cloud"
        templates:
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "lcl_debian"
          name: "lcl_debian"
          pullStrategy: PULL_NEVER
          pullTimeout: 30
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "lcl_debian-jdkmvn"
          name: "lcl_debian-jdkmvn"
          pullStrategy: PULL_NEVER
          pullTimeout: 30
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "lcl_debian-devworkplace"
          name: "lcl_debian-devworkplace"
          pullStrategy: PULL_ALWAYS
          pullTimeout: 30
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "lcl_debian-acdefault"
          name: "lcl_debian-acdefault"
          pullStrategy: PULL_ALWAYS
          pullTimeout: 30
    - docker:
        containerCap: 6
        dockerApi:
          connectTimeout: 60
          dockerHost:
            uri: "tcp://IP:2375"
          readTimeout: 60
        name: "aud-slave-cloud"
        templates:
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "aud_debian-acdefault"
          name: "aud_debian-acdefault"
          pullStrategy: PULL_ALWAYS
          pullTimeout: 30
  labelAtoms:
    - name: "lcl_debian"
    - name: "lcl_debian-jdkmvn"
    - name: "lcl_debian-devworkplace"
    - name: "lcl_debian-acdefault"
    - name: "aud_debian-acdefault"
    - name: "master"
  labelString: "master"
  crumbIssuer:
    standard:
      excludeClientIPFromCrumb: false
  disableRememberMe: false
  disabledAdministrativeMonitors:
    - "hudson.diagnosis.ReverseProxySetupMonitor"
  markupFormatter: "plainText"
  mode: EXCLUSIVE
  myViewsTabBar: "standard"
  numExecutors: 2
  primaryView:
    all:
      name: "all"
  projectNamingStrategy: "standard"
  quietPeriod: 5
  remotingSecurity:
    enabled: false
  scmCheckoutRetryCount: 2
  securityRealm:
      reverseProxy:
        disableLdapEmailResolver: false
        forwardedUser: "X-USER"
        headerGroups: "X-Forwarded-Groups"
        headerGroupsDelimiter: "|"
        inhibitInferRootDN: false
        updateInterval: 15
        userSearch: "uid=\{0}"
  slaveAgentPort: 50000
  systemMessage: "Jenkins master server"
  updateCenter:
    sites:
    - id: "default"
      url: "https://updates.jenkins.io/update-center.json"
  views:
  - all:
      name: "all"
  viewsTabBar: "standard"
unclassified:
  giteaServers:
    servers:
    - credentialsId: "api_service_user_giteatoken"
      displayName: "gitea server"
      manageHooks: true
      serverUrl: "#GITEA_SERVER#"
  globalLibraries:
    libraries:
    - defaultVersion: "master"
      name: "Hub"
      retriever:
        modernSCM:
          scm:
            git:
              id: "d6f0a286-756c-4667-aac2-b764c566661e"
              remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
              traits:
              - "branchDiscoveryTrait"
  buildDiscarders:
    configuredBuildDiscarders:
    - "jobBuildDiscarder"
  location:
    adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
    url: "#CFG_JENKINS_URL#"
  pollSCM:
    pollingThreadCount: 10
  email-ext:
    adminRequiredForTemplateTesting: false
    allowUnregisteredEnabled: true
    charset: "UTF-8"
    debugMode: false
    defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
    \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
    \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
    \   \n\
    \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
    \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
    \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
    >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
    \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
    >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
    \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
    \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
    \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
    \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
    \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
    \  </tr>\n      </table>\n    </div>\n</BODY>"
    defaultContentType: "text/html"
    defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
    defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
    defaultTriggerIds:
    - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
    mailAccount:
      smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
      smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
      smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
      smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
    maxAttachmentSize: -1
    maxAttachmentSizeMb: -1
    precedenceBulk: false
    watchingEnabled: false
jobs:
  - file: /data/jenkins/config/dsl/seed.groovy
  - file: /data/jenkins/config/dsl/custom.groovy{quote}

David Koenig made changes - 2021-03-17 17:03

Priority

Original: Minor [ 4 ]

New: Major [ 3 ]

David Koenig made changes - 2021-03-17 17:04

Description

Original:

i thought found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the refrenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Any idea, what do

Here is my casc.yml

{quote}credentials:
  system:
    domainCredentials:
    - credentials:
      - usernamePassword:
          description: "User to access gitea with a token"
          id: "api_service_user_giteatoken"
          password: "#API_SERVICE_USER_GITEATOKEN#"
          scope: SYSTEM
          username: "#API_SERVICE_USER_NAME#"
      - usernamePassword:
          description: "User to access all systems (except gitea, because token is needed)"
          id: "api_service_user_password"
          password: "#API_SERVICE_USER_PASSWORD#"
          scope: SYSTEM
          username: "#API_SERVICE_USER_NAME#"
jenkins:
  agentProtocols:
  - "JNLP4-connect"
  - "Ping"
  clouds:
    - docker:
        containerCap: 6
        dockerApi:
          connectTimeout: 60
          dockerHost:
            uri: "unix:///var/run/docker.sock"
          readTimeout: 60
        errorDuration: 60
        name: "lcl-slave-cloud"
        templates:
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "lcl_debian"
          name: "lcl_debian"
          pullStrategy: PULL_NEVER
          pullTimeout: 30
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "lcl_debian-jdkmvn"
          name: "lcl_debian-jdkmvn"
          pullStrategy: PULL_NEVER
          pullTimeout: 30
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "lcl_debian-devworkplace"
          name: "lcl_debian-devworkplace"
          pullStrategy: PULL_ALWAYS
          pullTimeout: 30
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "lcl_debian-acdefault"
          name: "lcl_debian-acdefault"
          pullStrategy: PULL_ALWAYS
          pullTimeout: 30
    - docker:
        containerCap: 6
        dockerApi:
          connectTimeout: 60
          dockerHost:
            uri: "tcp://IP:2375"
          readTimeout: 60
        name: "aud-slave-cloud"
        templates:
        - connector:
            attach:
              user: "jenkins"
          dockerTemplateBase:
            cpuPeriod: 0
            cpuQuota: 0
            image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
            pullCredentialsId: "api_service_user_password"
            volumes:
            - "/var/run/docker.sock:/var/run/docker.sock"
            volumesString: "/var/run/docker.sock:/var/run/docker.sock"
          labelString: "aud_debian-acdefault"
          name: "aud_debian-acdefault"
          pullStrategy: PULL_ALWAYS
          pullTimeout: 30
  labelAtoms:
    - name: "lcl_debian"
    - name: "lcl_debian-jdkmvn"
    - name: "lcl_debian-devworkplace"
    - name: "lcl_debian-acdefault"
    - name: "aud_debian-acdefault"
    - name: "master"
  labelString: "master"
  crumbIssuer:
    standard:
      excludeClientIPFromCrumb: false
  disableRememberMe: false
  disabledAdministrativeMonitors:
    - "hudson.diagnosis.ReverseProxySetupMonitor"
  markupFormatter: "plainText"
  mode: EXCLUSIVE
  myViewsTabBar: "standard"
  numExecutors: 2
  primaryView:
    all:
      name: "all"
  projectNamingStrategy: "standard"
  quietPeriod: 5
  remotingSecurity:
    enabled: false
  scmCheckoutRetryCount: 2
  securityRealm:
      reverseProxy:
        disableLdapEmailResolver: false
        forwardedUser: "X-USER"
        headerGroups: "X-Forwarded-Groups"
        headerGroupsDelimiter: "|"
        inhibitInferRootDN: false
        updateInterval: 15
        userSearch: "uid=\{0}"
  slaveAgentPort: 50000
  systemMessage: "Jenkins master server"
  updateCenter:
    sites:
    - id: "default"
      url: "https://updates.jenkins.io/update-center.json"
  views:
  - all:
      name: "all"
  viewsTabBar: "standard"
unclassified:
  giteaServers:
    servers:
    - credentialsId: "api_service_user_giteatoken"
      displayName: "gitea server"
      manageHooks: true
      serverUrl: "#GITEA_SERVER#"
  globalLibraries:
    libraries:
    - defaultVersion: "master"
      name: "Hub"
      retriever:
        modernSCM:
          scm:
            git:
              id: "d6f0a286-756c-4667-aac2-b764c566661e"
              remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
              traits:
              - "branchDiscoveryTrait"
  buildDiscarders:
    configuredBuildDiscarders:
    - "jobBuildDiscarder"
  location:
    adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
    url: "#CFG_JENKINS_URL#"
  pollSCM:
    pollingThreadCount: 10
  email-ext:
    adminRequiredForTemplateTesting: false
    allowUnregisteredEnabled: true
    charset: "UTF-8"
    debugMode: false
    defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
    \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
    \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
    \   \n\
    \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
    \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
    \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
    >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
    \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
    >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
    \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
    \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
    \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
    \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
    \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
    \  </tr>\n      </table>\n    </div>\n</BODY>"
    defaultContentType: "text/html"
    defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
    defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
    defaultTriggerIds:
    - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
    mailAccount:
      smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
      smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
      smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
      smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
    maxAttachmentSize: -1
    maxAttachmentSizeMb: -1
    precedenceBulk: false
    watchingEnabled: false
jobs:
  - file: /data/jenkins/config/dsl/seed.groovy
  - file: /data/jenkins/config/dsl/custom.groovy{quote}

New:

i thought i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the referenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Any idea, what do

Here is my casc.yml

{quote}credentials:
   system:
     domainCredentials:
     - credentials:
       - usernamePassword:
           description: "User to access gitea with a token"
           id: "api_service_user_giteatoken"
           password: "#API_SERVICE_USER_GITEATOKEN#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
       - usernamePassword:
           description: "User to access all systems (except gitea, because token is needed)"
           id: "api_service_user_password"
           password: "#API_SERVICE_USER_PASSWORD#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
jenkins:
   agentProtocols:
   - "JNLP4-connect"
   - "Ping"
   clouds:
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "unix:///var/run/docker.sock"
           readTimeout: 60
         errorDuration: 60
         name: "lcl-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian"
           name: "lcl_debian"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-jdkmvn"
           name: "lcl_debian-jdkmvn"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-devworkplace"
           name: "lcl_debian-devworkplace"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-acdefault"
           name: "lcl_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "tcp://IP:2375"
           readTimeout: 60
         name: "aud-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "aud_debian-acdefault"
           name: "aud_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
   labelAtoms:
     - name: "lcl_debian"
     - name: "lcl_debian-jdkmvn"
     - name: "lcl_debian-devworkplace"
     - name: "lcl_debian-acdefault"
     - name: "aud_debian-acdefault"
     - name: "master"
   labelString: "master"
   crumbIssuer:
     standard:
       excludeClientIPFromCrumb: false
   disableRememberMe: false
   disabledAdministrativeMonitors:
     - "hudson.diagnosis.ReverseProxySetupMonitor"
   markupFormatter: "plainText"
   mode: EXCLUSIVE
   myViewsTabBar: "standard"
   numExecutors: 2
   primaryView:
     all:
       name: "all"
   projectNamingStrategy: "standard"
   quietPeriod: 5
   remotingSecurity:
     enabled: false
   scmCheckoutRetryCount: 2
   securityRealm:
       reverseProxy:
         disableLdapEmailResolver: false
         forwardedUser: "X-USER"
         headerGroups: "X-Forwarded-Groups"
         headerGroupsDelimiter: "|"
         inhibitInferRootDN: false
         updateInterval: 15
         userSearch: "uid=\{0}"
   slaveAgentPort: 50000
   systemMessage: "Jenkins master server"
   updateCenter:
     sites:
     - id: "default"
       url: "https://updates.jenkins.io/update-center.json"
   views:
   - all:
       name: "all"
   viewsTabBar: "standard"
unclassified:
   giteaServers:
     servers:
     - credentialsId: "api_service_user_giteatoken"
       displayName: "gitea server"
       manageHooks: true
       serverUrl: "#GITEA_SERVER#"
   globalLibraries:
     libraries:
     - defaultVersion: "master"
       name: "Hub"
       retriever:
         modernSCM:
           scm:
             git:
               id: "d6f0a286-756c-4667-aac2-b764c566661e"
               remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
               traits:
               - "branchDiscoveryTrait"
   buildDiscarders:
     configuredBuildDiscarders:
     - "jobBuildDiscarder"
   location:
     adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
     url: "#CFG_JENKINS_URL#"
   pollSCM:
     pollingThreadCount: 10
   email-ext:
     adminRequiredForTemplateTesting: false
     allowUnregisteredEnabled: true
     charset: "UTF-8"
     debugMode: false
     defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
     \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
     \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
     \   \n\
     \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
     \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
     \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
     >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
     \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
     >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
     \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
     \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
     \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
     \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
     \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
     \  </tr>\n      </table>\n    </div>\n</BODY>"
     defaultContentType: "text/html"
     defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
     defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
     defaultTriggerIds:
     - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
     mailAccount:
       smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
       smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
       smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
       smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
     maxAttachmentSize: -1
     maxAttachmentSizeMb: -1
     precedenceBulk: false
     watchingEnabled: false
jobs:
   - file: /data/jenkins/config/dsl/seed.groovy
   - file: /data/jenkins/config/dsl/custom.groovy
{quote}

David Koenig made changes - 2021-03-22 09:30

Description

Original:

i thought i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the referenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Any idea, what do

Here is my casc.yml

{quote}credentials:
   system:
     domainCredentials:
     - credentials:
       - usernamePassword:
           description: "User to access gitea with a token"
           id: "api_service_user_giteatoken"
           password: "#API_SERVICE_USER_GITEATOKEN#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
       - usernamePassword:
           description: "User to access all systems (except gitea, because token is needed)"
           id: "api_service_user_password"
           password: "#API_SERVICE_USER_PASSWORD#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
jenkins:
   agentProtocols:
   - "JNLP4-connect"
   - "Ping"
   clouds:
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "unix:///var/run/docker.sock"
           readTimeout: 60
         errorDuration: 60
         name: "lcl-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian"
           name: "lcl_debian"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-jdkmvn"
           name: "lcl_debian-jdkmvn"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-devworkplace"
           name: "lcl_debian-devworkplace"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-acdefault"
           name: "lcl_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "tcp://IP:2375"
           readTimeout: 60
         name: "aud-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "aud_debian-acdefault"
           name: "aud_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
   labelAtoms:
     - name: "lcl_debian"
     - name: "lcl_debian-jdkmvn"
     - name: "lcl_debian-devworkplace"
     - name: "lcl_debian-acdefault"
     - name: "aud_debian-acdefault"
     - name: "master"
   labelString: "master"
   crumbIssuer:
     standard:
       excludeClientIPFromCrumb: false
   disableRememberMe: false
   disabledAdministrativeMonitors:
     - "hudson.diagnosis.ReverseProxySetupMonitor"
   markupFormatter: "plainText"
   mode: EXCLUSIVE
   myViewsTabBar: "standard"
   numExecutors: 2
   primaryView:
     all:
       name: "all"
   projectNamingStrategy: "standard"
   quietPeriod: 5
   remotingSecurity:
     enabled: false
   scmCheckoutRetryCount: 2
   securityRealm:
       reverseProxy:
         disableLdapEmailResolver: false
         forwardedUser: "X-USER"
         headerGroups: "X-Forwarded-Groups"
         headerGroupsDelimiter: "|"
         inhibitInferRootDN: false
         updateInterval: 15
         userSearch: "uid=\{0}"
   slaveAgentPort: 50000
   systemMessage: "Jenkins master server"
   updateCenter:
     sites:
     - id: "default"
       url: "https://updates.jenkins.io/update-center.json"
   views:
   - all:
       name: "all"
   viewsTabBar: "standard"
unclassified:
   giteaServers:
     servers:
     - credentialsId: "api_service_user_giteatoken"
       displayName: "gitea server"
       manageHooks: true
       serverUrl: "#GITEA_SERVER#"
   globalLibraries:
     libraries:
     - defaultVersion: "master"
       name: "Hub"
       retriever:
         modernSCM:
           scm:
             git:
               id: "d6f0a286-756c-4667-aac2-b764c566661e"
               remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
               traits:
               - "branchDiscoveryTrait"
   buildDiscarders:
     configuredBuildDiscarders:
     - "jobBuildDiscarder"
   location:
     adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
     url: "#CFG_JENKINS_URL#"
   pollSCM:
     pollingThreadCount: 10
   email-ext:
     adminRequiredForTemplateTesting: false
     allowUnregisteredEnabled: true
     charset: "UTF-8"
     debugMode: false
     defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
     \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
     \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
     \   \n\
     \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
     \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
     \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
     >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
     \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
     >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
     \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
     \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
     \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
     \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
     \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
     \  </tr>\n      </table>\n    </div>\n</BODY>"
     defaultContentType: "text/html"
     defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
     defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
     defaultTriggerIds:
     - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
     mailAccount:
       smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
       smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
       smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
       smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
     maxAttachmentSize: -1
     maxAttachmentSizeMb: -1
     precedenceBulk: false
     watchingEnabled: false
jobs:
   - file: /data/jenkins/config/dsl/seed.groovy
   - file: /data/jenkins/config/dsl/custom.groovy
{quote}

New:

i thought i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the referenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Here is my casc.yml

{quote}credentials:
   system:
     domainCredentials:
     - credentials:
       - usernamePassword:
           description: "User to access gitea with a token"
           id: "api_service_user_giteatoken"
           password: "#API_SERVICE_USER_GITEATOKEN#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
       - usernamePassword:
           description: "User to access all systems (except gitea, because token is needed)"
           id: "api_service_user_password"
           password: "#API_SERVICE_USER_PASSWORD#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
jenkins:
   agentProtocols:
   - "JNLP4-connect"
   - "Ping"
   clouds:
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "unix:///var/run/docker.sock"
           readTimeout: 60
         errorDuration: 60
         name: "lcl-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian"
           name: "lcl_debian"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-jdkmvn"
           name: "lcl_debian-jdkmvn"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-devworkplace"
           name: "lcl_debian-devworkplace"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-acdefault"
           name: "lcl_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "tcp://IP:2375"
           readTimeout: 60
         name: "aud-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "aud_debian-acdefault"
           name: "aud_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
   labelAtoms:
     - name: "lcl_debian"
     - name: "lcl_debian-jdkmvn"
     - name: "lcl_debian-devworkplace"
     - name: "lcl_debian-acdefault"
     - name: "aud_debian-acdefault"
     - name: "master"
   labelString: "master"
   crumbIssuer:
     standard:
       excludeClientIPFromCrumb: false
   disableRememberMe: false
   disabledAdministrativeMonitors:
     - "hudson.diagnosis.ReverseProxySetupMonitor"
   markupFormatter: "plainText"
   mode: EXCLUSIVE
   myViewsTabBar: "standard"
   numExecutors: 2
   primaryView:
     all:
       name: "all"
   projectNamingStrategy: "standard"
   quietPeriod: 5
   remotingSecurity:
     enabled: false
   scmCheckoutRetryCount: 2
   securityRealm:
       reverseProxy:
         disableLdapEmailResolver: false
         forwardedUser: "X-USER"
         headerGroups: "X-Forwarded-Groups"
         headerGroupsDelimiter: "|"
         inhibitInferRootDN: false
         updateInterval: 15
         userSearch: "uid=\{0}"
   slaveAgentPort: 50000
   systemMessage: "Jenkins master server"
   updateCenter:
     sites:
     - id: "default"
       url: "https://updates.jenkins.io/update-center.json"
   views:
   - all:
       name: "all"
   viewsTabBar: "standard"
unclassified:
   giteaServers:
     servers:
     - credentialsId: "api_service_user_giteatoken"
       displayName: "gitea server"
       manageHooks: true
       serverUrl: "#GITEA_SERVER#"
   globalLibraries:
     libraries:
     - defaultVersion: "master"
       name: "Hub"
       retriever:
         modernSCM:
           scm:
             git:
               id: "d6f0a286-756c-4667-aac2-b764c566661e"
               remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
               traits:
               - "branchDiscoveryTrait"
   buildDiscarders:
     configuredBuildDiscarders:
     - "jobBuildDiscarder"
   location:
     adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
     url: "#CFG_JENKINS_URL#"
   pollSCM:
     pollingThreadCount: 10
   email-ext:
     adminRequiredForTemplateTesting: false
     allowUnregisteredEnabled: true
     charset: "UTF-8"
     debugMode: false
     defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
     \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
     \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
     \   \n\
     \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
     \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
     \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
     >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
     \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
     >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
     \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
     \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
     \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
     \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
     \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
     \  </tr>\n      </table>\n    </div>\n</BODY>"
     defaultContentType: "text/html"
     defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
     defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
     defaultTriggerIds:
     - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
     mailAccount:
       smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
       smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
       smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
       smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
     maxAttachmentSize: -1
     maxAttachmentSizeMb: -1
     precedenceBulk: false
     watchingEnabled: false
jobs:
   - file: /data/jenkins/config/dsl/seed.groovy
   - file: /data/jenkins/config/dsl/custom.groovy
{quote}

we have now analyzed this in greater depth an tested that step by step. Here is the protocol:

*deleted config and recreated it*
- PULL_NEVER
- Keine credentials gesetzt
*- {color:#00875a}works{color}*

*Created a new cloud config*
- PULL_ALWAYS
- Credentials set
{color:#de350b}*- fail*{color}

*Changed cloud config to*

PULL_NEVER
- {color:#de350b}*fail*{color}

*- Credentials deleted*
{color:#de350b}*- fail*{color}

*Deleted complete configuration and recreated with smae name as before*
- PULL_NEVER
- No credential set
*{color:#de350b}- fail{color}*

*Recreated cloud config with new name (lcl_ac)*
- PULL_NEVER
- No credentials set
{color:#00875a}*- works*{color}

*Changed settings (lcl_ac)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name (abc)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(def)*
- PULL_ALWAYS
- Keine credentials gesetzt
- docker.socket mount
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(ghi)*
- PULL_NEVER
- Credentials set
- {color:#00875a}*works*{color}

{color:#172b4d}*Changed config (ghi)*{color}
- PULL_ONCE and update latest
- *works*

{color:#00875a} {color:#172b4d}*Deleted image locally*{color}{color}
* {color:#de350b}*failed but we get logs (which is not the case when we set PULL_ALWAYS)*{color}

{color:#de350b}2021-03-19 17:02:37.927+0000 [id=25781] INFO c.n.j.p.docker.DockerTemplate#pullImage: Pulling image 'ar.hub.msg.team/msg-p-gba-u-audiconnect/cid-jenkins-debian-slave-acdefault:4'. This may take awhile...
2021-03-19 17:02:37.927+0000 [id=25781] INFO i.j.docker.client.DockerAPI#getOrMakeClient: Cached connection io.jenkins.docker.client.DockerAPI$SharableDockerClient@66d0d3ee to DockerClientParameters\{dockerUri=unix:///var/run/docker.sock, credentialsId=null, readTimeoutInMsOrNull=300000, connectTimeoutInMsOrNull=60000}{color}

{color:#172b4d}-----------------------{color}

David Koenig made changes - 2021-03-22 09:37

Description

Original:

i thought i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the referenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Here is my casc.yml

{quote}credentials:
   system:
     domainCredentials:
     - credentials:
       - usernamePassword:
           description: "User to access gitea with a token"
           id: "api_service_user_giteatoken"
           password: "#API_SERVICE_USER_GITEATOKEN#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
       - usernamePassword:
           description: "User to access all systems (except gitea, because token is needed)"
           id: "api_service_user_password"
           password: "#API_SERVICE_USER_PASSWORD#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
jenkins:
   agentProtocols:
   - "JNLP4-connect"
   - "Ping"
   clouds:
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "unix:///var/run/docker.sock"
           readTimeout: 60
         errorDuration: 60
         name: "lcl-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian"
           name: "lcl_debian"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-jdkmvn"
           name: "lcl_debian-jdkmvn"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-devworkplace"
           name: "lcl_debian-devworkplace"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-acdefault"
           name: "lcl_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "tcp://IP:2375"
           readTimeout: 60
         name: "aud-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "aud_debian-acdefault"
           name: "aud_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
   labelAtoms:
     - name: "lcl_debian"
     - name: "lcl_debian-jdkmvn"
     - name: "lcl_debian-devworkplace"
     - name: "lcl_debian-acdefault"
     - name: "aud_debian-acdefault"
     - name: "master"
   labelString: "master"
   crumbIssuer:
     standard:
       excludeClientIPFromCrumb: false
   disableRememberMe: false
   disabledAdministrativeMonitors:
     - "hudson.diagnosis.ReverseProxySetupMonitor"
   markupFormatter: "plainText"
   mode: EXCLUSIVE
   myViewsTabBar: "standard"
   numExecutors: 2
   primaryView:
     all:
       name: "all"
   projectNamingStrategy: "standard"
   quietPeriod: 5
   remotingSecurity:
     enabled: false
   scmCheckoutRetryCount: 2
   securityRealm:
       reverseProxy:
         disableLdapEmailResolver: false
         forwardedUser: "X-USER"
         headerGroups: "X-Forwarded-Groups"
         headerGroupsDelimiter: "|"
         inhibitInferRootDN: false
         updateInterval: 15
         userSearch: "uid=\{0}"
   slaveAgentPort: 50000
   systemMessage: "Jenkins master server"
   updateCenter:
     sites:
     - id: "default"
       url: "https://updates.jenkins.io/update-center.json"
   views:
   - all:
       name: "all"
   viewsTabBar: "standard"
unclassified:
   giteaServers:
     servers:
     - credentialsId: "api_service_user_giteatoken"
       displayName: "gitea server"
       manageHooks: true
       serverUrl: "#GITEA_SERVER#"
   globalLibraries:
     libraries:
     - defaultVersion: "master"
       name: "Hub"
       retriever:
         modernSCM:
           scm:
             git:
               id: "d6f0a286-756c-4667-aac2-b764c566661e"
               remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
               traits:
               - "branchDiscoveryTrait"
   buildDiscarders:
     configuredBuildDiscarders:
     - "jobBuildDiscarder"
   location:
     adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
     url: "#CFG_JENKINS_URL#"
   pollSCM:
     pollingThreadCount: 10
   email-ext:
     adminRequiredForTemplateTesting: false
     allowUnregisteredEnabled: true
     charset: "UTF-8"
     debugMode: false
     defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
     \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
     \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
     \   \n\
     \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
     \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
     \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
     >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
     \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
     >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
     \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
     \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
     \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
     \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
     \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
     \  </tr>\n      </table>\n    </div>\n</BODY>"
     defaultContentType: "text/html"
     defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
     defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
     defaultTriggerIds:
     - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
     mailAccount:
       smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
       smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
       smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
       smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
     maxAttachmentSize: -1
     maxAttachmentSizeMb: -1
     precedenceBulk: false
     watchingEnabled: false
jobs:
   - file: /data/jenkins/config/dsl/seed.groovy
   - file: /data/jenkins/config/dsl/custom.groovy
{quote}

we have now analyzed this in greater depth an tested that step by step. Here is the protocol:

*deleted config and recreated it*
- PULL_NEVER
- Keine credentials gesetzt
*- {color:#00875a}works{color}*

*Created a new cloud config*
- PULL_ALWAYS
- Credentials set
{color:#de350b}*- fail*{color}

*Changed cloud config to*

PULL_NEVER
- {color:#de350b}*fail*{color}

*- Credentials deleted*
{color:#de350b}*- fail*{color}

*Deleted complete configuration and recreated with smae name as before*
- PULL_NEVER
- No credential set
*{color:#de350b}- fail{color}*

*Recreated cloud config with new name (lcl_ac)*
- PULL_NEVER
- No credentials set
{color:#00875a}*- works*{color}

*Changed settings (lcl_ac)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name (abc)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(def)*
- PULL_ALWAYS
- Keine credentials gesetzt
- docker.socket mount
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(ghi)*
- PULL_NEVER
- Credentials set
- {color:#00875a}*works*{color}

{color:#172b4d}*Changed config (ghi)*{color}
- PULL_ONCE and update latest
- *works*

{color:#00875a} {color:#172b4d}*Deleted image locally*{color}{color}
* {color:#de350b}*failed but we get logs (which is not the case when we set PULL_ALWAYS)*{color}

{color:#de350b}2021-03-19 17:02:37.927+0000 [id=25781] INFO c.n.j.p.docker.DockerTemplate#pullImage: Pulling image 'ar.hub.msg.team/msg-p-gba-u-audiconnect/cid-jenkins-debian-slave-acdefault:4'. This may take awhile...
2021-03-19 17:02:37.927+0000 [id=25781] INFO i.j.docker.client.DockerAPI#getOrMakeClient: Cached connection io.jenkins.docker.client.DockerAPI$SharableDockerClient@66d0d3ee to DockerClientParameters\{dockerUri=unix:///var/run/docker.sock, credentialsId=null, readTimeoutInMsOrNull=300000, connectTimeoutInMsOrNull=60000}{color}

{color:#172b4d}-----------------------{color}

New:

i thought i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the referenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Here is my casc.yml

{quote}credentials:
   system:
     domainCredentials:
     - credentials:
       - usernamePassword:
           description: "User to access gitea with a token"
           id: "api_service_user_giteatoken"
           password: "#API_SERVICE_USER_GITEATOKEN#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
       - usernamePassword:
           description: "User to access all systems (except gitea, because token is needed)"
           id: "api_service_user_password"
           password: "#API_SERVICE_USER_PASSWORD#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
jenkins:
   agentProtocols:
   - "JNLP4-connect"
   - "Ping"
   clouds:
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "unix:///var/run/docker.sock"
           readTimeout: 60
         errorDuration: 60
         name: "lcl-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian"
           name: "lcl_debian"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-jdkmvn"
           name: "lcl_debian-jdkmvn"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-devworkplace"
           name: "lcl_debian-devworkplace"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-acdefault"
           name: "lcl_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "tcp://IP:2375"
           readTimeout: 60
         name: "aud-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "aud_debian-acdefault"
           name: "aud_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
   labelAtoms:
     - name: "lcl_debian"
     - name: "lcl_debian-jdkmvn"
     - name: "lcl_debian-devworkplace"
     - name: "lcl_debian-acdefault"
     - name: "aud_debian-acdefault"
     - name: "master"
   labelString: "master"
   crumbIssuer:
     standard:
       excludeClientIPFromCrumb: false
   disableRememberMe: false
   disabledAdministrativeMonitors:
     - "hudson.diagnosis.ReverseProxySetupMonitor"
   markupFormatter: "plainText"
   mode: EXCLUSIVE
   myViewsTabBar: "standard"
   numExecutors: 2
   primaryView:
     all:
       name: "all"
   projectNamingStrategy: "standard"
   quietPeriod: 5
   remotingSecurity:
     enabled: false
   scmCheckoutRetryCount: 2
   securityRealm:
       reverseProxy:
         disableLdapEmailResolver: false
         forwardedUser: "X-USER"
         headerGroups: "X-Forwarded-Groups"
         headerGroupsDelimiter: "|"
         inhibitInferRootDN: false
         updateInterval: 15
         userSearch: "uid=\{0}"
   slaveAgentPort: 50000
   systemMessage: "Jenkins master server"
   updateCenter:
     sites:
     - id: "default"
       url: "https://updates.jenkins.io/update-center.json"
   views:
   - all:
       name: "all"
   viewsTabBar: "standard"
unclassified:
   giteaServers:
     servers:
     - credentialsId: "api_service_user_giteatoken"
       displayName: "gitea server"
       manageHooks: true
       serverUrl: "#GITEA_SERVER#"
   globalLibraries:
     libraries:
     - defaultVersion: "master"
       name: "Hub"
       retriever:
         modernSCM:
           scm:
             git:
               id: "d6f0a286-756c-4667-aac2-b764c566661e"
               remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
               traits:
               - "branchDiscoveryTrait"
   buildDiscarders:
     configuredBuildDiscarders:
     - "jobBuildDiscarder"
   location:
     adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
     url: "#CFG_JENKINS_URL#"
   pollSCM:
     pollingThreadCount: 10
   email-ext:
     adminRequiredForTemplateTesting: false
     allowUnregisteredEnabled: true
     charset: "UTF-8"
     debugMode: false
     defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
     \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
     \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
     \   \n\
     \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
     \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
     \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
     >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
     \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
     >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
     \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
     \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
     \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
     \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
     \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
     \  </tr>\n      </table>\n    </div>\n</BODY>"
     defaultContentType: "text/html"
     defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
     defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
     defaultTriggerIds:
     - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
     mailAccount:
       smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
       smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
       smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
       smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
     maxAttachmentSize: -1
     maxAttachmentSizeMb: -1
     precedenceBulk: false
     watchingEnabled: false
jobs:
   - file: /data/jenkins/config/dsl/seed.groovy
   - file: /data/jenkins/config/dsl/custom.groovy
{quote}

we have now analyzed this in greater depth an tested that step by step. Here is the protocol:

*deleted config and recreated it*
- PULL_NEVER
- Keine credentials gesetzt
-- {color:#00875a}works{color}*

*Created a new cloud config*
- PULL_ALWAYS
- Credentials set
{color:#de350b}*- fail*{color}

*Changed cloud config to*

PULL_NEVER
- {color:#de350b}*fail*{color}

*
-- Credentials deleted*
{color:#de350b}*- fail*{color}

*Deleted complete configuration and recreated with smae name as before*
- PULL_NEVER
- No credential set
*{color:#de350b}- fail{color}*

*Recreated cloud config with new name (lcl_ac)*
- PULL_NEVER
- No credentials set
{color:#00875a}*- works*{color}

*Changed settings (lcl_ac)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name (abc)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(def)*
- PULL_ALWAYS
- Keine credentials gesetzt
- docker.socket mount
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(ghi)*
- PULL_NEVER
- Credentials set
- {color:#00875a}*works*{color}

{color:#172b4d}*Changed config (ghi)*{color}
- PULL_ONCE and update latest
- *works*

{color:#00875a} *Deleted image locally*{color}
* *failed but we get logs (which is not the case when we set PULL_ALWAYS)*

{color:#de350b}2021-03-19 17:02:37.927+0000 [id=25781] INFO c.n.j.p.docker.DockerTemplate#pullImage: Pulling image 'ar.hub.msg.team/msg-p-gba-u-audiconnect/cid-jenkins-debian-slave-acdefault:4'. This may take awhile...
2021-03-19 17:02:37.927+0000 [id=25781] INFO i.j.docker.client.DockerAPI#getOrMakeClient: Cached connection io.jenkins.docker.client.DockerAPI$SharableDockerClient@66d0d3ee to DockerClientParameters\{dockerUri=unix:///var/run/docker.sock, credentialsId=null, readTimeoutInMsOrNull=300000, connectTimeoutInMsOrNull=60000}{color}

{color:#172b4d}-----------------------{color}

At next step we analyzed the network traffic.

"_Pull once and update latest_" we just get some communication to Nexus when we leave the _crendentials empty (there is no communication when we set credentials)_.

_2021-03-22T09:14:18+00:00 nginx: access: forwarded-for=10.xx.yy.zz remote=10.xx.yy.zz user=- host=foo.bar.my.team request="GET /v2/ HTTP/1.1" status=401 bytes=113 referer="-" user-agent="docker/19.03.12 go/go1.13.10 git-commit/48a66213fe kernel/4.9.0-14-amd64 os/linux arch/amd64"_
_2021-03-22T09:14:18+00:00 nginx: access: forwarded-for=- remote=10.xx.yy.zz user=- host=__foo.bar.my.team_ _request="GET /v2/ HTTP/1.1" status=401 bytes=113 referer="-" user-agent="docker/19.03.12 go/go1.13.10 git-commit/48a66213fe kernel/4.9.0-14-amd64 os/linux arch/amd64"_

When whe use option "PULL_ALWAYS" nothing happens. __

David Koenig made changes - 2021-03-22 09:37

Priority

Original: Major [ 3 ]

New: Blocker [ 1 ]

David Koenig made changes - 2021-03-22 09:38

Status

Original: Open [ 1 ]

New: In Progress [ 3 ]

David Koenig made changes - 2021-03-22 09:43

Description

Original:

i thought i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the referenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Here is my casc.yml

{quote}credentials:
   system:
     domainCredentials:
     - credentials:
       - usernamePassword:
           description: "User to access gitea with a token"
           id: "api_service_user_giteatoken"
           password: "#API_SERVICE_USER_GITEATOKEN#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
       - usernamePassword:
           description: "User to access all systems (except gitea, because token is needed)"
           id: "api_service_user_password"
           password: "#API_SERVICE_USER_PASSWORD#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
jenkins:
   agentProtocols:
   - "JNLP4-connect"
   - "Ping"
   clouds:
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "unix:///var/run/docker.sock"
           readTimeout: 60
         errorDuration: 60
         name: "lcl-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian"
           name: "lcl_debian"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-jdkmvn"
           name: "lcl_debian-jdkmvn"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-devworkplace"
           name: "lcl_debian-devworkplace"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-acdefault"
           name: "lcl_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "tcp://IP:2375"
           readTimeout: 60
         name: "aud-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "aud_debian-acdefault"
           name: "aud_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
   labelAtoms:
     - name: "lcl_debian"
     - name: "lcl_debian-jdkmvn"
     - name: "lcl_debian-devworkplace"
     - name: "lcl_debian-acdefault"
     - name: "aud_debian-acdefault"
     - name: "master"
   labelString: "master"
   crumbIssuer:
     standard:
       excludeClientIPFromCrumb: false
   disableRememberMe: false
   disabledAdministrativeMonitors:
     - "hudson.diagnosis.ReverseProxySetupMonitor"
   markupFormatter: "plainText"
   mode: EXCLUSIVE
   myViewsTabBar: "standard"
   numExecutors: 2
   primaryView:
     all:
       name: "all"
   projectNamingStrategy: "standard"
   quietPeriod: 5
   remotingSecurity:
     enabled: false
   scmCheckoutRetryCount: 2
   securityRealm:
       reverseProxy:
         disableLdapEmailResolver: false
         forwardedUser: "X-USER"
         headerGroups: "X-Forwarded-Groups"
         headerGroupsDelimiter: "|"
         inhibitInferRootDN: false
         updateInterval: 15
         userSearch: "uid=\{0}"
   slaveAgentPort: 50000
   systemMessage: "Jenkins master server"
   updateCenter:
     sites:
     - id: "default"
       url: "https://updates.jenkins.io/update-center.json"
   views:
   - all:
       name: "all"
   viewsTabBar: "standard"
unclassified:
   giteaServers:
     servers:
     - credentialsId: "api_service_user_giteatoken"
       displayName: "gitea server"
       manageHooks: true
       serverUrl: "#GITEA_SERVER#"
   globalLibraries:
     libraries:
     - defaultVersion: "master"
       name: "Hub"
       retriever:
         modernSCM:
           scm:
             git:
               id: "d6f0a286-756c-4667-aac2-b764c566661e"
               remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
               traits:
               - "branchDiscoveryTrait"
   buildDiscarders:
     configuredBuildDiscarders:
     - "jobBuildDiscarder"
   location:
     adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
     url: "#CFG_JENKINS_URL#"
   pollSCM:
     pollingThreadCount: 10
   email-ext:
     adminRequiredForTemplateTesting: false
     allowUnregisteredEnabled: true
     charset: "UTF-8"
     debugMode: false
     defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
     \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
     \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
     \   \n\
     \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
     \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
     \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
     >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
     \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
     >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
     \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
     \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
     \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
     \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
     \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
     \  </tr>\n      </table>\n    </div>\n</BODY>"
     defaultContentType: "text/html"
     defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
     defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
     defaultTriggerIds:
     - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
     mailAccount:
       smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
       smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
       smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
       smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
     maxAttachmentSize: -1
     maxAttachmentSizeMb: -1
     precedenceBulk: false
     watchingEnabled: false
jobs:
   - file: /data/jenkins/config/dsl/seed.groovy
   - file: /data/jenkins/config/dsl/custom.groovy
{quote}

we have now analyzed this in greater depth an tested that step by step. Here is the protocol:

*deleted config and recreated it*
- PULL_NEVER
- Keine credentials gesetzt
-- {color:#00875a}works{color}*

*Created a new cloud config*
- PULL_ALWAYS
- Credentials set
{color:#de350b}*- fail*{color}

*Changed cloud config to*

PULL_NEVER
- {color:#de350b}*fail*{color}

*
-- Credentials deleted*
{color:#de350b}*- fail*{color}

*Deleted complete configuration and recreated with smae name as before*
- PULL_NEVER
- No credential set
*{color:#de350b}- fail{color}*

*Recreated cloud config with new name (lcl_ac)*
- PULL_NEVER
- No credentials set
{color:#00875a}*- works*{color}

*Changed settings (lcl_ac)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name (abc)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(def)*
- PULL_ALWAYS
- Keine credentials gesetzt
- docker.socket mount
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(ghi)*
- PULL_NEVER
- Credentials set
- {color:#00875a}*works*{color}

{color:#172b4d}*Changed config (ghi)*{color}
- PULL_ONCE and update latest
- *works*

{color:#00875a} *Deleted image locally*{color}
* *failed but we get logs (which is not the case when we set PULL_ALWAYS)*

{color:#de350b}2021-03-19 17:02:37.927+0000 [id=25781] INFO c.n.j.p.docker.DockerTemplate#pullImage: Pulling image 'ar.hub.msg.team/msg-p-gba-u-audiconnect/cid-jenkins-debian-slave-acdefault:4'. This may take awhile...
2021-03-19 17:02:37.927+0000 [id=25781] INFO i.j.docker.client.DockerAPI#getOrMakeClient: Cached connection io.jenkins.docker.client.DockerAPI$SharableDockerClient@66d0d3ee to DockerClientParameters\{dockerUri=unix:///var/run/docker.sock, credentialsId=null, readTimeoutInMsOrNull=300000, connectTimeoutInMsOrNull=60000}{color}

{color:#172b4d}-----------------------{color}

At next step we analyzed the network traffic.

"_Pull once and update latest_" we just get some communication to Nexus when we leave the _crendentials empty (there is no communication when we set credentials)_.

_2021-03-22T09:14:18+00:00 nginx: access: forwarded-for=10.xx.yy.zz remote=10.xx.yy.zz user=- host=foo.bar.my.team request="GET /v2/ HTTP/1.1" status=401 bytes=113 referer="-" user-agent="docker/19.03.12 go/go1.13.10 git-commit/48a66213fe kernel/4.9.0-14-amd64 os/linux arch/amd64"_
_2021-03-22T09:14:18+00:00 nginx: access: forwarded-for=- remote=10.xx.yy.zz user=- host=__foo.bar.my.team_ _request="GET /v2/ HTTP/1.1" status=401 bytes=113 referer="-" user-agent="docker/19.03.12 go/go1.13.10 git-commit/48a66213fe kernel/4.9.0-14-amd64 os/linux arch/amd64"_

When whe use option "PULL_ALWAYS" nothing happens. __

New: Probably a similar issue is described [here|[Pull from ECR never completes (no errors) · Issue #828 · jenkinsci/docker-plugin (github.com)|https://github.com/jenkinsci/docker-plugin/issues/828].

i thought i found following issue today: When the name of a tag is too long, its not possible to run a build job. It stucks on "Jenkins doesn't have label one some images" without any information in the logfile, the ui, systemlog or something else. Its nearly impossible to find out, whats the problem.

I don't know whats the max length is, i used

lcl_cid-jenkins-debian-slave-wxyzconnectdefault

then i shorted it to "wx" and the job start working. Now i reconfigured my whole casc.yml and again the jobs are not working. Again there is nothing to see in the logfile (docker logs of my jenkins container).

The docker images can be pulled with the referenced credential, i also stored them locally. It possible to run the images manually, but no node is created automatically.

Here is my casc.yml

{quote}credentials:
   system:
     domainCredentials:
     - credentials:
       - usernamePassword:
           description: "User to access gitea with a token"
           id: "api_service_user_giteatoken"
           password: "#API_SERVICE_USER_GITEATOKEN#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
       - usernamePassword:
           description: "User to access all systems (except gitea, because token is needed)"
           id: "api_service_user_password"
           password: "#API_SERVICE_USER_PASSWORD#"
           scope: SYSTEM
           username: "#API_SERVICE_USER_NAME#"
jenkins:
   agentProtocols:
   - "JNLP4-connect"
   - "Ping"
   clouds:
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "unix:///var/run/docker.sock"
           readTimeout: 60
         errorDuration: 60
         name: "lcl-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian"
           name: "lcl_debian"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/ps/cid-jenkins-debian-slave-jdkmvn:latest"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-jdkmvn"
           name: "lcl_debian-jdkmvn"
           pullStrategy: PULL_NEVER
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/cid-jenkins-debian-slave-devworkplace:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-devworkplace"
           name: "lcl_debian-devworkplace"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "lcl_debian-acdefault"
           name: "lcl_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
     - docker:
         containerCap: 6
         dockerApi:
           connectTimeout: 60
           dockerHost:
             uri: "tcp://IP:2375"
           readTimeout: 60
         name: "aud-slave-cloud"
         templates:
         - connector:
             attach:
               user: "jenkins"
           dockerTemplateBase:
             cpuPeriod: 0
             cpuQuota: 0
             image: "docker.xyz.de/path/cid-jenkins-debian-slave-acdefault:4"
             pullCredentialsId: "api_service_user_password"
             volumes:
             - "/var/run/docker.sock:/var/run/docker.sock"
             volumesString: "/var/run/docker.sock:/var/run/docker.sock"
           labelString: "aud_debian-acdefault"
           name: "aud_debian-acdefault"
           pullStrategy: PULL_ALWAYS
           pullTimeout: 30
   labelAtoms:
     - name: "lcl_debian"
     - name: "lcl_debian-jdkmvn"
     - name: "lcl_debian-devworkplace"
     - name: "lcl_debian-acdefault"
     - name: "aud_debian-acdefault"
     - name: "master"
   labelString: "master"
   crumbIssuer:
     standard:
       excludeClientIPFromCrumb: false
   disableRememberMe: false
   disabledAdministrativeMonitors:
     - "hudson.diagnosis.ReverseProxySetupMonitor"
   markupFormatter: "plainText"
   mode: EXCLUSIVE
   myViewsTabBar: "standard"
   numExecutors: 2
   primaryView:
     all:
       name: "all"
   projectNamingStrategy: "standard"
   quietPeriod: 5
   remotingSecurity:
     enabled: false
   scmCheckoutRetryCount: 2
   securityRealm:
       reverseProxy:
         disableLdapEmailResolver: false
         forwardedUser: "X-USER"
         headerGroups: "X-Forwarded-Groups"
         headerGroupsDelimiter: "|"
         inhibitInferRootDN: false
         updateInterval: 15
         userSearch: "uid=\{0}"
   slaveAgentPort: 50000
   systemMessage: "Jenkins master server"
   updateCenter:
     sites:
     - id: "default"
       url: "https://updates.jenkins.io/update-center.json"
   views:
   - all:
       name: "all"
   viewsTabBar: "standard"
unclassified:
   giteaServers:
     servers:
     - credentialsId: "api_service_user_giteatoken"
       displayName: "gitea server"
       manageHooks: true
       serverUrl: "#GITEA_SERVER#"
   globalLibraries:
     libraries:
     - defaultVersion: "master"
       name: "Hub"
       retriever:
         modernSCM:
           scm:
             git:
               id: "d6f0a286-756c-4667-aac2-b764c566661e"
               remote: "#GITEA_SERVER#/hubadmin/Jenkins-Shared-Libs.git"
               traits:
               - "branchDiscoveryTrait"
   buildDiscarders:
     configuredBuildDiscarders:
     - "jobBuildDiscarder"
   location:
     adminAddress: "#CFG_JENKINS_ADMIN_MAIL_ADDRESS#"
     url: "#CFG_JENKINS_URL#"
   pollSCM:
     pollingThreadCount: 10
   email-ext:
     adminRequiredForTemplateTesting: false
     allowUnregisteredEnabled: true
     charset: "UTF-8"
     debugMode: false
     defaultBody: "<BODY style=\"border: 1px solid black;\">\n    <h1 style=\"border-bottom:solid\
     \ 3px #000000; background-color:#6264A7; font: normal bold 130% Calibri; color:\
     \ #ffffff; margin:0px; padding:5px 10px;\">$PROJECT_NAME</h1>\n\t<div>\n   \
     \   \n\
     \      <table style=\"border-collapse: separate; border-spacing: 10px 0;\">\n\
     \        <tr>\n          <td valign=\"center\">Status:</td>\n\t\t  <td></td>\n\
     \          <td valign=\"center\">\n            <b style=\"font-size: 130%;\"\
     >$BUILD_STATUS</b>\n          </td>\n        </tr>\n        <tr>\n         \
     \ <td>More info:</td>\n\t\t  <td></td>\n          <td><a href=\"$BUILD_URL\"\
     >$BUILD_URL</a></td>\n        </tr>\n        <tr>\n          <td>Branch:</td>\n\
     \t\t  <td></td>\n          <td>^${ENV,var=\"BRANCH_NAME\"}</td>\n        </tr>\n\
     \t\t<tr>\n          <td>Build number:</td>\n\t\t  <td></td>\n          <td>$BUILD_DISPLAY_NAME</td>\n\
     \        </tr>\n\t\t<tr>\n          <td>Job:</td>\n\t\t  <td></td>\n       \
     \   <td>$PROJECT_NAME</td>\n        </tr>\n        <tr>\n          <td>Build\
     \ cause:</td>\n          <td></td>\n          <td>$BUILD_CAUSE</td>\n      \
     \  </tr>\n      </table>\n    </div>\n</BODY>"
     defaultContentType: "text/html"
     defaultRecipients: "#CFG_JENKINS_MAIL_DEFAULT_RECIPIENT#"
     defaultSubject: "Build $BUILD_STATUS: $PROJECT_NAME $BUILD_DISPLAY_NAME"
     defaultTriggerIds:
     - "hudson.plugins.emailext.plugins.trigger.FailureTrigger"
     mailAccount:
       smtpHost: "#CFG_JENKINS_MAIL_SMTP_SERVER#"
       smtpPassword: "#CFG_JENKINS_MAIL_SMTP_PASSWORD#"
       smtpPort: "#CFG_JENKINS_MAIL_SMTP_PORT#"
       smtpUsername: "#CFG_JENKINS_MAIL_SMTP_USERNAME#"
     maxAttachmentSize: -1
     maxAttachmentSizeMb: -1
     precedenceBulk: false
     watchingEnabled: false
jobs:
   - file: /data/jenkins/config/dsl/seed.groovy
   - file: /data/jenkins/config/dsl/custom.groovy
{quote}

we have now analyzed this in greater depth an tested that step by step. Here is the protocol:

*deleted config and recreated it*
- PULL_NEVER
- Keine credentials gesetzt
-- {color:#00875a}works{color}*

*Created a new cloud config*
- PULL_ALWAYS
- Credentials set
{color:#de350b}*- fail*{color}

*Changed cloud config to*

PULL_NEVER
- {color:#de350b}*fail*{color}

*
-- Credentials deleted*
{color:#de350b}*- fail*{color}

*Deleted complete configuration and recreated with smae name as before*
- PULL_NEVER
- No credential set
*{color:#de350b}- fail{color}*

*Recreated cloud config with new name (lcl_ac)*
- PULL_NEVER
- No credentials set
{color:#00875a}*- works*{color}

*Changed settings (lcl_ac)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name (abc)*
- PULL_ALWAYS
- Credentials set
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(def)*
- PULL_ALWAYS
- Keine credentials gesetzt
- docker.socket mount
- {color:#de350b}*fail*{color}

*Recreted config with new name* *(ghi)*
- PULL_NEVER
- Credentials set
- {color:#00875a}*works*{color}

{color:#172b4d}*Changed config (ghi)*{color}
- PULL_ONCE and update latest
- *works*

{color:#00875a} *Deleted image locally*{color}
* *failed but we get logs (which is not the case when we set PULL_ALWAYS)*

{color:#de350b}2021-03-19 17:02:37.927+0000 [id=25781] INFO c.n.j.p.docker.DockerTemplate#pullImage: Pulling image 'ar.hub.msg.team/msg-p-gba-u-audiconnect/cid-jenkins-debian-slave-acdefault:4'. This may take awhile...
2021-03-19 17:02:37.927+0000 [id=25781] INFO i.j.docker.client.DockerAPI#getOrMakeClient: Cached connection io.jenkins.docker.client.DockerAPI$SharableDockerClient@66d0d3ee to DockerClientParameters\{dockerUri=unix:///var/run/docker.sock, credentialsId=null, readTimeoutInMsOrNull=300000, connectTimeoutInMsOrNull=60000}{color}

{color:#172b4d}-----------------------{color}

At next step we analyzed the network traffic.

"_Pull once and update latest_" we just get some communication to Nexus when we leave the _crendentials empty (there is no communication when we set credentials)_.

_2021-03-22T09:14:18+00:00 nginx: access: forwarded-for=10.xx.yy.zz remote=10.xx.yy.zz user=- host=foo.bar.my.team request="GET /v2/ HTTP/1.1" status=401 bytes=113 referer="-" user-agent="docker/19.03.12 go/go1.13.10 git-commit/48a66213fe kernel/4.9.0-14-amd64 os/linux arch/amd64"_
_2021-03-22T09:14:18+00:00 nginx: access: forwarded-for=- remote=10.xx.yy.zz user=- host=__foo.bar.my.team_ _request="GET /v2/ HTTP/1.1" status=401 bytes=113 referer="-" user-agent="docker/19.03.12 go/go1.13.10 git-commit/48a66213fe kernel/4.9.0-14-amd64 os/linux arch/amd64"_

When whe use option "PULL_ALWAYS" nothing happens. __

Jenkins

Details

Attachments

Activity

People

Dates