• Icon: Task Task
    • Resolution: Fixed
    • Icon: Critical Critical
    • evergreen
    • Evergreen - Milestone 1

      We must have some level of automated testing ASAP.

      My plan is to introduce at least a third branch to test the AWS flavor locally: the Jenkins master should at least start (which can well be not the case with a missing plugin, or wrong CasC config files).

      This is important for obvious general reasons, but also more specifically because for instance jglick is about to file a PR for the AWS flavor, and it's currently very hard to test if you are not involved deeply in the project. Some smoke tests should at least be available/done through the now usual make check

          [JENKINS-52581] Automatically run basic AWS flavor tests in CI

          Baptiste Mathus created issue -
          Baptiste Mathus made changes -
          Epic Link New: JENKINS-49853 [ 188837 ]
          Baptiste Mathus made changes -
          Description Original: We must have some level of automated testing ASAP.

          My plan is to introduce at least a third branch to test the AWS flavor locally: the Jenkins master should at least start (which can well be not the case with a missing plugin, or wrong CasC config files).
          New: We must have some level of automated testing ASAP.

          My plan is to introduce at least a third branch to test the AWS flavor locally: the Jenkins master should at least start (which can well be not the case with a missing plugin, or wrong CasC config files).

          ---

          This is important for obvious general reasons, but also more specifically because for instance [~jglick] is about to file a PR for the AWS flavor, and it's currently very hard to test if you are not involved deeply in the project. Some smoke tests should at least be available/done through the now usual {{make check}}

          Jesse Glick added a comment -

          For example I would expect that a PR introducing a typo in distribution/environments/aws-ec2-cloud/config/as-code/artifact-manager-s3.yaml would be marked as failed.

          Jesse Glick added a comment - For example I would expect that a PR introducing a typo in distribution/environments/aws-ec2-cloud/config/as-code/artifact-manager-s3.yaml would be marked as failed.
          Jesse Glick made changes -
          Link New: This issue relates to JENKINS-52304 [ JENKINS-52304 ]
          Baptiste Mathus made changes -
          Assignee Original: R. Tyler Croy [ rtyler ] New: Baptiste Mathus [ batmat ]
          Baptiste Mathus made changes -
          Status Original: Open [ 1 ] New: In Progress [ 3 ]
          Baptiste Mathus made changes -
          Rank New: Ranked higher
          Baptiste Mathus made changes -
          Remote Link New: This issue links to "evergreen PR (Web Link)" [ 21194 ]
          Baptiste Mathus made changes -
          Status Original: In Progress [ 3 ] New: In Review [ 10005 ]

            batmat Baptiste Mathus
            batmat Baptiste Mathus
            Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: