Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-72736

Summary of robot test cases is not updated with latest results when we execute the pabot command twice

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Not A Defect
    • Icon: Major Major
    • robot-plugin
    • None

      I have executed test using below commands

      pabot Testsuite/Sample.robot

      Above command executed 6 test cases, in which 4 were passed 

      pabot --rerunfailed output.xml --output rerun.xm Testsuite/Sample.robot

      Above command will execute the failed test cases (2) which got failed in intial execution.

       

      rebot merge output.xml rerun.xml

      Above command will merge both .xml file and generate new report.html and log.html,(refer to the attached screenshot please) 

      Issue Observed:

      The summary of jenkins is not getting updated with the latest stats of report.html/log.html

        1. Screenshot 2024-02-20 at 10.20.14 AM.png
          Screenshot 2024-02-20 at 10.20.14 AM.png
          204 kB
        2. Screenshot 2024-02-20 at 10.21.41 AM.png
          Screenshot 2024-02-20 at 10.21.41 AM.png
          45 kB

          [JENKINS-72736] Summary of robot test cases is not updated with latest results when we execute the pabot command twice

          Aleksi Simell added a comment - - edited

          Hi kiran_kavuri,

          How are you calling the plugin? Are you calling it with the original output.xml or the merged output.xml? I'm not able to reproduce this. I ran two suites with 16 tests (10 passes and 6 failures), then ran with --rerunfailed and it ran 6 tests (1 pass and 5 failures). The Robot Test Summary table shows correctly 11 passed and 5 failed. My pipeline looks like this

          stage("Run Robot") {
    steps { 
        sh script: "/home/jenkins/.local/bin/pabot --nostatusrc random_fails.robot
        sh script: "/home/jenkins/.local/bin/pabot --rerunfailed output.xml -o output2.xml --nostatusrc random_fails.robot simple.robot", returnStatus: true
        sh script: "rebot --merge --nostatusrc -o merge.xml output.xml output2.xml"
    }           
    post {      
        cleanup {
            robot outputPath: ".", passThreshold: 80.0, unstableThreshold: 70.0, disableArchiveOutput: true, outputFileName: "merge.xml"
        }
    }
}

          Aleksi Simell added a comment - - edited Hi kiran_kavuri , How are you calling the plugin? Are you calling it with the original output.xml or the merged output.xml? I'm not able to reproduce this. I ran two suites with 16 tests (10 passes and 6 failures), then ran with --rerunfailed and it ran 6 tests (1 pass and 5 failures). The Robot Test Summary table shows correctly 11 passed and 5 failed. My pipeline looks like this stage( "Run Robot" ) { steps { sh script: "/home/jenkins/.local/bin/pabot --nostatusrc random_fails.robot sh script: "/home/jenkins/.local/bin/pabot --rerunfailed output.xml -o output2.xml --nostatusrc random_fails.robot simple.robot" , returnStatus: true sh script: "rebot --merge --nostatusrc -o merge.xml output.xml output2.xml" } post { cleanup { robot outputPath: "." , passThreshold: 80.0, unstableThreshold: 70.0, disableArchiveOutput: true , outputFileName: "merge.xml" } } }

          sai Kiran added a comment - - edited

           Hi aleksisimell 

          Thanyou so much for your quick response, I have corrected the way, we need to merge the .xmls's , Its working awesomee...

          It helped alot aleksisimell ,

          sai Kiran added a comment - - edited  Hi aleksisimell   Thanyou so much for your quick response, I have corrected the way, we need to merge the .xmls's , Its working awesomee... It helped alot aleksisimell ,

            aleksisimell Aleksi Simell
            kiran_kavuri sai Kiran
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: