Uploaded image for project: 'Jenkins'
  1. Jenkins
  2. JENKINS-17802

TAP files with platform information and recursive result seeking strategy

XMLWordPrintable

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Major Major
    • testlink-plugin
    • None
    • Testlink 1.9.6, TestLink Plugin 3.5

      Hi there,
      I have some trouble with result seeking strategies, tap files and platforms. In detail:

      • my tap-files are in subfolders testresults/platform1/tf1.tap and testresults/platform2/tf1.tap
      • the result seeking strategy "testresults/**/*.tap" brings only the platform2 results to testlink
      • if I remove one platform (and the corresponding tap-file) everything works fine.

      The problem is, that I have testcases assigned to two platforms and I have 2 tap files with separate results for each platform. The TestLink Plugin only takes the second tap file (same filename as the first one) and overwrites the values of the first one. So in TestLink the tree entry is gray (shows the result over all assigned platforms). So how can I collect separate results for two platforms? Currently I make use of 2 Jenkins-Jobs to do this (a workaround). Also: one tap-File with two platform information don't seem to work...

      Hope that helps in any way.
      Thanks!
      Paul

        1. tapplattest.zip
          1 kB
        2. taptest.zip
          4 kB

          [JENKINS-17802] TAP files with platform information and recursive result seeking strategy

          Bruno P. Kinoshita added a comment -

          Hmmm, interesting issue. Looks like there's something buggy in the TAP result seeking strategy.

          If you could send me more details about your set up (you've already done an excellent report), like your TAP Streams, or some sample TAP streams that I could use to reproduce the issue here. Then I could try to fix it and include in the next release (probably cut in the next week or so).

          Thanks for reporting the issue!

          Bruno

          Bruno P. Kinoshita added a comment - Hmmm, interesting issue. Looks like there's something buggy in the TAP result seeking strategy. If you could send me more details about your set up (you've already done an excellent report), like your TAP Streams, or some sample TAP streams that I could use to reproduce the issue here. Then I could try to fix it and include in the next release (probably cut in the next week or so). Thanks for reporting the issue! Bruno

          Paul Zimmerman added a comment -

          Hi Bruno!

          I've just uploaded some TAP-files for testing.

          Thanks!

          Paul

          Paul Zimmerman added a comment - Hi Bruno! I've just uploaded some TAP-files for testing. Thanks! Paul

          Paul Zimmerman added a comment -

          Hello Bruno,

          I've corrected my description - the phrase **/*.tap looked very stange (had to mask ist)
          Also updated the attachment. Please use tapplattest.zip. I wasn't able to remove the other one.

          Regards
          Paul

          Paul Zimmerman added a comment - Hello Bruno, I've corrected my description - the phrase **/*.tap looked very stange (had to mask ist) Also updated the attachment. Please use tapplattest.zip. I wasn't able to remove the other one. Regards Paul

          Bruno P. Kinoshita added a comment -

          Hi Paul! Thanks for updating the issue. I've released tap-plugin 1.11 last Saturday, and am working to release a new version next Friday. I'll either start a cycle on testlink-plugin this week, or after I've finished tap 1.12.

          Bruno P. Kinoshita added a comment - Hi Paul! Thanks for updating the issue. I've released tap-plugin 1.11 last Saturday, and am working to release a new version next Friday. I'll either start a cycle on testlink-plugin this week, or after I've finished tap 1.12.

          Paul Zimmerman added a comment -

          Hi there,

          I've just checked the log of the testlink-plugin. The tap files are found! But: the problem is the filename. The filename of tap file 1 is platform1/tf1.tap. The filename of tap file 2 is platform2/tf1.tap. The tap files contain results for different platforms. The problem is: if there are tap files with the same filename, only the last one is taken. But they are for different plattforms. So both of them have to be performed.

          Thanks!
          Paul

          Paul Zimmerman added a comment - Hi there, I've just checked the log of the testlink-plugin. The tap files are found! But: the problem is the filename. The filename of tap file 1 is platform1/tf1.tap. The filename of tap file 2 is platform2/tf1.tap. The tap files contain results for different platforms. The problem is: if there are tap files with the same filename, only the last one is taken. But they are for different plattforms. So both of them have to be performed. Thanks! Paul

          Bruno P. Kinoshita added a comment -

          Hmmm, nice catch... perhaps adding a check box like "Include full path in match" ... let me think about it and see if I can come up with few ideas.

          Bruno P. Kinoshita added a comment - Hmmm, nice catch... perhaps adding a check box like "Include full path in match" ... let me think about it and see if I can come up with few ideas.

            kinow Bruno P. Kinoshita
            paumzimbo Paul Zimmermann
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: