-
Improvement
-
Resolution: Unresolved
-
Major
-
None
-
Testlink 1.9.6, TestLink Plugin 3.5
Hi there,
I have some trouble with result seeking strategies, tap files and platforms. In detail:
- my tap-files are in subfolders testresults/platform1/tf1.tap and testresults/platform2/tf1.tap
- the result seeking strategy "testresults/**/*.tap" brings only the platform2 results to testlink
- if I remove one platform (and the corresponding tap-file) everything works fine.
The problem is, that I have testcases assigned to two platforms and I have 2 tap files with separate results for each platform. The TestLink Plugin only takes the second tap file (same filename as the first one) and overwrites the values of the first one. So in TestLink the tree entry is gray (shows the result over all assigned platforms). So how can I collect separate results for two platforms? Currently I make use of 2 Jenkins-Jobs to do this (a workaround). Also: one tap-File with two platform information don't seem to work...
Hope that helps in any way.
Thanks!
Paul
[JENKINS-17802] TAP files with platform information and recursive result seeking strategy
Paul Zimmermann
created issue -
Paul Zimmermann
made changes -
| Description |
Original:
Hi there, I have some trouble with result seeking strategies, tap files and platforms. In detail: - my tap-files are in subfolders testresults/platform1/tf1.tap and testresults/platform2/tf1.tap - the result seeking strategy "testresults/**/*.tap" works almost fine: the test results are correctly transmitted to testlink (platform dependent), but: in TestLink the testcase tree shows only gray (not run) entries. If I click on them they show the correct test result (not passed) for ALL plattforms - if I remove one platform (and the corresponding tap-file) everything works find. - strange: if there are 4 testcases and only 1 has 2 platforms assigned to it ALL testcases are displayed as not run. Hope that helps in any way. Thanks! Paul |
New:
Hi there, I have some trouble with result seeking strategies, tap files and platforms. In detail: - my tap-files are in subfolders testresults/platform1/tf1.tap and testresults/platform2/tf1.tap - the result seeking strategy "testresults/**/*.tap" brings only the platform2 results to testlink - if I remove one platform (and the corresponding tap-file) everything works find. The problem is, that I have testcases assigned to two platforms and I have 2 tap files with separate results for each platform. The TestLink Plugin only takes the second tap file (same filename as the first one) and overwrites the values of the first one. So in TestLink the tree entry is gray (shows the result over all assigned platforms). So how can I collect separate results for two platforms? One tap-File with two platform information don't seem to work... Hope that helps in any way. Thanks! Paul |
| Status | Original: Open [ 1 ] | New: In Progress [ 3 ] |
Paul Zimmerman
made changes -
| Attachment | New: taptest.zip [ 24015 ] |
Paul Zimmerman
added a comment - Hi Bruno!
I've just uploaded some TAP-files for testing.
Thanks!
Paul
Paul Zimmerman
added a comment - Hi Bruno!
I've just uploaded some TAP-files for testing.
Thanks!
Paul Paul Zimmerman
made changes -
| Attachment | New: tapplattest.zip [ 24100 ] | |
| Description |
Original:
Hi there, I have some trouble with result seeking strategies, tap files and platforms. In detail: - my tap-files are in subfolders testresults/platform1/tf1.tap and testresults/platform2/tf1.tap - the result seeking strategy "testresults/**/*.tap" brings only the platform2 results to testlink - if I remove one platform (and the corresponding tap-file) everything works find. The problem is, that I have testcases assigned to two platforms and I have 2 tap files with separate results for each platform. The TestLink Plugin only takes the second tap file (same filename as the first one) and overwrites the values of the first one. So in TestLink the tree entry is gray (shows the result over all assigned platforms). So how can I collect separate results for two platforms? One tap-File with two platform information don't seem to work... Hope that helps in any way. Thanks! Paul |
New:
Hi there, I have some trouble with result seeking strategies, tap files and platforms. In detail: - my tap-files are in subfolders testresults/platform1/tf1.tap and testresults/platform2/tf1.tap - the result seeking strategy "testresults/\*\*/*.tap" brings only the platform2 results to testlink - if I remove one platform (and the corresponding tap-file) everything works fine. The problem is, that I have testcases assigned to two platforms and I have 2 tap files with separate results for each platform. The TestLink Plugin only takes the second tap file (same filename as the first one) and overwrites the values of the first one. So in TestLink the tree entry is gray (shows the result over all assigned platforms). So how can I collect separate results for two platforms? Currently I make use of 2 Jenkins-Jobs to do this (a workaround). Also: one tap-File with two platform information don't seem to work... Hope that helps in any way. Thanks! Paul |
Paul Zimmerman
added a comment - Hello Bruno,
I've corrected my description - the phrase **/*.tap looked very stange 
(had to mask ist)
Also updated the attachment. Please use tapplattest.zip. I wasn't able to remove the other one.
Regards
Paul
Paul Zimmerman
added a comment - Hello Bruno,
I've corrected my description - the phrase **/*.tap looked very stange (had to mask ist)
Also updated the attachment. Please use tapplattest.zip. I wasn't able to remove the other one.
Regards
Paul Hi Paul! Thanks for updating the issue. I've released tap-plugin 1.11 last Saturday, and am working to release a new version next Friday. I'll either start a cycle on testlink-plugin this week, or after I've finished tap 1.12.
Paul Zimmerman
added a comment - Hi there,
I've just checked the log of the testlink-plugin. The tap files are found! But: the problem is the filename. The filename of tap file 1 is platform1/tf1.tap. The filename of tap file 2 is platform2/tf1.tap. The tap files contain results for different platforms. The problem is: if there are tap files with the same filename, only the last one is taken. But they are for different plattforms. So both of them have to be performed.
Thanks!
Paul
Paul Zimmerman
added a comment - Hi there,
I've just checked the log of the testlink-plugin. The tap files are found! But: the problem is the filename. The filename of tap file 1 is platform1/tf1.tap. The filename of tap file 2 is platform2/tf1.tap. The tap files contain results for different platforms. The problem is: if there are tap files with the same filename, only the last one is taken. But they are for different plattforms. So both of them have to be performed.
Thanks!
Paul
Hmmm, interesting issue. Looks like there's something buggy in the TAP result seeking strategy.
If you could send me more details about your set up (you've already done an excellent report), like your TAP Streams, or some sample TAP streams that I could use to reproduce the issue here. Then I could try to fix it and include in the next release (probably cut in the next week or so).
Thanks for reporting the issue!
Bruno