background image
<< Running Tests - Merging testplan results sets | Running Tests - Generating a testplan Pass/Fail report >>
Running Tests - Compare Two Results command
<< Running Tests - Merging testplan results sets | Running Tests - Generating a testplan Pass/Fail report >>
User's Guide
161
6 R
UNNING
T
ESTS
AND
I
NTERPRETING
R
ESULTS
Managing results file information
For example, say you ran a section of the testplan consisting of 20 tests
yesterday and ran a different section of the testplan consisting of 10 tests
today. The merged results set would have today's date and would consist of
the results of 30 tests.
Note QA Organizer uses the test descriptions as well as the script,
testcase, and testdata statements to identify and locate the various
cases in the testplan and in the results set. When test results overlap
in the two results set that were merged, the more recent run is used.
If you change a test description between runs or modify the
statements, QA Organizer might be unable to find the test when you
try to merge results. QA Organizer will place these so-called
orphaned tests at the top of the results set.
Comparing different runs of a testplan
Compare Two Results
command
The Compare Two Results command allows you to quickly note only the
results that have changed from a prior run, without having to look at the same
errors over again. The command identifies differences based on the following
criteria:
·
A test passes in one testplan run and fails in the other
·
A test fails in both runs but the error is different
·
A test is executed in one testplan run but not in the other
Note QA Organizer uses the test descriptions as well as the test
statements to identify and locate the various cases in the testplan.
Therefore, if you change the descriptions or statements between
runs, QA Organizer will not be able to find the test when you run
Compare Two Results.
Procedure To find differences between testplan executions:
1
Make the results set you want to compare to another results set the active
window.
2
Select Results/Compare Two Results.
The Compare Two Results dialog appears.