background image
<< Controlling Runtime Information of a Suite | Execution Order >>
<< Controlling Runtime Information of a Suite | Execution Order >>

Start Group Information

124
Chapter 5 - Executing Tests
By modifying the runtime settings, you can manage:
s
Start group information
­ In performance testing, controls how virtual users are
started
s
Suite pass criteria
­ The criteria for whether a suite passes or fails
s
Execution order
­ In performance testing, controls the order in which a user group
runs
s
Time information
­ Controls how long the suite runs
s
Seed
­ Sets the number to feed to the random number generator
s
Enable IP aliasing
­ Controls aliasing in VU HTTP scripts
Start Group Information
In performance testing, the
Start group information
controls how virtual testers are
started. Virtual testers can start all at once or in groups.
To avoid overloading a server, start virtual testers in groups and specify the number
of virtual testers in those start groups.
Note:
If you start virtual testers in groups, you should also specify the number of start
scripts for the group. To do this, click
Suite > Edit Settings
, and modify the
Start scripts
box.
Suite Pass Criteria
The
Suite pass criteria
controls whether a suite passes or fails. Select one of the
following:
s
Suite ran to completion
­ The suite must run to completion without manual
termination of the run.
s
All suite items executed
­ All items in the suite must complete their assigned tasks.
s
All test scripts passed
­ No events fail and no commands time out.
s
All test cases executed
­ All test cases in the suite must complete all of their
assigned tasks.
s
All test cases passed
­ All test cases pass, which means that the application being
tested met the goals of the given test case.
If the suite does not meet the criteria, the Test Log window lists the Suite Start and
Suite End events as "failed."