background image
<< Response Time Trends for Key Pages | Test raw data display >>
<< Response Time Trends for Key Pages | Test raw data display >>

Test project-level managers

·
Can I get a report with more/less detail?
Executive Stakeholders
Executive stakeholders tend to have very specific reporting needs and expectations that
are often quite different from those of other team members. Stakeholders tend to prefer
information in small, digestible chunks that clearly highlight the key points. Additionally,
stakeholders like visual representations of data that are intuitive at a glance, as well as
"sound bite"­size explanations of those visual representations. Finally, stakeholders tend
to prefer consolidated and summarized information on a less frequent (though not
significantly less frequent) basis than other team members. The following are common
questions that executive stakeholders want performance test reports to answer:
·
Is this ready to ship?
·
How will these results relate to production?
·
How much confidence should I have in these results?
·
What needs to be done to get this ready to ship?
·
Is the performance testing proceeding as anticipated?
·
Is the performance testing adding value?
Project-Level Managers
Project-level managers -- including the project manager, development lead or manager,
and the test lead or manager -- have all of the same needs and questions as the executive
stakeholders, except that they want the answers more frequently and in more detail.
Additionally, they commonly want to know the following:
·
Are performance issues being detected efficiently?
·
Are performance issues being resolved efficiently?
·
What performance testing should we be conducting that we currently are not?
·
What performance testing are we currently doing that is not adding value?
·
Are there currently any blockers? If so, what are they?
Technical Team Members
Although technical team members have some degree of interest in all of the questions
posed by managers and stakeholders, they are more interested in receiving a continual
flow of information related to test results, monitored data, observations, and opportunities
for analysis and improvement. Technical team members tend to want to know the
following:
·
What do these results mean to my specialty/focus area?
·
Where can I go to see the results for the last test?
·
Where can I go to get the raw data?
·
Can you capture metric X during the next test run?
Types of Results Sharing
In the most basic sense, there are three distinct types of results sharing: raw data display,
technical reports, and stakeholder reports. While all are based on timely, accurate, and
relevant communication of results, observations, concerns, and recommendations, each