Performance Test Reporting

Performance Test Reporting

What is Performance Test Reporting?

Performance Test Reporting phase provides an overall test result, test analysis and recommendations to the project team or client from application’s performance perspective. The outcome of this phase i.e. Performance Test Report document helps to take the GO / NO-GO decision for the whole application or specific business flow.

Purpose of the Performance Test Report:

Performance Test Report comprises of:

  1. A detailed description of performance test results
  2. GO/NO-GO decision
  3. Observations and findings
  4. Recommendations
  5. Identified Defects (Detected/Closed/Open)

Performance Test Report is an important document from the project delivery perspective. Project delivery closure document must have the performance test report. In case, the performance test report gives NO-GO decision which signals application is unfit for production, then the application cannot Go-Live.

Accountability:

Performance Test Lead or Manager has a responsibility to prepare the Final Performance Test Report with the help of Performance Test Analyst or Engineer. The input of the Performance Test Engineer helps to prepare a quick and detailed report. A Performance Test Engineer works on the ground level and he knows the major and minor points observed during the test. These points may help to prepare a perfect performance test report document.

Performance Test Lead or Manager has another responsibility to walk-through the report in front of project team/client and get all the required sign-off from project stakeholders.

Approach:

Once all the performance test cycles are completed then a performance tester collects all the results and prepares the final performance test report. There are some important points which need to keep in mind while preparing the Final Performance Test Report:

  1. Use Simple (layman) language in the report
  2. Provide a summary of the overall test cycle
  3. Mention the GO / NO-GO status
  4. Justify the reason for either of the cases (in point 3)
  5. Check whether all the related NFRs meet or not
  6. Mark Pass / Fail to individual test
  7. Give a detailed description of defects along with the current status
  8. Provide proper and accurate recommendations
  9. Attach all the relevant artefacts for individual test
  10. Highlight the performance risk (if any)

GO / NO-GO Decision:

GO and NO-GO status refers to the decision on an application to go live or not. It indicates whether the performance of the application is as per defined NFRs or not. Following points helps to decide the GO or NO-GO status:

  1. GREEN: When all the tests meet the defined NFRs then the overall test result is marked as GREEN which signals GO. It refers that the application/project is good from the performance point of view and can go live.
  2. AMBER: When some of the tests do not meet the defined NFRs then the overall test result is marked as AMBER. In this situation, the performance test manager must:
      1. Analyse the criticality of the functionality
      2. Calculate the deviation of test results from the defined NFRs
      3. Understand the nature of defects
      4. Calculate the percentage of breached NFRs
      5. Investigate the cause of errors
      6. Identify the associated risk (in case of Go-live)

    The additional task for a Performance Test Manager/Lead is to schedule a meeting with project stakeholders and take a combined decision on GO and NO-GO of the application.

  3. RED: When all the tests do not meet the defined NFRs then the overall test result is marked as RED which signals NO-GO. It refers that the application/project is not fit for production from the performance point of view.

The last step is to present the final performance test report to the project stakeholders. The Performance Test Lead/Manager should walk through the test report in a detailed manner with the justification of GO or NO-GO decision.

Deliverable:

The final Performance Test Report is the deliverable of the performance test reporting phase which also represents the closure of Performance Testing. Download the template of the Performance Test Report.

Example:

PerfMate is happy to start the reporting phase of PerfProject. He conducted all the tests agreed in the performance test plan and the results are favourable which meet all the NFRs. Following is the summary of the test result:

PerfMate starts the preparation of Final Performance Test Report. He starts with the overall summary of the tests and provides GO sign-off from performance testing side. After that, he lists-out all the individual test results with his findings and observations. PerfMate attaches the relevant proofs i.e. Interim Test Reports, Heap dump analysis reports, AWR reports etc. for the individual test and gives Pass or Fail status as per the analysis.

PerfMate presents the Performance Test Report to the stakeholders of PerfProject and gets the sign-off from them. After getting all the sign-offs, he closes the Performance Testing ticket (assigned before starting the risk assessment at the initial stage) and attached the final report in the ticket.

That’s the end of the Performance Testing Life Cycle.


Leave a Reply

Your email address will not be published. Required fields are marked *