Proof of Concept: Website Performance Testing
In my previous blog post, I mentioned “Proof of Concept” for Performance Testing.
At first this might raise a flag, since you most likely contacted a consulting company seeking their expertise. The expectation might be that by contacting a consulting company there would be minimal questions and the project would just be done. However, it is a partnership between the client and consulting company to determine the best way to complete the project.
Let me explain.
What is Proof of Concept?
Initially when starting a Performance Testing project, the consultant will ask to be granted access to the application to be tested. They would also ask for the most complex workflow that could be part of the Performance Testing. By evaluating whether a tool can handle the most complex workflow, it would indicate that all lesser complex workflows should be supported as well.
For clients that have an in-house or preferred Performance Testing tool, we must ask the following questions:
- Is the tool in-house able to completely capture the workflow, so that the needed scripts can be created?
- What is the level of effort to complete the scripting, so a more accurate estimation for the project work can be created?
- Can the tool create and run the desired tests for the project?
For clients that do not have an in-house or preferred Performance Testing tool, a Proof of Concept will be created to determine the best tool to use for their specific needs. Among the most frequently used tools are Apache jMeter and MicroFocus LoadRunner, although other tools may be used.
The Proof of Concept addresses the following questions:
- Which tools can completely capture the script for the workflow and have the ability to create the desired tests for the project?
- For the selected tool, what is the level of effort to script the workflows and run the desired tests?
Among the tools that can do what is required, the most cost-effective tool will be selected- no reason to pay more than necessary.
Proof of Concept Scenario 1:
A company contacts a consulting firm to Performance Test their application upgrade, which was also moved to the cloud. After evaluating the client’s needs, a Proof of Concept is completed to determine what tool should be used for this specific project. This effort determines that the free open-source Apache jMeter tool meets the project’s basic requirements. However, the SAS platform BlazeMeter tool is also needed due to inability to create a local infrastructure of jMeter servers and the need to easily generate load from global geographic locations.
Between the determination of which tools to use and the level of effort needed to script the desired workflows, a more accurate Statement of Work and Schedule can be delivered to the client. This minimizes change requests and provides the client with a more accurate schedule for project completion, which saves time and sets realistic expectations.
Proof of Concept Scenario 2:
A company contacts a consulting firm to Performance Test their application upgrade, which was also moved to the cloud. The company may already have a previously used in-house tool. The Proof of Concept confirms that while the tool in-house meets basic requirements, it would be easier and faster to use a different one. Additionally, the infrastructure in place for the current tool may not be able to run the desired tests.
In this situation, switching to using a different tool with a cloud-based architecture could allow the project to be completed in significantly less time. When there are tight deadlines, anything that reduces time for project completion without diminishing quality of the end result is a win for the client.
These are just two examples of how Proof of Concept determines the best path for a Performance Testing project – every situation is unique and different. From this point, a Statement of Work would be developed and presented to the client, and the Performance Testing project would begin.
Need assistance to complete your next Performance Testing project, contact Olenick to learn how our Performance Testing services can benefit your business.