As the popularity of cloud computing increases, companies are now looking to conduct load testing through the Web-based hosting service as well. Essentially, the process entails remotely testing Internet-facing solutions and infrastructure against the actual number of anticipated users and integrating the tests onto a cloud platform. Because the process is executed by automated systems, this allows testing to occur in large numbers and repeatedly.
There has been an upswing in major technology providers developing load testing in the cloud solutions in the past few years, particularly throughout 2011 and 2012 thus far, though various companies have been producing these solutions since late 2008 or early 2009. In fact, IDC predicts that the market will continue to grow at a compound annual rate of 33.1 percent through 2015, when revenues are expected to reach up to $1 billion.
Advocates of load testing in the cloud find the process to be a cost-effective alternative to on-site load testing, while also providing quick on-demand results. Users are able to perform cloud-based performance tests from various geographical locations on a global level, typically through partnerships with cloud providers like Amazon or those detailed above.
Some recent significant contributors to the trend include the following:
LoadStorm released its cloud load testing tool in early 2009, and they have become probably the leading provider of this type of self-service automation tool. LoadStorm is best known for being the lowest cost provider in the industry. That's why they have over 6,000 clients. They also have a reputation for generating more test traffic than any self-service tool - reaching volumes up to 150,000 concurrent users. Recently, LoadStorm has started testing up to 500k users and has announced the goal of hitting 20 million concurrent users by July 1.
BlazeMeter developed a self-service load testing application using the cloud. The solution allows users to test on-site applications, as well as software running in third-party data centers. BlazeMeter is based on Apache JMeter, which the company offers with its on-demand service. In late 2011, the start-up company raised $1.2 million towards future projects.
Apica held a conference from February 13 to 16, 2012 regarding website performance on the cloud. The conferences included a live presentation of Apica WebExcellence Suite, consisting of Apica LoadTest, Apica WebPerformance and Apica WebOverload. The company also plans to release LoadTest 2 in March of 2012, a tool that provides a simplified testing set up and will be easily integrated with Selenium.
HP made its move towards cloud testing with the release of LoadRunner in the Cloud. Unlike the company’s legacy LoadRunner application performance software, this tool is available in SaaS format and has the ability to support up to 250 users at one time. The solution caters to organizations with a tight budget and small staff size. HP’s shift towards cloud based testing is reliant on partnerships with reseller Orasi Software, risk mitigation company Genilogix and life-cycle software management vendor J9 Technologies.
SOASTA released a new version of its CloudTest Platform that allows for a complete test of multi-touch mobile device applications, such as those in iPads and Androids. TouchTest, as the new feature has been named, is currently offered as an enhancement for existing SOASTA load testing solutions CloudTest and CloudTest Lite. This new addition remains in the beta stage. The company also launched a Private Device Cloud that gives users the ability to use personal mobile devices in a company’s private testing network.
However, there are various components to consider before making the leap towards load testing via the cloud. Major concerns revolve around security, as information passes through the Internet and companies must ensure there is no data leakage, as is generally the case with cloud computing. Companies must also take into account the applications that are being tested, as legacy systems may need modifications in order to be effectively tested.
With major companies such as HP joining the market and cloud-based load testing innovators such as LoadStorm setting the bar on low prices, the industry is still developing in order to combat current issues while retaining its cost-effective appeal.