The most important KPI is not the number of test cases but the percentage of test coverage. With TOSCA, customers can achieve test coverage of 95%. TOSCA’s inclusion in the ROSS Report is further validation of the value that TOSCA delivers in the market.
Vienna, Austria (PRWEB) January 08, 2013
TRICENTIS®, a global leader in automated software testing, announced a finding in the Ross Report today: TOSCA Testsuite now ranks as the second most widely used software test automation tool in Australia and New Zealand.
The “Ross Report 2012 – Software Testing Industry Benchmark” is Australia’s most comprehensive study of trends in the software testing and assurance industry. The respondents included stakeholders in software quality, assurance and testing, such as test managers and test directors. The study identified specific performance benchmarks across six major industries throughout Australia. TOSCA Testsuite was listed behind HP Quick Test Pro as the second most widely used test automation tool.
Key Survey Findings
According to the Ross Report, “a significant benefit of test automation is the reduced cost to re-execute an automated test compared to a manual test.” Furthermore, “Investment in automation will increase, supporting plans to increase automation coverage. Further investment is planned by over 60% of organizations (surveyed), and 11% are planning significant investment.”
The report highlights typical test failure rates. On average, respondents anticipate that 20% of test cases will fail. This figure, however, drops during retesting by more than half to 8%. Regression testing has a similar failure rate at 7.59%. Thus automation may be a good solution for normalizing the cost per defect, both for new functions and regression.
The key findings of the 2012 Ross Report include the following:
- Organizations intend to significantly increase their level of test automation coverage.
- Future adjustments in budgets will show a correlation between the increased use of tools and a reduction in staffing costs.
- Testing effort is focusing more on analysis instead of test execution. In the future more effort will be put into test management.
- Most testing consists of functional testing (80%), while the budget for non-functional testing remains limited (20%).
- The proportion of the average IT budget spent on testing is stabilizing at 20-25%.
- It is very difficult to convince business stakeholders to include software testing in the budget.
- Organizations are poor at finding and fixing defects in early lifecycle stages, with most defects being found in the testing phase or later, limiting opportunities for early defect correction.
- At current levels of detection, the introduction of more appropriate early detection techniques could reduce the costs resulting from finding and fixing defects by 40% and project costs by 25%.
Wolfgang Platz, founder and Managing Partner of TRICENTIS, responds to the report “Test automation remains essential to gaining efficiency in software testing. The elimination of test case redundancy across multiple technologies helps us work smarter and drive down costs. Automation alone is not enough, and a risk-based approach with the right test cases can ensure the effectiveness of testing. The most important KPI is not the number of test cases but the percentage of test coverage. With TOSCA, customers can achieve test coverage of 95%. TOSCA’s inclusion in the ROSS Report is further validation of the value that TOSCA delivers in the market.”
The TOSCA model-based approach marks a paradigm shift in automated software testing, empowering non-technical users to quickly create automated business test cases in plain English and configure them for multiple operating systems, browsers, and smart devices. TOSCA’s OneView Technology provides leapfrog advances in software testing, software management, and test automation technology and delivers a robust, cost effective, model-based solution that sets TOSCA apart from its competitors. TOSCA offers certified integration with SAP and with popular Application Lifecycle Management (ALM) Solutions, popular Defect Tracking and other testing solutions for medium, large and global enterprises.
About K.J. Ross
Since 1997, K.J. Ross and Associates has been performing industry surveys for the testing industry by interviewing test managers. The surveys cover the current year and the various indicators that are likely to impact the industry in coming years. When it was first implemented years ago, the survey methodology was limited to such important research topics as salary surveys, profiles of techniques used, and analysis of the critical challenges faced by test managers.
Today, the Ross Report is a comprehensive and factual analysis of all aspects of the testing industry. As the testing industry has increased in importance to IT regulation, the industry requires a comprehensive analysis of software testing practices and development of benchmarks that can be used as a guide for IT and test managers to plan and implement their testing and assurance strategies.
K.J. Ross was founded by Kelvin Ross, who holds a Ph.D. in Computer Science and Electrical Engineering with a concentration in the field of high-integrity software development. Dr. Ross has extensive experience in software verification and validation, software testing and risk management, and has published and presented both throughout Australia and internationally. In 2010, he was awarded the ACS (Qld) Achiever Award, which honored his commitment and contribution to the ICT industry both in Queensland and nationally.
TRICENTIS offers cross-industry expertise in all aspects of software testing and software quality assurance. The flagship product TOSCA Testsuite enables companies to test and assess business-critical enterprise applications with unprecedented effectiveness and efficiency. TOSCA is ideal for industries with workflow business processes, many operating engines, browsers and smart devices such as in Banking, Insurance, Financial Services, High Tech, Telecom, Manufacturing, Retail, Healthcare, Utilities, Public Sector and other leading industries requiring the highest quality of software testing. TRICENTIS as a group has a global presence with more than 300 customers and offices in Europe, the USA and Australia. TRICENTIS’ customer base includes companies like Auckland Savings Bank, Bank West, UBS, Allianz Insurance, Zurich Insurance, HBO, and many more. See http://www.tricentis.com for more information.
Winner of Best in Test Award, 2012
ASP Award, “The Year‘s Ten Best Web Support Sites“, 2012
Winner of R.E.C.S.S. (Recognition of Excellence in Customer Support and Service), 2011